Attachment 597505 Details for Bug 836973 – development.log during auto scaling up

development.log during auto scaling up

development.log (text/plain), 26.42 KB, created by jizhao on 2012-07-11 08:46:57 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: jizhao

Created: 2012-07-11 08:46:57 UTC

Size: 26.42 KB

patch

obsolete

>Started GET "/broker/rest/domains/jizhao8/applications/app2" for 127.0.0.1 at Wed Jul 11 04:36:34 -0400 2012
>  Processing by ApplicationsController#show as JSON
>  Parameters: {"broker_auth_key"=>"[FILTERED]", "broker_auth_iv"=>"[FILTERED]", "domain_id"=>"jizhao8", "id"=>"app2"}
>MongoDataStore.find(CloudUser, jizhao+8@redhat.com, jizhao+8@redhat.com)
>
>MongoDataStore.find(CloudUser, jizhao+8@redhat.com, jizhao+8@redhat.com)
>
>[REQ_ID=dc27b460c07a4aabab4938b6fc07ed06] ACTION=SHOW_APPLICATION Application 'app2' found
>Completed 200 OK in 703ms (Views: 37.9ms)
>
>
>Started POST "/broker/rest/domains/jizhao8/applications/app2/events" for 127.0.0.1 at Wed Jul 11 04:36:34 -0400 2012
>  Processing by AppEventsController#create as JSON
>  Parameters: {"broker_auth_key"=>"[FILTERED]", "broker_auth_iv"=>"[FILTERED]", "domain_id"=>"jizhao8", "event"=>"scale-up", "application_id"=>"app2"}
>MongoDataStore.find(CloudUser, jizhao+8@redhat.com, jizhao+8@redhat.com)
>
>MongoDataStore.find(CloudUser, jizhao+8@redhat.com, jizhao+8@redhat.com)
>
>DEBUG: rpc_get_fact: fact=active_capacity
>DEBUG: rpc_exec: rpc_client=#<MCollective::RPC::Client:0x7ff32abcbbd0>
>Current server: ip-10-100-233-239 active capacity: 2.5
>CURRENT SERVER: ip-10-100-233-239
>DEBUG: find_available_impl: current_server: ip-10-100-233-239: 2.5
>MongoDataStore.save(Application, jizhao+8@redhat.com, app2, #hidden)
>
>DEBUG: rpc_exec_direct: rpc_client=#<MCollective::RPC::Client:0x7ff32ae3b410>
>DEBUG: rpc_client.custom_request('cartridge_do', {:action=>"app-create", :args=>{"--with-container-name"=>"44365aec99", "--with-app-uuid"=>"f326404a548c4ef68f23a4637bcf33b8", "--with-container-uuid"=>"44365aec99bb449ebeeb55206732e056", "--with-namespace"=>"jizhao8", "--with-app-name"=>"app2"}, :cartridge=>"stickshift-node"}, @id, {'identity' => @id})
>DEBUG: [#<MCollective::RPC::Result:0x7ff32ad6ffb8 @action="cartridge_do", @results={:data=>{:exitcode=>0, :output=>""}, :sender=>"ip-10-100-233-239", :statusmsg=>"OK", :statuscode=>0}, @agent="stickshift">]
>DEBUG: DYNECT Login with path: /REST/Session/
>DEBUG: DYNECT Response: {"status": "success", "data": {"token": "MbjjE3qr5nQHgVhT4hhvG/3sKMGdkkeHnHM0bmdfspvjElSoORwcnQEXm7srhoUSIs4EIuCr2UUY0zqd8tM5hIOWf25aGgd0IzLO12vUQ3CFCouEDIrNuuGdbG7zvnuGlNpQuxTyqavR+4viBt112AIF3ZLp6x+e", "version": "3.3.4"}, "job_id": 135431632, "msgs": [{"INFO": "login: Login successful", "SOURCE": "BLL", "ERR_CD": null, "LVL": "INFO"}]}
>DEBUG: DYNECT Response data: tokenMbjjE3qr5nQHgVhT4hhvG/3sKMGdkkeHnHM0bmdfspvjElSoORwcnQEXm7srhoUSIs4EIuCr2UUY0zqd8tM5hIOWf25aGgd0IzLO12vUQ3CFCouEDIrNuuGdbG7zvnuGlNpQuxTyqavR+4viBt112AIF3ZLp6x+eversion3.3.4
>DEBUG: Public ip being configured 'ec2-75-101-184-120.compute-1.amazonaws.com' to app '44365aec99'
>DEBUG: DYNECT put/post with path: /REST/CNAMERecord/rhcloud.com/44365aec99-jizhao8.dev.rhcloud.com/ json data: {"rdata":{"cname":"ec2-75-101-184-120.compute-1.amazonaws.com"},"ttl":"60"} and headers: {"Content-Type"=>"application/json", "Auth-Token"=>"[hidden]"}
>DEBUG: DYNECT Response: {"status": "success", "data": {"zone": "rhcloud.com", "ttl": 60, "fqdn": "44365aec99-jizhao8.dev.rhcloud.com", "record_type": "CNAME", "rdata": {"cname": "ec2-75-101-184-120.compute-1.amazonaws.com."}, "record_id": 0}, "job_id": 135431648, "msgs": [{"INFO": "add: Record added", "SOURCE": "BLL", "ERR_CD": null, "LVL": "INFO"}]}
>DEBUG: DYNECT Response data: zonerhcloud.comfqdn44365aec99-jizhao8.dev.rhcloud.comrecord_typeCNAMErecord_id0ttl60rdatacnameec2-75-101-184-120.compute-1.amazonaws.com.
>DEBUG: DYNECT put/post with path: /REST/Zone/rhcloud.com/ json data: {"publish":"true"} and headers: {"Content-Type"=>"application/json", "Auth-Token"=>"[hidden]"}
>DEBUG: DYNECT Response: {"status": "success", "data": {"zone_type": "Primary", "serial_style": "increment", "serial": 1312472, "zone": "rhcloud.com"}, "job_id": 135431659, "msgs": [{"INFO": "publish: rhcloud.com published", "SOURCE": "BLL", "ERR_CD": null, "LVL": "INFO"}]}
>DEBUG: DYNECT Response data: zonerhcloud.comzone_typePrimaryserial1312472serial_styleincrement
>DEBUG: DYNECT delete with path: /REST/Session/ and headers: {"Content-Type"=>"application/json", "Auth-Token"=>"[hidden]"}
>DEBUG: DYNECT Response: {"status": "success", "data": {}, "job_id": 135431682, "msgs": [{"INFO": "logout: Logout successful", "SOURCE": "BLL", "ERR_CD": null, "LVL": "INFO"}]}
>DEBUG: DYNECT Response data: 
>DEBUG: Output of parallel execute: result_stdoutresult_stderrtagresult_exit_code0gear44365aec99bb449ebeeb55206732e056jobactionauthorized-ssh-key-addargs--with-ssh-key-typessh-rsa--with-app-uuidf326404a548c4ef68f23a4637bcf33b8--with-container-uuid44365aec99bb449ebeeb55206732e056--with-ssh-keyAAAAB3NzaC1yc2EAAAABIwAAAQEA4NeUyMMeM+8WZITvoArNSYtHeYH/gxpl02JZi2zn1nfAteIKhjY1jSJwmS9puXwOpY4IFIC0JT/ucbtGEQZFTSIhSrZ51bACiuY32pdtNmr5MHAvhIOVwktcjZ+Lmu2fZMEVeGO6bHct0WQ9zBLvcebwCSBKc0xwk5JVr740t+Q00fvcBktVp66qB6AjA7+ELR9reSQLMkQW8URpxeDu6vb8Wh5X/8Vy/m6vfAAEHIjozRNtuvMG5u7jfWs9/5TkpwkQeSs2Q452nndDq0Qt3zLJOYu9ARFandxQh2/CUsbIc9dqQLmTbIgkkjQkqps6J7DetbEAlt3sVyMP1RpH6w==--with-ssh-key-commentdefaultcartridgestickshift-noderesult_stdoutresult_stderrtagresult_exit_code0gear44365aec99bb449ebeeb55206732e056jobactionauthorized-ssh-key-addargs--with-app-uuidf326404a548c4ef68f23a4637bcf33b8--with-container-uuid44365aec99bb449ebeeb55206732e056--with-ssh-keyAAAAB3NzaC1yc2EAAAABIwAAAQEAmjDUm9udzt+PWwK2WjVP832KFm4h/d8DDG/8w0F0bNYbn56wQNp6D8XfoGB65ItY19gF72QjzqbhNuOHrSpDaYcqveTeXavfb9504xNl2Br1koAphNgx1BJTpUixeAfqaNTI05OeP7hmczgU/cWihvJxZKZ4/5ZsjgH/DOlqllcXDxGSQ82qM4Jcu0Jbd/Ed6lDKi6dpzTKONXb6Dejn4n1jwKZ62u3Xo/Ty49vZUgXgtnvH51Ev59l9nvw6MmjhbFLVuNqQ+7og9+5ZVvgQW5qkAudNStQiEuEQyaVUjDGo1W3MMnfs0JpzwgnSAs9PdvBKTavE3Xk4YLkw8O5nXw==--with-ssh-key-commentapp2cartridgestickshift-node, status: 0
>Configure order is ["@@app/comp-proxy/cart-jbossas-7/comp-jbossas-server", "@@app/comp-proxy/cart-haproxy-1.4", "@@app/comp-web/cart-jbossas-7/comp-jbossas-server", "@@app/comp-web", "@@app/comp-proxy"]
>DEBUG: rpc_exec_direct: rpc_client=#<MCollective::RPC::Client:0x7ff32adc8d98>
>DEBUG: rpc_client.custom_request('cartridge_do', {:action=>"configure", :args=>"'44365aec99' 'jizhao8' '44365aec99bb449ebeeb55206732e056'", :cartridge=>"jbossas-7"}, @id, {'identity' => @id})
>DEBUG: []
>DEBUG: rpc_exec: rpc_client=#<MCollective::RPC::Client:0x7ff32ac08030>
>Node execution failure (error getting result from node).  If the problem persists please contact Red Hat support.
>#<StickShift::NodeException: Node execution failure (error getting result from node).  If the problem persists please contact Red Hat support.>
>["/usr/lib/ruby/gems/1.8/gems/gearchanger-mcollective-plugin-0.0.8/lib/gearchanger-mcollective-plugin/gearchanger/mcollective_application_container_proxy.rb:1008:in `parse_result'", "/usr/lib/ruby/gems/1.8/gems/gearchanger-mcollective-plugin-0.0.8/lib/gearchanger-mcollective-plugin/gearchanger/mcollective_application_container_proxy.rb:1130:in `run_cartridge_command_old'", "/var/www/stickshift/broker/lib/express/broker/mcollective_ext.rb:14:in `run_cartridge_command'", "/usr/lib/ruby/gems/1.8/gems/gearchanger-mcollective-plugin-0.0.8/lib/gearchanger-mcollective-plugin/gearchanger/mcollective_application_container_proxy.rb:230:in `configure_cartridge'", "/usr/lib/ruby/gems/1.8/gems/stickshift-controller-0.13.12/lib/stickshift-controller/app/models/gear.rb:93:in `configure'", "/usr/lib/ruby/gems/1.8/gems/stickshift-controller-0.13.12/lib/stickshift-controller/app/models/application.rb:452:in `configure_dependencies'", "/usr/lib/ruby/gems/1.8/gems/stickshift-controller-0.13.12/lib/stickshift-controller/app/models/application.rb:1504:in `call'", "/usr/lib/ruby/gems/1.8/gems/stickshift-controller-0.13.12/lib/stickshift-controller/app/models/application.rb:1504:in `run_on_gears'", "/usr/lib/ruby/gems/1.8/gems/stickshift-controller-0.13.12/lib/stickshift-controller/app/models/application.rb:1502:in `each'", "/usr/lib/ruby/gems/1.8/gems/stickshift-controller-0.13.12/lib/stickshift-controller/app/models/application.rb:1502:in `run_on_gears'", "/usr/lib/ruby/gems/1.8/gems/stickshift-controller-0.13.12/lib/stickshift-controller/app/models/application.rb:447:in `configure_dependencies'", "/usr/lib/ruby/gems/1.8/gems/stickshift-controller-0.13.12/lib/stickshift-controller/app/models/application.rb:441:in `each'", "/usr/lib/ruby/gems/1.8/gems/stickshift-controller-0.13.12/lib/stickshift-controller/app/models/application.rb:441:in `configure_dependencies'", "/usr/lib/ruby/gems/1.8/gems/stickshift-controller-0.13.12/lib/stickshift-controller/app/models/application.rb:361:in `scaleup'", "/usr/lib/ruby/gems/1.8/gems/stickshift-controller-0.13.12/lib/stickshift-controller/app/controllers/app_events_controller.rb:69:in `create'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_controller/metal/implicit_render.rb:4:in `send_action'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_controller/metal/implicit_render.rb:4:in `send_action'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/abstract_controller/base.rb:150:in `process_action'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_controller/metal/rendering.rb:11:in `process_action'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/abstract_controller/callbacks.rb:18:in `process_action'", "/usr/lib/ruby/gems/1.8/gems/activesupport-3.0.13/lib/active_support/callbacks.rb:446:in `_run__1028180711__process_action__1531936886__callbacks'", "/usr/lib/ruby/gems/1.8/gems/activesupport-3.0.13/lib/active_support/callbacks.rb:410:in `send'", "/usr/lib/ruby/gems/1.8/gems/activesupport-3.0.13/lib/active_support/callbacks.rb:410:in `_run_process_action_callbacks'", "/usr/lib/ruby/gems/1.8/gems/activesupport-3.0.13/lib/active_support/callbacks.rb:94:in `send'", "/usr/lib/ruby/gems/1.8/gems/activesupport-3.0.13/lib/active_support/callbacks.rb:94:in `run_callbacks'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/abstract_controller/callbacks.rb:17:in `process_action'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_controller/metal/rescue.rb:17:in `process_action'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_controller/metal/instrumentation.rb:30:in `process_action'", "/usr/lib/ruby/gems/1.8/gems/activesupport-3.0.13/lib/active_support/notifications.rb:52:in `instrument'", "/usr/lib/ruby/gems/1.8/gems/activesupport-3.0.13/lib/active_support/notifications/instrumenter.rb:21:in `instrument'", "/usr/lib/ruby/gems/1.8/gems/activesupport-3.0.13/lib/active_support/notifications.rb:52:in `instrument'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_controller/metal/instrumentation.rb:29:in `process_action'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/abstract_controller/base.rb:119:in `process'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/abstract_controller/rendering.rb:41:in `process'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_controller/metal.rb:138:in `dispatch'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_controller/metal/rack_delegation.rb:14:in `dispatch'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_controller/metal.rb:178:in `action'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/routing/route_set.rb:68:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/routing/route_set.rb:68:in `dispatch'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/routing/route_set.rb:33:in `call'", "/usr/lib/ruby/gems/1.8/gems/rack-mount-0.7.1/lib/rack/mount/route_set.rb:150:in `call'", "/usr/lib/ruby/gems/1.8/gems/rack-mount-0.7.1/lib/rack/mount/code_generation.rb:93:in `recognize'", "/usr/lib/ruby/gems/1.8/gems/rack-mount-0.7.1/lib/rack/mount/code_generation.rb:82:in `optimized_each'", "/usr/lib/ruby/gems/1.8/gems/rack-mount-0.7.1/lib/rack/mount/code_generation.rb:92:in `recognize'", "/usr/lib/ruby/gems/1.8/gems/rack-mount-0.7.1/lib/rack/mount/route_set.rb:141:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/routing/route_set.rb:499:in `call'", "/usr/lib/ruby/gems/1.8/gems/mongo_mapper-0.11.1/lib/mongo_mapper/middleware/identity_map.rb:10:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/middleware/best_standards_support.rb:17:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/middleware/head.rb:14:in `call'", "/usr/lib/ruby/gems/1.8/gems/rack-1.3.0/lib/rack/methodoverride.rb:24:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/middleware/params_parser.rb:21:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/middleware/flash.rb:182:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/middleware/session/abstract_store.rb:149:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/middleware/cookies.rb:302:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/middleware/callbacks.rb:46:in `call'", "/usr/lib/ruby/gems/1.8/gems/activesupport-3.0.13/lib/active_support/callbacks.rb:416:in `_run_call_callbacks'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/middleware/callbacks.rb:44:in `call'", "/usr/lib/ruby/gems/1.8/gems/rack-1.3.0/lib/rack/sendfile.rb:102:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/middleware/remote_ip.rb:48:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/middleware/show_exceptions.rb:47:in `call'", "/usr/lib/ruby/gems/1.8/gems/railties-3.0.13/lib/rails/rack/logger.rb:13:in `call'", "/usr/lib/ruby/gems/1.8/gems/rack-1.3.0/lib/rack/runtime.rb:17:in `call'", "/usr/lib/ruby/gems/1.8/gems/rack-1.3.0/lib/rack/lock.rb:34:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/middleware/static.rb:30:in `call'", "/usr/lib/ruby/gems/1.8/gems/railties-3.0.13/lib/rails/application.rb:168:in `call'", "/usr/lib/ruby/gems/1.8/gems/railties-3.0.13/lib/rails/application.rb:77:in `send'", "/usr/lib/ruby/gems/1.8/gems/railties-3.0.13/lib/rails/application.rb:77:in `method_missing'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/rack/request_handler.rb:96:in `process_request'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/abstract_request_handler.rb:514:in `accept_and_process_next_request'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/abstract_request_handler.rb:274:in `main_loop'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/rack/application_spawner.rb:205:in `start_request_handler'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/rack/application_spawner.rb:78:in `spawn_application'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/utils.rb:479:in `safe_fork'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/rack/application_spawner.rb:63:in `spawn_application'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/spawn_manager.rb:264:in `spawn_rack_application'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/spawn_manager.rb:137:in `spawn_application'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/spawn_manager.rb:275:in `handle_spawn_application'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/abstract_server.rb:357:in `__send__'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/abstract_server.rb:357:in `server_main_loop'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/abstract_server.rb:206:in `start_synchronously'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/helper-scripts/passenger-spawn-server:102"]
>exceptionNode execution failure (error getting result from node).  If the problem persists please contact Red Hat support.failedexceptionNode execution failure (error getting result from node).  If the problem persists please contact Red Hat support.gear#<Gear:0x7ff32abcd7c8>successfulgear#<Gear:0x7ff32abf54f8>return--DEBUG--
>
>--RESULT--
>
>--MESSAGE--
>
>--ERROR--
>
>--APP INFO--
>
>--CART COMMANDS--
>
>--CART PROPERTIES--
>{}
>--DATA--
>
>--EXIT CODE--
>0
>["/usr/lib/ruby/gems/1.8/gems/stickshift-controller-0.13.12/lib/stickshift-controller/app/models/application.rb:1515:in `run_on_gears'", "/usr/lib/ruby/gems/1.8/gems/stickshift-controller-0.13.12/lib/stickshift-controller/app/models/application.rb:1502:in `each'", "/usr/lib/ruby/gems/1.8/gems/stickshift-controller-0.13.12/lib/stickshift-controller/app/models/application.rb:1502:in `run_on_gears'", "/usr/lib/ruby/gems/1.8/gems/stickshift-controller-0.13.12/lib/stickshift-controller/app/models/application.rb:447:in `configure_dependencies'", "/usr/lib/ruby/gems/1.8/gems/stickshift-controller-0.13.12/lib/stickshift-controller/app/models/application.rb:441:in `each'", "/usr/lib/ruby/gems/1.8/gems/stickshift-controller-0.13.12/lib/stickshift-controller/app/models/application.rb:441:in `configure_dependencies'", "/usr/lib/ruby/gems/1.8/gems/stickshift-controller-0.13.12/lib/stickshift-controller/app/models/application.rb:361:in `scaleup'", "/usr/lib/ruby/gems/1.8/gems/stickshift-controller-0.13.12/lib/stickshift-controller/app/controllers/app_events_controller.rb:69:in `create'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_controller/metal/implicit_render.rb:4:in `send_action'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_controller/metal/implicit_render.rb:4:in `send_action'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/abstract_controller/base.rb:150:in `process_action'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_controller/metal/rendering.rb:11:in `process_action'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/abstract_controller/callbacks.rb:18:in `process_action'", "/usr/lib/ruby/gems/1.8/gems/activesupport-3.0.13/lib/active_support/callbacks.rb:446:in `_run__1028180711__process_action__1531936886__callbacks'", "/usr/lib/ruby/gems/1.8/gems/activesupport-3.0.13/lib/active_support/callbacks.rb:410:in `send'", "/usr/lib/ruby/gems/1.8/gems/activesupport-3.0.13/lib/active_support/callbacks.rb:410:in `_run_process_action_callbacks'", "/usr/lib/ruby/gems/1.8/gems/activesupport-3.0.13/lib/active_support/callbacks.rb:94:in `send'", "/usr/lib/ruby/gems/1.8/gems/activesupport-3.0.13/lib/active_support/callbacks.rb:94:in `run_callbacks'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/abstract_controller/callbacks.rb:17:in `process_action'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_controller/metal/rescue.rb:17:in `process_action'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_controller/metal/instrumentation.rb:30:in `process_action'", "/usr/lib/ruby/gems/1.8/gems/activesupport-3.0.13/lib/active_support/notifications.rb:52:in `instrument'", "/usr/lib/ruby/gems/1.8/gems/activesupport-3.0.13/lib/active_support/notifications/instrumenter.rb:21:in `instrument'", "/usr/lib/ruby/gems/1.8/gems/activesupport-3.0.13/lib/active_support/notifications.rb:52:in `instrument'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_controller/metal/instrumentation.rb:29:in `process_action'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/abstract_controller/base.rb:119:in `process'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/abstract_controller/rendering.rb:41:in `process'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_controller/metal.rb:138:in `dispatch'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_controller/metal/rack_delegation.rb:14:in `dispatch'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_controller/metal.rb:178:in `action'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/routing/route_set.rb:68:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/routing/route_set.rb:68:in `dispatch'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/routing/route_set.rb:33:in `call'", "/usr/lib/ruby/gems/1.8/gems/rack-mount-0.7.1/lib/rack/mount/route_set.rb:150:in `call'", "/usr/lib/ruby/gems/1.8/gems/rack-mount-0.7.1/lib/rack/mount/code_generation.rb:93:in `recognize'", "/usr/lib/ruby/gems/1.8/gems/rack-mount-0.7.1/lib/rack/mount/code_generation.rb:82:in `optimized_each'", "/usr/lib/ruby/gems/1.8/gems/rack-mount-0.7.1/lib/rack/mount/code_generation.rb:92:in `recognize'", "/usr/lib/ruby/gems/1.8/gems/rack-mount-0.7.1/lib/rack/mount/route_set.rb:141:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/routing/route_set.rb:499:in `call'", "/usr/lib/ruby/gems/1.8/gems/mongo_mapper-0.11.1/lib/mongo_mapper/middleware/identity_map.rb:10:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/middleware/best_standards_support.rb:17:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/middleware/head.rb:14:in `call'", "/usr/lib/ruby/gems/1.8/gems/rack-1.3.0/lib/rack/methodoverride.rb:24:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/middleware/params_parser.rb:21:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/middleware/flash.rb:182:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/middleware/session/abstract_store.rb:149:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/middleware/cookies.rb:302:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/middleware/callbacks.rb:46:in `call'", "/usr/lib/ruby/gems/1.8/gems/activesupport-3.0.13/lib/active_support/callbacks.rb:416:in `_run_call_callbacks'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/middleware/callbacks.rb:44:in `call'", "/usr/lib/ruby/gems/1.8/gems/rack-1.3.0/lib/rack/sendfile.rb:102:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/middleware/remote_ip.rb:48:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/middleware/show_exceptions.rb:47:in `call'", "/usr/lib/ruby/gems/1.8/gems/railties-3.0.13/lib/rails/rack/logger.rb:13:in `call'", "/usr/lib/ruby/gems/1.8/gems/rack-1.3.0/lib/rack/runtime.rb:17:in `call'", "/usr/lib/ruby/gems/1.8/gems/rack-1.3.0/lib/rack/lock.rb:34:in `call'", "/usr/lib/ruby/gems/1.8/gems/actionpack-3.0.13/lib/action_dispatch/middleware/static.rb:30:in `call'", "/usr/lib/ruby/gems/1.8/gems/railties-3.0.13/lib/rails/application.rb:168:in `call'", "/usr/lib/ruby/gems/1.8/gems/railties-3.0.13/lib/rails/application.rb:77:in `send'", "/usr/lib/ruby/gems/1.8/gems/railties-3.0.13/lib/rails/application.rb:77:in `method_missing'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/rack/request_handler.rb:96:in `process_request'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/abstract_request_handler.rb:514:in `accept_and_process_next_request'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/abstract_request_handler.rb:274:in `main_loop'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/rack/application_spawner.rb:205:in `start_request_handler'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/rack/application_spawner.rb:78:in `spawn_application'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/utils.rb:479:in `safe_fork'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/rack/application_spawner.rb:63:in `spawn_application'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/spawn_manager.rb:264:in `spawn_rack_application'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/spawn_manager.rb:137:in `spawn_application'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/spawn_manager.rb:275:in `handle_spawn_application'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/abstract_server.rb:357:in `__send__'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/abstract_server.rb:357:in `server_main_loop'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/lib/phusion_passenger/abstract_server.rb:206:in `start_synchronously'", "/usr/lib/ruby/gems/1.8/gems/passenger-3.0.4/helper-scripts/passenger-spawn-server:102"]
>DEBUG: rpc_exec_direct: rpc_client=#<MCollective::RPC::Client:0x7ff32aea61e8>
>DEBUG: rpc_client.custom_request('cartridge_do', {:action=>"deconfigure", :args=>"'0ef6c62c3f' 'jizhao8' '0ef6c62c3fb5494c8e51fc0c3b6890a8'", :cartridge=>"jbossas-7"}, @id, {'identity' => @id})
>DEBUG: [#<MCollective::RPC::Result:0x7ff32ad9c9f0 @action="cartridge_do", @results={:data=>{:exitcode=>0, :output=>""}, :sender=>"ip-10-100-233-239", :statusmsg=>"OK", :statuscode=>0}, @agent="stickshift">]
>DEBUG: Cartridge command jbossas-7::deconfigure exitcode = 0
>DEBUG: rpc_exec_direct: rpc_client=#<MCollective::RPC::Client:0x7ff32ad77a10>
>DEBUG: rpc_client.custom_request('cartridge_do', {:action=>"deconfigure", :args=>"'44365aec99' 'jizhao8' '44365aec99bb449ebeeb55206732e056'", :cartridge=>"jbossas-7"}, @id, {'identity' => @id})
>DEBUG: [#<MCollective::RPC::Result:0x7ff32ac75298 @action="cartridge_do", @results={:data=>{:exitcode=>0, :output=>""}, :sender=>"ip-10-100-233-239", :statusmsg=>"OK", :statuscode=>0}, @agent="stickshift">]
>DEBUG: Cartridge command jbossas-7::deconfigure exitcode = 0
>DEBUG: rpc_exec_direct: rpc_client=#<MCollective::RPC::Client:0x7ff32acaada8>
>DEBUG: rpc_client.custom_request('cartridge_do', {:action=>"app-destroy", :args=>{"--with-app-uuid"=>"f326404a548c4ef68f23a4637bcf33b8", "--with-container-uuid"=>"0ef6c62c3fb5494c8e51fc0c3b6890a8"}, :cartridge=>"stickshift-node"}, @id, {'identity' => @id})
>DEBUG: [#<MCollective::RPC::Result:0x7ff32aef5090 @action="cartridge_do", @results={:data=>{:exitcode=>0, :output=>""}, :sender=>"ip-10-100-233-239", :statusmsg=>"OK", :statuscode=>0}, @agent="stickshift">]
>MongoDataStore.save(Application, jizhao+8@redhat.com, app2, #hidden)
>
>DEBUG: rpc_exec_direct: rpc_client=#<MCollective::RPC::Client:0x7ff32ae3bed8>
>DEBUG: rpc_client.custom_request('cartridge_do', {:action=>"app-destroy", :args=>{"--with-app-uuid"=>"f326404a548c4ef68f23a4637bcf33b8", "--with-container-uuid"=>"44365aec99bb449ebeeb55206732e056"}, :cartridge=>"stickshift-node"}, @id, {'identity' => @id})
>DEBUG: [#<MCollective::RPC::Result:0x7ff32ad32ca8 @action="cartridge_do", @results={:data=>{:exitcode=>0, :output=>""}, :sender=>"ip-10-100-233-239", :statusmsg=>"OK", :statuscode=>0}, @agent="stickshift">]
>MongoDataStore.save(Application, jizhao+8@redhat.com, app2, #hidden)
>
>MongoDataStore.save(Application, jizhao+8@redhat.com, app2, #hidden)
>
>Node execution failure (error getting result from node).  If the problem persists please contact Red Hat support.
>[REQ_ID=4cc807f52d1a4a55a22dbcbbb46591cc] ACTION=SCALE_UP_APPLICATION Application event 'scale-up' failed: Node execution failure (error getting result from node).  If the problem persists please contact Red Hat support.
>Completed 500 Internal Server Error in 120468ms (Views: 6.6ms)

Actions: View

Attachments on bug 836973: 597323 | 597505 | 597578