Hide Forgot
Description of problem: After upgrade from ose-1.1.3 to ose-1.2.3, fail to scale-up, the scale-up command succeed, but the newly added gear is not active. Version-Release number of selected component (if applicable): Upgrade from ose-1.1.3 to ose-1.2.3 How reproducible: Always Steps to Reproduce: 1.Setup ose-1.1.3 env 2.Create all supported scalable applications, e.g: php, ruby-1.9 3.Add "disable_auto_scaling" marker in app's repo 4.Upgrade this env from ose-1.1.3 to ose-1.2.3 5.Try to scale up scalable application. Actual results: New gears is added, but this gear is not active seen in http://<app>/haproxy-status/ Expected results: New added gear should be active. Additional info: The following error is seen in the mcollective log: I, [2013-09-22T08:15:30.713695 #6523] INFO -- : openshift.rb:91:in `execute_action' Executing action [expose-port] using method oo_expose_port with args [{"--with-app-uuid"=>"5b7ffeb9ce224dfc83a4b6bce26c8307", "--with-app-name"=>"ruby19scal", "--with-container-uuid"=>"523edf51ecf7d789bb00003e", "--with-container-name"=>"523edf51ecf7d789bb00003e", "--with-namespace"=>"jialiu", "--with-request-id"=>"3e1471356c8aea8df01a38b9ead283db", "--cart-name"=>"ruby-1.9", "--component-name"=>"ruby-1.9", "--with-software-version"=>"", "--cartridge-vendor"=>""}] I, [2013-09-22T08:15:31.254603 #6523] INFO -- : openshift.rb:100:in `execute_action' Finished executing action [expose-port] (0) I, [2013-09-22T08:15:31.255068 #6523] INFO -- : openshift.rb:91:in `execute_action' Executing action [expose-port] using method oo_expose_port with args [{"--with-app-uuid"=>"5b7ffeb9ce224dfc83a4b6bce26c8307", "--with-app-name"=>"ruby19scal", "--with-container-uuid"=>"523edf51ecf7d789bb00003e", "--with-container-name"=>"523edf51ecf7d789bb00003e", "--with-namespace"=>"jialiu", "--with-request-id"=>"3e1471356c8aea8df01a38b9ead283db", "--cart-name"=>"haproxy-1.4", "--component-name"=>"web_proxy", "--with-software-version"=>"", "--cartridge-vendor"=>""}] E, [2013-09-22T08:15:31.257838 #6523] ERROR -- : openshift.rb:170:in `rescue in with_container_from_args' Failed to get cartridge 'haproxy-1.4' from in gear 523edf51ecf7d789bb00003e: Cartridge directory not found for haproxy-1.4 E, [2013-09-22T08:15:31.257919 #6523] ERROR -- : openshift.rb:171:in `rescue in with_container_from_args' /opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-node-1.9.14.5/lib/openshift-origin-node/model/v2_cart_model.rb:145:in `rescue in get_cartridge' /opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-node-1.9.14.5/lib/openshift-origin-node/model/v2_cart_model.rb:138:in `get_cartridge' /opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-node-1.9.14.5/lib/openshift-origin-node/model/application_container.rb:214:in `create_public_endpoints' /opt/rh/ruby193/root/usr/libexec/mcollective/mcollective/agent/openshift.rb:556:in `block in oo_expose_port' /opt/rh/ruby193/root/usr/libexec/mcollective/mcollective/agent/openshift.rb:166:in `with_container_from_args' /opt/rh/ruby193/root/usr/libexec/mcollective/mcollective/agent/openshift.rb:555:in `oo_expose_port' /opt/rh/ruby193/root/usr/libexec/mcollective/mcollective/agent/openshift.rb:93:in `execute_action' /opt/rh/ruby193/root/usr/libexec/mcollective/mcollective/agent/openshift.rb:126:in `block in execute_parallel_action' /opt/rh/ruby193/root/usr/libexec/mcollective/mcollective/agent/openshift.rb:119:in `each' /opt/rh/ruby193/root/usr/libexec/mcollective/mcollective/agent/openshift.rb:119:in `execute_parallel_action' /opt/rh/ruby193/root/usr/share/ruby/mcollective/rpc/agent.rb:86:in `handlemsg' /opt/rh/ruby193/root/usr/share/ruby/mcollective/agents.rb:126:in `block (2 levels) in dispatch' /opt/rh/ruby193/root/usr/share/ruby/timeout.rb:69:in `timeout' /opt/rh/ruby193/root/usr/share/ruby/mcollective/agents.rb:125:in `block in dispatch' I, [2013-09-22T08:15:31.257988 #6523] INFO -- : openshift.rb:100:in `execute_action' Finished executing action [expose-port] (-1) I, [2013-09-22T08:15:31.258152 #6523] INFO -- : openshift.rb:132:in `execute_parallel_action' execute_parallel_action call - [{:tag=>"expose-ports::523ec70decf7d727e200006e", :gear=>"523edf51ecf7d789bb00003e", :job=>{:cartridge=>"openshift-origin-node", :action=>"expose-port", :args=>{"--with-app-uuid"=>"5b7ffeb9ce224dfc83a4b6bce26c8307", "--with-app-name"=>"ruby19scal", "--with-container-uuid"=>"523edf51ecf7d789bb00003e", "--with-container-name"=>"523edf51ecf7d789bb00003e", "--with-namespace"=>"jialiu", "--with-request-id"=>"3e1471356c8aea8df01a38b9ead283db", "--cart-name"=>"ruby-1.9", "--component-name"=>"ruby-1.9", "--with-software-version"=>"", "--cartridge-vendor"=>""}}, :result_stdout=>"", :result_stderr=>"", :result_exit_code=>0}, {:tag=>"expose-ports::523ec70decf7d727e200006f", :gear=>"523edf51ecf7d789bb00003e", :job=>{:cartridge=>"openshift-origin-node", :action=>"expose-port", :args=>{"--with-app-uuid"=>"5b7ffeb9ce224dfc83a4b6bce26c8307", "--with-app-name"=>"ruby19scal", "--with-container-uuid"=>"523edf51ecf7d789bb00003e", "--with-container-name"=>"523edf51ecf7d789bb00003e", "--with-namespace"=>"jialiu", "--with-request-id"=>"3e1471356c8aea8df01a38b9ead283db", "--cart-name"=>"haproxy-1.4", "--component-name"=>"web_proxy", "--with-software-version"=>"", "--cartridge-vendor"=>""}}, :result_stdout=>"Failed to get cartridge 'haproxy-1.4' from in gear 523edf51ecf7d789bb00003e: Cartridge directory not found for haproxy-1.4", :result_stderr=>"", :result_exit_code=>-1}] E, [2013-09-22T08:15:31.257838 #6523] ERROR -- : openshift.rb:170:in `rescue in with_container_from_args' Failed to get cartridge 'haproxy-1.4' from in gear 523edf51ecf7d789bb00003e: Cartridge directory not found for haproxy-1.4 E, [2013-09-22T08:15:31.257919 #6523] ERROR -- : openshift.rb:171:in `rescue in with_container_from_args' /opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-node-1.9.14.5/lib/openshift-origin-node/model/v2_cart_model.rb:145:in `rescue in get_cartridge' /opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-node-1.9.14.5/lib/openshift-origin-node/model/v2_cart_model.rb:138:in `get_cartridge' /opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-node-1.9.14.5/lib/openshift-origin-node/model/application_container.rb:214:in `create_public_endpoints' /opt/rh/ruby193/root/usr/libexec/mcollective/mcollective/agent/openshift.rb:556:in `block in oo_expose_port' /opt/rh/ruby193/root/usr/libexec/mcollective/mcollective/agent/openshift.rb:166:in `with_container_from_args' /opt/rh/ruby193/root/usr/libexec/mcollective/mcollective/agent/openshift.rb:555:in `oo_expose_port' /opt/rh/ruby193/root/usr/libexec/mcollective/mcollective/agent/openshift.rb:93:in `execute_action' /opt/rh/ruby193/root/usr/libexec/mcollective/mcollective/agent/openshift.rb:126:in `block in execute_parallel_action' /opt/rh/ruby193/root/usr/libexec/mcollective/mcollective/agent/openshift.rb:119:in `each' /opt/rh/ruby193/root/usr/libexec/mcollective/mcollective/agent/openshift.rb:119:in `execute_parallel_action' /opt/rh/ruby193/root/usr/share/ruby/mcollective/rpc/agent.rb:86:in `handlemsg' /opt/rh/ruby193/root/usr/share/ruby/mcollective/agents.rb:126:in `block (2 levels) in dispatch' /opt/rh/ruby193/root/usr/share/ruby/timeout.rb:69:in `timeout' /opt/rh/ruby193/root/usr/share/ruby/mcollective/agents.rb:125:in `block in dispatch' I, [2013-09-22T08:15:31.257988 #6523] INFO -- : openshift.rb:100:in `execute_action' Finished executing action [expose-port] (-1)
In initial report, I mentioned the gear's status was inactive, that was because timeout issue, so ignore it. But the error message was still seen, actually this error message also could be seen in the latest puddle env, so it is unrelated with upgrade stuff. Though the error message is seen in the log, but new gear could be added successfully, and its status is active, so I low its severity and priority.