Created attachment 668732 [details] development.log Description of problem: Can't move non_scalable app with DB embed accross district successfully(please see the attachment for detail) part log: 2012-12-25 01:10:43.661 [INFO ] Completed 500 Internal Server Error in 14ms (pid:1783) 2012-12-25 01:10:43.665 [FATAL] Mongoid::Errors::DocumentNotFound ( Problem: Document(s) not found for class CloudUser with id(s) qgong. Summary: When calling CloudUser.find with an id or array of ids, each parameter must match a document in the database or this error will be raised. The search was for the id(s): qgong ... (1 total) and the following ids were not found: qgong. Resolution: Search for an id that is in the database or set the Mongoid.raise_not_found_error configuration option to false, which will cause a nil to be returned instead of raising this error when searching for a single id, or only the matched documents when searching for multiples.): Version-Release number of selected component (if applicable): fork_ami_refctr1_372 How reproducible: Always Steps to Reproduce: 1.Setup the multi districts env 2.Move the app embed with any DB 3. Actual results: [root@ip-10-224-110-206 openshift]# oo-admin-move --gear_uuid 50d940690ba57bf70600018f -i ip-10-100-203-152 --allow_change_district URL: http://qpython-qgong21.dev.rhcloud.com Login: qgong App UUID: 50d940690ba57bf70600018f Gear UUID: 50d940690ba57bf70600018f DEBUG: Source district uuid: 50d908950ba57bab31000001 DEBUG: Destination district uuid: 50d940ce0ba57b3452000001 DEBUG: Getting existing app 'qpython' status before moving DEBUG: Gear component 'python-2.6' was running DEBUG: Stopping existing app cartridge 'mysql-5.1' before moving DEBUG: Performing cartridge level pre-move for embedded mysql-5.1 for 'qpython' on ip-10-224-110-206 DEBUG: Stopping existing app cartridge 'python-2.6' before moving DEBUG: Force stopping existing app cartridge 'python-2.6' before moving DEBUG: Reserved uid '1002' on district: '50d940ce0ba57b3452000001' DEBUG: Creating new account for gear 'qpython' on ip-10-100-203-152 DEBUG: Moving content for app 'qpython', gear 'qpython' to ip-10-100-203-152 Identity added: /var/www/openshift/broker/config/keys/rsync_id_rsa (/var/www/openshift/broker/config/keys/rsync_id_rsa) Agent pid 28169 unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 28169 killed; DEBUG: Performing cartridge level move for 'python-2.6' on ip-10-100-203-152 DEBUG: Performing cartridge level move for embedded mysql-5.1 for 'qpython' on ip-10-100-203-152 DEBUG: Moving failed. Rolling back gear 'qpython' 'qpython' with remove-httpd-proxy on 'ip-10-100-203-152' DEBUG: Moving failed. Rolling back gear 'qpython' in 'qpython' with destroy on 'ip-10-100-203-152' /usr/sbin/oo-admin-move:112:in `<main>': undefined method `debugIO' for 1:Fixnum (NoMethodError) Expected results: Could move successfully. Additional info:
Retest on fork_ami_refctr1_381 Can't move non_scalable app with DB embed and db gear that embed to scalable app accross district. [root@ip-10-38-21-76 ~]# oo-admin-move --gear_uuid 50e7a524776856a8080001dc -i ip-10-140-76-15 --allow_change_district URL: http://redmine19-qgong8.dev.rhcloud.com Login: qgong App UUID: 50e7a524776856a8080001dc Gear UUID: 50e7a524776856a8080001dc DEBUG: Source district uuid: 50e79b17776856de32000001 DEBUG: Destination district uuid: 50e7d5827768568321000001 DEBUG: Getting existing app 'redmine19' status before moving DEBUG: Gear component 'ruby-1.9' was running DEBUG: Stopping existing app cartridge 'mysql-5.1' before moving DEBUG: Performing cartridge level pre-move for embedded mysql-5.1 for 'redmine19' on ip-10-100-222-253 DEBUG: Stopping existing app cartridge 'ruby-1.9' before moving DEBUG: Force stopping existing app cartridge 'ruby-1.9' before moving DEBUG: Reserved uid '1023' on district: '50e7d5827768568321000001' DEBUG: Creating new account for gear 'redmine19' on ip-10-140-76-15 DEBUG: Moving content for app 'redmine19', gear 'redmine19' to ip-10-140-76-15 Identity added: /var/www/openshift/broker/config/keys/rsync_id_rsa (/var/www/openshift/broker/config/keys/rsync_id_rsa) Agent pid 19506 unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 19506 killed; DEBUG: Performing cartridge level move for 'ruby-1.9' on ip-10-140-76-15 DEBUG: Performing cartridge level move for embedded mysql-5.1 for 'redmine19' on ip-10-140-76-15 DEBUG: Moving failed. Rolling back gear 'redmine19' 'redmine19' with remove-httpd-proxy on 'ip-10-140-76-15' DEBUG: Moving failed. Rolling back gear 'redmine19' in 'redmine19' with destroy on 'ip-10-140-76-15' /opt/rh/ruby193/root/usr/share/gems/gems/mongoid-3.0.5/lib/mongoid/attributes.rb:225:in `method_missing': undefined method `set_embedded_cart_info' for #<Application:0x000000069e5a60> (NoMethodError) from /opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-msg-broker-mcollective-1.3.1/lib/openshift/mcollective_application_container_proxy.rb:733:in `block in move_gear' from /opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-msg-broker-mcollective-1.3.1/lib/openshift/mcollective_application_container_proxy.rb:714:in `each' from /opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-msg-broker-mcollective-1.3.1/lib/openshift/mcollective_application_container_proxy.rb:714:in `move_gear' from /opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-msg-broker-mcollective-1.3.1/lib/openshift/mcollective_application_container_proxy.rb:670:in `block in move_gear_secure' from /opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-controller-1.3.2/app/models/application.rb:947:in `run_in_application_lock' from /opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-msg-broker-mcollective-1.3.1/lib/openshift/mcollective_application_container_proxy.rb:669:in `move_gear_secure' from /usr/sbin/oo-admin-move:110:in `<main>'
Fixed with rev#53728e6872cd92d7dbe4f8ffa7f4b4fe4d6f02ac
verified on fork_ami_refctr1_395 [root@ip-10-212-70-181 openshift]# oo-admin-move --gear_uuid 50ee8d838d51f0f70b0000f4 -i ip-10-212-70-181 --allow_change_district URL: http://qphp-qgong8.dev.rhcloud.com Login: qgong App UUID: 50ee8d838d51f0f70b0000f4 Gear UUID: 50ee8d838d51f0f70b0000f4 DEBUG: Source district uuid: 50ee8c738d51f0c041000001 DEBUG: Destination district uuid: 50ee8c888d51f09443000001 DEBUG: Getting existing app 'qphp' status before moving DEBUG: Gear component 'php-5.3' was running DEBUG: Stopping existing app cartridge 'mongodb-2.2' before moving DEBUG: Performing cartridge level pre-move for embedded mongodb-2.2 for 'qphp' on ip-10-64-62-60 DEBUG: Stopping existing app cartridge 'php-5.3' before moving DEBUG: Force stopping existing app cartridge 'php-5.3' before moving DEBUG: Reserved uid '1003' on district: '50ee8c888d51f09443000001' DEBUG: Creating new account for gear 'qphp' on ip-10-212-70-181 DEBUG: Moving content for app 'qphp', gear 'qphp' to ip-10-212-70-181 Identity added: /var/www/openshift/broker/config/keys/rsync_id_rsa (/var/www/openshift/broker/config/keys/rsync_id_rsa) Agent pid 5270 unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 5270 killed; DEBUG: Performing cartridge level move for 'php-5.3' on ip-10-212-70-181 DEBUG: Performing cartridge level move for embedded mongodb-2.2 for 'qphp' on ip-10-212-70-181 DEBUG: Performing cartridge level post-move for embedded mongodb-2.2 for 'qphp' on ip-10-212-70-181 DEBUG: Starting cartridge 'php-5.3' in 'qphp' after move on ip-10-212-70-181 DEBUG: Starting cartridge 'mongodb-2.2' in 'qphp' after move on ip-10-212-70-181 DEBUG: Fixing DNS and mongo for gear 'qphp' after move DEBUG: Changing server identity of 'qphp' from 'ip-10-64-62-60' to 'ip-10-212-70-181' DEBUG: The gear's node profile changed from c9 to small DEBUG: Deconfiguring old app 'qphp' on ip-10-64-62-60 after move Successfully moved 'qphp' with gear uuid '50ee8d838d51f0f70b0000f4' from 'ip-10-64-62-60' to 'ip-10-212-70-181'