Bug 963156

*** Bug 963157 has been marked as a duplicate of this bug. ***

Looks like the issue is this logic:

function send_stopped_status {
    _state=`get_app_state`

    case "$_state" in
      idle)     send_attr "status=ALREADY_IDLED" ;;
      stopped)  send_attr "status=ALREADY_STOPPED" ;;
      *)
          if [ -f $APP_DIR/run/stop_lock ]
          then
              if oo-frontend-check-idle --with-container-uuid "$uuid"
              then
                  send_attr "status=ALREADY_IDLED"
              else
                  send_attr "status=ALREADY_STOPPED"
              fi
          fi
          ;;
    esac
}



Is missing from v2

Commit pushed to master at https://github.com/openshift/origin-server

https://github.com/openshift/origin-server/commit/bf867f95538bbb66e81fc766245f3b36b002505e
Bug 963156

https://github.com/openshift/origin-server/pull/2500

Created attachment 748624 [details]
log

the issue still can be reproduced on devenv_3231

comment 5 have attached the development.log

It says from the PR that the change didn't go in until 3232:

Online Merge Results: SUCCESS (https://ci.dev.openshift.redhat.com/jenkins/job/test_pull_requests/2590/) (Image: devenv_3232)

verified this bug on devenv_3235

[root@ip-10-152-186-180 ~]# oo-admin-move --gear_uuid 51958c94444fff0a52000001 -i ip-10-165-14-227
URL: http://zqphp-zqd.dev.rhcloud.com
Login: zzhao
App UUID: 51958c94444fffe43c000006
Gear UUID: 51958c94444fffe43c000006
DEBUG: Source district uuid: c81bb5dabe9311e28eed22000a98bab4
DEBUG: Destination district uuid: c81bb5dabe9311e28eed22000a98bab4
DEBUG: Getting existing app 'zqphp' status before moving
DEBUG: Gear component 'php-5.3' was running
DEBUG: Stopping existing app cartridge 'php-5.3' before moving
DEBUG: Force stopping existing app cartridge 'php-5.3' before moving
DEBUG: Creating new account for gear 'zqphp' on ip-10-165-14-227
DEBUG: Moving content for app 'zqphp', gear 'zqphp' to ip-10-165-14-227
Identity added: /var/www/openshift/broker/config/keys/rsync_id_rsa (/var/www/openshift/broker/config/keys/rsync_id_rsa)
Warning: Permanently added '10.152.186.180' (RSA) to the list of known hosts.
Warning: Permanently added '10.165.14.227' (RSA) to the list of known hosts.
Agent pid 9941
unset SSH_AUTH_SOCK;
unset SSH_AGENT_PID;
echo Agent pid 9941 killed;
DEBUG: Moving system components for app 'zqphp', gear 'zqphp' to ip-10-165-14-227
Identity added: /var/www/openshift/broker/config/keys/rsync_id_rsa (/var/www/openshift/broker/config/keys/rsync_id_rsa)
Agent pid 10002
unset SSH_AUTH_SOCK;
unset SSH_AGENT_PID;
echo Agent pid 10002 killed;
DEBUG: Starting cartridge 'php-5.3' in 'zqphp' after move on ip-10-165-14-227
DEBUG: Fixing DNS and mongo for gear 'zqphp' after move
DEBUG: Changing server identity of 'zqphp' from 'ip-10-152-186-180' to 'ip-10-165-14-227'
DEBUG: Deconfiguring old app 'zqphp' on ip-10-152-186-180 after move
Successfully moved gear with uuid '51958c94444fff0a52000001' of app 'zqphp' from 'ip-10-152-186-180' to 'ip-10-165-14-227'

I get this same error (see below) when moving Mysql from one node to another. I can move all the other gears without problem. I am using OSE 1.1. I am also suspecting that this is applicable to any embedded cartrige like all the database cartridges.

App UUID: 65ddaa7339504b01acc7695bbd30cefe
Gear UUID: e7b66d9cf7d4465bac76bee1559c1355
DEBUG: Source district uuid: NONE
DEBUG: Destination district uuid: NONE
DEBUG: Getting existing app 'scaledphp' status before moving
DEBUG: Gear component 'php-5.3' was running
DEBUG: Stopping existing app cartridge 'mysql-5.1' before moving
DEBUG: Performing cartridge level pre-move for embedded mysql-5.1 for 'scaledphp' on node1.oseoloncadjaibr.csb
DEBUG: Performing cartridge level post-move for embedded mysql-5.1 for 'scaledphp' on node1.oseoloncadjaibr.csb
ERROR: Error performing cartridge level post-move for embedded mysql-5.1 for 'scaledphp' on node1.oseoloncadjaibr.csb: Node execution failure (invalid exit code from node).  If the problem persists please contact Red Hat support.
/usr/lib/ruby/gems/1.8/gems/openshift-origin-msg-broker-mcollective-1.0.5/lib/openshift-origin-msg-broker-mcollective/lib/openshift/mcollective_application_container_proxy.rb:1265:in `run_cartridge_command': Node execution failure (invalid exit code from node).  If the problem persists please contact Red Hat support. (OpenShift::NodeException)
        from /usr/lib/ruby/gems/1.8/gems/openshift-origin-msg-broker-mcollective-1.0.5/lib/openshift-origin-msg-broker-mcollective/lib/openshift/mcollective_application_container_proxy.rb:731:in `send'
        from /usr/lib/ruby/gems/1.8/gems/openshift-origin-msg-broker-mcollective-1.0.5/lib/openshift-origin-msg-broker-mcollective/lib/openshift/mcollective_application_container_proxy.rb:731:in `move_gear_pre'
        from /usr/lib/ruby/gems/1.8/gems/openshift-origin-msg-broker-mcollective-1.0.5/lib/openshift-origin-msg-broker-mcollective/lib/openshift/mcollective_application_container_proxy.rb:708:in `each'
        from /usr/lib/ruby/gems/1.8/gems/openshift-origin-msg-broker-mcollective-1.0.5/lib/openshift-origin-msg-broker-mcollective/lib/openshift/mcollective_application_container_proxy.rb:708:in `move_gear_pre'
        from /usr/lib/ruby/gems/1.8/gems/openshift-origin-msg-broker-mcollective-1.0.5/lib/openshift-origin-msg-broker-mcollective/lib/openshift/mcollective_application_container_proxy.rb:769:in `move_gear'
        from /usr/sbin/oo-admin-move:111