Bug 845154

Summary: Can't Create scalable application success by rhc-0.96.7
Product: OKD Reporter: Rony Gong 🔥 <qgong>
Component: ocAssignee: Clayton Coleman <ccoleman>
Status: CLOSED CURRENTRELEASE QA Contact: libra bugs <libra-bugs>
Severity: high Docs Contact:
Priority: high    
Version: 2.xCC: jizhao, johnp, ramr, rmillner, wsun
Target Milestone: ---Keywords: Regression
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2012-08-07 20:42:51 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
development.log none

Description Rony Gong 🔥 2012-08-02 02:27:04 UTC
Created attachment 601857 [details]
development.log

Description of problem:
This error happened in INT(1933) and devenv_1933, and can't happen in devenv_1931


Version-Release number of selected component (if applicable):
INT and devenv_1933

How reproducible:
always


Steps to Reproduce:
1.rhc app create -a qjbossas -t jbossas-7 -s 
2.
3.
  
Actual results:
[root@localhost mytest]# rhcappcre -a qs4jbossas -t jbossas-7 -s
Submitting form:
rhlogin: qgong1
debug: true
Contacting https://ec2-184-73-140-24.compute-1.amazonaws.com
Creating application: qs4jbossas in qgong2
DEBUG: 'qs4jbossas' creation returned success.
Now your new domain name is being propagated worldwide (this might take a minute)...
Pulling new repo down
git clone --quiet ssh://140c182862544899aaf1431903c89f1c.rhcloud.com/~/git/qs4jbossas.git/ qs4jbossas
Warning: Permanently added 'qs4jbossas-qgong2.dev.rhcloud.com' (RSA) to the list of known hosts.
remote: Counting objects: 39, done.
remote: Compressing objects: 100% (30/30), done.
remote: Total 39 (delta 1), reused 0 (delta 0)
Receiving objects: 100% (39/39), 19.78 KiB | 7 KiB/s, done.
Resolving deltas: 100% (1/1), done.
Confirming application 'qs4jbossas' is available
  Attempt # 1
Server responded with 200
<!doctype html>
<html lang="en">
<head>
  <meta charset="utf-8">
  <meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1">
  <title>Welcome to OpenShift</title>
  <style>
  html { 
  background: black; 
  }
  body {
    background: #333;
    background: -webkit-linear-gradient(top, black, #666);
    background: -o-linear-gradient(top, black, #666);
    background: -moz-linear-gradient(top, black, #666);
    background: linear-gradient(top, black, #666);
    color: white;
    font-family: "Helvetica Neue",Helvetica,"Liberation Sans",Arial,sans-serif;
    width: 40em;
    margin: 0 auto;
    padding: 3em;
  }
  a {
    color: white;
  }

  h1 {
    text-transform: capitalize;
    -moz-text-shadow: -1px -1px 0 black;
    -webkit-text-shadow: 2px 2px 2px black;
    text-shadow: -1px -1px 0 black;
    box-shadow: 1px 2px 2px rgba(0, 0, 0, 0.5);
    background: #CC0000;
    width: 22.5em;
    margin: 1em -2em;
    padding: .3em 0 .3em 1.5em;
    position: relative;
  }
  h1:before {
    content: '';
    width: 0;
    height: 0;
    border: .5em solid #91010B;
    border-left-color: transparent;
    border-bottom-color: transparent;
    position: absolute;
    bottom: -1em;
    left: 0;
    z-index: -1000;
  }
  h1:after {
    content: '';
    width: 0;
    height: 0;
    border: .5em solid #91010B;
    border-right-color: transparent;
    border-bottom-color: transparent;
    position: absolute;
    bottom: -1em;
    right: 0;
    z-index: -1000;
  }
  h2 { 
    margin: 2em 0 .5em;
    border-bottom: 1px solid #999;
  }

  pre {
    background: black;
    padding: 1em 0 0;
    -webkit-border-radius: 1em;
    -moz-border-radius: 1em;
    border-radius: 1em;
    color: #9cf;
  }

  ul { 
    margin: 0; 
    padding: 0;
  }
  li {
    list-style-type: none;
    padding: .5em 0;
  }

  .brand {
    display: block;
    text-decoration: none;
  }
  .brand .brand-image {
    float: left;
  }
  .brand .brand-text {
    float: left;
    font-size: 24px;
    line-height: 24px;
    padding: 4px 0;
    color: white;
    text-transform: uppercase;
  }
  .brand:hover,
  .brand:active {
    text-decoration: underline;
  }

  .brand:before,
  .brand:after {
    content: ' ';
    display: table;
  }
  .brand:after {
    clear: both;
  }
  </style>
</head>
<body>
  <a href="http://openshift.com" class="brand">
    <img class="brand-image"
      alt="OpenShift logo"
      src="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAADAAAAAgCAYAAABU1PscAAAAAXNSR0IArs4c6QAAAAZiS0dEAAAAAAAA+UO7fwAAAAlwSFlzAAARHgAAER4B27UUrQAABUhJREFUWMPFWFlsVGUU/s5/70zbaSltA7RQpJ2lC9CFkQkWIgSJxkAhRA0JCYFq4hPG6JsoGKNCtPigxqhvGlPAuGIaE4igNaElbIW2yNL2tkOtTYGWCqWF2e79fCh7p1Bmpnge/3vuOef7z/nPJiTxMHS6pMRuu6YqFNTTAJYSyAU4GZB0AH2AGCANAfc5Qrba6T3HrmECScYLwCioSIcV2AjidQDZ45Q/LJRaWrLV03X89P8GwHB5XwG4DcDkGPWEBKimNrzN094efGQAzjm9GWHFr4R4LiHKgFaSL3r8zYcmHEBbkW+KFo7UEyhKsNeHlMgyV8eJo4kQpqId9ub6HCoc+XWcxl8lcBTATwDax8GfZtHa054/f/bNg8ZcnyOhHjBc834E8MJ9/vML8aYZQX1hd1PP3WFXkhMRfYkIlpOoGomc0WRRTnch+XAQWG2KTNJNLbuy68C/cQMwXOWrAKkdgz8A8kMdg9X5fn/gQcI7POXLaMk3AGbe/P8SbF0D1KcGRGXpIJJpIQkWBHhnsf/Ie3GF0DmnMxmQT8bg7RellXr8ze+Ox3gAcBvNf+iUUhH5FODLSvScAerDGpiVxTAyGUYKzICA34nCwbhDyHB7N4L8PAofhVzh9jfvjffR/ZZTnupIsR8G0C9EjW7Tfnii/dBgrPL0u83kmjHy33Z3Z/zG97uKi7xpWA8GHZpE1mcZRne8MvXblfbxqQAWR+Fp+mdW5hZPjAqu5JVlhrTwOgrXi2ABbjjchF4FYGvi0qhprgagjYod4OeldXWRWBUEtdBjEH4mwIJ7vF2V4Dqgot0+NEFdPAqmdZ5tAXA8Slx6LrpKsxMHQJge5ft1v0oe2OOu+PZ39+LCOFqImqiXo8JzAeBkXlnmnoKK9LgACJl2R9gELsHW1saUwKCpnbIoa8UMTokVgGXJmSjHkfNWUlWDy9d6USVdyoiEF8b1iElxQKHuPG1D/bCtVEBhCiykMQQFgCK2mN2sSx+tkdcbhGq7wKSkK9RnmsCG2xVSLsflAR1S6eloWhawtF8yGJGskSJDBdQR8pIjZMXcfFmm1gOg2lRaSRdT1AD1PBPQbCAyxcRMifCpc41HEtILNbh9s8SSvYTUmBp2LDGOdCOB1OD0XbeByWliwY5bugc9nU2T4wqhCx7PNAV9bSGwARp3TzVaP0j09GQUzJubLUgefY3SEHMh63MVr4FIlYL+7C1AlCwAmxM+/plYy6hhgN2xp1HBawAr72krnH3uoicTaXyHx7uIwKZoT0QhUhszAAI7x7ivL0a60/jp77yyTFrWt6N6rxE99c7OkxdiBhC2y/cAorXHpama/aNG8dkOO32b6p3zTzXmeysfPu4LkkKafA3IrGjfCfPtuGfiPlfx+xBsuWtwpa3zIuy2YaoZ5o0eSQc5TVnb53aeeAuk9eBtRvkqUH0MoTsqA7nL429eFzeA3lyfQ08eaiNgCrjTYNozQ1S+WyUfQCosTLqZ+oiDUNwhggPujpZTuCMXGwUV6cJgKYnNIJffR3df2NLLZ5871puQrUR//pzpU7rOnAfJP53eDELrsoPpk4RIGRn5xqIBAAdBOCAoBjBjPJsJUdZSt9HSOGFrld5cn2M4KbwfkIUJzqYhQlYWdJ7YN2FrFQCY3nPsmk61AuSuRNYyUdaiRBk/7tViR37Zcir1JYC8WNshgjWWPfhq0dmzVx/5bhQAWnLKU1Md8gZHOsjxAgmD2GEKq4s6m1sxASQPu16HiBh53goqPg9ac0TEcwNQEOBlQAZEcMgC94dDZt2c7r8GMIH0H43ZRDC51RVCAAAAAElFTkSuQmCC">
    <div class="brand-text"><s

..................



Expected results:
Create app success


Additional info:

Comment 1 Rony Gong 🔥 2012-08-02 02:32:20 UTC
This error happened for all scalable app.

Comment 2 Ram Ranganathan 2012-08-02 02:41:28 UTC
Hmm, this looks to be a client tools issue -- since the app is available and responding w/ a 200 code and giving the sample app page to the client. 
What version of client tools do you have?? 
Can you check w/ an older version and see if it works.

Comment 3 Ram Ranganathan 2012-08-02 03:02:43 UTC
This works fine for me w/ rhc 0.95.14  but fails w/ rhc 0.96.6 -- the
rhc version 0.96.6 is treating the 200 as an error and is exponentially backing off and retrying the app availability check and eventually deletes the app. 

Assigning to Clayton.

Comment 4 Rony Gong 🔥 2012-08-02 03:18:53 UTC
This error only happens on rhc-0.96.7, it works well when (rhc-0.96.6, devenv_1933)

Comment 5 Clayton Coleman 2012-08-02 14:58:13 UTC
*** Bug 845171 has been marked as a duplicate of this bug. ***

Comment 6 Clayton Coleman 2012-08-02 14:59:14 UTC
The healthcheck URL is empty, which means it checks the root page for a request, then it fails.  Two problems - 1 healthcheck is empty, and 2 the healthcheck is not a 100% reliable mechanism.  The healthcheck being empty needs to be debugged by broker team.  I'll look at the other aspect

Comment 7 John (J5) Palmieri 2012-08-02 15:08:55 UTC
Could be related to this commit - 9ded965acdec25a4e75fb87d1d6f3c6332944405 use health_check_path returned by API

Comment 8 John Poelstra 2012-08-02 17:03:59 UTC
working on a fix should have finished in next 1/2 hour

Comment 9 Clayton Coleman 2012-08-02 18:48:23 UTC
Waiting for review

Comment 10 Clayton Coleman 2012-08-02 19:44:02 UTC
Changes in master, https://github.com/openshift/rhc/pull/114 is the pull to stage.

Comment 11 Clayton Coleman 2012-08-02 19:51:34 UTC
Change is in stage.

Comment 12 Rony Gong 🔥 2012-08-03 01:56:02 UTC
Verified on stage, with client rhc-0.96.8
[root@localhost mytest]# rhc app create -a qsjbossas -t jbossas-7 -s
Password:******
Submitting form:
rhlogin: qgong
debug: true
Contacting https://stg.openshift.redhat.com
Creating application: qsjbossas in lignpzdyql
DEBUG: 'qsjbossas' creation returned success.
Now your new domain name is being propagated worldwide (this might take a minute)...
Pulling new repo down
git clone --quiet ssh://1bd045b9a58e417d8c30cd006a280e3e.rhcloud.com/~/git/qsjbossas.git/ qsjbossas
remote: Counting objects: 39, done.
remote: Compressing objects: 100% (30/30), done.
remote: Total 39 (delta 1), reused 0 (delta 0)
Receiving objects: 100% (39/39), 19.78 KiB, done.
Resolving deltas: 100% (1/1), done.
Checking if the application is available #1
Application qsjbossas is available at: http://qsjbossas-lignpzdyql.stg.rhcloud.com/
  Git URL: ssh://1bd045b9a58e417d8c30cd006a280e3e.rhcloud.com/~/git/qsjbossas.git/
To make changes to 'qsjbossas', commit to qsjbossas/.
Successfully created application: qsjbossas