Created attachment 601857 [details] development.log Description of problem: This error happened in INT(1933) and devenv_1933, and can't happen in devenv_1931 Version-Release number of selected component (if applicable): INT and devenv_1933 How reproducible: always Steps to Reproduce: 1.rhc app create -a qjbossas -t jbossas-7 -s 2. 3. Actual results: [root@localhost mytest]# rhcappcre -a qs4jbossas -t jbossas-7 -s Submitting form: rhlogin: qgong1 debug: true Contacting https://ec2-184-73-140-24.compute-1.amazonaws.com Creating application: qs4jbossas in qgong2 DEBUG: 'qs4jbossas' creation returned success. Now your new domain name is being propagated worldwide (this might take a minute)... Pulling new repo down git clone --quiet ssh://140c182862544899aaf1431903c89f1c.rhcloud.com/~/git/qs4jbossas.git/ qs4jbossas Warning: Permanently added 'qs4jbossas-qgong2.dev.rhcloud.com' (RSA) to the list of known hosts. remote: Counting objects: 39, done. remote: Compressing objects: 100% (30/30), done. remote: Total 39 (delta 1), reused 0 (delta 0) Receiving objects: 100% (39/39), 19.78 KiB | 7 KiB/s, done. Resolving deltas: 100% (1/1), done. Confirming application 'qs4jbossas' is available Attempt # 1 Server responded with 200 <!doctype html> <html lang="en"> <head> <meta charset="utf-8"> <meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1"> <title>Welcome to OpenShift</title> <style> html { background: black; } body { background: #333; background: -webkit-linear-gradient(top, black, #666); background: -o-linear-gradient(top, black, #666); background: -moz-linear-gradient(top, black, #666); background: linear-gradient(top, black, #666); color: white; font-family: "Helvetica Neue",Helvetica,"Liberation Sans",Arial,sans-serif; width: 40em; margin: 0 auto; padding: 3em; } a { color: white; } h1 { text-transform: capitalize; -moz-text-shadow: -1px -1px 0 black; -webkit-text-shadow: 2px 2px 2px black; text-shadow: -1px -1px 0 black; box-shadow: 1px 2px 2px rgba(0, 0, 0, 0.5); background: #CC0000; width: 22.5em; margin: 1em -2em; padding: .3em 0 .3em 1.5em; position: relative; } h1:before { content: ''; width: 0; height: 0; border: .5em solid #91010B; border-left-color: transparent; border-bottom-color: transparent; position: absolute; bottom: -1em; left: 0; z-index: -1000; } h1:after { content: ''; width: 0; height: 0; border: .5em solid #91010B; border-right-color: transparent; border-bottom-color: transparent; position: absolute; bottom: -1em; right: 0; z-index: -1000; } h2 { margin: 2em 0 .5em; border-bottom: 1px solid #999; } pre { background: black; padding: 1em 0 0; -webkit-border-radius: 1em; -moz-border-radius: 1em; border-radius: 1em; color: #9cf; } ul { margin: 0; padding: 0; } li { list-style-type: none; padding: .5em 0; } .brand { display: block; text-decoration: none; } .brand .brand-image { float: left; } .brand .brand-text { float: left; font-size: 24px; line-height: 24px; padding: 4px 0; color: white; text-transform: uppercase; } .brand:hover, .brand:active { text-decoration: underline; } .brand:before, .brand:after { content: ' '; display: table; } .brand:after { clear: both; } </style> </head> <body> <a href="http://openshift.com" class="brand"> <img class="brand-image" alt="OpenShift logo" src="data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAADAAAAAgCAYAAABU1PscAAAAAXNSR0IArs4c6QAAAAZiS0dEAAAAAAAA+UO7fwAAAAlwSFlzAAARHgAAER4B27UUrQAABUhJREFUWMPFWFlsVGUU/s5/70zbaSltA7RQpJ2lC9CFkQkWIgSJxkAhRA0JCYFq4hPG6JsoGKNCtPigxqhvGlPAuGIaE4igNaElbIW2yNL2tkOtTYGWCqWF2e79fCh7p1Bmpnge/3vuOef7z/nPJiTxMHS6pMRuu6YqFNTTAJYSyAU4GZB0AH2AGCANAfc5Qrba6T3HrmECScYLwCioSIcV2AjidQDZ45Q/LJRaWrLV03X89P8GwHB5XwG4DcDkGPWEBKimNrzN094efGQAzjm9GWHFr4R4LiHKgFaSL3r8zYcmHEBbkW+KFo7UEyhKsNeHlMgyV8eJo4kQpqId9ub6HCoc+XWcxl8lcBTATwDax8GfZtHa054/f/bNg8ZcnyOhHjBc834E8MJ9/vML8aYZQX1hd1PP3WFXkhMRfYkIlpOoGomc0WRRTnch+XAQWG2KTNJNLbuy68C/cQMwXOWrAKkdgz8A8kMdg9X5fn/gQcI7POXLaMk3AGbe/P8SbF0D1KcGRGXpIJJpIQkWBHhnsf/Ie3GF0DmnMxmQT8bg7RellXr8ze+Ox3gAcBvNf+iUUhH5FODLSvScAerDGpiVxTAyGUYKzICA34nCwbhDyHB7N4L8PAofhVzh9jfvjffR/ZZTnupIsR8G0C9EjW7Tfnii/dBgrPL0u83kmjHy33Z3Z/zG97uKi7xpWA8GHZpE1mcZRne8MvXblfbxqQAWR+Fp+mdW5hZPjAqu5JVlhrTwOgrXi2ABbjjchF4FYGvi0qhprgagjYod4OeldXWRWBUEtdBjEH4mwIJ7vF2V4Dqgot0+NEFdPAqmdZ5tAXA8Slx6LrpKsxMHQJge5ft1v0oe2OOu+PZ39+LCOFqImqiXo8JzAeBkXlnmnoKK9LgACJl2R9gELsHW1saUwKCpnbIoa8UMTokVgGXJmSjHkfNWUlWDy9d6USVdyoiEF8b1iElxQKHuPG1D/bCtVEBhCiykMQQFgCK2mN2sSx+tkdcbhGq7wKSkK9RnmsCG2xVSLsflAR1S6eloWhawtF8yGJGskSJDBdQR8pIjZMXcfFmm1gOg2lRaSRdT1AD1PBPQbCAyxcRMifCpc41HEtILNbh9s8SSvYTUmBp2LDGOdCOB1OD0XbeByWliwY5bugc9nU2T4wqhCx7PNAV9bSGwARp3TzVaP0j09GQUzJubLUgefY3SEHMh63MVr4FIlYL+7C1AlCwAmxM+/plYy6hhgN2xp1HBawAr72krnH3uoicTaXyHx7uIwKZoT0QhUhszAAI7x7ivL0a60/jp77yyTFrWt6N6rxE99c7OkxdiBhC2y/cAorXHpama/aNG8dkOO32b6p3zTzXmeysfPu4LkkKafA3IrGjfCfPtuGfiPlfx+xBsuWtwpa3zIuy2YaoZ5o0eSQc5TVnb53aeeAuk9eBtRvkqUH0MoTsqA7nL429eFzeA3lyfQ08eaiNgCrjTYNozQ1S+WyUfQCosTLqZ+oiDUNwhggPujpZTuCMXGwUV6cJgKYnNIJffR3df2NLLZ5871puQrUR//pzpU7rOnAfJP53eDELrsoPpk4RIGRn5xqIBAAdBOCAoBjBjPJsJUdZSt9HSOGFrld5cn2M4KbwfkIUJzqYhQlYWdJ7YN2FrFQCY3nPsmk61AuSuRNYyUdaiRBk/7tViR37Zcir1JYC8WNshgjWWPfhq0dmzVx/5bhQAWnLKU1Md8gZHOsjxAgmD2GEKq4s6m1sxASQPu16HiBh53goqPg9ac0TEcwNQEOBlQAZEcMgC94dDZt2c7r8GMIH0H43ZRDC51RVCAAAAAElFTkSuQmCC"> <div class="brand-text"><s .................. Expected results: Create app success Additional info:
This error happened for all scalable app.
Hmm, this looks to be a client tools issue -- since the app is available and responding w/ a 200 code and giving the sample app page to the client. What version of client tools do you have?? Can you check w/ an older version and see if it works.
This works fine for me w/ rhc 0.95.14 but fails w/ rhc 0.96.6 -- the rhc version 0.96.6 is treating the 200 as an error and is exponentially backing off and retrying the app availability check and eventually deletes the app. Assigning to Clayton.
This error only happens on rhc-0.96.7, it works well when (rhc-0.96.6, devenv_1933)
*** Bug 845171 has been marked as a duplicate of this bug. ***
The healthcheck URL is empty, which means it checks the root page for a request, then it fails. Two problems - 1 healthcheck is empty, and 2 the healthcheck is not a 100% reliable mechanism. The healthcheck being empty needs to be debugged by broker team. I'll look at the other aspect
Could be related to this commit - 9ded965acdec25a4e75fb87d1d6f3c6332944405 use health_check_path returned by API
working on a fix should have finished in next 1/2 hour
Waiting for review
Changes in master, https://github.com/openshift/rhc/pull/114 is the pull to stage.
Change is in stage.
Verified on stage, with client rhc-0.96.8 [root@localhost mytest]# rhc app create -a qsjbossas -t jbossas-7 -s Password:****** Submitting form: rhlogin: qgong debug: true Contacting https://stg.openshift.redhat.com Creating application: qsjbossas in lignpzdyql DEBUG: 'qsjbossas' creation returned success. Now your new domain name is being propagated worldwide (this might take a minute)... Pulling new repo down git clone --quiet ssh://1bd045b9a58e417d8c30cd006a280e3e.rhcloud.com/~/git/qsjbossas.git/ qsjbossas remote: Counting objects: 39, done. remote: Compressing objects: 100% (30/30), done. remote: Total 39 (delta 1), reused 0 (delta 0) Receiving objects: 100% (39/39), 19.78 KiB, done. Resolving deltas: 100% (1/1), done. Checking if the application is available #1 Application qsjbossas is available at: http://qsjbossas-lignpzdyql.stg.rhcloud.com/ Git URL: ssh://1bd045b9a58e417d8c30cd006a280e3e.rhcloud.com/~/git/qsjbossas.git/ To make changes to 'qsjbossas', commit to qsjbossas/. Successfully created application: qsjbossas