Bug 1086593 - 503 error returns when access php existing app url after upgrade and migration
Summary: 503 error returns when access php existing app url after upgrade and migration
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: OpenShift Online
Classification: Red Hat
Component: Image
Version: 2.x
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: ---
: ---
Assignee: Vojtech Vitek
QA Contact: libra bugs
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2014-04-11 07:33 UTC by Wenjing Zheng
Modified: 2015-05-15 00:41 UTC (History)
3 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2014-05-15 15:29:00 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)
tail logs for existing php-5.3, drupal and wordpress apps (11.10 KB, text/plain)
2014-04-11 11:24 UTC, Wenjing Zheng
no flags Details
INT php process list (4.33 KB, text/plain)
2014-04-15 11:09 UTC, Wenjing Zheng
no flags Details
devenv migration php process list (2.07 KB, text/plain)
2014-04-15 11:10 UTC, Wenjing Zheng
no flags Details

Description Wenjing Zheng 2014-04-11 07:33:58 UTC
Description:
1. php existing apps including quickstart cannot be accessed after server upgraded and migration, 503 error returns;
2. php applications cannot be started, restarted with below errors:
Failed to execute: 'control restart' for
/var/lib/openshift/534608176cec0ed674000041/php
3. Issue can be reproduced on php-5.3, php-5.4 and php quickstart; and can be reproduced in devenv migration

Version-Release number of selected component (if applicable):
INT(devenv_4654),devenv_4654

How reproducible:
always

steps to Reproduce:
1. Create php apps(php-5.3, php-5.4 or php quickstart)
2. After server upgrade and migaration, access the apps url

Actual results:
503 error returns.

Expected results:
It should be accessed normally

Additional info:

Comment 1 Wenjing Zheng 2014-04-11 11:24:58 UTC
Created attachment 885378 [details]
tail logs for existing php-5.3, drupal and wordpress apps

Comment 2 Vojtech Vitek 2014-04-11 15:05:00 UTC
Interesting logs:

> ==> app-root/logs/php.log <==
> [Thu Apr 10 17:31:12 2014] [notice] caught SIGWINCH, shutting down gracefully

> ==> app-root/logs/phpmyadmin.log <==
> [Thu Apr 10 22:45:09 2014] [notice] caught SIGWINCH, shutting down gracefully

> ==> app-root/logs/postgresql.log <==
> LOG:  trying another address for the statistics collector
> LOG:  could not bind socket for statistics collector: Cannot assign requested address
> LOG:  disabling statistics collector for lack of working socket
> WARNING:  autovacuum not started because of misconfiguration
> LOG:  received smart shutdown request

> ==> app-root/logs/mysql.log <==
> chown: changing ownership of `/var/lib/openshift/5345ff1303ef648e9100003b/mysql//stdout.err': Operation not permitted


> ==> app-root/logs/php.log <==
> (98)Address already in use: make_sock: could not bind to address 127.4.65.129:8080
no listening sockets available, shutting down
> Unable to open logs

Comment 3 Vojtech Vitek 2014-04-14 17:05:31 UTC
@Wenjing, seems like port 8080 is already taken, so Apache can't bind to it. Can you please investigate what processes are running after the upgrade (ps aux)?

Comment 4 Wenjing Zheng 2014-04-15 11:07:57 UTC
@vvitek attached are two process files, one is from INT and another is from devenv migration(failed too when migrate from devenv-stage_802 to devenv_4674). Please have a check.

Comment 5 Wenjing Zheng 2014-04-15 11:09:12 UTC
Created attachment 886441 [details]
INT php process list

Comment 6 Wenjing Zheng 2014-04-15 11:10:22 UTC
Created attachment 886442 [details]
devenv migration php process list

Comment 9 Vojtech Vitek 2014-04-16 15:38:16 UTC
@Wenjing, could you please retest?

If you hit the problem again, could you please provide all the platform/migration/application logs?
Also, could you send me the machine IP, so I can look into the gears?

Comment 10 Wenjing Zheng 2014-04-17 08:15:06 UTC
The previous failed apps still cannot be accessed, however I execute a migration from devenv-stage_802 to devenv_4690 and succeed in accessing the existing apps. Below is the migration console output:
http://ciqe.englab.nay.redhat.com/job/OpenShift-Migration/235/console

So mark this defect as verified and also will delete the broken apps, create new ones to check on next INT.


Note You need to log in before you can comment on or make changes to this bug.