Bug 651562 - Provider and template creation intermittently causing httpd proxy error
Summary: Provider and template creation intermittently causing httpd proxy error
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: CloudForms Cloud Engine
Classification: Retired
Component: aeolus-conductor
Version: 0.3.1
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: alpha
Assignee: Matt Wagner
QA Contact: Dave Johnson
URL:
Whiteboard:
Depends On:
Blocks: ce-regression
TreeView+ depends on / blocked
 
Reported: 2010-11-09 19:53 UTC by Dave Johnson
Modified: 2014-08-17 22:27 UTC (History)
8 users (show)

Fixed In Version:
Clone Of:
Environment:
Last Closed:
Embargoed:


Attachments (Terms of Use)
new gem with proxy error fix (21.00 KB, application/octet-stream)
2011-02-22 16:42 UTC, Dave Johnson
no flags Details
error log (in debug mode) for httpd, when this occurred (49.94 KB, application/octet-stream)
2011-08-12 06:52 UTC, Justin Clift
no flags Details
Screenshot of the proxy error, showing exact url request (61.95 KB, image/png)
2011-08-12 06:54 UTC, Justin Clift
no flags Details
thin logfile (267 bytes, application/octet-stream)
2011-08-12 07:10 UTC, Justin Clift
no flags Details
Rails log file (17.53 KB, application/octet-stream)
2011-08-12 07:10 UTC, Justin Clift
no flags Details
Deltacloud log with exception (17.53 KB, application/octet-stream)
2011-08-12 07:22 UTC, Justin Clift
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Red Hat Bugzilla 643989 0 low CLOSED [UI]: Entering a new provider account always leaves me at a Proxy Error 2021-02-22 00:41:40 UTC

Internal Links: 643989

Description Dave Johnson 2010-11-09 19:53:01 UTC
Description of problem:
Running the template automation is intermittently hitting a "proxy: error reading status line".  

==> httpd/error_log <==
[Tue Nov 09 00:31:59 2010] [error] [client 10.11.231.193] (70014)End of file found: proxy: error reading status line from remote server localhost, referer: http://10.16.120.156/deltacloud/templates/new
[Tue Nov 09 00:31:59 2010] [debug] mod_proxy_http.c(1456): [client 10.11.231.193] proxy: NOT Closing connection to client although reading from backend server localhost failed., referer: http://10.16.120.156/deltacloud/templates/new
[Tue Nov 09 00:31:59 2010] [error] [client 10.11.231.193] proxy: Error reading from remote server returned by /deltacloud/templates, referer: http://10.16.120.156/deltacloud/templates/new
[Tue Nov 09 00:31:59 2010] [debug] proxy_util.c(2029): proxy: HTTP: has released connection for (localhost)


Still investigating...

Comment 1 wes hayutin 2011-01-26 16:17:05 UTC
please update this bug after the next official build.. thanks

Comment 2 wes hayutin 2011-02-09 17:27:28 UTC
also found @  provider account creation


10.16.120.31 - - [09/Feb/2011:12:14:19 -0500] "GET /deltacloud/javascripts/application.js?1297178292 HTTP/1.1" 200 6350
10.16.120.31 - - [09/Feb/2011:12:14:19 -0500] "GET /deltacloud/javascripts/jquery.ui-1.8.1/jquery-ui-1.8.1.custom.min.js?1297178292 HTTP/1.1" 200 31425
10.16.120.31 - - [09/Feb/2011:12:14:19 -0500] "GET /deltacloud/javascripts/modernizr-1.5.js?1297178292 HTTP/1.1" 200 32889
10.16.120.31 - - [09/Feb/2011:12:14:21 -0500] "POST /deltacloud/admin/provider_accounts HTTP/1.1" 302 123
10.16.120.31 - - [09/Feb/2011:12:14:48 -0500] "GET /deltacloud/admin/provider_accounts/7 HTTP/1.1" 502 530



[Wed Feb 09 12:14:11 2011] [error] [client 10.16.120.31] File does not exist: /var/www/html/favicon.ico
[Wed Feb 09 12:14:12 2011] [error] [client 10.16.120.31] File does not exist: /var/www/html/favicon.ico
[Wed Feb 09 12:14:49 2011] [error] [client 10.16.120.31] (20014)Internal error: proxy: error reading status line from remote server localhost:3000, referer: http://10.16.120.139/deltacloud/admin/provider_accounts/new
[Wed Feb 09 12:14:49 2011] [error] [client 10.16.120.31] proxy: Error reading from remote server returned by /deltacloud/admin/provider_accounts/7, referer: http://10.16.120.139/deltacloud/admin/provider_accounts/new

Comment 3 wes hayutin 2011-02-10 14:43:50 UTC
STEPS TO REPRODUCE::

http://aeolus-fedora.virt.bos.redhat.com/deltacloud/admin/providers
1. create a provider w/ "name" and http://1.1.1.1:3002/api as the url

Comment 4 wes hayutin 2011-02-10 14:46:28 UTC
This bug will not reproduce if you are using a development machine.. apache must be proxying for rails.  

Recreated w/ using the released rpms  + the rpms from 
http://aeolus-fedora.virt.bos.redhat.com/rpms/latest/

	deltacloud-aggregator-0.0.2-0.fc14.20110209215937git325d592.x86_64.rpm	09-Feb-2011 17:03	1.4M	 
	deltacloud-aggregator-daemons-0.0.2-0.fc14.20110209215937git325d592.x86_64.rpm	09-Feb-2011 17:03	 15K	 
	deltacloud-aggregator-doc-0.0.2-0.fc14.20110209215937git325d592.x86_64.rpm

Comment 5 wes hayutin 2011-02-10 14:59:31 UTC
<matty_dubs> weshay_hm: IMHO, it's two bugs... One is that the page should have a reasonable timeout. The other is more of a necessary new feature: the ability to handle more than one concurrent connection

Comment 6 wes hayutin 2011-02-21 18:00:20 UTC
some bugs were not listed as "phase 2"

Comment 7 Dave Johnson 2011-02-22 16:42:24 UTC
Created attachment 480175 [details]
new gem with proxy error fix

Matt Warner sent QE the attached deltacloud-client.gem which contained some fixes for the proxy error.  I noticed that after applying it, I cannot add a provider account and see the following exception in rails.log.  I tried on both fedora and rhel, same results.


Processing Admin::ProviderAccountsController#create (for 10.11.231.102 at 2011-02-22 11:42:11) [POST]
  Parameters: {"commit"=>"Add", "action"=>"create", "quota"=>{"maximum_running_instances"=>"unlimited"}, "controller"=>"admin/provider_accounts", "__map"=>{"set_selected_provider"=>{"method"=>"GET", "url"=>"/deltacloud/admin/provider_accounts/set_selected_provider"}}, "provider_account"=>{"x509_cert_pub_file"=>#<File:/tmp/RackMultipart20110222-5146-18sq092-0>, "label"=>"ec2acct", "x509_cert_priv_file"=>#<File:/tmp/RackMultipart20110222-5146-1kpl35-0>, "provider_id"=>"2", "username"=>"AKIAJJBQZYJW2LN26OJQ", "account_number"=>"3897-8764-2310", "password"=>"[FILTERED]"}}

DeltaCloud::API::BackendError ():
  /usr/lib/ruby/gems/1.8/gems/deltacloud-client-0.2.0/lib/deltacloud.rb:371:in `handle_backend_error'
  /usr/lib/ruby/gems/1.8/gems/deltacloud-client-0.2.0/lib/deltacloud.rb:279:in `method_missing'
  /usr/lib/ruby/gems/1.8/gems/deltacloud-client-0.2.0/lib/deltacloud.rb:331:in `request'
  /usr/lib/ruby/gems/1.8/gems/rest-client-1.6.1/lib/restclient/request.rb:218:in `call'
  /usr/lib/ruby/gems/1.8/gems/rest-client-1.6.1/lib/restclient/request.rb:218:in `process_result'
  /usr/lib/ruby/gems/1.8/gems/rest-client-1.6.1/lib/restclient/request.rb:169:in `transmit'
  /usr/lib/ruby/1.8/net/http.rb:543:in `start'
  /usr/lib/ruby/gems/1.8/gems/rest-client-1.6.1/lib/restclient/request.rb:166:in `transmit'
  /usr/lib/ruby/gems/1.8/gems/rest-client-1.6.1/lib/restclient/request.rb:60:in `execute'
  /usr/lib/ruby/gems/1.8/gems/rest-client-1.6.1/lib/restclient/request.rb:31:in `execute'
  /usr/lib/ruby/gems/1.8/gems/rest-client-1.6.1/lib/restclient/resource.rb:63:in `post'
  /usr/lib/ruby/gems/1.8/gems/deltacloud-client-0.2.0/lib/deltacloud.rb:328:in `send'
  /usr/lib/ruby/gems/1.8/gems/deltacloud-client-0.2.0/lib/deltacloud.rb:328:in `request'
  /usr/lib/ruby/gems/1.8/gems/deltacloud-client-0.2.0/lib/deltacloud.rb:275:in `method_missing'
  app/models/provider_account.rb:204:in `generate_auth_key'
  app/models/provider_account_observer.rb:9:in `after_create'
  /usr/lib/ruby/1.8/observer.rb:185:in `notify_observers'
  /usr/lib/ruby/1.8/observer.rb:184:in `each'
  /usr/lib/ruby/1.8/observer.rb:184:in `notify_observers'
  app/controllers/admin/provider_accounts_controller.rb:80:in `create'
  compass (0.10.4) lib/compass/app_integration/rails/actionpack2/action_controller.rb:7:in `process'
  haml (3.0.18) rails/./lib/sass/plugin/rack.rb:41:in `call'
  haml (3.0.18) rails/./lib/sass/plugin/rack.rb:41:in `call'
  thin (1.2.5) lib/thin/connection.rb:76:in `pre_process'
  thin (1.2.5) lib/thin/connection.rb:74:in `catch'
  thin (1.2.5) lib/thin/connection.rb:74:in `pre_process'
  thin (1.2.5) lib/thin/connection.rb:57:in `process'
  thin (1.2.5) lib/thin/connection.rb:42:in `receive_data'
  eventmachine (0.12.10) lib/eventmachine.rb:256:in `run_machine'
  eventmachine (0.12.10) lib/eventmachine.rb:256:in `run'
  thin (1.2.5) lib/thin/backends/base.rb:57:in `start'
  thin (1.2.5) lib/thin/server.rb:156:in `start'
  thin (1.2.5) lib/thin/controllers/controller.rb:80:in `start'
  thin (1.2.5) lib/thin/runner.rb:177:in `send'
  thin (1.2.5) lib/thin/runner.rb:177:in `run_command'
  thin (1.2.5) lib/thin/runner.rb:143:in `run!'
  thin (1.2.5) bin/thin:6
  /usr/bin/thin:19:in `load'
  /usr/bin/thin:19

Rendering template within layouts/application
Rendering layouts/error

Comment 8 wes hayutin 2011-03-03 17:33:51 UTC
fyi.. you can circumvent the proxy by starting the conductor w/ 

thin start -c /usr/share/aeolus-conductor -l /var/log/aeolus-conductor/thin.log -P /var/run/aeolus-conductor/thin.pid -a 0.0.0.0 -p 3000 -e production --user aeolus --group aeolus  -d --prefix=/conductor -A rails

Comment 9 Jan Provaznik 2011-03-09 10:03:15 UTC
I hit this problem now too, unfortunately not able to reproduce it.  Creating provider with url http://1.1.1.1:3002/api gives proxy error, but because of timeout -> proxy timeout should be increased.

Anyway google suggests to use these options:
keepalive Off
SetEnv force-proxy-request-1.0 1
etEnv proxy-nokeepalive 1

But I can't say if this solves problem or not - I'm not able to reproduce bug now w/ or w/o above options.

Comment 10 wes hayutin 2011-03-17 18:28:59 UTC
Triaged 3/17

Comment 11 Matt Wagner 2011-04-12 16:06:35 UTC
This has been fixed for a bit in deltacloud-client, but apparently not in a released RPM or in the version installed if you do a gem install. 0.3.0 is now an RC, and will hopefully be released shortly.

I have a small patch to Conductor to gracefully handle the error: https://fedorahosted.org/pipermail/aeolus-devel/2011-April/001065.html

This is not necessary to avoid the Apache errors, however; that's done with an earlier deltacloud-client patch.

Comment 12 wes hayutin 2011-06-14 15:48:11 UTC
*** Bug 643989 has been marked as a duplicate of this bug. ***

Comment 13 Matt Wagner 2011-07-01 19:57:06 UTC
We've got rubygems-deltacloud-client in the testing repos now. This shouldn't happen anymore. (There's also a separate BZ for the one place this has happened recently.)

Comment 14 wes hayutin 2011-07-08 21:37:41 UTC
unfortunately this is still an issue.. but not one for the beta :(

Comment 15 Shveta 2011-07-26 05:41:04 UTC
Getting Proxy very often while adding/deleting provider .

Comment 16 Justin Clift 2011-08-12 06:49:36 UTC
Just hit this on the Aeolus 0.3.0 release rpms, on RHEL 6.1.  (physical hardware, not a vm)

Was about to add an EC2 provider account.

Attaching the screenshot, plus apache's debug level error log for the request this occurred on. (ie not a huge file)

Hope that's useful.

Comment 17 Justin Clift 2011-08-12 06:52:37 UTC
Created attachment 517967 [details]
error log (in debug mode) for httpd, when this occurred

Entries prior to the request that generated the error have been removed.

Comment 18 Justin Clift 2011-08-12 06:54:41 UTC
Created attachment 517970 [details]
Screenshot of the proxy error, showing exact url request

Comment 19 Jan Provaznik 2011-08-12 07:00:13 UTC
Could you please attach thin log? (/var/log/aeolus-conductor/thin.log)

Comment 20 Justin Clift 2011-08-12 07:09:32 UTC
Sure.  There's nothing much of interest in it, however there *is* an interesting error (with stack dump thing) at the end of rails.log.

Attaching both now.

Comment 21 Justin Clift 2011-08-12 07:10:14 UTC
Created attachment 517972 [details]
thin logfile

Comment 22 Justin Clift 2011-08-12 07:10:44 UTC
Created attachment 517973 [details]
Rails log file

Comment 23 Justin Clift 2011-08-12 07:22:15 UTC
Created attachment 517975 [details]
Deltacloud log with exception

Comment 24 Jan Provaznik 2011-08-12 10:04:41 UTC
Spent a while trying to debug this, no luck, though most often advice for
"Internal error: proxy: error reading status line from remote server localhost"
error is to disable keepalive connections. And I think it's worth to try it.

Comment 25 wes hayutin 2011-09-28 14:54:36 UTC
calling this fixed.. have not seen a proxy error in months.. will open if there is an issue.

Comment 26 wes hayutin 2011-12-08 14:03:48 UTC
closing out old bugs

Comment 27 wes hayutin 2011-12-08 14:15:25 UTC
perm close


Note You need to log in before you can comment on or make changes to this bug.