Bug 1201380

+++ This bug was initially created as a clone of Bug #1188868 +++

Description of problem:

The first time a client runs rhn_check after the Proxy's authentication token has expired, the client will receive an Internal Server Error.

Version-Release number of selected component (if applicable):

Client:
rhn-check-1.0.0.1-18.el6.noarch
rhn-client-tools-1.0.0.1-18.el6.noarch
yum-rhn-plugin-0.9.1-50.el6.noarch

Proxy:
spacewalk-proxy-broker-2.3.0-5.el6sat.noarch

Satellite:
spacewalk-backend-server-2.3.3-23.el6sat.noarch

How reproducible:

100%

Steps to Reproduce:
1.) On Satellite 5.7, edit /etc/rhn/rhn.conf on the Satellite, set:

proxy_auth_timeout = 300.0

and restart rhn-satellite, to set proxy authentication token lifetime to 5 minutes instead of the 6 hour default.

2.) Activate Proxy 5.7 to the Satellite.

3.) Register RHEL 6.6 system to the Proxy. Wait 5 minutes, then run rhn_check. See error output on first attempt. Subsequent attempts succeed, until the proxy's authentication token expires after another 5 minutes have passed.

# rhn_check
XMLRPC ProtocolError: <ProtocolError for <hostname> /XMLRPC: 400 Bad Request>
# rhn_check
#


Actual results:

Internal Server Error when running rhn_check.

Expected results:

No error on the client; Proxy silently re-authenticates with the Satellite.

Additional info:

--- Additional comment from Stephen Herr on 2015-03-10 18:23:24 EDT ---

The problem appears to be that we hit a 60 second timeout attempting to read the WsgiRequest body. If I strip away the SmartIO changes from apacheRequest.py we can see the real error:

mod_wsgi (pid=3599): Exception occurred processing WSGI script '/usr/share/rhn/wsgi/xmlrpc.py'.
Traceback (most recent call last):
  File "/usr/share/rhn/wsgi/xmlrpc.py", line 22, in application
    return wsgiHandler.handle(environ, start_response, "xmlrpc", "server.xmlrpc")
  File "/usr/share/rhn/wsgi/wsgiHandler.py", line 44, in handle
    ret = appServ(req)
  File "/usr/lib/python2.6/site-packages/spacewalk/server/apacheHandler.py", line 201, in handler
    ret = self._req_processor.process()
  File "/usr/lib/python2.6/site-packages/spacewalk/server/apacheRequest.py", line 475, in process
    _body = self.req.read(self.input.length)
  File "/usr/share/rhn/wsgi/wsgiRequest.py", line 95, in read
    return self.headers_in['wsgi.input'].read(buf)
IOError: request data read error

Why? I have no idea. Will continue investigating tomorrow.