The get_distros AJAX call on the reserve workflow page (to /reserveworkflow/get_distro_options) intermittently returns a 404 for no good reason.

    Traceback (most recent call last):
      File "/usr/lib/python2.6/site-packages/CherryPy-2.3.0-py2.6.egg/cherrypy/_cphttptools.py", line 121, in _run
        self.main()
      File "/usr/lib/python2.6/site-packages/CherryPy-2.3.0-py2.6.egg/cherrypy/_cphttptools.py", line 264, in main
        body = page_handler(*virtual_path, **self.params)
      File "<string>", line 3, in get_distro_options
      File "/usr/lib/python2.6/site-packages/turbogears/controllers.py", line 374, in expose
        raise cherrypy.NotFound
    NotFound: (404, "The path '/reserveworkflow/get_distro_options' was not found.")
    Request Headers:
      COOKIE: tg-visit=4076ccd316cdd8b6765ab8b635043a91f4be33f0
      Content-Length:
      USER-AGENT: Mozilla/5.0 (X11; Linux x86_64; rv:10.0.1) Gecko/20120209 Firefox/10.0.1
      CONNECTION: keep-alive
      REFERER: http://localhost:9090/reserveworkflow/
      X-REQUESTED-WITH: XMLHttpRequest
      HOST: localhost:9090
      ACCEPT: application/json
      Remote-Addr: 127.0.0.1
      ACCEPT-LANGUAGE: en-us,en;q=0.5
      Content-Type:
      ACCEPT-ENCODING: gzip, deflate
    127.0.0.1 - admin [22/Feb/2012:00:55:15 +0000] "GET /reserveworkflow/get_distro_options?tg_format=json&tg_random=1329872115108&arch=i386&arch=x86_64&distro_family=&tag= HTTP/1.1" 404 1475 "http://localhost:9090/reserveworkflow/" "Mozilla/5.0 (X11; Linux x86_64; rv:10.0.1) Gecko/20120209 Firefox/10.0.1"

It seems to happen at random, with any combination of parameters. It's not reliably reproducible, though it happens very often for me when running the test suite.

I can't find any evidence of it happening in production, which means the problem is probably connected to or triggered by the CherryPy server we use in tests.

The underlying NoApplicableMethods exception comes from here:

    Traceback (most recent call last):
      File "/usr/lib/python2.6/site-packages/turbogears/controllers.py", line 364, in expose
        *args, **kw)
      File "<generated code>", line 0, in run_with_transaction
      File "/usr/lib/python2.6/site-packages/peak/rules/core.py", line 153, in __call__
        return self.body(*args, **kw)
      File "/usr/lib/python2.6/site-packages/turbogears/database.py", line 458, in sa_rwt
        retval = func(*args, **kw)
      File "/usr/lib/python2.6/site-packages/turbogears/controllers.py", line 245, in _expose
        @abstract()
      File "/usr/lib/python2.6/site-packages/peak/rules/core.py", line 214, in __call__
        raise self.__class__(*self.args+(args,kw))  # XXX
    NoApplicableMethods: ((<function get_distro_options at 0x3610758>, 'application/json', True, <bkr.server.reserve_workflow.ReserveWorkflow instance at 0x3876710>), {'distro_family': u'', 'tg_format': u'json', 'tag': u'', 'arch': u'i386', 'tg_random': u'1329873374091'})

though PEAK Rules is so convoluted and insane that I can't figure out why it might be happening.