Description of problem:
The beta site is missing a robots.txt.  The lack of this file will allow search engines to index the bugs there, polluting the search engines with references to non-production bugs.

The beta site should have a copy of the robots.txt from Partner-Bugzilla, which will tell search engines to ignore the entire site.

When Bugzilla 5 goes to production, it should have the same robots.txt that the current Bugzilla 4 production instance has.

Version-Release number of selected component (if applicable):
5.0.3 (beta.bugzilla.redhat.com)

How reproducible:
Always

Steps to Reproduce:
1. wget https://beta.bugzilla.redhat.com/robots.txt

Actual results:
404 Not Found

Expected results:
The robots.txt from partner-bugzilla is:

User-agent: *
Disallow: /

Additional info:
The robots.txt from production is:

User-agent: *
Crawl-delay: 5
Disallow: /
Disallow: /show_bug.cgi*ctype=xml*
Allow: /index.cgi
Allow: /show_bug.cgi
Allow: /sitemap_index.xml
Allow: /sitemap*xml.gz
Sitemap: https://bugzilla.redhat.com/sitemap_index.xml