Bug 762209 (GLUSTER-477) - Allow search engines to crawl Bugzilla
Summary: Allow search engines to crawl Bugzilla
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: GLUSTER-477
Product: GlusterFS
Classification: Community
Component: unclassified
Version: mainline
Hardware: All
OS: All
medium
medium
Target Milestone: ---
Assignee: Vijay Bellur
QA Contact:
URL: http://bugs.gluster.com/robots.txt
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2009-12-16 05:19 UTC by Hraban Luyat
Modified: 2010-03-30 10:19 UTC (History)
3 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed:
Regression: RTNR
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:


Attachments (Terms of Use)

Description Hraban Luyat 2009-12-16 05:19:40 UTC
I just tried to search for a bug report that I created a while ago to see if other people having the same issue would be able to find it through a public search engine, but it does not turn up anywhere. Apparently, the robots.txt file blocks all spiders, as per the default Bugzilla setting:

User-agent: *
Allow: /index.cgi
Disallow: /

In my opinion, allowing public search engines to crawl the bug reports could be of a great benefit to people looking for help with a particular bug (and to people who do not like the Bugzilla search engine... ;)). I would propose allowing access to show_bug.cgi and to a page that lists all (at least active) bugs.

Comment 1 Anand Avati 2010-01-23 18:06:04 UTC
http://bugs.gluster.com/robots.txt reflects the requested change


Note You need to log in before you can comment on or make changes to this bug.