Bug 1155271 - The pulpproject.org v1 user guide docs should not be indexed by search engines
Summary: The pulpproject.org v1 user guide docs should not be indexed by search engines
Keywords:
Status: CLOSED UPSTREAM
Alias: None
Product: Pulp
Classification: Retired
Component: documentation
Version: Master
Hardware: Unspecified
OS: Unspecified
medium
medium
Target Milestone: ---
: ---
Assignee: Michael Hrivnak
QA Contact: Preethi Thomas
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2014-10-21 18:58 UTC by Brian Bouterse
Modified: 2015-02-28 22:40 UTC (History)
2 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2015-02-28 22:40:45 UTC
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Pulp Redmine 586 0 None None None Never

Description Brian Bouterse 2014-10-21 18:58:15 UTC 
The v1 user guide docs should not be listed in search results. A robots.txt should be added to pulpproject.org that contains the following contents:

User-agent: *
Disallow: /ug/*
Comment 1 Michael Hrivnak 2015-01-05 16:01:23 UTC 
I installed a plugin that manages robots.txt content and added a disallow statement for /ug/



$ curl http://www.pulpproject.org/robots.txt

################

# 2 record(s) for any robot joined
User-agent: *
Disallow: /wp-admin/
Disallow: /ug/
Comment 2 Preethi Thomas 2015-01-28 20:30:45 UTC 
verified

[pthomas@pthomas-lt ~]$ curl http://www.pulpproject.org/robots.txt

################

# 2 record(s) for any robot joined
User-agent: *
Disallow: /wp-admin/
Disallow: /ug/
Comment 3 Brian Bouterse 2015-02-28 22:40:45 UTC 
Moved to https://pulp.plan.io/issues/586
Note You need to log in before you can comment on or make changes to this bug.