Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1155271

Summary:	The pulpproject.org v1 user guide docs should not be indexed by search engines
Product:	[Retired] Pulp	Reporter:	Brian Bouterse <bmbouter>
Component:	documentation	Assignee:	Michael Hrivnak <mhrivnak>
Status:	CLOSED UPSTREAM	QA Contact:	Preethi Thomas <pthomas>
Severity:	medium	Docs Contact:
Priority:	medium
Version:	Master	CC:	cduryee, pthomas
Target Milestone:	---	Keywords:	Documentation, Task, Triaged
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2015-02-28 22:40:45 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Brian Bouterse 2014-10-21 18:58:15 UTC

The v1 user guide docs should not be listed in search results. A robots.txt should be added to pulpproject.org that contains the following contents:

User-agent: *
Disallow: /ug/*

Comment 1 Michael Hrivnak 2015-01-05 16:01:23 UTC

I installed a plugin that manages robots.txt content and added a disallow statement for /ug/



$ curl http://www.pulpproject.org/robots.txt

################

# 2 record(s) for any robot joined
User-agent: *
Disallow: /wp-admin/
Disallow: /ug/

Comment 2 Preethi Thomas 2015-01-28 20:30:45 UTC

verified

[pthomas@pthomas-lt ~]$ curl http://www.pulpproject.org/robots.txt

################

# 2 record(s) for any robot joined
User-agent: *
Disallow: /wp-admin/
Disallow: /ug/

Comment 3 Brian Bouterse 2015-02-28 22:40:45 UTC

Moved to https://pulp.plan.io/issues/586