Bug 1093724

Summary:	Repo Publishing: listing file is not always getting created
Product:	Red Hat Satellite	Reporter:	Bryan Kearney <bkearney>
Component:	Content Management	Assignee:	Justin Sherrill <jsherril>
Status:	CLOSED CURRENTRELEASE	QA Contact:	Kedar Bidarkar <kbidarka>
Severity:	high	Docs Contact:
Priority:	unspecified
Version:	6.0.3	CC:	cwelton, kbidarka, mmccune
Target Milestone:	Unspecified
Target Release:	Unused
Hardware:	Unspecified
OS:	Unspecified
URL:	http://projects.theforeman.org/issues/4649
Whiteboard:
Fixed In Version:		Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2014-07-02 14:05:21 UTC	Type:	---
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Bryan Kearney 2014-05-02 13:09:59 UTC

It appears that the 'listing' file is not getting created during the publish process for all repos.  This may be an issue in the 'clone' distributor; however, it needs to be investigated.

The following is a scenario followed by the resulting tree layout for /var/lib/pulp/publish/https/repos/ACME_Corporation:

1. create a repo that points to a RHEL6.5 kickstart repo  (Note: same issue observed for non-kickstart repos)
2. sync the repo (creates: ACME_Corporation-rhel6_5-kickstart)
3. create a content view, add the above repo and publish a version (creates: ACME_Corporation-view2-1-rhel6_5-kickstart & ACME_Corporation-Library-view2-rhel6_5-kickstart)
4. promote the content view to dev (creates: ACME_Corporation-rhel6_5-kickstart)

tree output: (observe 'listing' missing from: ACME_Corporation-view2-1-rhel6_5-kickstart, ACME_Corporation-Library-view2-rhel6_5-kickstart & ACME_Corporation-rhel6_5-kickstart)

.
├── content_views
│   └── view2
│       └── 1
│           └── custom
│               └── rhel6_5
│                   └── kickstart -> /var/lib/pulp/working/repos/ACME_Corporation-view2-1-rhel6_5-kickstart/distributors/yum_distributor
├── dev
│   └── view2
│       └── custom
│           └── rhel6_5
│               └── kickstart -> /var/lib/pulp/working/repos/ACME_Corporation-dev-view2-rhel6_5-kickstart/distributors/yum_distributor
├── Library
│   ├── custom
│   │   ├── listing
│   │   └── rhel6_5
│   │       ├── kickstart -> /var/lib/pulp/working/repos/ACME_Corporation-rhel6_5-kickstart/distributors/yum_distributor
│   │       └── listing
│   ├── listing
│   └── view2
│       └── custom
│           └── rhel6_5
│               └── kickstart -> /var/lib/pulp/working/repos/ACME_Corporation-Library-view2-rhel6_5-kickstart/distributors/yum_distributor
└── listing

19 directories, 4 files

Comment 1 Bryan Kearney 2014-05-02 13:10:01 UTC

Created from redmine issue http://projects.theforeman.org/issues/4649

Comment 2 Bryan Kearney 2014-05-02 13:10:05 UTC

Upstream bug assigned to jsherril

Comment 4 Justin Sherrill 2014-06-06 21:13:27 UTC

This was fixed in pulp 2.4, moving to on_qa

Comment 5 Kedar Bidarkar 2014-06-11 14:11:47 UTC

The cv cv-rhel65-ks-manifest5 is with rhel65-kickstart from manifest.
I think the directory structure where the content gets stored has changed with pulp2.4

[root@xxxx dist]# pwd
/var/lib/pulp/published/yum/https/repos/ACME_Corporation/Dev/cv-rhel65-ks-manifest5/content/dist
[root@xxxx dist]# cd /var/lib/pulp/published/yum/https/repos/ACME_Corporation/Dev/
[root@xxxx Dev]# ls
cv-fedora20-ks  cv-rhel65-ks  cv-rhel65-ks-manifest  cv-rhel65-ks-manifest5  cv-rhel7-ks  listing
[root@xxx Dev]# cat listing
cv-fedora20-ks
cv-rhel65-ks-manifest
cv-rhel65-ks
cv-rhel7-ks
cv-rhel65-ks-manifest5[root@dhcp201-170 Dev]# cd cv-rhel65-ks-manifest5
[root@xxxx cv-rhel65-ks-manifest5]# ls
content  listing
[root@xxxx cv-rhel65-ks-manifest5]# cat listing 
------------------------------------------------------------------------------

[root@xxxx 1]# cd /var/lib/pulp/published/yum/https/repos/ACME_Corporation/
[root@xxxx ACME_Corporation]# ls
content_views  Dev  Library  listing  Test
[root@xxxx ACME_Corporation]# cd Library/
[root@xxxx Library]# ls
content  custom  cv-fedora20-ks  cv-rhel65-ks  cv-rhel65-ks-manifest  cv-rhel65-ks-manifest5  cv-rhel7-ks  listing
[root@xxxx Library]# cat listing 
cv-fedora20-ks
cv-rhel65-ks-manifest
content
cv-rhel65-ks
cv-rhel7-ks
custom
cv-rhel65-ks-manifest5[root@dhcp201-170 Library]# cd cv-rhel65-ks-manifest5
[root@xxxx cv-rhel65-ks-manifest5]# ls
content  listing
[root@xxxx cv-rhel65-ks-manifest5]# cat listing 


------------------------------------------------------------------------------

content[root@dhcp201-170 cv-rhel65-ks-manifest5]# cd ../
[root@xxxx Dev]# ls
cv-fedora20-ks  cv-rhel65-ks  cv-rhel65-ks-manifest  cv-rhel65-ks-manifest5  cv-rhel7-ks  listing
[root@xxxx Dev]# cd ../
[root@xxxx ACME_Corporation]# ls
content_views  Dev  Library  listing  Test
[root@xxxx ACME_Corporation]# cd content_views/
[root@xxxx content_views]# ls
cv-fedora20-ks  cv-rhel65-ks  cv-rhel65-ks-manifest  cv-rhel65-ks-manifest3  cv-rhel65-ks-manifest5  cv-rhel7-ks  listing
[root@xxxx content_views]# cat listing
cv-rhel65-ks-manifest3
cv-fedora20-ks
cv-rhel65-ks-manifest
cv-rhel65-ks
cv-rhel7-ks
cv-rhel65-ks-manifest5[root@dhcp201-170 content_views]# ls
cv-fedora20-ks  cv-rhel65-ks  cv-rhel65-ks-manifest  cv-rhel65-ks-manifest3  cv-rhel65-ks-manifest5  cv-rhel7-ks  listing
[root@xxxx content_views]# cd cv-rhel65-ks
[root@xxxx cv-rhel65-ks]# ls
1  listing
[root@xxxx cv-rhel65-ks]# cat listing 
1[root@xxxx cv-rhel65-ks]# cd 1
[root@xxxx 1]# ls
custom  listing

Comment 6 Bryan Kearney 2014-07-02 14:05:21 UTC

This was delivered with 6.0.3, which is the Satellite 6 Beta.