636072 – Pulp repo sync not cleaning up the temp_repo directories that are in the sync directories

Bug 636072 - Pulp repo sync not cleaning up the temp_repo directories that are in the sync directories

Summary: Pulp repo sync not cleaning up the temp_repo directories that are in the sync...

Keywords:
Status:	CLOSED CURRENTRELEASE
Alias:	None
Product:	Pulp
Classification:	Retired
Component:	z_other
Sub Component:
Version:	unspecified
Hardware:	All
OS:	Linux
Priority:	medium
Severity:	medium
Target Milestone:	---
Target Release:	---
Assignee:	John Matthews
QA Contact:	Preethi Thomas
Docs Contact:
URL:
Whiteboard:
Depends On:
Blocks:	verified-to-close
TreeView+	depends on / blocked

Reported:	2010-09-21 13:43 UTC by Preethi Thomas
Modified:	2011-08-16 14:20 UTC (History)
CC List:	3 users (show)
Fixed In Version:
Doc Type:	Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed:	2011-08-16 14:20:06 UTC
Embargoed:

Attachments	(Terms of Use)

Description Preethi Thomas 2010-09-21 13:43:04 UTC

Description of problem:

There are temp repo directories present in the sync directories after repo sync

After syncing a f13 repo

[root@preethi ~]# ls -l /var/lib/pulp/repos/released/F-13/GOLD/Fedora/x86_64/os/ 
total 24292
-rw-r--r--. 1 apache apache  2763864 May 12 20:47 0c8eec639425a769091e326226c690b8115620b5fdc6430a769ba6c3f39bfe34-filelists.xml.gz
-rw-r--r--. 1 apache apache   396760 May 12 20:47 2afec9b506dd4f46bd68d674d579a6fdff4f0618c78f86c48301fca5e660130e-Fedora-13-comps.xml.gz
-rw-r--r--. 1 apache apache  1311358 May 12 20:47 530c5ad13176b61694b322634f0aaa2bfd80052baf4b97df7522c6626031487a-other.xml.gz
-rw-r--r--. 1 apache apache  3108269 May 12 20:47 5c3ab96a2b58cb1b6ca21d59539e294bb9a95c8fdbb8ab209429e98bd2cc0853-filelists.sqlite.bz2
-rw-r--r--. 1 apache apache  1223273 May 12 20:47 6274ed49dbcfa42ca5ccf5bfbc75937404deb550369750628aa25eb35f352458-other.sqlite.bz2
-rw-r--r--. 1 apache apache 10448896 Sep 13 09:06 a75e0184a58b95011684ff760bce2d1c868b054fc8eb17d04276611bc58aecd0-primary.sqlite
-rw-r--r--. 1 apache apache  2338862 May 12 20:47 a75e0184a58b95011684ff760bce2d1c868b054fc8eb17d04276611bc58aecd0-primary.sqlite.bz2
-rw-r--r--. 1 apache apache        0 Sep 21 09:27 cachecookie
-rw-r--r--. 1 apache apache  1253772 May 12 20:47 ed88d22fca1c8bcc07d85bb677d5f8f45422a373a53b6dd213d57d7dfc278878-primary.xml.gz
-rw-r--r--. 1 apache apache  1726573 May 12 20:47 fce31f091be8211a394d8942fcf4f6cbeffa3d40d87b61af55a97b1a88b46987-Fedora-13-comps.xml
drwxr-sr-x. 3 apache apache     4096 Sep 20 10:25 images
drwxr-sr-x. 2 apache apache     4096 Sep 13 09:06 packages
drwxr-sr-x. 2 apache apache   204800 Sep 20 10:25 Packages
drwxr-sr-x. 2 apache apache     4096 Sep 13 09:06 repodata
-rw-r--r--. 1 apache apache     3819 May 12 20:47 repomd.xml
drwxr-sr-x. 3 apache apache     4096 Sep 13 09:10 temp_repo-1284383411.92
drwxr-sr-x. 3 apache apache     4096 Sep 13 13:56 temp_repo-1284400585.22
drwxr-sr-x. 3 apache apache     4096 Sep 13 13:57 temp_repo-1284400678.17
drwxr-sr-x. 3 apache apache     4096 Sep 14 15:58 temp_repo-1284494329.2
drwxr-sr-x. 3 apache apache     4096 Sep 15 10:22 temp_repo-1284560566.0
drwxr-sr-x. 3 apache apache     4096 Sep 15 10:38 temp_repo-1284561486.08
drwxr-sr-x. 3 apache apache     4096 Sep 15 10:51 temp_repo-1284562262.07
drwxr-sr-x. 3 apache apache     4096 Sep 15 10:52 temp_repo-1284562349.43
drwxr-sr-x. 3 apache apache     4096 Sep 16 11:58 temp_repo-1284652696.62
drwxr-sr-x. 3 apache apache     4096 Sep 16 12:00 temp_repo-1284652824.78
drwxr-sr-x. 3 apache apache     4096 Sep 16 12:02 temp_repo-1284652933.82
drwxr-sr-x. 3 apache apache     4096 Sep 20 10:25 temp_repo-1284992712.4
drwxr-sr-x. 3 apache apache     4096 Sep 20 10:53 temp_repo-1284994382.25
drwxr-sr-x. 3 apache apache     4096 Sep 20 11:36 temp_repo-1284997017.32
drwxr-sr-x. 3 apache apache     4096 Sep 21 09:28 temp_repo-1285075739.04

After syncing F-12

[root@preethi ~]# ls -l /var/lib/pulp/repos/released/F-12/GOLD/Fedora/x86_64/os/
total 24196
-rw-r--r--. 1 apache apache 10264576 Sep 13 14:37 0f5da33301eede419bc705b20dccbb4c8b10257f36c4a9e437640ff07e4ddc31-primary.sqlite
-rw-r--r--. 1 apache apache  2314508 Nov  8  2009 0f5da33301eede419bc705b20dccbb4c8b10257f36c4a9e437640ff07e4ddc31-primary.sqlite.bz2
-rw-r--r--. 1 apache apache  3288402 Nov  8  2009 2de5790eec1bf18896a2ae422e7b245cb9a4c253584fbe2f055a71dcf419dda1-filelists.sqlite.bz2
-rw-r--r--. 1 apache apache   398570 Nov  8  2009 5e26b8663057063df885eddf5a6525b801ec07a20ab061c853df0a723ed072ac-Fedora-12-comps.xml.gz
-rw-r--r--. 1 apache apache  1207907 Nov  8  2009 6a153203e88320fb5b8e93faf1407bc826b5fd5dd95e3bb7d000ec601d2bada7-other.xml.gz
-rw-r--r--. 1 apache apache  1729531 Nov  8  2009 6a72ae27742d1b4ac04f2eec0e5ffb0b7c909d58b9c6e346a7ee5cfb627832d4-Fedora-12-comps.xml
-rw-r--r--. 1 apache apache  2910785 Nov  8  2009 80e8fd053cc3b015fc747dfb325f43ea3602f786f09a4847d9751fce454d4f50-filelists.xml.gz
-rw-r--r--. 1 apache apache  1226749 Nov  8  2009 a4ebee776b3c4898086e124a512e7f8c701ab1699fd83b2dcea3d7592b5c9ff0-primary.xml.gz
-rw-r--r--. 1 apache apache        0 Sep 20 14:03 cachecookie
-rw-r--r--. 1 apache apache  1144678 Nov  8  2009 cbc2825e3d9400d255d5817bcbb80132af3bfcaa575fa5d534e94343012fc028-other.sqlite.bz2
drwxr-sr-x. 3 apache apache     4096 Sep 20 11:42 images
drwxr-sr-x. 2 apache apache     4096 Sep 13 14:37 packages
drwxr-sr-x. 2 apache apache   221184 Sep 20 11:42 Packages
drwxr-sr-x. 2 apache apache     4096 Sep 13 14:37 repodata
-rw-r--r--. 1 apache apache     3819 Nov  8  2009 repomd.xml
drwxr-sr-x. 3 apache apache     4096 Sep 13 14:41 temp_repo-1284403295.63
drwxr-sr-x. 3 apache apache     4096 Sep 14 12:08 temp_repo-1284480479.42
drwxr-sr-x. 3 apache apache     4096 Sep 15 10:20 temp_repo-1284560412.67
drwxr-sr-x. 3 apache apache     4096 Sep 15 10:35 temp_repo-1284561316.06
drwxr-sr-x. 3 apache apache     4096 Sep 15 10:45 temp_repo-1284561949.25
drwxr-sr-x. 3 apache apache     4096 Sep 16 11:55 temp_repo-1284652548.06
drwxr-sr-x. 3 apache apache     4096 Sep 20 11:42 temp_repo-1284997339.73
drwxr-sr-x. 3 apache apache     4096 Sep 20 14:04 temp_repo-1285005839.63

Comment 1 John Matthews 2011-01-03 22:28:26 UTC

To test:

Re-sync a repo with packages a few times.  
Look at "/tmp"

Prior to this fix you would see several "temp_repo_XXXXXX" directories as noted in above comment.  After this fix has been in place you should not see any temporary directories from pulp remaining.

Below is the commit
http://git.fedorahosted.org/git/?p=pulp.git;a=commit;h=90e40194959220f4835cf06c70a9a12ec35b3cab

Comment 2 Jay Dobies 2011-01-05 19:45:16 UTC

Fixed in 0.120.

Comment 3 Preethi Thomas 2011-01-06 16:20:43 UTC

[root@preethi ~]# rpm -q pulp
pulp-0.0.120-1.fc14.noarch


[root@preethi ~]# ls -l /tmp/
total 416
-rw-r--r--. 1 root    root    381816 Jan  3 15:58 foo.txt
drwx------. 2 preethi preethi   4096 Jan  4 08:18 keyring-8KP4Zc
drwx------. 2 preethi preethi   4096 Jan  5 08:17 keyring-BVpva1
drwx------. 2 preethi preethi   4096 Jan  4 09:06 keyring-izLGTj
drwx------. 2 preethi preethi   4096 Dec  6 11:17 keyring-McaPOP
srwxr-xr-x. 1 mongodb mongodb      0 Jan  5 16:58 mongodb-27017.sock
srwxr-xr-x. 1 mongodb mongodb      0 Jan  5 16:58 mongodb-28017.sock
drwx------. 2 gdm     gdm       4096 Jan  5 15:30 orbit-gdm
drwx------. 2 gdm     gdm       4096 Jan  5 14:59 pulse-gfkyKLWyXMba
drwx------. 2 preethi preethi   4096 Jan  5 08:18 pulse-wttbnx19qRoZ
drwx------. 2 preethi preethi   4096 Jan  5 08:18 virtual-preethi.GtxTTR
drwx------. 2 preethi preethi   4096 Jan  4 09:06 virtual-preethi.pvTKpT
drwx------. 2 preethi preethi   4096 Jan  4 08:19 virtual-preethi.z5Y1qz


[root@preethi ~]# ls -l /var/lib/pulp/repos/released/F-13/GOLD/Fedora/x86_64/os/
total 24228
-rw-r--r--. 1 apache apache  2763864 May 12  2010 0c8eec639425a769091e326226c690b8115620b5fdc6430a769ba6c3f39bfe34-filelists.xml.gz
-rw-r--r--. 1 apache apache   396760 May 12  2010 2afec9b506dd4f46bd68d674d579a6fdff4f0618c78f86c48301fca5e660130e-Fedora-13-comps.xml.gz
-rw-r--r--. 1 apache apache  1311358 May 12  2010 530c5ad13176b61694b322634f0aaa2bfd80052baf4b97df7522c6626031487a-other.xml.gz
-rw-r--r--. 1 apache apache  3108269 May 12  2010 5c3ab96a2b58cb1b6ca21d59539e294bb9a95c8fdbb8ab209429e98bd2cc0853-filelists.sqlite.bz2
-rw-r--r--. 1 apache apache  1223273 May 12  2010 6274ed49dbcfa42ca5ccf5bfbc75937404deb550369750628aa25eb35f352458-other.sqlite.bz2
-rw-r--r--. 1 apache apache 10448896 Jan  5 17:19 a75e0184a58b95011684ff760bce2d1c868b054fc8eb17d04276611bc58aecd0-primary.sqlite
-rw-r--r--. 1 apache apache  2338862 May 12  2010 a75e0184a58b95011684ff760bce2d1c868b054fc8eb17d04276611bc58aecd0-primary.sqlite.bz2
-rw-r--r--. 1 apache apache        0 Jan  6 10:35 cachecookie
-rw-r--r--. 1 apache apache  1253772 May 12  2010 ed88d22fca1c8bcc07d85bb677d5f8f45422a373a53b6dd213d57d7dfc278878-primary.xml.gz
-rw-r--r--. 1 apache apache  1726573 May 12  2010 fce31f091be8211a394d8942fcf4f6cbeffa3d40d87b61af55a97b1a88b46987-Fedora-13-comps.xml
drwxr-sr-x. 3 apache apache     4096 Jan  5 17:19 images
drwxr-sr-x. 2 apache apache     4096 Jan  5 17:19 packages
drwxr-sr-x. 2 apache apache   200704 Jan  6 10:36 Packages
drwxr-sr-x. 2 apache apache     4096 Jan  5 17:19 repodata
-rw-r--r--. 1 apache apache     3819 May 12  2010 repomd.xml


[root@preethi ~]# ls -l /var/lib/pulp/published/repos/released/F-13/GOLD/Fedora/x86_64/os/
total 24228
-rw-r--r--. 1 apache apache  2763864 May 12  2010 0c8eec639425a769091e326226c690b8115620b5fdc6430a769ba6c3f39bfe34-filelists.xml.gz
-rw-r--r--. 1 apache apache   396760 May 12  2010 2afec9b506dd4f46bd68d674d579a6fdff4f0618c78f86c48301fca5e660130e-Fedora-13-comps.xml.gz
-rw-r--r--. 1 apache apache  1311358 May 12  2010 530c5ad13176b61694b322634f0aaa2bfd80052baf4b97df7522c6626031487a-other.xml.gz
-rw-r--r--. 1 apache apache  3108269 May 12  2010 5c3ab96a2b58cb1b6ca21d59539e294bb9a95c8fdbb8ab209429e98bd2cc0853-filelists.sqlite.bz2
-rw-r--r--. 1 apache apache  1223273 May 12  2010 6274ed49dbcfa42ca5ccf5bfbc75937404deb550369750628aa25eb35f352458-other.sqlite.bz2
-rw-r--r--. 1 apache apache 10448896 Jan  5 17:19 a75e0184a58b95011684ff760bce2d1c868b054fc8eb17d04276611bc58aecd0-primary.sqlite
-rw-r--r--. 1 apache apache  2338862 May 12  2010 a75e0184a58b95011684ff760bce2d1c868b054fc8eb17d04276611bc58aecd0-primary.sqlite.bz2
-rw-r--r--. 1 apache apache        0 Jan  6 10:35 cachecookie
-rw-r--r--. 1 apache apache  1253772 May 12  2010 ed88d22fca1c8bcc07d85bb677d5f8f45422a373a53b6dd213d57d7dfc278878-primary.xml.gz
-rw-r--r--. 1 apache apache  1726573 May 12  2010 fce31f091be8211a394d8942fcf4f6cbeffa3d40d87b61af55a97b1a88b46987-Fedora-13-comps.xml
drwxr-sr-x. 3 apache apache     4096 Jan  5 17:19 images
drwxr-sr-x. 2 apache apache     4096 Jan  5 17:19 packages
drwxr-sr-x. 2 apache apache   200704 Jan  6 10:36 Packages
drwxr-sr-x. 2 apache apache     4096 Jan  5 17:19 repodata
-rw-r--r--. 1 apache apache     3819 May 12  2010 repomd.xml
[root@preethi ~]# 




[root@preethi ~]# ls -l /var/lib/pulp/published/ks/released/F-13/GOLD/Fedora/x86_64/os/
total 24228
-rw-r--r--. 1 apache apache  2763864 May 12  2010 0c8eec639425a769091e326226c690b8115620b5fdc6430a769ba6c3f39bfe34-filelists.xml.gz
-rw-r--r--. 1 apache apache   396760 May 12  2010 2afec9b506dd4f46bd68d674d579a6fdff4f0618c78f86c48301fca5e660130e-Fedora-13-comps.xml.gz
-rw-r--r--. 1 apache apache  1311358 May 12  2010 530c5ad13176b61694b322634f0aaa2bfd80052baf4b97df7522c6626031487a-other.xml.gz
-rw-r--r--. 1 apache apache  3108269 May 12  2010 5c3ab96a2b58cb1b6ca21d59539e294bb9a95c8fdbb8ab209429e98bd2cc0853-filelists.sqlite.bz2
-rw-r--r--. 1 apache apache  1223273 May 12  2010 6274ed49dbcfa42ca5ccf5bfbc75937404deb550369750628aa25eb35f352458-other.sqlite.bz2
-rw-r--r--. 1 apache apache 10448896 Jan  5 17:19 a75e0184a58b95011684ff760bce2d1c868b054fc8eb17d04276611bc58aecd0-primary.sqlite
-rw-r--r--. 1 apache apache  2338862 May 12  2010 a75e0184a58b95011684ff760bce2d1c868b054fc8eb17d04276611bc58aecd0-primary.sqlite.bz2
-rw-r--r--. 1 apache apache        0 Jan  6 10:35 cachecookie
-rw-r--r--. 1 apache apache  1253772 May 12  2010 ed88d22fca1c8bcc07d85bb677d5f8f45422a373a53b6dd213d57d7dfc278878-primary.xml.gz
-rw-r--r--. 1 apache apache  1726573 May 12  2010 fce31f091be8211a394d8942fcf4f6cbeffa3d40d87b61af55a97b1a88b46987-Fedora-13-comps.xml
drwxr-sr-x. 3 apache apache     4096 Jan  5 17:19 images
drwxr-sr-x. 2 apache apache     4096 Jan  5 17:19 packages
drwxr-sr-x. 2 apache apache   200704 Jan  6 10:36 Packages
drwxr-sr-x. 2 apache apache     4096 Jan  5 17:19 repodata
-rw-r--r--. 1 apache apache     3819 May 12  2010 repomd.xml

Comment 4 Preethi Thomas 2011-08-16 14:20:06 UTC

Closing with Community Release 15

pulp-0.0.223-4.

Note You need to log in before you can comment on or make changes to this bug.