Bug 630082 - Bug When Attempting to Delete Sync'd Repo
Summary: Bug When Attempting to Delete Sync'd Repo
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Pulp
Classification: Retired
Component: z_other
Version: unspecified
Hardware: x86_64
OS: Linux
high
high
Target Milestone: ---
: ---
Assignee: John Matthews
QA Contact: wes hayutin
URL:
Whiteboard:
Depends On:
Blocks: pulp-verified
TreeView+ depends on / blocked
 
Reported: 2010-09-03 16:24 UTC by Jason E. Rist
Modified: 2011-08-16 13:59 UTC (History)
5 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2011-08-16 13:59:25 UTC
Embargoed:


Attachments (Terms of Use)

Description Jason E. Rist 2010-09-03 16:24:12 UTC
Description of problem:
Bug When Attempting to Delete Sync'd Repo - attempted to delete via:
sudo pulp-admin repo list -u admin -p admin |grep Label | awk '{print $2}' | xargs -n 1 -I foo sudo pulp-admin repo delete -u admin -p admin --id=foo


Version-Release number of selected component (if applicable):
Latest (.59?) - master 

How reproducible:
Very!

Steps to Reproduce:
1. sync a repo - in this case rhel-server-5Server-i386
2. wait 'til it is done
3. try to delete with sudo pulp-admin repo list -u admin -p admin |grep Label | awk '{print $2}' | xargs -n 1 -I foo sudo pulp-admin repo delete -u admin -p admin --id=foo
  
Actual results:
Every repo deleted but the last one.
Successful deleted Repo [ rhel-server-3ES-ia64 ] 
 Successful deleted Repo [ rhel-server-4ES-i386 ] 
 Successful deleted Repo [ rhel-server-4AS-s390 ] 
 Successful deleted Repo [ rhel-server-5Server-ia64 ] 
 Successful deleted Repo [ rhel-server-4AS-x86_64 ] 
 Successful deleted Repo [ rhel-server-5Server-x86_64 ] 
 Successful deleted Repo [ rhel-server-3ES-i386 ] 
 Successful deleted Repo [ rhel-server-3AS-ia64 ] 
 Successful deleted Repo [ rhel-server-3AS-i386 ] 
 Successful deleted Repo [ rhel-server-4AS-i386 ] 
 Successful deleted Repo [ rhel-server-3AS-ppc ] 
 Successful deleted Repo [ rhel-server-4AS-ppc ] 
 Successful deleted Repo [ 917571-0 ] 
 Successful deleted Repo [ rhel-server-4AS-ia64 ] 
 Successful deleted Repo [ rhel-server-5Server-s390x ] 
 Successful deleted Repo [ rhel-server-4ES-ia64 ] 
 Successful deleted Repo [ rhel-server-4ES-x86_64 ] 
 Successful deleted Repo [ rhel-server-4AS-s390x ] 
 Successful deleted Repo [ rhel-server-2.1AS-i386 ] 
 Deleted operation failed on Repo [ rhel-server-5Server-i386 ] 
xargs: sudo: exited with status 255; aborting


Expected results:
Expected every Repo to delete.

Additional info:
Here is the stack trace!
2010-09-03 08:46:29,436 [ERROR][MainThread] report_error() @ base.py:55 - Traceback (most recent call last):
  File "/workspace/pulp/src/pulp/server/webservices/controllers/base.py", line 51, in report_error
    return method(self, *args, **kwargs)
  File "/workspace/pulp/src/pulp/server/webservices/role_check.py", line 106, in check_roles
    result = f(instance, *fargs, **kw)
  File "/workspace/pulp/src/pulp/server/webservices/controllers/repositories.py", line 143, in DELETE
    api.delete(id=id)
  File "/workspace/pulp/src/pulp/server/auditing.py", line 186, in _audit
    result = method(*args, **kwargs)
  File "/workspace/pulp/src/pulp/server/api/repo.py", line 183, in delete
    self.objectdb.remove(repo, safe=True)
  File "/usr/lib64/python2.6/site-packages/pymongo/collection.py", line 379, in remove
    message.delete(self.__full_name, spec, safe), safe)
  File "/usr/lib64/python2.6/site-packages/pymongo/message.py", line 139, in delete
    data += bson.BSON.from_dict(spec)
  File "/usr/lib64/python2.6/site-packages/pymongo/bson.py", line 569, in from_dict
    return cls(_dict_to_bson(dct, check_keys))
InvalidDocument: document too large - BSON documents are limited to 4 MB

Comment 1 Preethi Thomas 2010-09-21 14:02:27 UTC
[root@preethi ~]# pulp-admin -u admin -p admin repo delete --id=f13
 Deleted operation failed on Repo [ f13 ] 


2010-09-21 10:11:31,916 [ERROR][Dummy-3] check_admin_cert() @ role_check.py:177 - ID in admin certificate for user [admin] was incorrect
2010-09-21 10:11:35,093 [ERROR][Dummy-3] report_error() @ base.py:55 - Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/pulp/server/webservices/controllers/base.py", line 51, in report_error
    return method(self, *args, **kwargs)
  File "/usr/lib/python2.6/site-packages/pulp/server/webservices/role_check.py", line 106, in check_roles
    result = f(instance, *fargs, **kw)
  File "/usr/lib/python2.6/site-packages/pulp/server/webservices/controllers/repositories.py", line 158, in DELETE
    api.delete(id=id)
  File "/usr/lib/python2.6/site-packages/pulp/server/auditing.py", line 193, in _audit
    result = method(*args, **kwargs)
  File "/usr/lib/python2.6/site-packages/pulp/server/api/repo.py", line 183, in delete
    self.objectdb.remove(repo, safe=True)
  File "/usr/lib64/python2.6/site-packages/pymongo/collection.py", line 379, in remove
    message.delete(self.__full_name, spec, safe), safe)
  File "/usr/lib64/python2.6/site-packages/pymongo/message.py", line 139, in delete
    data += bson.BSON.from_dict(spec)
  File "/usr/lib64/python2.6/site-packages/pymongo/bson.py", line 569, in from_dict
    return cls(_dict_to_bson(dct, check_keys))
InvalidDocument: document too large - BSON documents are limited to 4 MB

Comment 2 Mike McCune 2010-09-23 21:54:29 UTC
Fixed in :

commit d716c9f151ed929ffa5fb14f3f64f3ee79feffcc
Author: Pradeep Kilambi <pkilambi>
Date:   Thu Sep 23 17:09:22 2010 -0400

    fixing delete repos to nuke the repo from DB as well as filesystem

Comment 3 Preethi Thomas 2010-09-28 16:43:51 UTC
fails-qa

Looks like the repo files exists in the file system even after the repo delete operation.


[root@preethi ~]# rpm -q pulp
pulp-0.0.68-1.fc13.noarch

[root@preethi ~]# sudo pulp-admin repo delete --id=f13
 Successful deleted Repo [ f13 ]
[root@preethi ~]# sudo pulp-admin repo list
+------------------------------------------+
       List of Available Repositories
+------------------------------------------+

Label                   f13-updates              
Name                    f13-updates              
Feed                    {u'url': u'http://download.fedora.redhat.com/pub/fedora/linux/updates/13/x86_64/', u'type': u'yum', u'supported_types': [u'yum', u'local', u'rhn']}
Arch                    x86_64                   
Sync Schedule           None                     
Packages                6784                     
Files                   0                        



[root@preethi ~]# ls /var/lib/pulp/repos/pub/fedora/linux/releases/F13/Fedora/x86_64/os/
0c8eec639425a769091e326226c690b8115620b5fdc6430a769ba6c3f39bfe34-filelists.xml.gz
2afec9b506dd4f46bd68d674d579a6fdff4f0618c78f86c48301fca5e660130e-Fedora-13-comps.xml.gz
530c5ad13176b61694b322634f0aaa2bfd80052baf4b97df7522c6626031487a-other.xml.gz
5c3ab96a2b58cb1b6ca21d59539e294bb9a95c8fdbb8ab209429e98bd2cc0853-filelists.sqlite.bz2
6274ed49dbcfa42ca5ccf5bfbc75937404deb550369750628aa25eb35f352458-other.sqlite.bz2
a75e0184a58b95011684ff760bce2d1c868b054fc8eb17d04276611bc58aecd0-primary.sqlite
a75e0184a58b95011684ff760bce2d1c868b054fc8eb17d04276611bc58aecd0-primary.sqlite.bz2
cachecookie
ed88d22fca1c8bcc07d85bb677d5f8f45422a373a53b6dd213d57d7dfc278878-primary.xml.gz
fce31f091be8211a394d8942fcf4f6cbeffa3d40d87b61af55a97b1a88b46987-Fedora-13-comps.xml
images
packages
Packages
repodata
repomd.xml

Comment 4 John Matthews 2010-10-29 17:25:19 UTC
Moving to ON_QA

I think Pradeep fixed this recently (past 2-3 weeks) when working on product-repo relationship.

I tested deletion of 2 repos with pulp-cli.

Pulp repo was removed from mongo and it was removed from /var/lib/pulp/repos and the symlink under /var/lib/pulp/published/repos was removed as well.

Comment 5 Preethi Thomas 2010-11-02 18:21:47 UTC
verified


[root@preethi ~]# pulp-admin repo delete   --id=f13_test_relativeSuccessful deleted repository [ f13_test_relative ]

[root@preethi ~]# ls /var/lib/pulp/
agentplugins/ messaging/    packages/     published/    repos/
[root@preethi ~]# ls /var/lib/pulp/repos/
clone_f12/               pub/                     tmp/
clone_f13_test_relative/ repos/                   
content/                 test-groupid/            

[root@preethi ~]# ls /var/lib/pulp/repos/
clone_f12/               pub/                     tmp/
clone_f13_test_relative/ repos/                   
content/                 test-groupid/            
[root@preethi ~]# ls /var/lib/pulp/repos/t
test-groupid/ tmp/          
[root@preethi ~]# pulp-admin repo delete   --id=test-groupid
Successful deleted repository [ test-groupid ]

[root@preethi ~]# ls /var/lib/pulp/repos/
clone_f12  clone_f13_test_relative  content  pub  repos  tmp

[root@preethi ~]# 
[root@preethi ~]# pulp-admin repo delete   --id=repo-gpg^C
[root@preethi ~]# 
[root@preethi ~]# 
[root@preethi ~]# 
[root@preethi ~]# ls /var/lib/pulp/repos/
clone_f12  clone_f13_test_relative  content  pub  repos  tmp
[root@preethi ~]# 
[root@preethi ~]# 
[root@preethi ~]# ls /var/lib/pulp/repos/content/extras/
cachecookie                        primary.xml.gz.sqlite
filelists.xml.gz                   python-suds-0.4-1.fc11.noarch.rpm
other.xml.gz                       repodata/
packages/                          repomd.xml
primary.xml.gz                     RPM-GPG-KEY-jortel
[root@preethi ~]# ls /var/lib/pulp/repos/
clone_f12/               content/                 repos/
clone_f13_test_relative/ pub/                     tmp/
[root@preethi ~]# ls /var/lib/pulp/repos/repos/pulp/pulp/testing/fedora-13/
[root@preethi ~]# 
[root@preethi ~]# 
[root@preethi ~]# ls /var/lib/pulp/repos/
clone_f12/               content/                 repos/
clone_f13_test_relative/ pub/                     tmp/
[root@preethi ~]# 
[root@preethi ~]# 
[root@preethi ~]# 
[root@preethi ~]# pulp-admin repo delete   --id=repo-gpg
Successful deleted repository [ repo-gpg ]

[root@preethi ~]# ls /var/lib/pulp/repos/
clone_f12/               content/                 repos/
clone_f13_test_relative/ pub/                     tmp/
[root@preethi ~]# ls /var/lib/pulp/repos/c
clone_f12/               clone_f13_test_relative/ content/
[root@preethi ~]# ls /var/lib/pulp/repos/c
clone_f12/               clone_f13_test_relative/ content/
[root@preethi ~]# ls /var/lib/pulp/repos/content/
[root@preethi ~]# pulp-admin repo list
+------------------------------------------+
       List of Available Repositories
+------------------------------------------+

Label              	f13                      
Name               	f13                      
FeedURL            	http://download.devel.redhat.com/released/F-13/GOLD/Fedora/x86_64/os/
FeedType           	yum                      
Arch               	x86_64                   
Sync Schedule      	None                     
Packages           	3102                     
Files              	8                        
Publish            	True                     
Clones             	[u'clone_nofeed', u'clone_nofeed']


Label              	f12_x86_64_update        
Name               	f12-repo--arch=x86_64    
FeedURL            	http://download.fedora.redhat.com/pub/fedora/linux/updates/12/x86_64/
FeedType           	yum                      
Arch               	noarch                   
Sync Schedule      	None                     
Packages           	9477                     
Files              	0                        
Publish            	True                     
Clones             	[u'clone_f12']           


Label              	clone_f12                
Name               	clone_f12                
FeedURL            	file:///var/lib/pulp/repos/pub/fedora/linux/updates/12/x86_64
FeedType           	local                    
Arch               	noarch                   
Sync Schedule      	None                     
Packages           	9477                     
Files              	0                        
Publish            	True                     
Clones             	[]                       


Label              	clone_f13_test_relative  
Name               	clone_f13_test_relative  
FeedURL            	http://repos.fedorapeople.org/repos/pulp/pulp/testing/fedora-13/x86_64/
FeedType           	yum                      
Arch               	noarch                   
Sync Schedule      	None                     
Packages           	10                       
Files              	0                        
Publish            	True                     
Clones             	[]

Comment 6 Preethi Thomas 2011-08-16 13:59:25 UTC
Closing with Community Release 15

pulp-0.0.223-4.


Note You need to log in before you can comment on or make changes to this bug.