Bug 752187

Summary: pulp-admin generate_metadata --status does not have the latest info
Product: [Retired] Pulp Reporter: dgao
Component: user-experienceAssignee: Pradeep Kilambi <pkilambi>
Status: CLOSED CURRENTRELEASE QA Contact: dgao
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: unspecifiedCC: pthomas
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2012-02-24 20:13:42 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description dgao 2011-11-08 18:59:51 UTC
[root@pulp-qe ~]# pulp-admin -u admin -p admin content upload --repoid=foo /tmp/patb-0.1-1.noarch.rpm 
* Starting Content Upload operation. See /var/log/pulp/client.log for more verbose output

* Performing Content Uploads to Pulp server

* Performing Repo Associations 

* Metadata generation has been scheduled for repository [foo] with a task id [33daed42-0a39-11e1-b54a-5254009326ae]; use `pulp-admin repo generate_metadata --status` to check the status.

* Content Upload complete.
[root@pulp-qe ~]# pulp-admin -u admin -p admin repo generate_metadata --status --id=foo

Task Id          	33daed42-0a39-11e1-b54a-5254009326ae
Status           	finished                 
Message          	None                     
Start Time       	2011-11-08 13:40:59-05:00
Finish Time      	2011-11-08 13:41:00-05:00


[root@pulp-qe ~]# pulp-admin -u admin -p admin content upload --repoid=foo /tmp/emoticons-0.1-1.noarch.rpm 
* Starting Content Upload operation. See /var/log/pulp/client.log for more verbose output

* Performing Content Uploads to Pulp server

* Performing Repo Associations 

* Metadata generation has been scheduled for repository [foo] with a task id [3cd07d5e-0a39-11e1-b001-5254009326ae]; use `pulp-admin repo generate_metadata --status` to check the status.

* Content Upload complete.
[root@pulp-qe ~]# pulp-admin -u admin -p admin repo generate_metadata --status --id=foo

Task Id          	33daed42-0a39-11e1-b54a-5254009326ae
Status           	finished                 
Message          	None                     
Start Time       	2011-11-08 13:40:59-05:00
Finish Time      	2011-11-08 13:41:00-05:00


Status is not showing status for the new task id.

Comment 1 Pradeep Kilambi 2011-11-08 20:04:53 UTC
fixed! commit 0f8785cdc0a305b041250bf659aa752a094dbd3f

$ sudo pulp-admin -u admin -p admin repo generate_metadata --id=101
Metadata generation has been successfully scheduled for repo id [101]. Use --status to check the status.

$ sudo pulp-admin -u admin -p admin repo generate_metadata --id=101 --status

Task Id          	6bef9a4c-0a44-11e1-bbc2-0023ae793dbc
Status           	finished                 
Message          	None                     
Start Time       	2011-11-08 15:01:18-05:00
Finish Time      	2011-11-08 15:01:20-05:00

$ sudo pulp-admin -u admin -p admin repo generate_metadata --id=101
Metadata generation has been successfully scheduled for repo id [101]. Use --status to check the status.

$ sudo pulp-admin -u admin -p admin repo generate_metadata --id=101 --status

Task Id          	70b3b11c-0a44-11e1-9afe-0023ae793dbc
Status           	finished                 
Message          	None                     
Start Time       	2011-11-08 15:01:26-05:00
Finish Time      	2011-11-08 15:01:28-05:00

Comment 2 Jay Dobies 2011-11-09 20:32:08 UTC
Fixed in build 0.247.

Comment 3 Preethi Thomas 2011-11-10 18:40:58 UTC
Seeing error in subsequent metadata generation

[root@preethi init.d]# pulp-admin -u admin -p admin repo generate_metadata --id=f15
Metadata generation has been successfully scheduled for repo id [f15]. Use --status to check the status.
[root@preethi init.d]# pulp-admin -u admin -p admin repo generate_metadata --id=f15 --status

Task Id          	ca2d0568-0bca-11e1-8ccb-002564a85a58
Status           	finished                 
Message          	None                     
Start Time       	2011-11-10 13:35:40-05:00
Finish Time      	2011-11-10 13:36:57-05:00

[root@preethi init.d]# pulp-admin -u admin -p admin repo generate_metadata --id=f15
Metadata generation has been successfully scheduled for repo id [f15]. Use --status to check the status.
[root@preethi init.d]# pulp-admin -u admin -p admin repo generate_metadata --id=f15 --status

Task Id          	ca2d0568-0bca-11e1-8ccb-002564a85a58
Status           	finished                 
Message          	None                     
Start Time       	2011-11-10 13:35:40-05:00
Finish Time      	2011-11-10 13:36:57-05:00

[root@preethi init.d]# pulp-admin -u admin -p admin repo generate_metadata --id=f15 --status

Task Id          	406929e6-0bcb-11e1-93a8-002564a85a58
Status           	error                    
Message          	CreateRepoError()        
Start Time       	2011-11-10 13:38:58-05:00
Finish Time      	2011-11-10 13:40:14-05:00

2011-11-10 13:40:14,561 26644:140527638935296: pulp.server.util:ERROR: util:496 createrepo on /var/lib/pulp//repos/released/F-15/GOLD/Fedora/x86_64/os failed with returncode <1>
2011-11-10 13:40:14,562 26644:140527638935296: pulp.server.util:ERROR: util:497 createrepo stdout:

Saving Primary metadata
Saving file lists metadata
Saving other metadata
Generating sqlite DBs
Sqlite DBs complete

2011-11-10 13:40:14,562 26644:140527638935296: pulp.server.util:ERROR: util:498 createrepo stderr:
Traceback (most recent call last):
  File "/usr/share/createrepo/genpkgmetadata.py", line 278, in <module>
    main(sys.argv[1:])
  File "/usr/share/createrepo/genpkgmetadata.py", line 256, in main
    mdgen.doRepoMetadata()
  File "/usr/lib/python2.7/site-packages/createrepo/__init__.py", line 1025, in doRepoMetadata
    mdcontent = self._createRepoDataObject(self.conf.groupfile, 'group_gz')
  File "/usr/lib/python2.7/site-packages/createrepo/__init__.py", line 853, in _createRepoDataObject
    (csum, outfn) = checksum_and_rename(outfn, self.conf.sumtype)
  File "/usr/lib/python2.7/site-packages/createrepo/utils.py", line 111, in checksum_and_rename
    os.rename(fn_path, csum_path)
OSError: [Errno 36] File name too long

2011-11-10 13:40:14,587 26644:140527638935296: pulp.server.tasking.task:ERROR: task:455 Task failed: Task 406929e6-0bcb-11e1-93a8-002564a85a58: RepoApi._generate_metadata(f15, )
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/pulp/server/tasking/task.py", line 404, in run
    result = self.callable(*self.args, **self.kwargs)
  File "/usr/lib/python2.7/site-packages/pulp/server/api/repo.py", line 1961, in _generate_metadata
    pulp.server.util.create_repo(repo_path, checksum_type=repo["checksum_type"])
  File "/usr/lib/python2.7/site-packages/pulp/server/util.py", line 499, in create_repo
    raise CreateRepoError(err_msg)
CreateRepoError: Traceback (most recent call last):
  File "/usr/share/createrepo/genpkgmetadata.py", line 278, in <module>
    main(sys.argv[1:])
  File "/usr/share/createrepo/genpkgmetadata.py", line 256, in main
    mdgen.doRepoMetadata()
  File "/usr/lib/python2.7/site-packages/createrepo/__init__.py", line 1025, in doRepoMetadata
    mdcontent = self._createRepoDataObject(self.conf.groupfile, 'group_gz')
  File "/usr/lib/python2.7/site-packages/createrepo/__init__.py", line 853, in _createRepoDataObject
    (csum, outfn) = checksum_and_rename(outfn, self.conf.sumtype)
  File "/usr/lib/python2.7/site-packages/createrepo/utils.py", line 111, in checksum_and_rename
    os.rename(fn_path, csum_path)
OSError: [Errno 36] File name too long

Comment 4 Pradeep Kilambi 2011-11-10 18:50:41 UTC
this is a completely different issue and a known one. Our groups metadata file name checksum gets appended to the existing file. Please open a different bug if there isnt already one. iirc we had a bug on this already

Comment 5 Pradeep Kilambi 2011-11-10 18:55:23 UTC
here is the existing bug#742320

Comment 6 Preethi Thomas 2011-11-10 19:58:57 UTC
moving to verified

Comment 7 Preethi Thomas 2012-02-24 20:13:42 UTC
Pulp v1.0 is released
Closed Current Release.