Bug 1329640

Summary: Unable to sync rhel6-ks repo on rhel6
Product: Red Hat Satellite Reporter: Kedar Bidarkar <kbidarka>
Component: PulpAssignee: satellite6-bugs <satellite6-bugs>
Status: CLOSED ERRATA QA Contact: Lukas Pramuk <lpramuk>
Severity: high Docs Contact:
Priority: high    
Version: 6.2.0CC: bbuckingham, bmbouter, daviddavis, dkliban, ehelms, ggainey, ipanova, jcline, lpramuk, mhrivnak, mmccune, pcreech, peter.vreman, rchan, ttereshc
Target Milestone: UnspecifiedKeywords: Triaged
Target Release: Unused   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: pulp-server-2.8.3-1 Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2016-07-27 11:03:16 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Bug Depends On:    
Bug Blocks: 1122832    

Description Kedar Bidarkar 2016-04-22 12:41:11 UTC
Description of problem:

Cannot sync rhel6-ks repo on sat62 running on rhel6.

2016-04-22 08:31:58 [app] [I]   Parameters: {"call_report"=>"[FILTERED]", "event_type"=>"repo.sync.finish", "payload"=>{"importer_id"=>"yum_importer", "exception"=>nil, "repo_id"=>"Default_Organization-Red_Hat_Enterprise_Linux_Server-Red_Hat_Enterprise_Linux_6_Server_Kickstart_x86_64_6_7", "traceback"=>nil, "started"=>"2016-04-22T12:31:52Z", "_ns"=>"repo_sync_results", "completed"=>"2016-04-22T12:31:58Z", "importer_type_id"=>"yum_importer", "error_message"=>nil, "summary"=>{"content"=>{"state"=>"FINISHED"}, "comps"=>{"state"=>"FINISHED"}, "purge_duplicates"=>{"state"=>"FINISHED"}, "distribution"=>{"state"=>"FINISHED"}, "errata"=>{"state"=>"FINISHED"}, "metadata"=>{"state"=>"FINISHED"}}, "added_count"=>0, "result"=>"success", "updated_count"=>0, "details"=>{"content"=>{"size_total"=>0, "items_left"=>0, "items_total"=>0, "state"=>"FINISHED", "size_left"=>0, "details"=>{"rpm_total"=>0, "rpm_done"=>0, "drpm_total"=>0, "drpm_done"=>0}, "error_details"=>nil}, "comps"=>{"state"=>"FINISHED"}, "purge_duplicates"=>{"state"=>"FINISHED"}, "distribution"=>{"items_total"=>0, "state"=>"FINISHED", "error_details"=>nil, "items_left"=>0}, "errata"=>{"state"=>"FINISHED"}, "metadata"=>{"state"=>"FINISHED"}}, "id"=>"571a19bec758a1535b128265", "removed_count"=>0}, "token"=>"xUXfDN5xQ6NfcRxUMHL3Mk2hPYgpQFZv", "api_version"=>"v2", "repository"=>{}}
2016-04-22 08:31:58 [app] [I] Sync_complete called for Red Hat Enterprise Linux 6 Server Kickstart x86_64 6.7, running after_sync.
2016-04-22 08:31:58 [app] [I] Completed 200 OK in 65ms (Views: 0.5ms | ActiveRecord: 2.9ms)
2016-04-22 08:32:00 [app] [I] Started GET "/katello/sync_management/sync_status?repoids%5B%5D=3&_=1461328293902" for  at 2016-04-22 08:32:00 -0400
2016-04-22 08:32:00 [app] [I] Processing by Katello::SyncManagementController#sync_status as JSON
2016-04-22 08:32:00 [app] [I]   Parameters: {"repoids"=>["3"], "_"=>"1461328293902"}
2016-04-22 08:32:00 [app] [I] Completed 200 OK in 70ms (Views: 0.4ms | ActiveRecord: 5.9ms)
2016-04-22 08:32:01 [app] [I] Started GET "/katello/sync_management/sync_status?repoids%5B%5D=3&_=1461328293903" for  at 2016-04-22 08:32:01 -0400
2016-04-22 08:32:01 [app] [I] Processing by Katello::SyncManagementController#sync_status as JSON
2016-04-22 08:32:01 [app] [I]   Parameters: {"repoids"=>["3"], "_"=>"1461328293903"}
2016-04-22 08:32:01 [app] [I] Completed 200 OK in 133ms (Views: 0.6ms | ActiveRecord: 11.5ms)
2016-04-22 08:32:02 [foreman-tasks/action] [E] PLP0000: iter (Katello::Errors::PulpError)
 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.0.0.21/app/lib/actions/pulp/abstract_async_task.rb:121:in `block in external_task='
 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.0.0.21/app/lib/actions/pulp/abstract_async_task.rb:119:in `each'
 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.0.0.21/app/lib/actions/pulp/abstract_async_task.rb:119:in `external_task='
 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.0.0.21/app/lib/actions/pulp/repository/sync.rb:46:in `external_task='
 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/action/polling.rb:98:in `poll_external_task_with_rescue'
 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/action/polling.rb:21:in `run'
 | /opt/theforeman/tfm/root/usr/share/gems/gems/dynflow-0.8.10/lib/dynflow/action/cancellable.rb:9:in `run'
 | /opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.0.0.21/app/lib/actions/pulp/abstract_async_task.rb:45:in `run'



Version-Release number of selected component (if applicable):
sat62-snap9.0

How reproducible:


Steps to Reproduce:
1. sync rhel6-ks repo on rhel6
2.
3.

Actual results:

sync status says "Sync Incomplete"

Expected results:
Syncing should be completed.

Additional info:

Comment 3 Brad Buckingham 2016-04-22 15:42:09 UTC
In /var/log/messages of the attached debug, I do see the following error reported:

Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496) Exception caught from plugin during publish for repo [Default_Organization-Red_Hat_Enterprise_Linux_Server-Red_Hat_Enterprise_Linux_6_Server_Kickstart_x86_64_6_7]
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496) Traceback (most recent call last):
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496)   File "/usr/lib/python2.6/site-packages/pulp/server/controllers/repository.py", line 1023, in _do_publish
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496)     publish_report = publish_repo(transfer_repo, conduit, call_config)
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496)   File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 658, in wrap_f
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496)     return f(*args, **kwargs)
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496)   File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/distributor.py", line 174, in publish_repo
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496)     return self._publisher.process_lifecycle()
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496)   File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 562, in process_lifecycle
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496)     super(PluginStep, self).process_lifecycle()
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496)   File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 159, in process_lifecycle
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496)     step.process()
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496)   File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 232, in process
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496)     self._process_block(item=item)
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496)   File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 291, in _process_block
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496)     self.process_main(item=item)
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496)   File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/publish.py", line 748, in process_main
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496)     self._publish_distribution_files(unit)
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496)   File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/publish.py", line 816, in _publish_distribution_files
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496)     self._write_pulp_distribution_file(distro_files, xml_file_path)
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496)   File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/publish.py", line 835, in _write_pulp_distribution_file
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496)     old_files = [old_element.text for old_element in old_xml_root.iter('file')]
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.controllers.repository:ERROR: (21339-18496) AttributeError: iter
Apr 22 08:32:00 qe-sat6-feature-rhel6 pulp: pulp.server.async.tasks:INFO: Task failed : [2ef0a440-5cf9-4007-869e-535787182483]

Comment 5 Michael Hrivnak 2016-04-22 16:06:04 UTC
Looks like a python 2.6 incompatibility in a new bug fix. We'll get it fixed ASAP.

Comment 6 pulp-infra@redhat.com 2016-04-22 17:33:38 UTC
The Pulp upstream bug status is at POST. Updating the external tracker on this bug.

Comment 7 pulp-infra@redhat.com 2016-04-22 17:33:41 UTC
The Pulp upstream bug priority is at Normal. Updating the external tracker on this bug.

Comment 8 pulp-infra@redhat.com 2016-04-22 19:03:36 UTC
The Pulp upstream bug status is at MODIFIED. Updating the external tracker on this bug.

Comment 9 pulp-infra@redhat.com 2016-04-26 23:03:36 UTC
The Pulp upstream bug status is at ON_QA. Updating the external tracker on this bug.

Comment 10 Brad Buckingham 2016-05-02 13:22:05 UTC
*** Bug 1332188 has been marked as a duplicate of this bug. ***

Comment 11 Lukas Pramuk 2016-05-02 13:34:11 UTC
A sync of "Red Hat Enterprise Linux 5 Server Kickstart x86_64 5.11" fails the same way. While sync of "Red Hat Enterprise Linux 7 Server Kickstart x86_64 7.2" succeeded.

So, this seems related to multiple archs available for RHEL5 and RHEL6.
( while RHEL7 has only x86_64 arch)

Comment 12 Lukas Pramuk 2016-05-02 13:35:00 UTC
(...and python 2.6 compatibility of course )

Comment 13 pulp-infra@redhat.com 2016-05-06 17:30:41 UTC
The Pulp upstream bug status is at VERIFIED. Updating the external tracker on this bug.

Comment 14 pulp-infra@redhat.com 2016-05-17 20:00:28 UTC
The Pulp upstream bug status is at CLOSED - CURRENTRELEASE. Updating the external tracker on this bug.

Comment 15 Lukas Pramuk 2016-05-26 10:27:05 UTC
VERIFIED.

@satellite-6.2.0-13.0.el6sat.noarch
pulp-server-2.8.3-1.el6sat.noarch


With RHEL6 Satellite, the error "PLP0000: iter"  no longer occurs when syncing:
- Red Hat Enterprise Linux 6 Server Kickstart x86_64 6.7
- Red Hat Enterprise Linux 5 Server Kickstart x86_64 5.11

Comment 16 Bryan Kearney 2016-07-27 11:03:16 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2016:1501