Red Hat Satellite engineering is moving the tracking of its product development work on Satellite to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "Satellite project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs will be migrated starting at the end of May. If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "Satellite project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/SAT-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 1944317 - pulp3: 2to3 migration fails with 'Cursor not found' on slow hardware
Summary: pulp3: 2to3 migration fails with 'Cursor not found' on slow hardware
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Satellite
Classification: Red Hat
Component: Pulp
Version: 6.9.0
Hardware: Unspecified
OS: Unspecified
unspecified
medium
Target Milestone: 6.9.1
Assignee: satellite6-bugs
QA Contact: Lai
URL:
Whiteboard:
: 1972998 (view as bug list)
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2021-03-29 18:18 UTC by Justin Sherrill
Modified: 2022-09-07 16:28 UTC (History)
10 users (show)

Fixed In Version: python-pulp_2to3_migration-0.11.0
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2021-04-26 17:36:58 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Pulp Redmine 8470 0 Normal CLOSED - CURRENTRELEASE As a user, I can configure the batch size for the content premigration 2021-04-12 17:36:03 UTC
Red Hat Knowledge Base (Solution) 6521251 0 None None None 2021-11-17 15:09:01 UTC
Red Hat Product Errata RHBA-2021:1371 0 None None None 2021-04-26 17:37:08 UTC

Description Justin Sherrill 2021-03-29 18:18:54 UTC 
Description of problem:

When migrating content on slow hardware with a lot of errata (or a lot of repos with the errata), the migration may fail with 

Cursor not found

This does not happen on faster hardware (with SSDs)

Version-Release number of selected component (if applicable):
6.9.0


Additional info:

pymongo.errors.CursorNotFound: Cursor not found, cursor id: 177029458308, full error: {'ok': 0.0, 'errmsg': 'Cursor not found, cursor id: 177029458308', 'code': 43, 'codeName': 'CursorNotFound'}
Traceback (most recent call last):
File "/usr/lib/python3.6/site-packages/rq/worker.py", line 936, in perform_job
rv = job.perform()
File "/usr/lib/python3.6/site-packages/rq/job.py", line 684, in perform
self._result = self._execute()
File "/usr/lib/python3.6/site-packages/rq/job.py", line 690, in _execute
return self.func(*self.args, **self.kwargs)
File "/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/tasks/migrate.py", line 77, in migrate_from_pulp2
pre_migrate_all_content(plan)
File "/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/pre_migration.py", line 69, in pre_migrate_all_content
pre_migrate_content_type(content_model, mutable_type, lazy_type, premigrate_hook)
File "/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/pre_migration.py", line 173, in pre_migrate_content_type
for i, record in enumerate(batched_mongo_content_qs.no_cache()):
File "/usr/lib/python3.6/site-packages/mongoengine/queryset/base.py", line 1590, in __next__
raw_doc = next(self._cursor)
File "/usr/lib64/python3.6/site-packages/pymongo/cursor.py", line 1207, in next
if len(self.__data) or self._refresh():
File "/usr/lib64/python3.6/site-packages/pymongo/cursor.py", line 1144, in _refresh
self.__send_message(g)
File "/usr/lib64/python3.6/site-packages/pymongo/cursor.py", line 1001, in __send_message
address=self.__address)
File "/usr/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1372, in _run_operation_with_response
exhaust=exhaust)
File "/usr/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1471, in _retryable_read
return func(session, server, sock_info, slave_ok)
File "/usr/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1366, in _cmd
unpack_res)
File "/usr/lib64/python3.6/site-packages/pymongo/server.py", line 137, in run_operation_with_response
first, sock_info.max_wire_version)
File "/usr/lib64/python3.6/site-packages/pymongo/helpers.py", line 164, in _check_command_response
max_wire_version)
pymongo.errors.CursorNotFound: Cursor not found, cursor id: 177029458308, full error: {'ok': 0.0, 'errmsg': 'Cursor not found, cursor id: 177029458308', 'code': 43, 'codeName': 'CursorNotFound'}
Comment 1 Justin Sherrill 2021-03-29 18:20:25 UTC 
Note: this will likely require 2 changes:

1.  Pulp making a page size configurable
2.  Katello exposing this page size over the installer
Comment 2 pulp-infra@redhat.com 2021-03-29 19:12:29 UTC 
The Pulp upstream bug status is at NEW. Updating the external tracker on this bug.
Comment 3 pulp-infra@redhat.com 2021-03-29 19:12:30 UTC 
The Pulp upstream bug priority is at Normal. Updating the external tracker on this bug.
Comment 4 pulp-infra@redhat.com 2021-04-07 19:17:31 UTC 
The Pulp upstream bug status is at ASSIGNED. Updating the external tracker on this bug.
Comment 5 pulp-infra@redhat.com 2021-04-09 13:21:05 UTC 
The Pulp upstream bug status is at MODIFIED. Updating the external tracker on this bug.
Comment 6 pulp-infra@redhat.com 2021-04-09 14:14:17 UTC 
All upstream Pulp bugs are at MODIFIED+. Moving this bug to POST.
Comment 7 pulp-infra@redhat.com 2021-04-12 17:36:05 UTC 
The Pulp upstream bug status is at CLOSED - CURRENTRELEASE. Updating the external tracker on this bug.
Comment 8 Lai 2021-04-15 18:47:13 UTC 
I have verified that the code is in place since there's no good way to verify this on a fast machine.

Verified on 6.9.1_02 with python3-pulp-2to3-migration-0.11.0-1.el7pc.noarch
Comment 13 errata-xmlrpc 2021-04-26 17:36:58 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Satellite 6.9.1 Async Bug Fix Update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:1371
Comment 14 Brad Buckingham 2021-07-01 15:09:09 UTC 
*** Bug 1972998 has been marked as a duplicate of this bug. ***
Note You need to log in before you can comment on or make changes to this bug.