Red Hat Satellite engineering is moving the tracking of its product development work on Satellite to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "Satellite project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs will be migrated starting at the end of May. If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "Satellite project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/SAT-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 1993921 - This worker is not supposed to run with new style tasks
Summary: This worker is not supposed to run with new style tasks
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Satellite
Classification: Red Hat
Component: Satellite Maintain
Version: 6.9.0
Hardware: x86_64
OS: Linux
unspecified
low
Target Milestone: 6.10.0
Assignee: satellite6-bugs
QA Contact: Gaurav Talreja
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2021-08-16 12:16 UTC by Kenny Tordeurs
Modified: 2021-11-16 13:48 UTC (History)
5 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2021-11-16 13:48:19 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Foreman Issue Tracker 33411 0 None None None 2021-09-03 13:40:56 UTC
Red Hat Product Errata RHBA-2021:4697 0 None None None 2021-11-16 13:48:30 UTC

Description Kenny Tordeurs 2021-08-16 12:16:24 UTC 
Description of problem:

The following traceback is observed during upgrade from 6.9 to 6.10:
~~~
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: Traceback (most recent call last):
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: File "/usr/bin/rq", line 11, in <module>
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: load_entry_point('rq==1.8.1', 'console_scripts', 'rq')()
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: File "/usr/lib/python3.6/site-packages/click/core.py", line 829, in __call__
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: return self.main(*args, **kwargs)
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: File "/usr/lib/python3.6/site-packages/click/core.py", line 782, in main
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: rv = self.invoke(ctx)
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: File "/usr/lib/python3.6/site-packages/click/core.py", line 1259, in invoke
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: return _process_result(sub_ctx.command.invoke(sub_ctx))
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: File "/usr/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: return ctx.invoke(self.callback, **ctx.params)
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: File "/usr/lib/python3.6/site-packages/click/core.py", line 610, in invoke
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: return callback(*args, **kwargs)
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: File "/usr/lib/python3.6/site-packages/rq/cli/cli.py", line 83, in wrapper
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: return ctx.invoke(func, cli_config, *args[1:], **kwargs)
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: File "/usr/lib/python3.6/site-packages/click/core.py", line 610, in invoke
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: return callback(*args, **kwargs)
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: File "/usr/lib/python3.6/site-packages/rq/cli/cli.py", line 256, in worker
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: serializer=serializer
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: File "/usr/lib/python3.6/site-packages/pulpcore/tasking/worker.py", line 67, in __init__
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: raise NotImplementedError("This worker is not supposed to run with new style tasks.")
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: NotImplementedError: This worker is not supposed to run with new style tasks.
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: Traceback (most recent call last):
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: File "/usr/bin/rq", line 11, in <module>
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: load_entry_point('rq==1.8.1', 'console_scripts', 'rq')()
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/click/core.py", line 829, in __call__
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: return self.main(*args, **kwargs)
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/click/core.py", line 782, in main
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: rv = self.invoke(ctx)
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/click/core.py", line 1259, in invoke
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: return _process_result(sub_ctx.command.invoke(sub_ctx))
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: return ctx.invoke(self.callback, **ctx.params)
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/click/core.py", line 610, in invoke
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: return callback(*args, **kwargs)
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/rq/cli/cli.py", line 83, in wrapper
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: return ctx.invoke(func, cli_config, *args[1:], **kwargs)
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/click/core.py", line 610, in invoke
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: return callback(*args, **kwargs)
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/rq/cli/cli.py", line 256, in worker
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: serializer=serializer
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulpcore/tasking/worker.py", line 67, in __init__
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: raise NotImplementedError("This worker is not supposed to run with new style tasks.")
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: NotImplementedError: This worker is not supposed to run with new style tasks.
~~~

Version-Release number of selected component (if applicable):
6.9.4 > 6.10

How reproducible:
100%

Steps to Reproduce:
1. satellite-maintain upgrade run --target-version 6.10
2. observe /var/log/messages
3.

Actual results:
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: raise NotImplementedError("This worker is not supposed to run with new style tasks.")
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-2: NotImplementedError: This worker is not supposed to run with new style tasks.
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: Traceback (most recent call last):
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: File "/usr/bin/rq", line 11, in <module>
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: load_entry_point('rq==1.8.1', 'console_scripts', 'rq')()
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/click/core.py", line 829, in __call__
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: return self.main(*args, **kwargs)
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/click/core.py", line 782, in main
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: rv = self.invoke(ctx)
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/click/core.py", line 1259, in invoke
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: return _process_result(sub_ctx.command.invoke(sub_ctx))
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: return ctx.invoke(self.callback, **ctx.params)
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/click/core.py", line 610, in invoke
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: return callback(*args, **kwargs)
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/rq/cli/cli.py", line 83, in wrapper
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: return ctx.invoke(func, cli_config, *args[1:], **kwargs)
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/click/core.py", line 610, in invoke
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: return callback(*args, **kwargs)
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/rq/cli/cli.py", line 256, in worker
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: serializer=serializer
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: File "/usr/lib/python3.6/site-packages/pulpcore/tasking/worker.py", line 67, in __init__
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: raise NotImplementedError("This worker is not supposed to run with new style tasks.")
Aug 16 13:07:16 ktordeur-testathon pulpcore-worker-3: NotImplementedError: This worker is not supposed to run with new style tasks.

Expected results:
No such tracebacks

Additional info:
Comment 1 Brad Buckingham 2021-08-16 13:06:54 UTC 
Did you run the content-prepare prior to the upgrade?

Is the upgrade successful despite the errors?
Comment 2 Kenny Tordeurs 2021-08-16 13:08:35 UTC 
Did you run the content-prepare prior to the upgrade?
-> Yes, without errors

Is the upgrade successful despite the errors?
-> Yes, the upgrade passes without issues I just noticed these passing as I was doing `foreman-tail` during the upgrade.
Comment 3 Tanya Tereshchenko 2021-08-22 19:31:19 UTC 
It looks like Satellite 6.9/Pulp 3 workers haven't been stopped after the final content migration run during switchover.
Not sure which component is responsible for that, foreman-maintain?
Comment 5 Bryan Kearney 2021-09-03 16:05:31 UTC 
Upstream bug assigned to aupadhye
Comment 6 Bryan Kearney 2021-09-03 16:05:33 UTC 
Upstream bug assigned to aupadhye
Comment 8 Bryan Kearney 2021-09-07 16:05:32 UTC 
Moving this bug to POST for triage into Satellite since the upstream issue https://projects.theforeman.org/issues/33411 has been resolved.
Comment 9 Amit Upadhye 2021-09-07 17:58:42 UTC 
I mistakenly moved this to pulp, reverting it to foreman-maintain.
Comment 10 Gaurav Talreja 2021-10-18 21:42:42 UTC 
Verified.

Tested on Satellite 6.9.7
Version: rubygem-foreman_maintain-0.8.19-1.el7sat.noarch (From Satellite 6.10.0 Snap 23)

Steps:
1. Perform upgrade to 6.10, watch /var/log/messages, and grep for 'pulpcore-worker' or for 'This worker is not supposed to run with new style tasks'

Observation:
Pulpcore workers are stopped after the final content migration run during the switchover, which fixes this issue and no such warnings are observed in /var/log/messages.
Also, for confirming, tried removing that step to stop pulpcore-workers after the final content migration, was able to reproduce those tracebacks.
Comment 13 errata-xmlrpc 2021-11-16 13:48:19 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Satellite 6.10 Satellite Maintenance Release), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:4697
Note You need to log in before you can comment on or make changes to this bug.