Red Hat Satellite engineering is moving the tracking of its product development work on Satellite to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "Satellite project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs will be migrated starting at the end of May. If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "Satellite project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/SAT-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 1212674 - Failed to unregister system as required lock is already taken by "Listen on candlepin events" task
Summary: Failed to unregister system as required lock is already taken by "Listen on c...
Keywords:
Status: CLOSED NEXTRELEASE
Alias: None
Product: Red Hat Satellite
Classification: Red Hat
Component: Subscription Management
Version: 6.1.0
Hardware: x86_64
OS: Linux
unspecified
high
Target Milestone: Unspecified
Assignee: satellite6-bugs
QA Contact: Katello QA List
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2015-04-17 03:14 UTC by Liushihui
Modified: 2019-09-26 13:53 UTC (History)
10 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2017-08-22 17:54:23 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)
conflict task (104.20 KB, image/png)
2015-04-17 03:14 UTC, Liushihui
no flags Details
Destroy Content Host (102.38 KB, image/png)
2015-05-12 02:18 UTC, Liushihui
no flags Details
register_conflict (106.97 KB, image/png)
2016-09-14 05:36 UTC, Liushihui
no flags Details

Description Liushihui 2015-04-17 03:14:35 UTC
Created attachment 1015442 [details]
conflict task

Description of problem:
Unregister system, it will show "Required lock is already taken by other running tasks" in the log file, this task has conflicted with "Listen on candlepin events" task.

Version-Release number of selected component (if applicable):
subscription-manager-1.14.5-1.el6.x86_64
python-rhsm-1.14.2-1.el6.x86_64
virt-who-0.12-5.el6.noarch
candlepin-0.9.48-1.el7.noarch
foreman-1.7.2.15-1.el7sat.noarch
Satellite-6.1.0-RHEL-7-20150409.0

How reproducible:
50%

Steps to Reproduce:
1. Register system to satellite
[root@rhel6 ~]# subscription-manager identity
system identity: 1e3261fc-2f53-47a1-9fda-abf9cb31ba87
name: rhel6.7-20150415.redhat.com
org name: Default Organization
org ID: Default_Organization
environment name: Library
2. Restart virt-who service, then unregister system
[root@rhel6 ~]# subscription-manager unregister
Required lock is already taken by other running tasks.
Please inspect their state, fix their errors and resume them.
Required lock: write
Conflicts with tasks:
3. Check the virt-who's log
4. On the satellite webUI, Go to Monitor-->Task, filter out "result=pending"

Actual results:
Failed to unregister system unless force unlock the conflict task. it will show error in the log.
2015-04-16 21:29:35,259 [DEBUG]  @subscriptionmanager.py:76 - Authenticating with certificate: /etc/pki/consumer/cert.pem
2015-04-16 21:29:36,637 [DEBUG] subscription-manager:3556 @connection.py:521 - Response: status=500
2015-04-16 21:29:36,637 [WARNING] subscription-manager:3556 @connection.py:525 - Clock skew detected, please check your system time
2015-04-16 21:29:36,637 [ERROR] subscription-manager:3556 @managercli.py:160 - Unregister failed
2015-04-16 21:29:36,638 [ERROR] subscription-manager:3556 @managercli.py:161 - Required lock is already taken by other running tasks.
Please inspect their state, fix their errors and resume them.

Required lock: write
Conflicts with tasks:
Traceback (most recent call last):
  File "/usr/share/rhsm/subscription_manager/managercli.py", line 1232, in _do_command
    managerlib.unregister(self.cp, self.identity.uuid)
  File "/usr/share/rhsm/subscription_manager/managerlib.py", line 788, in unregister
    uep.unregisterConsumer(consumer_uuid)
  File "/usr/lib64/python2.6/site-packages/rhsm/connection.py", line 990, in unregisterConsumer
    return self.conn.request_delete(method)
  File "/usr/lib64/python2.6/site-packages/rhsm/connection.py", line 614, in request_delete
    return self._request("DELETE", method, params)
  File "/usr/lib64/python2.6/site-packages/rhsm/connection.py", line 530, in _request
    self.validateResponse(result, request_type, handler)
  File "/usr/lib64/python2.6/site-packages/rhsm/connection.py", line 572, in validateResponse
    raise RestlibException(response['status'], error_msg)
RestlibException: Required lock is already taken by other running tasks.
Please inspect their state, fix their errors and resume them.

Required lock: write
Conflicts with tasks:
================================================================
On the satellite webUI, it will show a conflict task as the following or see the screenshot in the attachment.
 Id: 1a3d1a63-4552-4a56-9916-a91c02e65dbf
Label: Actions::Candlepin::ListenOnCandlepinEvents
Name: Listen on candlepin events
Owner:
Started at: 2015-04-10 11:47:38 UTC
Ended at:
State: running
Result: -
Params: {"locale"=>"en"}
50.0% Complete
50%
Output:

{"messages"=>"5b02c6b5-4073-3d25-8c80-b36134106f55",
 "last_message"=>"5b02c6b5-4073-3d25-8c80-b36134106f55 - consumer.modified",
 "connection"=>"Connected"}

Expected results:
Success to unregister system. 

Additional info:
Sometimes do some actions such as attach or unattach subscriptions also has this problem.

Comment 1 RHEL Program Management 2015-04-17 03:33:06 UTC
Since this issue was entered in Red Hat Bugzilla, the release flag has been
set to ? to ensure that it is properly evaluated for this release.

Comment 5 Liushihui 2015-05-12 02:18:46 UTC
Created attachment 1024432 [details]
Destroy Content Host

Comment 6 Liushihui 2015-06-05 07:55:04 UTC
It still exist on candlepin-0.9.49.0-1.el7.noarch. failed to unregister system since it conflict with "update" task. please see the detail as the following: 

Checked version:
candlepin-0.9.49.0-1.el7.noarch
katello-2.2.0.10-1.el7sat.noarch                                 
foreman-1.7.2.25-1.el7sat.noarch
subscription-manager-1.14.9-1.el6.x86_64
virt-who-0.12-9.el6.noarch

1. Unregister system
[root@hp-z220-06 ~]# subscription-manager unregister
Required lock is already taken by other running tasks.
Please inspect their state, fix their errors and resume them.
Required lock: read
Conflicts with tasks:
- https://hp-dl360g6-01.rhts.eng.bos.redhat.com/foreman_tasks/tasks/f095e167-d4e3-49f1-9e19-efdf8b707a5f
2. Check the register status, system still registered.
[root@hp-z220-06 ~]# subscription-manager identity                                               
system identity: df66dd3d-f506-4ac7-92b0-37c15e96fd89
name: hp-z220-06.qe.lab.eng.nay.redhat.com
org name: Default Organization
org ID: Default_Organization
environment name: Library
3. In the Satellite webUI, Open the conflict task, it will show the unregister task conflict with "update" task 
Id: f095e167-d4e3-49f1-9e19-efdf8b707a5f 
Label: Actions::Katello::System::Update 
Name: Update 
Owner:  
Started at: 2015-06-05 03:08:22 UTC 
Ended at:  
Status: paused 
Result: error 
Parameter: system 'hp-z220-06.qe.lab.eng.nay.redhat.com'; organization 'Default Organization'

Comment 7 Mike McCune 2015-07-10 15:27:17 UTC
Can we get access to your environment where this is happening?

Comment 8 Liushihui 2015-07-13 08:15:25 UTC
Hi Mike,

You can use RHEL6.7-20150617.0-Server-x86_64(IP: 10.66.144.5 : root/redhat) and Satellite-6.1.0-RHEL-7-20150707.4(IP:10.16.65.177 : root/red2015).
# subscription-manager register --username=admin --password=admin
When unreigster rhel system to Satellite, it still show conflict error as the following:
# subscription-manager unregister
Required lock is already taken by other running tasks.
Please inspect their state, fix their errors and resume them.
Required lock: read
Conflicts with tasks:
- https://tyan-gt24-01.rhts.eng.bos.redhat.com/foreman_tasks/tasks/65ca5204-7162-466e-ad12-bce296923204 

Thanks.



(In reply to Mike McCune from comment #7)
> Can we get access to your environment where this is happening?

Comment 9 Mike McCune 2015-07-20 22:12:45 UTC
I logged into this Satellite and saw the stuck task and tried the following:

1) Resume the task, it completed:

https://tyan-gt24-01.rhts.eng.bos.redhat.com/foreman_tasks/tasks/65ca5204-7162-466e-ad12-bce296923204

2) unregister completed

3) re-register completed fine

4) restart virt-who

5) unregister completed fine

6) re-register completed fine


I'm wondering if we can reproduce this again now as I can't seem to get it to error out.

Can you indicate how this started as I've not heard any other reports of this situation.

Comment 10 Liushihui 2015-07-23 05:33:20 UTC
Mike, After researching it, the lock tasks which I mentioned on comment 8 was caused by migration guest, please see detail info on bug 1220620.
About this bug, If it hasn't migration guest, unregister system won't generate locked task which mentioned on the bug description and comment 4 on the latest Satellite 6.1.0-20150716.0. Therefore, I think you can close this bug. Thanks. 

(In reply to Mike McCune from comment #9)
> I logged into this Satellite and saw the stuck task and tried the following:
> 
> 1) Resume the task, it completed:
> 
> https://tyan-gt24-01.rhts.eng.bos.redhat.com/foreman_tasks/tasks/65ca5204-
> 7162-466e-ad12-bce296923204
> 
> 2) unregister completed
> 
> 3) re-register completed fine
> 
> 4) restart virt-who
> 
> 5) unregister completed fine
> 
> 6) re-register completed fine
> 
> 
> I'm wondering if we can reproduce this again now as I can't seem to get it
> to error out.
> 
> Can you indicate how this started as I've not heard any other reports of
> this situation.

Comment 11 Bryan Kearney 2015-08-07 15:27:58 UTC
Closing this bug per comment 10.

Comment 12 Liushihui 2015-12-11 03:12:31 UTC
It has been reproduced on Satellite-6.1.0-RHEL-7-20151210.0. Therefore, reopen it.

Reproduced version:
Satellite-6.1.0-RHEL-7-20151210.0
katello-2.2.0.16-1.el7sat.noarch
foreman-1.7.2.49-1.el7sat.noarch
candlepin-0.9.49.9-1.el7.noarch

Reproduced process:
Do as the bug's description, when unregister rhel system, it was failed and show conflict task error.
#subscription-manager unregister
Required lock is already taken by other running tasks.
Please inspect their state, fix their errors and resume them.

Required lock: read
Conflicts with tasks:
- https://satellite-1c5f84e0-5a8a-4d14-8039-4cf8be754093.novalocal/foreman_tasks/tasks/b343bf9a-9a35-4de7-be2f-a61c3146ca18

Comment 13 Liushihui 2016-01-12 03:07:49 UTC
It still exist on Satellite-6.1.0-RHEL-7-20160107.0. when unregister system(RHEL6.8-20160111.0-x86_64), it also has the same problem.

#subscription-manager unregister
Required lock is already taken by other running tasks.
Please inspect their state, fix their errors and resume them.

Required lock: read
Conflicts with tasks:
- https://satellite-4df6a60a-42b5-4f29-9e4c-459656386bcf.novalocal/foreman_tasks/tasks/8356ed93-e999-401a-847c-52a26ae8cb89

Comment 16 Liushihui 2016-09-14 05:35:38 UTC
Register rhel to Satellite-6.2.0-RHEL-7-20160907.6 has the similar problem. please see the webUI screenshot in attachment.

# subscription-manager register --username=admin --password=admin
Registering to: ibm-x3655-04.ovirt.rhts.eng.bos.redhat.com:443/rhsm
Required lock is already taken by other running tasks.
Please inspect their state, fix their errors and resume them.

Required lock: read
Conflicts with tasks:
- https://ibm-x3655-04.ovirt.rhts.eng.bos.redhat.com/foreman_tasks/tasks/521989ac-6d62-4af0-8751-62a70c7c8021

Comment 17 Liushihui 2016-09-14 05:36:38 UTC
Created attachment 1200727 [details]
register_conflict

Comment 20 Bryan Kearney 2017-08-22 17:54:23 UTC
We believe the bugs around this have been fixed around

https://bugzilla.redhat.com/show_bug.cgi?id=1338578
https://bugzilla.redhat.com/show_bug.cgi?id=1209866
https://bugzilla.redhat.com/show_bug.cgi?id=1244309
https://bugzilla.redhat.com/show_bug.cgi?id=1276241
https://bugzilla.redhat.com/show_bug.cgi?id=1325879

I am closing this out as NEXTRELEASE. If you see additional cases with 6.3, please feel free to re-open this.


Note You need to log in before you can comment on or make changes to this bug.