Red Hat Satellite engineering is moving the tracking of its product development work on Satellite to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "Satellite project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs will be migrated starting at the end of May. If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "Satellite project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/SAT-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 1202896 - Subscriptions page shows incorrect counts
Summary: Subscriptions page shows incorrect counts
Keywords:
Status: CLOSED DUPLICATE of bug 1200877
Alias: None
Product: Red Hat Satellite
Classification: Red Hat
Component: Subscription Management
Version: 6.1.0
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: Unspecified
Assignee: Tom McKay
QA Contact: sthirugn@redhat.com
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2015-03-17 16:19 UTC by sthirugn@redhat.com
Modified: 2017-02-23 20:17 UTC (History)
5 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2015-03-25 12:19:21 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)

Description sthirugn@redhat.com 2015-03-17 16:19:14 UTC 
Description of problem:
Subscriptions page shows incorrect counts

Version-Release number of selected component (if applicable):
Satellite-6.1.0-RHEL-6-20150311.1

How reproducible:
Always

Steps to Reproduce:
1. Install Sat6
2. Upload manifest (with RH employee subscriptions), enable repositories, sync
3. Create activation key, attach subscriptions
4. Register three different content hosts
5. Subscriptions page showed correct consumed counts
- 3 consumed subscriptions
- 3 unlimited guest subscriptions corresponding to 3 content hosts
6. Unregister all three content hosts
7. Review the subscriptions page (see screenshot)

Actual results:
1. Unlimited guest subscriptions does not go away
2. Consumed subscriptions shows 1 although I did not have any content hosts registered

Expected results:
1. Unlimited guest subscriptions should go away when the corresponding content host is unregistered
2. If I dont have any content host, I should see zero subscriptions consumed

Additional info:
Comment 6 Adrian Likins 2015-03-18 18:24:37 UTC 
Quick glance in the logs reveal lots of :

2015-03-17 12:06:11,875 [=, org=] ERROR org.candlepin.audit.AMQPBusPublisher - Unable to send event: Event [id=null, t
arget=CONSUMER, type=DELETED, time=Tue Mar 17 12:06:11 EDT 2015, entity=8a90e0044c0f617e014c1513219307c8]
javax.jms.IllegalStateException: Object org.apache.qpid.client.AMQSession_0_10@598529e5 has been closed
        at org.apache.qpid.client.Closeable.checkNotClosed(Closeable.java:62) ~[qpid-client-0.30.redhat-1.jar:0.30.red
hat-1]
        at org.apache.qpid.client.AMQSession.checkNotClosed(AMQSession.java:549) ~[qpid-client-0.30.redhat-1.jar:0.30.
redhat-1]
        at org.apache.qpid.client.AMQSession.createTextMessage(AMQSession.java:1599) ~[qpid-client-0.30.redhat-1.jar:0
.30.redhat-1]
        at org.apache.qpid.client.AMQSession.createTextMessage(AMQSession.java:1614) ~[qpid-client-0.30.redhat-1.jar:0
.30.redhat-1]
        at org.apache.qpid.client.AMQSessionAdapter.createTextMessage(AMQSessionAdapter.java:77) ~[qpid-client-0.30.re
dhat-1.jar:0.30.redhat-1]
        at org.candlepin.audit.AMQPBusPublisher.onEvent(AMQPBusPublisher.java:60) ~[AMQPBusPublisher.class:na]
        at org.candlepin.audit.ListenerWrapper.onMessage(ListenerWrapper.java:52) [ListenerWrapper.class:na]
        at org.hornetq.core.client.impl.ClientConsumerImpl.callOnMessage(ClientConsumerImpl.java:1114) [hornetq-core-c
lient-2.3.5.Final-redhat-2.jar:2.3.5.Final-redhat-2]
        at org.hornetq.core.client.impl.ClientConsumerImpl.access$500(ClientConsumerImpl.java:57) [hornetq-core-client
-2.3.5.Final-redhat-2.jar:2.3.5.Final-redhat-2]
        at org.hornetq.core.client.impl.ClientConsumerImpl$Runner.run(ClientConsumerImpl.java:1249) [hornetq-core-clie
nt-2.3.5.Final-redhat-2.jar:2.3.5.Final-redhat-2]
        at org.hornetq.utils.OrderedExecutorFactory$OrderedExecutor$1.run(OrderedExecutorFactory.java:106) [hornetq-co
re-client-2.3.5.Final-redhat-2.jar:2.3.5.Final-redhat-2]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_75]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_75]
        at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
Comment 7 Adrian Likins 2015-03-18 18:45:30 UTC 
Timeframe of the screenshot in attachement 1?
Comment 8 Adrian Likins 2015-03-19 14:01:30 UTC 
Looking through the candlepin audit.log, I see the consumers registered and consuming subs with a created entitlement, but then also see each of them unattach the entitlements. It looks like everything get's deleted but it could be missing something.
Comment 9 Michael Stead 2015-03-23 11:55:05 UTC 
These errors should fail gracefully and not cause any issues in the candlepin transaction. The failed event sending should get queued up and retried when the connection to the broker is made again.

Unless the event failure handling is broken, I don't see how this could be causing the counts to be off. These counts should be coming from the current status of the pool/subscription, not from gutterball.
Comment 10 Devan Goodwin 2015-03-25 12:19:21 UTC 
Based on what we've seen leading to bug #1205378, this appears to be data from a Katello search index cache. The cache is updated when events are received, so events not being sent could cause the cache to not be updated.

I suspect running 'foreman-rake katello:reindex' will clear the issue up.

In the foreman debug for this issue, there are several failed events including 3 entitlements deleted that never made it to the message bus. This very likely indicates why Katello thought there were still three in use.

If you were to restart qpid, and then tomcat, all queued events should be sent out, which should also clear this up. 

The likely cause was a qpid restart without a tomcat restart, or possibly some kind of qpid crash though that is less commonly seen.

We're already working on more resiliency keeping connections open to the qpid message bus, as such I think I'm going to close this as a dupe as that appears to be the case here.

*** This bug has been marked as a duplicate of bug 1200877 ***
Comment 11 sthirugn@redhat.com 2015-04-13 17:53:05 UTC 
Clearing needinfo? flag as the other related bug https://bugzilla.redhat.com/show_bug.cgi?id=1200877 is verified.
Note You need to log in before you can comment on or make changes to this bug.