Bug 1357866
| Summary: | Helper rake tasks not fully updated for Host Unification and Scoped search | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Product: | Red Hat Satellite | Reporter: | Justin Sherrill <jsherril> | ||||||||
| Component: | Hosts | Assignee: | Justin Sherrill <jsherril> | ||||||||
| Status: | CLOSED ERRATA | QA Contact: | jcallaha | ||||||||
| Severity: | high | Docs Contact: | |||||||||
| Priority: | unspecified | ||||||||||
| Version: | 6.2.0 | CC: | aperotti, bbuckingham, bkearney, cduryee, chrobert, cwelton, ftsiadim, inecas, jcallaha, mmello, oshtaier | ||||||||
| Target Milestone: | Unspecified | Keywords: | Triaged | ||||||||
| Target Release: | Unused | ||||||||||
| Hardware: | Unspecified | ||||||||||
| OS: | Unspecified | ||||||||||
| URL: | http://projects.theforeman.org/issues/15721 | ||||||||||
| Whiteboard: | |||||||||||
| Fixed In Version: | rubygem-katello-3.0.0.91-1 | Doc Type: | If docs needed, set a value | ||||||||
| Doc Text: | Story Points: | --- | |||||||||
| Clone Of: | |||||||||||
| : | 1405500 (view as bug list) | Environment: | |||||||||
| Last Closed: | 2017-01-26 10:40:42 UTC | Type: | --- | ||||||||
| Regression: | --- | Mount Type: | --- | ||||||||
| Documentation: | --- | CRM: | |||||||||
| Verified Versions: | Category: | --- | |||||||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||||||
| Embargoed: | |||||||||||
| Bug Depends On: | |||||||||||
| Bug Blocks: | 1399395, 1405500 | ||||||||||
| Attachments: |
|
||||||||||
|
Description
Justin Sherrill
2016-07-19 12:39:18 UTC
Created from redmine issue http://projects.theforeman.org/issues/15721 Upstream bug assigned to jsherril Upstream bug assigned to jsherril Upstream bug assigned to jsherril Moving to POST since upstream bug http://projects.theforeman.org/issues/15721 has been closed *** Bug 1354555 has been marked as a duplicate of this bug. *** Created attachment 1232583 [details]
updated 6.2 copy of clean_backend_objects
there are a few things:
1. foreman-rake katello:reimport (this was formally reindex).
This pulls in content from pulp into the db that is missing. You can likely test this by running in the foreman-rake console:
[Katello::Erratum,
Katello::PackageGroup,
Katello::PuppetModule,
Katello::Rpm,
Katello::DockerManifest,
Katello::DockerTag].each{|content| content.destroy_all }
with various repos synced. Then run the rake task and check to see that all content listings for repos and content views is accurate.
2. foreman-rake katello:clean_backend_objects
This handles two cases:
a) Some consumer was deleted in candlepin but not in katello/foreman. You can reproduce this by registering a client and running this in the console:
User.current = User.anonymous_api_admin
Katello::Resources::Candlepin::Consumer.destroy("UUID")
where UUID is the uuid of some registered client.
b) Some consumer was deleted in katello/foreman but exists in candlepin. You can reproduce this by registering a client, subscribing it to some subscription, and running this in the console:
host = Host.find_by(:name => "foo.example.com")
host.subscription_facet.destroy
host.content_facet.destroy
host.destroy
the host should dissappear from the webUI, but it should still show as consuming a subscription on the subscriptions page. Then run the clean_backend_objects rake task and it should correct it.
Justin, I tried the steps you provided, but am seeing some questionable results. After running katello:reimport, i see significant count reductions throughout packages and errata. Content view before 24793 Packages 1892 Errata ( 379 1220 293 ) Content view after 128 Packages 128 Errata ( 13 93 22 ) After running the second scenario with clean_backend_objects, I'm still seeing the consumed subscriptions that the deleted host held. (See attached screenshot for after). -bash-4.2# hammer -u admin -p changeme host list --organization-id 1 ---|-------------------------------------------------------------|------------------|------------|---------------|------------------ ID | NAME | OPERATING SYSTEM | HOST GROUP | IP | MAC ---|-------------------------------------------------------------|------------------|------------|---------------|------------------ 18 | cloud-qe-06.idmqe.lab.eng.bos.redhat.com | RHEL Server 7.3 | | 10.19.34.35 | 34:40:b5:8a:43:ff 13 | ibm-x3250m4-06.lab.eng.rdu2.redhat.com | RHEL Server 7.3 | | 10.8.0.71 | 40:f2:e9:32:1c:ac 10 | ibm-x3550m3-09.lab.eng.brq.redhat.com | RHEL Server 7.3 | | 10.34.36.133 | 34:40:b5:a0:13:44 17 | mgmt3.rhq.lab.eng.bos.redhat.com | RHEL Server 7.3 | | 10.16.4.13 | 00:50:45:5f:3e:6f 14 | short | RedHat 7.2 | | 172.17.0.2 | 02:42:ac:11:00:02 15 | test | RedHat 7.2 | | 172.17.0.2 | 02:42:ac:11:00:02 9 | tom-temp | | | | 7 | unused | RHEL Server 7.3 | | 10.12.211.202 | 00:50:56:ae:89:e9 3 | virt-who-bulgaria.hq.gsslab.rdu.redhat.com-1 | | | | 8 | virt-who-dhcp-8-101-249.satellite.lab.eng.rdu2.redhat.com-1 | | | | 4 | virt-who-inorbit.hq.gsslab.rdu.redhat.com-1 | | | | 5 | virt-who-ironforge.satellite.lab.eng.rdu2.redhat.com-1 | | | | 6 | virt-who-nightwing.hq.gsslab.rdu.redhat.com-1 | | | | 2 | virt-who-supermicro-2027gr-tr2-1.gsslab.rdu2.redhat.com-1 | | | | ---|-------------------------------------------------------------|------------------|------------|---------------|------------------ -bash-4.2# foreman-rake console /usr/share/foreman/lib/tasks/console.rake:4: warning: already initialized constant ARGV Loading production environment (Rails 4.1.5) irb(main):001:0> host = Host.find_by(:name => "ibm-x3550m3-09.lab.eng.brq.redhat.com") => #<Host::Managed id: 10, name: "ibm-x3550m3-09.lab.eng.brq.redhat.com", last_compile: "2017-01-17 19:52:48", last_report: "2017-01-17 19:48:55", updated_at: "2017-01-17 19:52:58", created_at: "2017-01-16 14:40:04", root_pass: nil, architecture_id: 1, operatingsystem_id: 1, environment_id: 1, ptable_id: nil, medium_id: nil, build: false, comment: nil, disk: nil, installed_at: nil, model_id: 1, hostgroup_id: nil, owner_id: 1, owner_type: "User", enabled: true, puppet_ca_proxy_id: 2, managed: false, use_image: nil, image_file: nil, uuid: nil, compute_resource_id: nil, puppet_proxy_id: 2, certname: "ibm-x3550m3-09.lab.eng.brq.redhat.com", image_id: nil, organization_id: 1, location_id: 2, type: "Host::Managed", otp: nil, realm_id: nil, compute_profile_id: nil, provision_method: nil, content_source_id: nil, grub_pass: "", content_view_id: nil, lifecycle_environment_id: nil, global_status: 1, lookup_value_matcher: "fqdn=ibm-x3550m3-09.lab.eng.brq.redhat.com", discovery_rule_id: nil, openscap_proxy_id: nil> irb(main):002:0> host.subscription_facet.destroy => #<Katello::Host::SubscriptionFacet id: 20, host_id: 10, uuid: "8fc5bcb6-5b27-4c98-b887-b8a306d90994", last_checkin: "2017-01-17 19:52:57", service_level: nil, release_version: nil, autoheal: true, registered_at: "2017-01-17 19:52:50"> irb(main):003:0> host.content_facet.destroy => #<Katello::Host::ContentFacet id: 3, host_id: 10, uuid: "8fc5bcb6-5b27-4c98-b887-b8a306d90994", content_view_id: 5, lifecycle_environment_id: 1, kickstart_repository_id: nil> irb(main):004:0> host.destroy => #<Host::Managed id: 10, name: "ibm-x3550m3-09.lab.eng.brq.redhat.com", last_compile: "2017-01-17 19:52:48", last_report: "2017-01-17 19:48:55", updated_at: "2017-01-17 19:52:58", created_at: "2017-01-16 14:40:04", root_pass: nil, architecture_id: 1, operatingsystem_id: 1, environment_id: 1, ptable_id: nil, medium_id: nil, build: false, comment: nil, disk: nil, installed_at: nil, model_id: 1, hostgroup_id: nil, owner_id: 1, owner_type: "User", enabled: true, puppet_ca_proxy_id: 2, managed: false, use_image: nil, image_file: nil, uuid: nil, compute_resource_id: nil, puppet_proxy_id: 2, certname: "ibm-x3550m3-09.lab.eng.brq.redhat.com", image_id: nil, organization_id: 1, location_id: 2, type: "Host::Managed", otp: nil, realm_id: nil, compute_profile_id: nil, provision_method: nil, content_source_id: nil, grub_pass: "", content_view_id: nil, lifecycle_environment_id: nil, global_status: 1, lookup_value_matcher: "fqdn=ibm-x3550m3-09.lab.eng.brq.redhat.com", discovery_rule_id: nil, openscap_proxy_id: nil> irb(main):005:0> exit -bash-4.2# hammer -u admin -p changeme host list --organization-id 1 ---|-------------------------------------------------------------|------------------|------------|---------------|------------------ ID | NAME | OPERATING SYSTEM | HOST GROUP | IP | MAC ---|-------------------------------------------------------------|------------------|------------|---------------|------------------ 18 | cloud-qe-06.idmqe.lab.eng.bos.redhat.com | RHEL Server 7.3 | | 10.19.34.35 | 34:40:b5:8a:43:ff 13 | ibm-x3250m4-06.lab.eng.rdu2.redhat.com | RHEL Server 7.3 | | 10.8.0.71 | 40:f2:e9:32:1c:ac 17 | mgmt3.rhq.lab.eng.bos.redhat.com | RHEL Server 7.3 | | 10.16.4.13 | 00:50:45:5f:3e:6f 14 | short | RedHat 7.2 | | 172.17.0.2 | 02:42:ac:11:00:02 15 | test | RedHat 7.2 | | 172.17.0.2 | 02:42:ac:11:00:02 9 | tom-temp | | | | 7 | unused | RHEL Server 7.3 | | 10.12.211.202 | 00:50:56:ae:89:e9 3 | virt-who-bulgaria.hq.gsslab.rdu.redhat.com-1 | | | | 8 | virt-who-dhcp-8-101-249.satellite.lab.eng.rdu2.redhat.com-1 | | | | 4 | virt-who-inorbit.hq.gsslab.rdu.redhat.com-1 | | | | 5 | virt-who-ironforge.satellite.lab.eng.rdu2.redhat.com-1 | | | | 6 | virt-who-nightwing.hq.gsslab.rdu.redhat.com-1 | | | | 2 | virt-who-supermicro-2027gr-tr2-1.gsslab.rdu2.redhat.com-1 | | | | ---|-------------------------------------------------------------|------------------|------------|---------------|------------------ -bash-4.2# foreman-rake katello:clean_backend_objects The following changes will not actually be performed. Rerun with COMMIT=true to apply the changes 1 orphaned consumer id(s) found. -bash-4.2# foreman-rake katello:clean_backend_objects COMMIT=true 1 orphaned consumer id(s) found. -bash-4.2# foreman-rake katello:clean_backend_objects COMMIT=true 0 orphaned consumer id(s) found. Created attachment 1241971 [details]
still consumed subs
Jake, the content counts issue was reported in https://bugzilla.redhat.com/show_bug.cgi?id=1412486 (actually introduced as part of https://bugzilla.redhat.com/show_bug.cgi?id=1399294 ) For the 2nd issue, is your ListenOnCandlepinEvents process running properly? Justin, that'll do it! I don't know why that task keeps dropping, but with it running, the second scenario went off flawlessly. Will attach screenshots of the subscription's associations before and after running clean_backend_objects. Since the issue I saw with the first scenario is already covered in another BZ, I will mark this one as Verified in Satellite 6.2.7 Snap 2. -bash-4.2# hammer -u admin -p changeme host list --organization-id 1 ---|-------------------------------------------------------------|------------------|------------|---------------|------------------ ID | NAME | OPERATING SYSTEM | HOST GROUP | IP | MAC ---|-------------------------------------------------------------|------------------|------------|---------------|------------------ 18 | cloud-qe-06.idmqe.lab.eng.bos.redhat.com | RHEL Server 7.3 | | 10.19.34.35 | 34:40:b5:8a:43:ff 13 | ibm-x3250m4-06.lab.eng.rdu2.redhat.com | RHEL Server 7.3 | | 10.8.0.71 | 40:f2:e9:32:1c:ac 17 | mgmt3.rhq.lab.eng.bos.redhat.com | RHEL Server 7.3 | | 10.16.4.13 | 00:50:45:5f:3e:6f 14 | short | RedHat 7.2 | | 172.17.0.2 | 02:42:ac:11:00:02 15 | test | RedHat 7.2 | | 172.17.0.2 | 02:42:ac:11:00:02 9 | tom-temp | | | | 7 | unused | RHEL Server 7.3 | | 10.12.211.202 | 00:50:56:ae:89:e9 3 | virt-who-bulgaria.hq.gsslab.rdu.redhat.com-1 | | | | 8 | virt-who-dhcp-8-101-249.satellite.lab.eng.rdu2.redhat.com-1 | | | | 4 | virt-who-inorbit.hq.gsslab.rdu.redhat.com-1 | | | | 5 | virt-who-ironforge.satellite.lab.eng.rdu2.redhat.com-1 | | | | 6 | virt-who-nightwing.hq.gsslab.rdu.redhat.com-1 | | | | 2 | virt-who-supermicro-2027gr-tr2-1.gsslab.rdu2.redhat.com-1 | | | | ---|-------------------------------------------------------------|------------------|------------|---------------|------------------ -bash-4.2# foreman-rake console /usr/share/foreman/lib/tasks/console.rake:4: warning: already initialized constant ARGV Loading production environment (Rails 4.1.5) irb(main):001:0> host = Host.find_by(:name => "ibm-x3550m3-09.lab.eng.brq.redhat.com") => nil irb(main):002:0> host = Host.find_by(:name => "short") => #<Host::Managed id: 14, name: "short", last_compile: "2017-01-16 20:23:46", last_report: nil, updated_at: "2017-01-16 20:23:47", created_at: "2017-01-16 19:44:05", root_pass: nil, architecture_id: 1, operatingsystem_id: 2, environment_id: nil, ptable_id: nil, medium_id: nil, build: false, comment: nil, disk: nil, installed_at: nil, model_id: 1, hostgroup_id: nil, owner_id: 1, owner_type: "User", enabled: true, puppet_ca_proxy_id: nil, managed: false, use_image: nil, image_file: nil, uuid: nil, compute_resource_id: nil, puppet_proxy_id: nil, certname: nil, image_id: nil, organization_id: 1, location_id: 2, type: "Host::Managed", otp: nil, realm_id: nil, compute_profile_id: nil, provision_method: nil, content_source_id: nil, grub_pass: "", content_view_id: nil, lifecycle_environment_id: nil, global_status: 1, lookup_value_matcher: "fqdn=short", discovery_rule_id: nil, openscap_proxy_id: nil> irb(main):003:0> host.subscription_facet.destroy => #<Katello::Host::SubscriptionFacet id: 16, host_id: 14, uuid: "dce969ad-3bfa-4299-af3e-9b9c5ef39903", last_checkin: "2017-01-16 19:47:38", service_level: nil, release_version: nil, autoheal: true, registered_at: "2017-01-16 19:47:33"> irb(main):004:0> host.content_facet.destroy => #<Katello::Host::ContentFacet id: 7, host_id: 14, uuid: "dce969ad-3bfa-4299-af3e-9b9c5ef39903", content_view_id: 2, lifecycle_environment_id: 1, kickstart_repository_id: nil> irb(main):005:0> host.destroy => #<Host::Managed id: 14, name: "short", last_compile: "2017-01-16 20:23:46", last_report: nil, updated_at: "2017-01-16 20:23:47", created_at: "2017-01-16 19:44:05", root_pass: nil, architecture_id: 1, operatingsystem_id: 2, environment_id: nil, ptable_id: nil, medium_id: nil, build: false, comment: nil, disk: nil, installed_at: nil, model_id: 1, hostgroup_id: nil, owner_id: 1, owner_type: "User", enabled: true, puppet_ca_proxy_id: nil, managed: false, use_image: nil, image_file: nil, uuid: nil, compute_resource_id: nil, puppet_proxy_id: nil, certname: nil, image_id: nil, organization_id: 1, location_id: 2, type: "Host::Managed", otp: nil, realm_id: nil, compute_profile_id: nil, provision_method: nil, content_source_id: nil, grub_pass: "", content_view_id: nil, lifecycle_environment_id: nil, global_status: 1, lookup_value_matcher: "fqdn=short", discovery_rule_id: nil, openscap_proxy_id: nil> irb(main):006:0> exit -bash-4.2# hammer -u admin -p changeme host list --organization-id 1 ---|-------------------------------------------------------------|------------------|------------|---------------|------------------ ID | NAME | OPERATING SYSTEM | HOST GROUP | IP | MAC ---|-------------------------------------------------------------|------------------|------------|---------------|------------------ 18 | cloud-qe-06.idmqe.lab.eng.bos.redhat.com | RHEL Server 7.3 | | 10.19.34.35 | 34:40:b5:8a:43:ff 13 | ibm-x3250m4-06.lab.eng.rdu2.redhat.com | RHEL Server 7.3 | | 10.8.0.71 | 40:f2:e9:32:1c:ac 17 | mgmt3.rhq.lab.eng.bos.redhat.com | RHEL Server 7.3 | | 10.16.4.13 | 00:50:45:5f:3e:6f 15 | test | RedHat 7.2 | | 172.17.0.2 | 02:42:ac:11:00:02 9 | tom-temp | | | | 7 | unused | RHEL Server 7.3 | | 10.12.211.202 | 00:50:56:ae:89:e9 3 | virt-who-bulgaria.hq.gsslab.rdu.redhat.com-1 | | | | 8 | virt-who-dhcp-8-101-249.satellite.lab.eng.rdu2.redhat.com-1 | | | | 4 | virt-who-inorbit.hq.gsslab.rdu.redhat.com-1 | | | | 5 | virt-who-ironforge.satellite.lab.eng.rdu2.redhat.com-1 | | | | 6 | virt-who-nightwing.hq.gsslab.rdu.redhat.com-1 | | | | 2 | virt-who-supermicro-2027gr-tr2-1.gsslab.rdu2.redhat.com-1 | | | | ---|-------------------------------------------------------------|------------------|------------|---------------|------------------ -bash-4.2# foreman-rake katello:clean_backend_objects COMMIT=true 1 orphaned consumer id(s) found. Created attachment 1242252 [details]
before clean
Created attachment 1242253 [details]
after clean
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2017:0197 |