Red Hat Satellite engineering is moving the tracking of its product development work on Satellite to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "Satellite project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs will be migrated starting at the end of May. If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "Satellite project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/SAT-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 2104339 - Failed to upgrade: ERF73-0602 [Foreman::PermissionMissingException]: some permissions were not found: ["view_puppetclasses", "view_environments", :view_environments, :view_puppetclasses] (Foreman::PermissionMissingException)
Summary: Failed to upgrade: ERF73-0602 [Foreman::PermissionMissingException]: some per...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Satellite
Classification: Red Hat
Component: Discovery Plugin
Version: 6.11.0
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: 6.11.1
Assignee: Lukas Zapletal
QA Contact: Griffin Sullivan
URL:
Whiteboard:
: 2104904 (view as bug list)
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2022-07-06 02:25 UTC by Paul Armstrong
Modified: 2024-01-08 15:56 UTC (History)
16 users (show)

Fixed In Version: tfm-rubygem-foreman_discovery-19.0.5
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2022-07-27 17:27:10 UTC
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)
foreman-installer log from failed attempt (3.90 MB, text/plain)
2022-07-06 02:25 UTC, Paul Armstrong 		no flags Details
View All


Links
System ID Private Priority Status Summary Last Updated
Foreman Issue Tracker 35188 0 High Closed Failed to upgrade: ERF73-0602 [Foreman::PermissionMissingException]: some permissions were not found: ["view_puppetclass... 2023-01-12 15:05:34 UTC
Red Hat Issue Tracker SAT-14924 0 None None None 2023-01-15 17:32:43 UTC
Red Hat Knowledge Base (Solution) 6966847 0 None None None 2022-07-07 19:20:54 UTC
Red Hat Product Errata RHBA-2022:5742 0 None None None 2022-07-27 17:27:22 UTC

Internal Links: 2105915

Description Paul Armstrong 2022-07-06 02:25:12 UTC 
Created attachment 1894797 [details]
foreman-installer log from failed attempt

Description of problem:
Upgrade from 6.10.5 to 6.11 fails with foreman restart

ERF73-0602 [Foreman::PermissionMissingException]: some permissions were not found: ["view_puppetclasses", "view_environments", :view_environments, :view_puppetclasses] (Foreman::PermissionMissingException)

Version-Release number of selected component (if applicable):
6.11

How reproducible:
always

Steps to Reproduce:
1. Run satellite upgrade procedures as per documenation on Satellite 6.10.5
2. upgrade fails at configuration step 1795
3. see below

Actual results:
Long ugly failure results.
3 sidekiq processes and 1 pulp process consume near 100% CPU
installation exits as failed

Expected results:
upgrade succeeds.

Additional info:
workaround from https://community.theforeman.org/t/foreman-upgrade-issue-from-2-5-4-to-3-0-1/26567/2 results in successful installation
Comment 1 Paul Armstrong 2022-07-06 02:26:57 UTC 
Error occurring here. Seems like we are expecting permissions that have already been removed.

2022-07-05 18:56:17 [DEBUG ] [configure] /Service[foreman]: Starting to evaluate the resource (1795 of 2306)
2022-07-05 18:56:17 [DEBUG ] [configure] Executing: '/bin/systemctl is-active -- foreman'
2022-07-05 18:56:17 [DEBUG ] [configure] Executing: '/bin/systemctl is-enabled -- foreman'
2022-07-05 18:56:17 [DEBUG ] [configure] Executing: '/bin/systemctl show --property=NeedDaemonReload -- foreman'
2022-07-05 18:56:17 [DEBUG ] [configure] Executing: '/bin/systemctl unmask -- foreman'
2022-07-05 18:56:17 [DEBUG ] [configure] Executing: '/bin/systemctl start -- foreman'
2022-07-05 18:56:35 [DEBUG ] [configure] Running journalctl command to get logs for systemd start failure: journalctl -n 50 --since '5 minutes ago' -u foreman --no-pager
2022-07-05 18:56:35 [DEBUG ] [configure] Executing: 'journalctl -n 50 --since '5 minutes ago' -u foreman --no-pager'
2022-07-05 18:56:35 [ERROR ] [configure] Systemd start for foreman failed!
2022-07-05 18:56:35 [ERROR ] [configure] journalctl log for foreman:
2022-07-05 18:56:35 [ERROR ] [configure] -- Logs begin at Mon 2022-06-27 18:10:01 EDT, end at Tue 2022-07-05 18:56:35 EDT. --
2022-07-05 18:56:35 [ERROR ] [configure] Jul 05 18:51:50 sat6.parmstrong.ca foreman[17275]: => Booting Puma
2022-07-05 18:56:35 [ERROR ] [configure] Jul 05 18:51:50 sat6.parmstrong.ca foreman[17275]: => Rails 6.0.4.7 application starting in production
2022-07-05 18:56:35 [ERROR ] [configure] Jul 05 18:51:50 sat6.parmstrong.ca foreman[17275]: => Run `rails server --help` for more startup options
2022-07-05 18:56:35 [ERROR ] [configure] Jul 05 18:52:05 sat6.parmstrong.ca foreman[17275]: Exiting
2022-07-05 18:56:35 [ERROR ] [configure] Jul 05 18:52:05 sat6.parmstrong.ca foreman[17275]: /usr/share/foreman/app/models/role.rb:336:in `permission_records': ERF73-0602 [Foreman::PermissionMissingException]: some permissions were not found: ["view_puppetclasses", "view_environments", :view_environments, :view_puppetclasses] (Foreman::PermissionMissingException)
2022-07-05 18:56:35 [ERROR ] [configure] Jul 05 18:52:05 sat6.parmstrong.ca foreman[17275]: from /usr/share/foreman/app/models/role.rb:172:in `find_for_permission_removal'
2022-07-05 18:56:35 [ERROR ] [configure] Jul 05 18:52:05 sat6.parmstrong.ca foreman[17275]: from /usr/share/foreman/app/models/role.rb:213:in `remove_permissions!'
2022-07-05 18:56:35 [ERROR ] [configure] Jul 05 18:52:05 sat6.parmstrong.ca foreman[17275]: from /usr/share/foreman/app/services/foreman/plugin/role_lock.rb:56:in `block in update_plugin_role_permissions'
Comment 4 soham 2022-07-07 12:56:20 UTC 
*** Bug 2104904 has been marked as a duplicate of this bug. ***
Comment 14 Ron Lavi 2022-07-10 09:28:58 UTC 
Created redmine issue https://projects.theforeman.org/issues/35188 from this bug
Comment 15 Leos Stejskal 2022-07-11 06:29:49 UTC 
I'll take a look at the issues and take care of them
Comment 16 Bryan Kearney 2022-07-11 12:04:50 UTC 
Moving this bug to POST for triage into Satellite since the upstream issue https://projects.theforeman.org/issues/35188 has been resolved.
Comment 17 Paul Armstrong 2022-07-13 15:12:54 UTC 
Hi All,

I wanted to update the notes. I reverted the workaround mentioned in comment 3. I implemented the one liner from the commit upstream 

https://github.com/theforeman/foreman_discovery/pull/573 

This resolved my problems and my system is now functioning normally.

Please note:
Satellite was unable to define template capsule for subnet managed by the Satellite after upgrade. Capsule automatically picked up the configuration.
Satellite stopped listening on port 8000 so provisioning failed.
These were resolved by re-running installer with:

satellite-installer --scenario=satellite --foreman-proxy-templates=true --foreman-proxy-template-url=http://sat6.parmstrong.ca:8000 --foreman-proxy-http=true

I can open separate BZs for the above as necessary.
Comment 18 Ron Lavi 2022-07-13 15:59:20 UTC 
Thanks for the clarification @Paul!
Could you open a new BZ for the second issue?
Comment 19 Paul Armstrong 2022-07-13 17:32:32 UTC 
Created BZ
Satellite upgrade fails to set template capsule for satellite managed subnet
https://bugzilla.redhat.com/show_bug.cgi?id=2106864
Comment 20 Griffin Sullivan 2022-07-18 16:05:20 UTC 
6.11 upgrades successfully with foreman discovery image and puppet plugin installed.

Steps to Reproduce:
1. On 6.10.5 install and setup discovery environment
2. Upgrade to 6.11.1

Expected Results:
Upgrade runs successfully without puppet permission errors.

Actual Results:
Upgrade runs successfully without puppet permission errors.
Comment 28 errata-xmlrpc 2022-07-27 17:27:10 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Satellite 6.11.1 Async Bug Fix Update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2022:5742
Note You need to log in before you can comment on or make changes to this bug.