Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.
RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.

Bug 1785002

Summary: increase sizelimit in foreman tasks files
Product: Red Hat Enterprise Linux 7 Reporter: Pavel Moravec <pmoravec>
Component: sosAssignee: Jan Jansky <jjansky>
Status: CLOSED ERRATA QA Contact: Miroslav HradĂ­lek <mhradile>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 7.8CC: agk, bmr, fkrska, mhradile, plambri, pmoravec, sbradley
Target Milestone: rcKeywords: OtherQA
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: sos-3.9-2.el7 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2020-09-29 20:55:15 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1784466    

Description Pavel Moravec 2019-12-18 21:12:38 UTC
Description of problem:
TL;DR version: backport https://github.com/sosreport/sos/pull/1899 to RHEL7.

When a Satellite6 has tens or thousands of foreman tasks, the DB export can easily exceed default sizelimit of 25MB. While Sat6 shall be house-kept with less tasks, there are cases when this number is reached. Then it is worth to know e.g. what types of tasks are most often present - and 25MB of the data can be too few.


Version-Release number of selected component (if applicable):
sos-3.8


How reproducible:
100%


Steps to Reproduce:
1. Install Sat6 and generate tons of tasks
2. sosreport -o foreman --batch --build
3. wc <sos-path>/sos_commands/[dynflow|foreman]*


Actual results:
These four are the relevant that should have higher limit:

    72017   1944297  26214247 foreman_tasks_tasks
    50253     64606  26212578 dynflow_actions
    42224    204318  26213658 dynflow_execution_plans
    23647    330011  26213210 dynflow_steps


Expected results:
More than 25MB of those files (in case sufficient foreman tasks in DB).


Additional info:

Comment 5 Jan Jansky 2020-06-01 14:16:40 UTC
Hello,
thanks for the availability to test the fix. Please use below repository / package:


A yum repository for the build of sos-3.9-2.el7 (task 28860092) is available at:

http://brew-task-repos.usersys.redhat.com/repos/official/sos/3.9/2.el7/

You can install the rpms locally by putting this .repo file in your /etc/yum.repos.d/ directory:

http://brew-task-repos.usersys.redhat.com/repos/official/sos/3.9/2.el7/sos-3.9-2.el7.repo

RPMs and build logs can be found in the following locations:
http://brew-task-repos.usersys.redhat.com/repos/official/sos/3.9/2.el7/noarch/

The full list of available rpms is:
http://brew-task-repos.usersys.redhat.com/repos/official/sos/3.9/2.el7/noarch/sos-3.9-2.el7.src.rpm
http://brew-task-repos.usersys.redhat.com/repos/official/sos/3.9/2.el7/noarch/sos-3.9-2.el7.noarch.rpm

The repository will be available for the next 60 days. Scratch build output will be deleted
earlier, based on the Brew scratch build retention policy.

Comment 6 Pavel Moravec 2020-06-01 14:58:53 UTC
I can confirm this works as expected:

previously:

# rpm -q sos
sos-3.8-6.el7.noarch
# sosreport -o foreman --batch --build

sosreport (version 3.8)

..

sosreport build tree is located at : /var/tmp/sosreport-provisioning-2020-06-01-arpjgnq

# ll /var/tmp/sosreport-provisioning-2020-06-01-arpjgnq/sos_commands/foreman/dynflow_*
-rw-r--r--. 1 root root 26212723 Jun  1 16:38 /var/tmp/sosreport-provisioning-2020-06-01-arpjgnq/sos_commands/foreman/dynflow_actions
-rw-r--r--. 1 root root  4770157 Jun  1 16:37 /var/tmp/sosreport-provisioning-2020-06-01-arpjgnq/sos_commands/foreman/dynflow_execution_plans
-rw-r--r--. 1 root root       38 Jun  1 16:37 /var/tmp/sosreport-provisioning-2020-06-01-arpjgnq/sos_commands/foreman/dynflow_schema_info
-rw-r--r--. 1 root root 26213180 Jun  1 16:37 /var/tmp/sosreport-provisioning-2020-06-01-arpjgnq/sos_commands/foreman/dynflow_steps
# head -n1 /var/tmp/sosreport-provisioning-2020-06-01-arpjgnq/sos_commands/foreman/dynflow_steps
s/gems/katello-3.10.0.59/app/models/katello/concerns/user_extensions.rb:21:in `cp_config'", ..

(see the 25M limit appliead and missing CSV headers in the file - so it was tailed)


Now:

# rpm -q sos
sos-3.9-2.el7.noarch
# time sosreport -o foreman --batch --build

sosreport (version 3.9)
..
Your sosreport build tree has been generated in:
  /var/tmp/sosreport-provisioning-2020-06-01-rhlrfgk

# ll /var/tmp/sosreport-provisioning-2020-06-01-rhlrfgk/sos_commands/foreman/dynflow_*
-rw-r--r--. 1 root root 49031539 Jun  1 16:48 /var/tmp/sosreport-provisioning-2020-06-01-rhlrfgk/sos_commands/foreman/dynflow_actions
-rw-r--r--. 1 root root  4770157 Jun  1 16:48 /var/tmp/sosreport-provisioning-2020-06-01-rhlrfgk/sos_commands/foreman/dynflow_execution_plans
-rw-r--r--. 1 root root       38 Jun  1 16:48 /var/tmp/sosreport-provisioning-2020-06-01-rhlrfgk/sos_commands/foreman/dynflow_schema_info
-rw-r--r--. 1 root root       79 Jun  1 16:45 /var/tmp/sosreport-provisioning-2020-06-01-rhlrfgk/sos_commands/foreman/dynflow_sidekiq_status
-rw-r--r--. 1 root root 54360892 Jun  1 16:48 /var/tmp/sosreport-provisioning-2020-06-01-rhlrfgk/sos_commands/foreman/dynflow_steps
-rw-r--r--. 1 root root      139 Jun  1 16:45 /var/tmp/sosreport-provisioning-2020-06-01-rhlrfgk/sos_commands/foreman/dynflow_units
# head -n1 /var/tmp/sosreport-provisioning-2020-06-01-rhlrfgk/sos_commands/foreman/dynflow_steps
execution_plan_uuid,id,action_id,data,state,started_at,ended_at,real_time,execution_time,progress_done,progress_weight,class,error,action_class,children,queue
#

So much more data collected, CSV header included in head -> no tail.

Comment 9 errata-xmlrpc 2020-09-29 20:55:15 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (sos bug fix and enhancement update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2020:4034