Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1904071

Summary: fluentd chunkLimitSize wrong values echoed
Product: OpenShift Container Platform Reporter: tmicheli
Component: LoggingAssignee: Sashank Agarwal <sasagarw>
Status: CLOSED ERRATA QA Contact: Anping Li <anli>
Severity: low Docs Contact:
Priority: low    
Version: 4.6.zCC: aos-bugs, michael.chalvatzis, tmicheli, vimalkum
Target Milestone: ---   
Target Release: 4.7.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard: logging-core
Fixed In Version: Doc Type: No Doc Update
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-02-24 11:22:30 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description tmicheli 2020-12-03 13:21:48 UTC
Description of problem:

When the `chunkLimitSize` for fluentd is configured according to the documentation. The wrong chunk_limit_size is shown in the logs

Version-Release number of selected component (if applicable):
4.6

How reproducible:


Steps to Reproduce:
1. Deploy cluster-logging
2. Set chunk_size_limit for fluentd
~~~~
# oc edit ClusterLogging instance
 spec:
  forwarder:
    fluentd:
      buffer:
        chunkLimitSize: 750k
~~~~
3. Verify that it is applied
~~~~
# oc extract configmap/fluentd --confirm
# grep chunk fluent.conf
~~~~

4. View logs
~~~~
# oc get pods   | grep fluent                                                                                                                                                                                                   ✭
NAME                                            READY   STATUS      RESTARTS   AGE

fluentd-4t5n7                                   1/1     Running     0          6m18s
fluentd-dkjhr                                   1/1     Running     0          8m11s
fluentd-fzcqb                                   1/1     Running     0          7m26s
fluentd-l5tr5                                   1/1     Running     0          6m58s
fluentd-pf2td                                   1/1     Running     0          7m50s
fluentd-tvjks                                   1/1     Running     0          6m42s
kibana-5db88c8cf-6w4t5                          2/2     Running     0          2d15h
# oc logs fluentd-4t5n7 | head -3                                                                                                                                                                                  ✭
Setting each total_size_limit for 2 buffers to 9621286195 bytes
Setting queued_chunks_limit_size for each buffer to 1146
Setting chunk_limit_size for each buffer to 8388608
~~~~

Actual results:
Setting each total_size_limit for 2 buffers to 9621286195 bytes
Setting queued_chunks_limit_size for each buffer to 1146
Setting chunk_limit_size for each buffer to 8388608

Expected results:
Setting each total_size_limit for 2 buffers to 9621286195 bytes
Setting queued_chunks_limit_size for each buffer to 1146
Setting chunk_limit_size for each buffer to 768000

Additional info:
* `run.sh` is still calculating it depending on the ${BUFFER_SIZE_LIMIT}` variable, which is no longer applied.

BUFFER_SIZE_LIMIT=$(echo ${BUFFER_SIZE_LIMIT:-8m} |  sed -e "s/[Kk]/*1024/g;s/[Mm]/*1024*1024/g;s/[Gg]/*1024*1024*1024/g;s/i//g" | bc)
BUFFER_QUEUE_LIMIT=$(expr $TOTAL_LIMIT_SIZE / $BUFFER_SIZE_LIMIT)
echo "Setting queued_chunks_limit_size for each buffer to $BUFFER_QUEUE_LIMIT"
export BUFFER_QUEUE_LIMIT
echo "Setting chunk_limit_size for each buffer to $BUFFER_SIZE_LIMIT"
export BUFFER_SIZE_LIMIT

Comment 2 Anping Li 2021-01-26 15:24:32 UTC
Verified on cluster-logging.5.0.0-25

Comment 5 errata-xmlrpc 2021-02-24 11:22:30 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Errata Advisory for Openshift Logging 5.0.0), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:0652