Bug 1543992

Summary: rsyslog appears to duplicate messages from journald when journald rotates its log files
Product: [Fedora] Fedora Reporter: Rich Megginson <rmeggins>
Component: rsyslogAssignee: Jiří Vymazal <jvymazal>
Status: CLOSED ERRATA QA Contact: Fedora Extras Quality Assurance <extras-qa>
Severity: high Docs Contact:
Priority: urgent    
Version: 28CC: bbreard, bleanhar, dapospis, dkopecek, jlieskov, jvymazal, lkundrak, mah.darade, nkinder, pportant, qe-baseos-security, rmeggins, rmetrich, rsroka, stwalter, tosykora, xuliu
Target Milestone: ---Keywords: Patch, Triaged
Target Release: ---   
Hardware: All   
OS: Linux   
Whiteboard:
Fixed In Version: rsyslog-8.36.0-1.fc28 rsyslog-8.36.0-1.fc27 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: 1538372 Environment:
Last Closed: 2018-07-06 16:43:09 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1538372    
Bug Blocks:    

Comment 1 Rich Megginson 2018-02-09 18:26:52 UTC
Description of problem:

    When the journal rotates only new logs from the
    previous location spot in the journal should be
    collected when the journal is re-opened.  Instead,
    it appears that certain logs are re-read and
    appear as duplicates in the rsyslog output.

Version-Release number of selected component (if applicable):

    rsyslogd 8.24.0, compiled with:
	PLATFORM:				x86_64-redhat-linux-gnu
	PLATFORM (lsb_release -d):
	FEATURE_REGEXP:				Yes
	GSSAPI Kerberos 5 support:		Yes
	FEATURE_DEBUG (debug build, slow code):	No
	32bit Atomic operations supported:	Yes
	64bit Atomic operations supported:	Yes
	memory allocator:			system default
	Runtime Instrumentation (slow code):	No
	uuid support:				Yes
	Number of Bits in RainerScript integers: 64

How reproducible:

    Fairly easily with the right logging rate for a
    journald configuration to cause the journal files
    to rotate.

Steps to Reproduce:

    1. Create unique log messages flowing through
       journal periodically
    2. Place a load on journald that will cause sufficient
       logs to be collected to cause rotation
    3. Observe the output of logs where ever rsyslog is
       directed to send them (files, or otherwise, or both)

Actual results:

    Duplicates appear in all output methods configured.

Expected results:

    No duplicates are seen in any output method.

Comment 2 Fedora End Of Life 2018-02-20 15:22:28 UTC
This bug appears to have been reported against 'rawhide' during the Fedora 28 development cycle.
Changing version to '28'.

Comment 3 Fedora Update System 2018-07-02 14:49:30 UTC
rsyslog-8.36.0-1.fc27 librelp-1.2.16-1.fc27 has been submitted as an update to Fedora 27. https://bodhi.fedoraproject.org/updates/FEDORA-2018-c136c9059a

Comment 4 Fedora Update System 2018-07-02 14:50:13 UTC
rsyslog-8.36.0-1.fc28 librelp-1.2.16-1.fc28 has been submitted as an update to Fedora 28. https://bodhi.fedoraproject.org/updates/FEDORA-2018-89f20e179a

Comment 5 Fedora Update System 2018-07-03 14:00:24 UTC
librelp-1.2.16-1.fc27, rsyslog-8.36.0-1.fc27 has been pushed to the Fedora 27 testing repository. If problems still persist, please make note of it in this bug report.
See https://fedoraproject.org/wiki/QA:Updates_Testing for
instructions on how to install test updates.
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2018-c136c9059a

Comment 6 Fedora Update System 2018-07-03 17:53:42 UTC
librelp-1.2.16-1.fc28, rsyslog-8.36.0-1.fc28 has been pushed to the Fedora 28 testing repository. If problems still persist, please make note of it in this bug report.
See https://fedoraproject.org/wiki/QA:Updates_Testing for
instructions on how to install test updates.
You can provide feedback for this update here: https://bodhi.fedoraproject.org/updates/FEDORA-2018-89f20e179a

Comment 7 Fedora Update System 2018-07-06 16:43:09 UTC
librelp-1.2.16-1.fc28, rsyslog-8.36.0-1.fc28 has been pushed to the Fedora 28 stable repository. If problems still persist, please make note of it in this bug report.

Comment 8 Fedora Update System 2018-08-08 15:32:34 UTC
librelp-1.2.16-1.fc27, rsyslog-8.36.0-1.fc27 has been pushed to the Fedora 27 stable repository. If problems still persist, please make note of it in this bug report.