Bug 1373402

Summary: [RFE] journalctl cleanup in RHEV-H hypervisors
Product: Red Hat Enterprise Virtualization Manager Reporter: Shivraj <shipatil>
Component: rhev-hypervisorAssignee: Douglas Schilling Landgraf <dougsland>
Status: CLOSED NOTABUG QA Contact: Wei Wang <weiwang>
Severity: high Docs Contact:
Priority: medium    
Version: 3.6.8CC: cshao, dguo, dougsland, fdeutsch, gklein, huzhao, jiawu, leiwang, lsurette, mgoldboi, pstehlik, rbarry, shipatil, srevivo, weiwang, yaniwang, ycui, ykaul, yzhao
Target Milestone: ovirt-3.6.11Keywords: FutureFeature
Target Release: ---   
Hardware: All   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2017-01-02 16:48:30 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Node RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Shivraj 2016-09-06 08:04:30 UTC
Description of problem:
In RHEV-H 7.2 hypervisors '/var/log/journal'  directory grows very big and not cleaned up in a similar way like logrotate does.

Version-Release number of selected component (if applicable):
rhevm-3.6.8
Red Hat Enterprise Virtualization Hypervisor release 7.2 (20160711.0.el7ev)

How reproducible:


Steps to Reproduce:
1. Install/ Upgrade to rhevm-3.6.8
2. Install the RHEV-H hypervisor
3. 

Actual results:

'/var/log/journal'  directory grows very big

Expected results:

'/var/log/journal'  directory should be cleaned up

Comment 8 Shivraj 2016-10-10 17:08:37 UTC
Hi Douglas,

I have communicated given workaround to the customer  and waiting for results.

FYI customer used systemctl vaccum command to free the space.

//
Shivraj

Comment 11 Wei Wang 2016-10-20 06:45:22 UTC
I retest with rhevh-7.2-20160711.0.el7ev, the bug can be reproduced.

Steps:
1. Install the RHEV-H hypervisor
2. Register RHEV-H to RHEVM

Result:
The size of journal files grown up from 16M to 24M after one day

So QE can reproduce this bug.

Comment 12 Douglas Schilling Landgraf 2016-10-20 13:45:49 UTC
(In reply to weiwang from comment #11)
> I retest with rhevh-7.2-20160711.0.el7ev, the bug can be reproduced.
> 
> Steps:
> 1. Install the RHEV-H hypervisor
> 2. Register RHEV-H to RHEVM
> 
> Result:
> The size of journal files grown up from 16M to 24M after one day
> 
> So QE can reproduce this bug.

do you have the output of du -sh /var/log ?
We have the bz#1380596 which is affecting log rotation of vdsm, might contributing here too.

Thanks!

Comment 13 cshao 2016-10-21 05:45:56 UTC
Hi weiwang,

This is rfe bug, so can you reproduce this issue on RHVH 40 build as well?

Thanks.

Comment 14 Wei Wang 2016-10-21 05:50:03 UTC
(In reply to Douglas Schilling Landgraf from comment #12)
> (In reply to weiwang from comment #11)
> > I retest with rhevh-7.2-20160711.0.el7ev, the bug can be reproduced.
> > 
> > Steps:
> > 1. Install the RHEV-H hypervisor
> > 2. Register RHEV-H to RHEVM
> > 
> > Result:
> > The size of journal files grown up from 16M to 24M after one day
> > 
> > So QE can reproduce this bug.
> 
> do you have the output of du -sh /var/log ?
> We have the bz#1380596 which is affecting log rotation of vdsm, might
> contributing here too.
> 
> Thanks!

The output of du -sh /var/log today is as below:
[root@dhcp-8-149 ~]# du -sh /var/log
40M	/var/log

Comment 15 Wei Wang 2016-10-27 08:41:22 UTC
I will give RHVH 40 result later since we need to do test runs recently.

Comment 16 Wei Wang 2016-10-31 09:50:57 UTC
I retest with redhat-virtualization-host-4.0-20161027.1, the bug can be reproduced.

Steps:
1. Install the RHEV-H hypervisor
2. Register RHEV-H to RHEVM
3. After half day, check with command: du -sh /var/log

Result:
The size of journal files grown up from 2.5M to 8.9M

Comment 17 Fabian Deutsch 2016-12-20 10:28:06 UTC
The journal logs are not managed by cron, but rather by journald itself.

Configuration can be used to set the desired size or time limits:
https://www.freedesktop.org/software/systemd/man/journald.conf.html

Is this solution sufficient?

Comment 18 Shivraj 2016-12-29 12:52:27 UTC
Hi Fabian,

I have already communicated this settings to customer and it is sufficient.

Comment 19 Fabian Deutsch 2017-01-02 16:48:30 UTC
Closing accThanks.

Closing this bug according to comment 18.

NOTABUG, because RHVH behaves just like RHEL.