Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1752852

Summary: hourly error: "ETL service aggregation to hourly tables has encountered an error."
Product: Red Hat Enterprise Virtualization Manager Reporter: Juan Orti Alcaine <jortialc>
Component: ovirt-engine-dwhAssignee: Shirly Radco <sradco>
Status: CLOSED DUPLICATE QA Contact: Lukas Svaty <lsvaty>
Severity: low Docs Contact:
Priority: high    
Version: 4.3.5CC: fdelorey, lsurette, mrhodes, mwest, Rhev-m-bugs, srevivo, tburke
Target Milestone: ovirt-4.3.7Flags: lsvaty: testing_plan_complete-
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2019-11-04 08:17:54 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Metrics RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Juan Orti Alcaine 2019-09-17 12:15:14 UTC
Description of problem:

The error "ETL service aggregation to hourly tables has encountered an error." keeps logging every hour.

#  date
Fri Aug 30 13:09:04 CEST 2019

select * from  history_configuration;
     var_name      | var_value |      var_datetime
-------------------+-----------+------------------------
 default_language  | en_US     |
 firstSync         | false     | 2017-10-14 15:31:00+02
 MinimalETLVersion | 4.3.0     |
 lastHourAggr      |           | 2019-08-30 12:00:00+02
 HourlyAggFailed   | false     |
 lastDayAggr       |           | 2019-08-29 00:00:00+02

ovirt-engine-dwhd.log:

2019-09-17 06:57:59|NyQqtI|7pd0Rm|A13nZQ|16274|OVIRT_ENGINE_DWH|SampleTimeKeepingJob|_FvEy8LzqEeCaj-T1n0SCFw|4.3|Default||end|success|60001
2019-09-17 06:57:59|Y00nw5|7pd0Rm|A13nZQ|16274|OVIRT_ENGINE_DWH|SampleTimeKeepingJob|_FvEy8LzqEeCaj-T1n0SCFw|4.3|Default||begin||
2019-09-17 06:58:11 Statistics sync ended. Duration: 11819 milliseconds 
2019-09-17 06:58:59|Y00nw5|7pd0Rm|A13nZQ|16274|OVIRT_ENGINE_DWH|SampleTimeKeepingJob|_FvEy8LzqEeCaj-T1n0SCFw|4.3|Default||end|success|60001
2019-09-17 06:58:59|BSDjI2|7pd0Rm|A13nZQ|16274|OVIRT_ENGINE_DWH|SampleTimeKeepingJob|_FvEy8LzqEeCaj-T1n0SCFw|4.3|Default||begin||
2019-09-17 06:59:10 Statistics sync ended. Duration: 11718 milliseconds 
2019-09-17 06:59:59|BSDjI2|7pd0Rm|A13nZQ|16274|OVIRT_ENGINE_DWH|SampleTimeKeepingJob|_FvEy8LzqEeCaj-T1n0SCFw|4.3|Default||end|success|60001
2019-09-17 06:59:59|bblpeD|7pd0Rm|A13nZQ|16274|OVIRT_ENGINE_DWH|SampleTimeKeepingJob|_FvEy8LzqEeCaj-T1n0SCFw|4.3|Default||begin||
2019-09-17 07:00:00|U3YczX|7pd0Rm|A13nZQ|16274|OVIRT_ENGINE_DWH|HourlyTimeKeepingJob|_Q9_uQNI6EeCOk4qSIFFDtw|4.3|Default||end|success|3576033
2019-09-17 07:00:00|f84LwU|7pd0Rm|A13nZQ|16274|OVIRT_ENGINE_DWH|HourlyTimeKeepingJob|_Q9_uQNI6EeCOk4qSIFFDtw|4.3|Default||begin||
2019-09-17 07:00:13 Statistics sync ended. Duration: 14202 milliseconds 
Exception in component tJDBCInput_3
org.postgresql.util.PSQLException: This connection has been closed.
        at org.postgresql.jdbc2.AbstractJdbc2Connection.checkClosed(AbstractJdbc2Connection.java:822)
        at org.postgresql.jdbc3.AbstractJdbc3Connection.createStatement(AbstractJdbc3Connection.java:229)
        at org.postgresql.jdbc2.AbstractJdbc2Connection.createStatement(AbstractJdbc2Connection.java:294)
        at ovirt_engine_dwh.hourlytimekeepingjob_4_3.HourlyTimeKeepingJob.tJDBCInput_3Process(HourlyTimeKeepingJob.java:1372)
        at ovirt_engine_dwh.hourlytimekeepingjob_4_3.HourlyTimeKeepingJob.tPostjob_1Process(HourlyTimeKeepingJob.java:1111)
        at ovirt_engine_dwh.hourlytimekeepingjob_4_3.HourlyTimeKeepingJob.runJobInTOS(HourlyTimeKeepingJob.java:9360)
        at ovirt_engine_dwh.hourlytimekeepingjob_4_3.HourlyTimeKeepingJob.runJob(HourlyTimeKeepingJob.java:9011)
        at ovirt_engine_dwh.parallelrun_4_3.ParallelRun.tInfiniteLoop_2Process(ParallelRun.java:3123)
        at ovirt_engine_dwh.parallelrun_4_3.ParallelRun.tJava_3Process(ParallelRun.java:2884)
        at ovirt_engine_dwh.parallelrun_4_3.ParallelRun$3.run(ParallelRun.java:5666)
2019-09-17 07:00:27|f84LwU|A13nZQ|7pd0Rm|OVIRT_ENGINE_DWH|HourlyTimeKeepingJob|Default|6|Java Exception|tJDBCInput_3|org.postgresql.util.PSQLException:This connection has been closed.|1
2019-09-17 07:00:27|f84LwU|7pd0Rm|A13nZQ|16274|OVIRT_ENGINE_DWH|HourlyTimeKeepingJob|_Q9_uQNI6EeCOk4qSIFFDtw|4.3|Default||end|success|26722
2019-09-17 07:00:27|kUwlsB|7pd0Rm|A13nZQ|16274|OVIRT_ENGINE_DWH|HourlyTimeKeepingJob|_Q9_uQNI6EeCOk4qSIFFDtw|4.3|Default||begin||
2019-09-17 07:00:27|kUwlsB|A13nZQ|7pd0Rm|OVIRT_ENGINE_DWH|HourlyTimeKeepingJob|Default|5|tWarn|tWarn_1|2019-09-17 07:00:27| ETL service aggregation to hourly tables has encountered an error. lastHourAgg value =Tue Sep 17 06:00:00 CEST 2019 and runTime = Tue Sep 17 07:00:27 CEST 2019 .Please consult the service log for more details.|42
2019-09-17 07:00:27 Aggregation to Hourly ended.
2019-09-17 07:00:59|bblpeD|7pd0Rm|A13nZQ|16274|OVIRT_ENGINE_DWH|SampleTimeKeepingJob|_FvEy8LzqEeCaj-T1n0SCFw|4.3|Default||end|success|60001
2019-09-17 07:00:59|GMsWo3|7pd0Rm|A13nZQ|16274|OVIRT_ENGINE_DWH|SampleTimeKeepingJob|_FvEy8LzqEeCaj-T1n0SCFw|4.3|Default||begin||
2019-09-17 07:01:10 Statistics sync ended. Duration: 10963 milliseconds

Version-Release number of selected component (if applicable):
ovirt-engine-4.3.5.4-0.1.el7.noarch
ovirt-engine-dwh-4.3.5-1.el7ev.noarch

How reproducible:
Hourly in this installation

Steps to Reproduce:
1.  Upgrade to 4.3.5.4 version

Actual results:
Error happening hourly

Expected results:
No errors

Additional info:
It began to appear after upgrading to 4.3.5.4

Comment 2 Juan Orti Alcaine 2019-09-17 13:14:04 UTC
Maybe related to this bug?

Bug 1673808 - ovirt-dwh prevents autovacuum from data garbage collection.

Comment 10 Sandro Bonazzola 2019-11-04 08:17:54 UTC
Closing as duplicate of bug #1730384. Fix is included in ovirt-engine-dwh-4.3.5.1

*** This bug has been marked as a duplicate of bug 1730384 ***