1195395 – ETL service aggregation to hourly tables is failing due to NullPointerException for specific timezones due to the way the ETL interprets the timezone

Bug 1195395 - ETL service aggregation to hourly tables is failing due to NullPointerException for specific timezones due to the way the ETL interprets the timezone

Summary: ETL service aggregation to hourly tables is failing due to NullPointerExcepti...

Keywords:
Status:	CLOSED ERRATA
Alias:	None
Product:	Red Hat Enterprise Virtualization Manager
Classification:	Red Hat
Component:	ovirt-engine-dwh
Sub Component:
Version:	3.5.0
Hardware:	Unspecified
OS:	Unspecified
Priority:	high
Severity:	high
Target Milestone:	ovirt-3.6.0-rc
Target Release:	3.6.0
Assignee:	Shirly Radco
QA Contact:	Lukas Svaty
Docs Contact:
URL:
Whiteboard:
Duplicates (1):	1222447 (view as bug list)
Depends On:	1164125
Blocks:	1222447 1228974
TreeView+	depends on / blocked

Reported:	2015-02-23 18:15 UTC by Bimal Chollera
Modified:	2019-09-12 08:15 UTC (History)
CC List:	15 users (show)
Fixed In Version:	ovirt-3.6.0-beta2
Doc Type:	Bug Fix
Doc Text:
Clone Of:
Clones:	1228974 (view as bug list)
Environment:
Last Closed:	2016-03-09 21:22:55 UTC
oVirt Team:	Infra
Target Upstream Version:

Attachments	(Terms of Use)
Add an attachment (proposed patch, testcase, etc.)

Links
System	ID	Priority	Status	Summary	Last Updated
Red Hat Knowledge Base (Solution)	1364073	None	None	None	Never
Red Hat Product Errata	RHEA-2016:0404	normal	SHIPPED_LIVE	rhevm-dwh bug fix and enhancement update	2016-03-10 01:29:45 UTC
oVirt gerrit	40234	None	None	None	Never

Description Bimal Chollera 2015-02-23 18:15:40 UTC

Description of problem:

After upgrading to RHEVM 3.5, a number of end-users have reported getting the following errors in the event log:

"ETL service aggregation to hourly tables has encountered an error. Please consult the service log for more details."

Version-Release number of selected component (if applicable):


How reproducible:

By upgrading to RHEVM 3.5


Steps to Reproduce:
1.
2.
3.

Actual results:

ETL service failing due to NPE

Expected results:

Should be able to aggregate

Additional info:

Errors in `/var/log/ovirt-engine/ovirt-engine-dwhd.log`

~~
2015-02-18 12:05:38|ETL Service Started
Exception in component tJDBCInput_1
Exception in component tJDBCInput_10
Exception in component tJDBCInput_11
Exception in component tJDBCInput_13
Exception in component tJDBCInput_2
Exception in component tJDBCInput_5
Exception in component tJDBCInput_3
Exception in component tJDBCInput_4
Exception in component tJDBCInput_9
java.lang.NullPointerException
        at ovirt_engine_dwh.aggregationtohourly_3_5.AggregationToHourly.tJDBCInput_1Process(AggregationToHourly.java:2377)
        at ovirt_engine_dwh.aggregationtohourly_3_5.AggregationToHourly$2.run(AggregationToHourly.java:25665)
java.lang.NullPointerException
        at ovirt_engine_dwh.aggregationtohourly_3_5.AggregationToHourly.tJDBCInput_11Process(AggregationToHourly.java:15308)
        at ovirt_engine_dwh.aggregationtohourly_3_5.AggregationToHourly$7.run(AggregationToHourly.java:25895)
java.lang.NullPointerException
        at ovirt_engine_dwh.aggregationtohourly_3_5.AggregationToHourly.tJDBCInput_9Process(AggregationToHourly.java:20681)
        at ovirt_engine_dwh.aggregationtohourly_3_5.AggregationToHourly$9.run(AggregationToHourly.java:25987)
java.lang.NullPointerException
        at ovirt_engine_dwh.aggregationtohourly_3_5.AggregationToHourly.tJDBCInput_13Process(AggregationToHourly.java:18186)
        at ovirt_engine_dwh.aggregationtohourly_3_5.AggregationToHourly$8.run(AggregationToHourly.java:25941)
java.lang.NullPointerException
        at ovirt_engine_dwh.aggregationtohourly_3_5.AggregationToHourly.tJDBCInput_5Process(AggregationToHourly.java:13356)
        at ovirt_engine_dwh.aggregationtohourly_3_5.AggregationToHourly$6.run(AggregationToHourly.java:25849)
java.lang.NullPointerException
        at ovirt_engine_dwh.aggregationtohourly_3_5.AggregationToHourly.tJDBCInput_4Process(AggregationToHourly.java:11256)
        at ovirt_engine_dwh.aggregationtohourly_3_5.AggregationToHourly$5.run(AggregationToHourly.java:25803)
java.lang.NullPointerException
        at ovirt_engine_dwh.aggregationtohourly_3_5.AggregationToHourly.tJDBCInput_3Process(AggregationToHourly.java:8231)
        at ovirt_engine_dwh.aggregationtohourly_3_5.AggregationToHourly$4.run(AggregationToHourly.java:25757)
java.lang.NullPointerException
        at ovirt_engine_dwh.aggregationtohourly_3_5.AggregationToHourly.tJDBCInput_2Process(AggregationToHourly.java:5968)
        at ovirt_engine_dwh.aggregationtohourly_3_5.AggregationToHourly$3.run(AggregationToHourly.java:25711)
java.lang.NullPointerException
        at ovirt_engine_dwh.aggregationtohourly_3_5.AggregationToHourly.tJDBCInput_10Process(AggregationToHourly.java:24091)
        at ovirt_engine_dwh.aggregationtohourly_3_5.AggregationToHourly$10.run(AggregationToHourly.java:26033)
2015-02-18 14:00:00|IWpxRl|R75JMm|ujbv9q|OVIRT_ENGINE_DWH|AggregationToHourly|Default|6|Java Exception|tJDBCInput_2|java.lang.NullPointerException:null|1
2015-02-18 14:00:00|IWpxRl|R75JMm|ujbv9q|OVIRT_ENGINE_DWH|AggregationToHourly|Default|6|Java Exception|tJDBCInput_9|java.lang.NullPointerException:null|1
2015-02-18 14:00:00|IWpxRl|R75JMm|ujbv9q|OVIRT_ENGINE_DWH|AggregationToHourly|Default|6|Java Exception|tJDBCInput_10|java.lang.NullPointerException:null|1
Exception in component tJDBCOutput_6
org.postgresql.util.PSQLException: ERROR: transacción abortada, las órdenes serán ignoradas hasta el fin de bloque de transacción
        at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2094)
        at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1827)
        at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:255)
        at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:508)
        at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:384)
        at org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:330)
        at ovirt_engine_dwh.aggregationtohourly_3_5.AggregationToHourly.tRowGenerator_1Process(AggregationToHourly.java:19905)
        at ovirt_engine_dwh.aggregationtohourly_3_5.AggregationToHourly.tPostjob_1Process(AggregationToHourly.java:19496)
        at ovirt_engine_dwh.aggregationtohourly_3_5.AggregationToHourly.runJobInTOS(AggregationToHourly.java:26081)
        at ovirt_engine_dwh.aggregationtohourly_3_5.AggregationToHourly.runJob(AggregationToHourly.java:25464)
        at ovirt_engine_dwh.hourlytimekeepingjob_3_5.HourlyTimeKeepingJob.tRunJob_1Process(HourlyTimeKeepingJob.java:2541)
        at ovirt_engine_dwh.hourlytimekeepingjob_3_5.HourlyTimeKeepingJob.tJDBCInput_1Process(HourlyTimeKeepingJob.java:2369)
        at ovirt_engine_dwh.hourlytimekeepingjob_3_5.HourlyTimeKeepingJob.tJDBCConnection_1Process(HourlyTimeKeepingJob.java:1822)
        at ovirt_engine_dwh.hourlytimekeepingjob_3_5.HourlyTimeKeepingJob.tJDBCConnection_2Process(HourlyTimeKeepingJob.java:1694)
        at ovirt_engine_dwh.hourlytimekeepingjob_3_5.HourlyTimeKeepingJob$2.run(HourlyTimeKeepingJob.java:6371)
2015-02-18 14:00:00|IWpxRl|R75JMm|ujbv9q|OVIRT_ENGINE_DWH|AggregationToHourly|Default|6|Java Exception|tJDBCOutput_6|org.postgresql.util.PSQLException:ERROR: transacción abortada, las órdenes serán ignoradas hasta el fin de bloque de transacción|1
Exception in component tRunJob_1
java.lang.RuntimeException: Child job running failed
~~~

Comment 9 Shirly Radco 2015-02-25 11:26:16 UTC

Please also provide pg dumps of the engine and history databases:
su -
su - postgres
/usr/bin/pg_dump -U "postgres" -F custom -f "<file>" "engine"
/usr/bin/pg_dump -U "postgres" -F custom -f "<file>" "ovirt_engine_history"

Comment 22 Shirly Radco 2015-03-01 11:50:24 UTC


*** This bug has been marked as a duplicate of bug 1164125 ***

Comment 28 Yaniv Lavi 2015-08-20 07:14:24 UTC

*** Bug 1222447 has been marked as a duplicate of this bug. ***

Comment 30 errata-xmlrpc 2016-03-09 21:22:55 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://rhn.redhat.com/errata/RHEA-2016-0404.html

Note You need to log in before you can comment on or make changes to this bug.