Bug 1324557

Summary: [nightly 4.0] after restart of engine sometimes we got FileNotFoundException
Product: [oVirt] ovirt-engine Reporter: Kobi Hakimi <khakimi>
Component: Frontend.CoreAssignee: Alexander Wels <awels>
Status: CLOSED CURRENTRELEASE QA Contact: Jiri Belka <jbelka>
Severity: high Docs Contact:
Priority: unspecified    
Version: 4.0.0CC: awels, bugs, didi, gshereme, khakimi, masayag, mperina, oourfali, rnori, sradco
Target Milestone: ovirt-4.0.0-rcKeywords: Regression
Target Release: 4.0.0Flags: rule-engine: ovirt-4.0.0+
rule-engine: blocker+
rule-engine: planning_ack+
rule-engine: devel_ack+
pstehlik: testing_ack+
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2016-07-05 08:00:32 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: UX RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Attachments:
Description Flags
server.log file
none
engine.log file none

Description Kobi Hakimi 2016-04-06 15:43:32 UTC
Created attachment 1144249 [details]
server.log file

Description of problem:
after restart of engine sometimes we got FileNotFoundException

Version-Release number of selected component (if applicable):
 oVirt Engine Version: 4.0.0-0.0.master.20160403161629.gita1dcde8.el7.centos 

How reproducible:
50%

Steps to Reproduce:
1. Restart engine

Actual results:
got the error:
2016-04-05 10:55:21,630 ERROR [io.undertow.request] (default task-5) UT005023: Exception handling request to /ovirt-engine/: org.apache.jasper.JasperException: java.io.FileNotFoundException: no such file: /var/lib/ovirt-engine/jboss_runtime/tmp/engine.ear.welcome.war/org/apache/jsp/tag/meta/obrand/obrand/favicon_tag.class

as you can see in the attached file

Expected results:


Additional info:

Comment 1 Kobi Hakimi 2016-04-06 15:46:26 UTC
Created attachment 1144250 [details]
engine.log file

Comment 2 Oved Ourfali 2016-04-07 05:57:36 UTC
Do we even have jasper in 4.0?
Shirly?

Comment 3 Shirly Radco 2016-04-07 06:35:48 UTC
(In reply to Oved Ourfali from comment #2)
> Do we even have jasper in 4.0?
> Shirly?

Not at this point.

Comment 4 Oved Ourfali 2016-04-07 06:39:39 UTC
(In reply to Shirly Radco from comment #3)
> (In reply to Oved Ourfali from comment #2)
> > Do we even have jasper in 4.0?
> > Shirly?
> 
> Not at this point.

So I guess you need to check why we still see that.
Perhaps an integration issue.
CC-ing also Didi.

Comment 5 Yedidyah Bar David 2016-04-07 19:50:14 UTC
Checked the attached logs and can't see anything suspicious. Please attach setup logs.

Comment 6 Greg Sheremeta 2016-04-12 14:07:29 UTC
I think this is Jasper == the JSP compiler engine. Not Jasper Reports.

"Jasper is Tomcat's JSP Engine." https://en.wikipedia.org/wiki/Apache_Tomcat

So, not related to reports.

Comment 7 Yedidyah Bar David 2016-04-12 14:15:46 UTC
http://www.catb.org/jargon/html/T/TLA.html

Comment 8 Red Hat Bugzilla Rules Engine 2016-04-12 18:05:54 UTC
This bug report has Keywords: Regression or TestBlocker.
Since no regressions or test blockers are allowed between releases, it is also being identified as a blocker for this release. Please resolve ASAP.

Comment 9 Kobi Hakimi 2016-04-13 08:24:18 UTC
After talking with didi the need info is not relevant

Comment 10 Sandro Bonazzola 2016-05-02 10:06:42 UTC
Moving from 4.0 alpha to 4.0 beta since 4.0 alpha has been already released and bug is not ON_QA.

Comment 11 Yaniv Lavi 2016-05-23 13:21:29 UTC
oVirt 4.0 beta has been released, moving to RC milestone.

Comment 12 Yaniv Lavi 2016-05-23 13:24:26 UTC
oVirt 4.0 beta has been released, moving to RC milestone.

Comment 13 Martin Perina 2016-05-26 14:43:51 UTC
Ravi, could you please try to investigate?

Comment 14 Moti Asayag 2016-05-29 10:39:58 UTC
Adding some more information:

By looking at the exception from the log [1] - the expected path for the welcome page classes to appear is:
 
/var/lib/ovirt-engine/jboss_runtime/tmp/engine.ear.welcome.war/

However, the actual folder is (due to branding patch ?):
/var/lib/ovirt-engine/jboss_runtime/tmp/rhev.ear.rhev.war/

but there seems not to be any files under that folder.

[1] 2016-05-27 10:51:32,482 ERROR [org.apache.jasper.compiler] (default task-6) JBWEB005032: Compiler error: java.io.FileNotFoundException: /var/lib/ovirt-engine/jboss_runtime/tmp/engine.ear.welcome.war/org/apache/jsp/tag/meta/obrand/obrand/messages_tag.class (No such file or directory)

Comment 15 Oved Ourfali 2016-05-29 10:44:46 UTC
Alexander - thoughts?

Comment 16 Alexander Wels 2016-05-31 15:31:44 UTC
The branding package does install a rhev.ear/war which includes its own branding.jar. Could it be that depending on the order in which stuff is started the boot loader gets one or the other (branding.jar is what contains the tags).

I get a feeling we are not properly isolating the branding.jar from the rhev.ear/war. And that could be interfering with the one from the welcome page application. Let me investigate a little, might have to pull in Juan to give us some answers.

Comment 17 Alexander Wels 2016-05-31 15:49:30 UTC
So comparing the applications, I think this might be another one of those symlinks in jboss issues where jboss doesn't follow symlinks unless specified. I am going to create a new build of rhevm-branding that tells jboss to follow symlinks and lets see if that helps.

Comment 18 Martin Perina 2016-06-02 14:06:06 UTC
We were not able to reproduce the issue, but Alex posted a patch to rhevm-branding, which helped to fix similar issue in the past. So I'm changing bug status to MODIFIED.

Comment 19 Jiri Belka 2016-06-22 15:50:36 UTC
ok, rhevm-4.0.0.6-0.1.el7ev.noarch

i don't see such error with above version

Comment 20 Sandro Bonazzola 2016-07-05 08:00:32 UTC
oVirt 4.0.0 has been released, closing current release.