Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1264001

Summary:	JON UI fails to load metrics with the message "Cannot load metrics" while plugin container is restarting
Product:	[JBoss] JBoss Operations Network	Reporter:	bkramer <bkramer>
Component:	UI	Assignee:	Josejulio Martínez <jmartine>
Status:	CLOSED ERRATA	QA Contact:	Hayk Hovsepyan <hhovsepy>
Severity:	medium	Docs Contact:
Priority:	medium
Version:	JON 3.2.2	CC:	fbrychta, hhovsepy, jmartine, loleary, spinder
Target Milestone:	ER01	Keywords:	Triaged
Target Release:	JON 3.3.6
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2016-07-27 15:30:52 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description bkramer 2015-09-17 09:44:06 UTC

Description of problem:
This is a copy of Bugzilla: https://bugzilla.redhat.com/show_bug.cgi?id=1142318. Original bugzilla is closed with WONTFIX status. It is clear that this is an edge case but UI should not display "Cannot load metrics" message and empty metrics page which is currently the case.

The following error from the user's server.log:

************************************************
07:52:45,040 ERROR [org.rhq.enterprise.communications.command.client.ClientCommandSenderTask] (http-/0.0.0.0:7080-16) {ClientCommandSenderTask.send-failed}Failed to send command [Command: type=[remotepojo]; cmd-in-response=[false]; config=[{rhq.security-token=fVOGVTEmF+SNLHk32nOm/xn/KisSwnV6AhEyLqP5Uz3Axtru8W2aUWc5pMKH8xtLOvc=, rhq.timeout=5000, rhq.send-throttle=true}]; params=[{invocation=NameBasedInvocation[ping], targetInterfaceName=org.rhq.enterprise.communications.Ping}]]. Cause: java.util.concurrent.TimeoutException:null. Cause: java.util.concurrent.TimeoutException
07:52:55,050 ERROR [org.jboss.as.ejb3.invocation] (http-/0.0.0.0:7080-22) JBAS014134: EJB Invocation failed on component MeasurementDataManagerBean for method public abstract java.util.Set org.rhq.enterprise.server.measurement.MeasurementDataManagerRemote.findLiveData(org.rhq.core.domain.auth.Subject,int,int[]): javax.ejb.EJBException: java.lang.reflect.UndeclaredThrowableException
...
	at org.rhq.enterprise.server.measurement.MeasurementDataManagerLocal$$$view123.findLiveData(Unknown Source) [rhq-server.jar:4.9.0.JON320GA-redhat-2]
	at org.rhq.coregui.server.gwt.MeasurementDataGWTServiceImpl.findLiveData(MeasurementDataGWTServiceImpl.java:85)
...
Caused by: java.lang.reflect.UndeclaredThrowableException
	at com.sun.proxy.$Proxy5638.getRealTimeMeasurementValue(Unknown Source)
	at org.rhq.enterprise.server.measurement.MeasurementDataManagerBean.findLiveData(MeasurementDataManagerBean.java:892) [rhq-server.jar:4.9.0.JON320GA-redhat-2]
	at org.rhq.enterprise.server.measurement.MeasurementDataManagerBean.findLiveData(MeasurementDataManagerBean.java:858) [rhq-server.jar:4.9.0.JON320GA-redhat-2]
...
Caused by: java.lang.NoSuchMethodException: There is no remote POJO that can service the method invocation request. Command: Command: type=[remotepojo]; cmd-in-response=[false]; config=[{rhq.security-token=fVOGVTEmF+SNLHk32nOm/xn/KisSwnV6AhEyLqP5Uz3Axtru8W2aUWc5pMKH8xtLOvc=, rhq.send-throttle=true}]; params=[{targetInterfaceName=org.rhq.core.clientapi.agent.measurement.MeasurementAgentService, invocation=NameBasedInvocation[getRealTimeMeasurementValue]}]
...
************************************************

I tried to reproduce the same but I got the following error (but the same empty screen and "Cannot load metrics" message in the JON UI):

************************************************
10:24:34,996 ERROR [org.jboss.as.ejb3.invocation] (http-/0.0.0.0:7080-1) JBAS014134: EJB Invocation failed on component MeasurementDataManagerBean for method public abstract java.util.Set org.rhq.enterprise.server.measurement.MeasurementDataManagerRemote.findLiveData(org.rhq.core.domain.auth.Subject,int,int[]): javax.ejb.EJBException: java.lang.NullPointerException
...
	at org.rhq.enterprise.server.measurement.MeasurementDataManagerLocal$$$view122.findLiveData(Unknown Source) [rhq-server.jar:4.9.0.JON320GA-redhat-2]
	at org.rhq.coregui.server.gwt.MeasurementDataGWTServiceImpl.findLiveData(MeasurementDataGWTServiceImpl.java:85)
...
	at org.rhq.coregui.server.gwt.AbstractGWTServiceImpl.service(AbstractGWTServiceImpl.java:88)
...
	at org.rhq.helpers.rtfilter.filter.RtFilter.doFilter(RtFilter.java:125) [rhq-rtfilter-4.9.0.JON320GA.jar:4.9.0.JON320GA]
...
	at org.rhq.coregui.server.filter.CacheControlFilter.doFilter(CacheControlFilter.java:70)
...
Caused by: java.lang.NullPointerException
	at org.rhq.core.pc.measurement.MeasurementManager.getRealTimeMeasurementValue(MeasurementManager.java:463)
...
	at org.rhq.enterprise.communications.command.impl.remotepojo.server.RemotePojoInvocationCommandService.execute(RemotePojoInvocationCommandService.java:184) [rhq-enterprise-comm-4.9.0.JON320GA.jar:4.9.0.JON320GA]
...
	at org.rhq.enterprise.communications.command.server.CommandProcessor.handleIncomingInvocationRequest(CommandProcessor.java:290) [rhq-enterprise-comm-4.9.0.JON320GA.jar:4.9.0.JON320GA]
	at org.rhq.enterprise.communications.command.server.CommandProcessor.invoke(CommandProcessor.java:184) [rhq-enterprise-comm-4.9.0.JON320GA.jar:4.9.0.JON320GA]

10:24:35,005 WARN  [org.rhq.coregui.server.gwt.MeasurementDataGWTServiceImpl] (http-/0.0.0.0:7080-1) Sending exception to client: [1442481875004] : javax.ejb.EJBException: java.lang.NullPointerException
...
	at org.rhq.enterprise.server.measurement.MeasurementDataManagerLocal$$$view122.findLiveData(Unknown Source) [rhq-server.jar:4.9.0.JON320GA-redhat-2]
	at org.rhq.coregui.server.gwt.MeasurementDataGWTServiceImpl.findLiveData(MeasurementDataGWTServiceImpl.java:85) [classes:]
...
	at org.rhq.coregui.server.gwt.AbstractGWTServiceImpl.service(AbstractGWTServiceImpl.java:88) [classes:]
...
	at org.rhq.coregui.server.filter.CacheControlFilter.doFilter(CacheControlFilter.java:70) [classes:]
...
Caused by: java.lang.NullPointerException
	at org.rhq.core.pc.measurement.MeasurementManager.getRealTimeMeasurementValue(MeasurementManager.java:463)
...
	at org.rhq.enterprise.communications.command.impl.remotepojo.server.RemotePojoInvocationCommandService.execute(RemotePojoInvocationCommandService.java:184) [rhq-enterprise-comm-4.9.0.JON320GA.jar:4.9.0.JON320GA]
...
	at org.rhq.enterprise.communications.command.server.CommandProcessor.handleIncomingInvocationRequest(CommandProcessor.java:290) [rhq-enterprise-comm-4.9.0.JON320GA.jar:4.9.0.JON320GA]
	at org.rhq.enterprise.communications.command.server.CommandProcessor.invoke(CommandProcessor.java:184) [rhq-enterprise-comm-4.9.0.JON320GA.jar:4.9.0.JON320GA]
...
************************************************

Message logged in the Message Center was:

************************************************
Time :	
Thursday, September 17, 2015 10:24:35 AM UTC+1
Root Cause :	
java.lang.NullPointerException:null
Detail :	
java.lang.RuntimeException:[1442481875004] javax.ejb.EJBException:java.lang.NullPointerException -> java.lang.NullPointerException:null
--- STACK TRACE FOLLOWS ---
[1442481875004] javax.ejb.EJBException:java.lang.NullPointerException -> java.lang.NullPointerException:null
   at Unknown.Throwable_0(http://biljana.usersys.redhat.com:7080/coregui/org.rhq.coregui.CoreGUI/06E758624CCFC2583DEFD316718272D1.cache.html@22)
   at Unknown.Exception_0(http://biljana.usersys.redhat.com:7080/coregui/org.rhq.coregui.CoreGUI/06E758624CCFC2583DEFD316718272D1.cache.html@15)
   at Unknown.RuntimeException_0(http://biljana.usersys.redhat.com:7080/coregui/org.rhq.coregui.CoreGUI/06E758624CCFC2583DEFD316718272D1.cache.html@15)
   at Unknown.instantiate_32(http://biljana.usersys.redhat.com:7080/coregui/org.rhq.coregui.CoreGUI/06E758624CCFC2583DEFD316718272D1.cache.html@10)
   at Unknown.$instantiate_0(http://biljana.usersys.redhat.com:7080/coregui/org.rhq.coregui.CoreGUI/06E758624CCFC2583DEFD316718272D1.cache.html@35)
   at Unknown.$instantiate(http://biljana.usersys.redhat.com:7080/coregui/org.rhq.coregui.CoreGUI/06E758624CCFC2583DEFD316718272D1.cache.html@36)
   at Unknown.$readObject(http://biljana.usersys.redhat.com:7080/coregui/org.rhq.coregui.CoreGUI/06E758624CCFC2583DEFD316718272D1.cache.html@119)
   at Unknown.$onResponseReceived(http://biljana.usersys.redhat.com:7080/coregui/org.rhq.coregui.CoreGUI/06E758624CCFC2583DEFD316718272D1.cache.html@453)
   at Unknown.onResponseReceived_4(http://biljana.usersys.redhat.com:7080/coregui/org.rhq.coregui.CoreGUI/06E758624CCFC2583DEFD316718272D1.cache.html@31)
   at Unknown.$fireOnResponseReceived(http://biljana.usersys.redhat.com:7080/coregui/org.rhq.coregui.CoreGUI/06E758624CCFC2583DEFD316718272D1.cache.html@14)
   at Unknown.onReadyStateChange_0(http://biljana.usersys.redhat.com:7080/coregui/org.rhq.coregui.CoreGUI/06E758624CCFC2583DEFD316718272D1.cache.html@51)
   at Unknown.<anonymous>(http://biljana.usersys.redhat.com:7080/coregui/org.rhq.coregui.CoreGUI/06E758624CCFC2583DEFD316718272D1.cache.html@13)
   at Unknown.apply(http://biljana.usersys.redhat.com:7080/coregui/org.rhq.coregui.CoreGUI/06E758624CCFC2583DEFD316718272D1.cache.html@21)
   at Unknown.entry0(http://biljana.usersys.redhat.com:7080/coregui/org.rhq.coregui.CoreGUI/06E758624CCFC2583DEFD316718272D1.cache.html@16)
   at Unknown.<anonymous>(http://biljana.usersys.redhat.com:7080/coregui/org.rhq.coregui.CoreGUI/06E758624CCFC2583DEFD316718272D1.cache.html@14)
************************************************

Version-Release number of selected component (if applicable):
JON 3.2.2

How reproducible:
Sometimes

Steps to Reproduce:
1. Install and start JON 3.2.2 server
2. Schedule operation "Restart Plugin Container" on RHQ agent resource. This operation should be scheduled to be executed "Now & Repeat".
3. While above operation is executing, attempt to view metrics in JON UI

Actual results:
A blank page is shown and message "Cannot load metrics" is displayed at the top of the screen.

Expected results:
Metric page and graphs are available and message "Cannot load metric" is not shown.

Additional info:

Comment 1 Michael Burman 2015-09-17 10:57:20 UTC

Hi

I guess you meant the other Michael Burman --> miburman

Comment 5 Josejulio Martínez 2016-05-31 14:51:11 UTC

commit 8ccd6ac336b80f9ccdb54be200018d15af6bb151
Merge: a23b1a0 613f1ef
Author: Michael Burman <yak>
Date:   Tue May 31 16:19:50 2016 +0300

    Merge pull request #260 from josejulio/bugs/1264001
    
    Bug 1264001 - JON UI fails to load metrics with the message "Cannot l…

commit 613f1ef26fe3660d352b9f39defad49ec06f6c57
Author: Josejulio Martínez <jmartine>
Date:   Thu May 26 19:21:12 2016 -0500

    Bug 1264001 - JON UI fails to load metrics with the message "Cannot load metrics" while plugin container is restarting
    
     Ignores the NoSuchMethodException and returns empty result set.

Comment 7 Simeon Pinder 2016-07-07 08:22:59 UTC

Moving to ON_QA as available to test with the following build:
https://brewweb.engineering.redhat.com/brew/buildinfo?buildID=502442

Note: 	jon-server-patch-3.3.0.GA.zip maps to JON 3.3.6(jon-server-3.3.0.GA-update-06.zip)

Comment 8 Hayk Hovsepyan 2016-07-12 15:30:03 UTC

Verified on revision jon-server-3.3.0.GA-update-06.
Now it shows the metrics and does not show error message.

Comment 10 errata-xmlrpc 2016-07-27 15:30:52 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://rhn.redhat.com/errata/RHSA-2016-1519.html