+++ This bug was initially created as a clone of Bug #1679863 +++ Description of problem: ======================= UI exception seen in the Hosted Engine. Version-Release number of selected component (if applicable): ============================================================ ovirt-engine-4.3.0.4-0.1.el7.noarch rhvh-4.3.0.4-0.20190220.0+1 How reproducible: ================= 2/2 Steps to Reproduce: =================== 1.Deploy the RHHI 1.6 enviornment( RHV 4.3 + RHGS 3.4.3 ) 2.Powered off the vm and restarted it 3.It failed to come up and then could see the UI exception popping up Actual results: =============== Exception seen Expected results: ================ Exception shouldn't be seen Additional info: =============== --- Additional comment from RHEL Product and Program Management on 2019-02-22 05:09:55 UTC --- This bug is automatically being proposed for RHHI-V 1.6 release at Red Hat Hyperconverged Infrastructure for Virtualization product, by setting the release flag 'rhiv‑1.6' to '?'. If this bug should be proposed for a different release, please manually change the proposed release flag. --- Additional comment from bipin on 2019-02-22 05:24:45 UTC --- UI log: ======= 2019-02-22 09:47:18,819+05 ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-219) [] Permutation name: 93F142F4D9B55F57C12620FDF860807F 2019-02-22 09:47:18,820+05 ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-219) [] Uncaught exception: com.google.gwt.event.shared.UmbrellaException: Exception caught: (TypeError) : b is undefined at java.lang.Throwable.Throwable(Throwable.java:70) [rt.jar:1.8.0_191] at java.lang.RuntimeException.RuntimeException(RuntimeException.java:32) [rt.jar:1.8.0_191] at com.google.web.bindery.event.shared.UmbrellaException.UmbrellaException(UmbrellaException.java:64) [gwt-servlet.jar:] at com.google.gwt.event.shared.UmbrellaException.UmbrellaException(UmbrellaException.java:25) [gwt-servlet.jar:] at com.google.gwt.event.shared.HandlerManager.$fireEvent(HandlerManager.java:117) [gwt-servlet.jar:] at com.google.gwt.user.client.ui.Widget.$fireEvent(Widget.java:127) [gwt-servlet.jar:] at com.google.gwt.user.client.ui.Widget.fireEvent(Widget.java:127) [gwt-servlet.jar:] at com.google.gwt.event.dom.client.DomEvent.fireNativeEvent(DomEvent.java:110) [gwt-servlet.jar:] at com.google.gwt.user.client.ui.Widget.$onBrowserEvent(Widget.java:163) [gwt-servlet.jar:] at com.google.gwt.user.client.ui.Widget.onBrowserEvent(Widget.java:163) [gwt-servlet.jar:] at com.google.gwt.user.client.DOM.dispatchEvent(DOM.java:1415) [gwt-servlet.jar:] at com.google.gwt.user.client.impl.DOMImplStandard.dispatchEvent(DOMImplStandard.java:312) [gwt-servlet.jar:] at com.google.gwt.core.client.impl.Impl.apply(Impl.java:236) [gwt-servlet.jar:] at com.google.gwt.core.client.impl.Impl.entry0(Impl.java:275) [gwt-servlet.jar:] at Unknown.Su/<(https://hostedenginesm3.lab.eng.blr.redhat.com/ovirt-engine/webadmin/?locale=en_US) at Unknown.anonymous(Unknown) Caused by: com.google.gwt.core.client.JavaScriptException: (TypeError) : b is undefined at com.google.gwt.event.shared.EventBus.$castFireEvent(EventBus.java:65) [gwt-servlet.jar:] at org.ovirt.engine.ui.uicommonweb.models.ValidationCompleteEvent.fire(ValidationCompleteEvent.java:27) at org.ovirt.engine.ui.uicommonweb.models.vms.UnitVmModel.$validate(UnitVmModel.java:2794) at org.ovirt.engine.ui.uicommonweb.models.templates.VmBaseListModel.$validateVm(VmBaseListModel.java:294) at org.ovirt.engine.ui.uicommonweb.models.vms.VmListModel.$preSavePhase3(VmListModel.java:1670) at org.ovirt.engine.ui.uicommonweb.models.vms.VmListModel.$preSavePhase2(VmListModel.java:1637) at org.ovirt.engine.ui.uicommonweb.models.vms.VmListModel.$preSave(VmListModel.java:1603) at org.ovirt.engine.ui.uicommonweb.models.vms.VmListModel.$executeCommand(VmListModel.java:2017) at org.ovirt.engine.ui.uicommonweb.models.vms.VmListModel.executeCommand(VmListModel.java:2017) at org.ovirt.engine.ui.uicommonweb.UICommand.$execute(UICommand.java:163) at org.ovirt.engine.ui.common.presenter.AbstractModelBoundPopupPresenterWidget.$lambda$4(AbstractModelBoundPopupPresenterWidget.java:306) at org.ovirt.engine.ui.common.presenter.AbstractModelBoundPopupPresenterWidget$lambda$4$Type.onClick(AbstractModelBoundPopupPresenterWidget.java:306) at com.google.gwt.event.dom.client.ClickEvent.dispatch(ClickEvent.java:55) [gwt-servlet.jar:] at com.google.gwt.event.shared.GwtEvent.dispatch(GwtEvent.java:76) [gwt-servlet.jar:] at com.google.web.bindery.event.shared.SimpleEventBus.$doFire(SimpleEventBus.java:173) [gwt-servlet.jar:]
Increasing the severity to high since this seems to be a generic exception. The exception is seen when something fails or error's out in UI. Also, if the failure is not resolved the exception keeps popping up.
I see similar exception while doing remove brick operation . Steps: ===== 1.Create a replica 3 (1*3) volume 2.Create vm's and pump IO to it. 3.Add bricks to the volume mentioned above, now its 2*3 4.Start the rebalance 5.Once the rebalance is completed,click on remove brick 6.Once the sync is completed , go to remove brick icon and click commit. 7.Click on the volume where the brick were removed, exceptions pop up. 2019-03-04 16:26:41,212+05 ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-2639) [] Permutation name: 504B4D619F980B291CB55B30720BC4CC 2019-03-04 16:26:41,212+05 ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-2639) [] Uncaught exception: com.google.gwt.core.client.JavaScriptException: (TypeError) : b is null at com.google.gwt.i18n.shared.DateTimeFormat.$format(DateTimeFormat.java:761) [gwt-servlet.jar:] at org.ovirt.engine.ui.common.widget.uicommon.tasks.StepWidget.StepWidget(StepWidget.java:59) at org.ovirt.engine.ui.common.widget.uicommon.tasks.StepWidget.$lambda$0(StepWidget.java:76) at org.ovirt.engine.ui.common.widget.uicommon.tasks.StepWidget$lambda$0$Type.accept(StepWidget.java:76) at java.util.ArrayList.$forEach(ArrayList.java:172) [rt.jar:1.8.0_191] at java.util.ArrayList.forEach(ArrayList.java:172) [rt.jar:1.8.0_191] at org.ovirt.engine.ui.common.widget.uicommon.tasks.StepWidget.StepWidget(StepWidget.java:59) at org.ovirt.engine.ui.common.widget.uicommon.tasks.StepWidget.StepWidget(StepWidget.java:55) at org.ovirt.engine.ui.common.widget.uicommon.tasks.TaskWidget.$lambda$0(TaskWidget.java:80) at org.ovirt.engine.ui.common.widget.uicommon.tasks.TaskWidget$lambda$0$Type.accept(TaskWidget.java:80) at java.util.ArrayList.$forEach(ArrayList.java:172) [rt.jar:1.8.0_191] at java.util.ArrayList.forEach(ArrayList.java:172) [rt.jar:1.8.0_191] at org.ovirt.engine.ui.common.widget.uicommon.tasks.TaskWidget.TaskWidget(TaskWidget.java:53) at org.ovirt.engine.ui.webadmin.section.main.view.overlay.TasksView.$lambda$0(TasksView.java:45) at org.ovirt.engine.ui.webadmin.section.main.view.overlay.TasksView$lambda$0$Type.accept(TasksView.java:45) at java.util.ArrayList.$forEach(ArrayList.java:172) [rt.jar:1.8.0_191] at java.util.ArrayList.forEach(ArrayList.java:172) [rt.jar:1.8.0_191] at org.ovirt.engine.ui.webadmin.section.main.view.overlay.TasksView.$updateTaskStatus(TasksView.java:41) at org.ovirt.engine.ui.webadmin.section.main.presenter.overlay.TasksPresenterWidget$1.eventRaised(TasksPresenterWidget.java:66) at org.ovirt.engine.ui.uicompat.Event.$raise(Event.java:99) at org.ovirt.engine.ui.uicommonweb.models.SearchableListModel.$setItems(SearchableListModel.java:708) at org.ovirt.engine.ui.uicommonweb.models.events.TaskListModel.$lambda$2(TaskListModel.java:218) at org.ovirt.engine.ui.uicommonweb.models.events.TaskListModel$lambda$2$Type.onSuccess(TaskListModel.java:218) at org.ovirt.engine.ui.frontend.Frontend$1.$onSuccess(Frontend.java:227) [frontend.jar:] at org.ovirt.engine.ui.frontend.Frontend$1.onSuccess(Frontend.java:227) [frontend.jar:] at org.ovirt.engine.ui.frontend.communication.OperationProcessor$1.$onSuccess(OperationProcessor.java:133) [frontend.jar:] at org.ovirt.engine.ui.frontend.communication.OperationProcessor$1.onSuccess(OperationProcessor.java:133) [frontend.jar:] at org.ovirt.engine.ui.frontend.communication.GWTRPCCommunicationProvider$5$1.$onSuccess(GWTRPCCommunicationProvider.java:270) [frontend.jar:] at org.ovirt.engine.ui.frontend.communication.GWTRPCCommunicationProvider$5$1.onSuccess(GWTRPCCommunicationProvider.java:270) [frontend.jar:] at com.google.gwt.user.client.rpc.impl.RequestCallbackAdapter.onResponseReceived(RequestCallbackAdapter.java:198) [gwt-servlet.jar:] at com.google.gwt.http.client.Request.$fireOnResponseReceived(Request.java:233) [gwt-servlet.jar:] at com.google.gwt.http.client.RequestBuilder$1.onReadyStateChange(RequestBuilder.java:409) [gwt-servlet.jar:] at Unknown.onreadystatechange<(https://hostedenginesm3.lab.eng.blr.redhat.com/ovirt-engine/webadmin/?locale=en_US#volumes) at com.google.gwt.core.client.impl.Impl.apply(Impl.java:236) [gwt-servlet.jar:] at com.google.gwt.core.client.impl.Impl.entry0(Impl.java:275) [gwt-servlet.jar:] at Unknown.Su/<(https://hostedenginesm3.lab.eng.blr.redhat.com/ovirt-engine/webadmin/?locale=en_US#volumes) at Unknown.anonymous(Unknown)
Seems like an infra item. Greg, could you take a look?
There are two unrelated NPEs. 1. StepWidget -- I'll fix. 2. something in UnitVmModel -- I need someone from virt to look, because I'm not familiar with that. @Andrej or Sharon, could one of you assist?
4.3.2 has been released a while ago, re-targeting to 4.3.3 for re-evaluation.
(In reply to Greg Sheremeta from comment #7) > There are two unrelated NPEs. > > 1. StepWidget -- I'll fix. https://gerrit.ovirt.org/98815 > 2. something in UnitVmModel -- I need someone from virt to look, because I'm > not familiar with that. @Andrej or Sharon, could one of you assist?
(In reply to Greg Sheremeta from comment #9) > > > 2. something in UnitVmModel -- I need someone from virt to look, because I'm > > not familiar with that. @Andrej or Sharon, could one of you assist? Need a similar environment for reproducing this NPE. Polina, do we you have such an environment as described in comment #0 for reproducing? In addition, @bshetty can you please send the exact VM configuration that caused that exception?
Sharon, unfortunately, our group has no such environment
@ bipin, do you have such an environment as described in comment #0 for reproducing this issue?
Hi Sharon, Right now i don't have such environment. But have seen such exceptions multiple times
Hi Bipin, can you check this verification? We have a deadline for ONQA bugs today. If you need help let us know, and we can help or take over? Thanks!
Hi Lukas, Will update the results shortly.
Moving back the bug to assigned since the exception are still seen while performing the test mentioned in comment 4. Steps: ===== 1.Create a replica 3 (1*3) volume 2.Create vm's and pump IO to it. 3.Add bricks to the volume mentioned above, now its 2*3 4.Start the rebalance 5.Once the rebalance is completed,click on remove brick 6.Once the sync is completed , go to remove brick icon and click commit. 7.Click on the volume where the brick were removed, exceptions pop up. Component version: ================= ovirt-engine-4.3.5.4-0.1.el7.noarch ovirt-web-ui-1.5.3-1.el7ev.noarch Snippet: ======== 2019-07-17 16:00:11,768+05 ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-42) [] Permutation name: ECB0017A77B1F0ABE452044584E93B7F 2019-07-17 16:00:11,769+05 ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-42) [] Uncaught exception: com.google.gwt.core.client.JavaScriptException: (TypeError) : b is null at com.google.gwt.i18n.shared.DateTimeFormat.$format(DateTimeFormat.java:761) [gwt-servlet.jar:] at org.ovirt.engine.ui.common.widget.uicommon.tasks.StepWidget.StepWidget(StepWidget.java:59) at org.ovirt.engine.ui.common.widget.uicommon.tasks.StepWidget.$lambda$0(StepWidget.java:76) at org.ovirt.engine.ui.common.widget.uicommon.tasks.StepWidget$lambda$0$Type.accept(StepWidget.java:76) at java.util.ArrayList.$forEach(ArrayList.java:172) [rt.jar:1.8.0_222-ea] at java.util.ArrayList.forEach(ArrayList.java:172) [rt.jar:1.8.0_222-ea] at org.ovirt.engine.ui.common.widget.uicommon.tasks.StepWidget.StepWidget(StepWidget.java:59) at org.ovirt.engine.ui.common.widget.uicommon.tasks.StepWidget.StepWidget(StepWidget.java:55) at org.ovirt.engine.ui.common.widget.uicommon.tasks.TaskWidget.$lambda$0(TaskWidget.java:82) at org.ovirt.engine.ui.common.widget.uicommon.tasks.TaskWidget$lambda$0$Type.accept(TaskWidget.java:82) at java.util.ArrayList.$forEach(ArrayList.java:172) [rt.jar:1.8.0_222-ea] at java.util.ArrayList.forEach(ArrayList.java:172) [rt.jar:1.8.0_222-ea] at org.ovirt.engine.ui.common.widget.uicommon.tasks.TaskWidget.TaskWidget(TaskWidget.java:55) at org.ovirt.engine.ui.webadmin.section.main.view.overlay.TasksView.$lambda$0(TasksView.java:45) at org.ovirt.engine.ui.webadmin.section.main.view.overlay.TasksView$lambda$0$Type.accept(TasksView.java:45) at java.util.ArrayList.$forEach(ArrayList.java:172) [rt.jar:1.8.0_222-ea] at java.util.ArrayList.forEach(ArrayList.java:172) [rt.jar:1.8.0_222-ea] at org.ovirt.engine.ui.webadmin.section.main.view.overlay.TasksView.$updateTaskStatus(TasksView.java:41) at org.ovirt.engine.ui.webadmin.section.main.presenter.overlay.TasksPresenterWidget$1.eventRaised(TasksPresenterWidget.java:66) at org.ovirt.engine.ui.uicompat.Event.$raise(Event.java:99) at org.ovirt.engine.ui.uicommonweb.models.SearchableListModel.$setItems(SearchableListModel.java:708) at org.ovirt.engine.ui.uicommonweb.models.events.TaskListModel.$lambda$2(TaskListModel.java:218) at org.ovirt.engine.ui.uicommonweb.models.events.TaskListModel$lambda$2$Type.onSuccess(TaskListModel.java:218) at org.ovirt.engine.ui.frontend.Frontend$1.$onSuccess(Frontend.java:227) [frontend.jar:] at org.ovirt.engine.ui.frontend.Frontend$1.onSuccess(Frontend.java:227) [frontend.jar:] at org.ovirt.engine.ui.frontend.communication.OperationProcessor$1.$onSuccess(OperationProcessor.java:133) [frontend.jar:] at org.ovirt.engine.ui.frontend.communication.OperationProcessor$1.onSuccess(OperationProcessor.java:133) [frontend.jar:] at org.ovirt.engine.ui.frontend.communication.GWTRPCCommunicationProvider$5$1.$onSuccess(GWTRPCCommunicationProvider.java:270) [frontend.jar:] at org.ovirt.engine.ui.frontend.communication.GWTRPCCommunicationProvider$5$1.onSuccess(GWTRPCCommunicationProvider.java:270) [frontend.jar:] at com.google.gwt.user.client.rpc.impl.RequestCallbackAdapter.onResponseReceived(RequestCallbackAdapter.java:198) [gwt-servlet.jar:] at com.google.gwt.http.client.Request.$fireOnResponseReceived(Request.java:233) [gwt-servlet.jar:] at com.google.gwt.http.client.RequestBuilder$1.onReadyStateChange(RequestBuilder.java:409) [gwt-servlet.jar:] at Unknown.onreadystatechange<(https://hostedenginesm3.lab.eng.blr.redhat.com/ovirt-engine/webadmin/?locale=en_US) at com.google.gwt.core.client.impl.Impl.apply(Impl.java:236) [gwt-servlet.jar:] at com.google.gwt.core.client.impl.Impl.entry0(Impl.java:275) [gwt-servlet.jar:] at Unknown.Tu/<(https://hostedenginesm3.lab.eng.blr.redhat.com/ovirt-engine/webadmin/?locale=en_US) at Unknown.anonymous(Unknown) 2019-07-17 16:00:15,692+05 ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-42) [] Permutation name: ECB0017A77B1F0ABE452044584E93B7F 2019-07-17 16:00:15,692+05 ERROR [org.ovirt.engine.ui.frontend.server.gwt.OvirtRemoteLoggingService] (default task-42) [] Uncaught exception: com.google.gwt.core.client.JavaScriptException: (TypeError) : b is null at com.google.gwt.i18n.shared.DateTimeFormat.$format(DateTimeFormat.java:761) [gwt-servlet.jar:] at org.ovirt.engine.ui.common.widget.uicommon.tasks.StepWidget.StepWidget(StepWidget.java:59) at org.ovirt.engine.ui.common.widget.uicommon.tasks.StepWidget.$lambda$0(StepWidget.java:76) at org.ovirt.engine.ui.common.widget.uicommon.tasks.StepWidget$lambda$0$Type.accept(StepWidget.java:76) at java.util.ArrayList.$forEach(ArrayList.java:172) [rt.jar:1.8.0_222-ea] at java.util.ArrayList.forEach(ArrayList.java:172) [rt.jar:1.8.0_222-ea] at org.ovirt.engine.ui.common.widget.uicommon.tasks.StepWidget.StepWidget(StepWidget.java:59) at org.ovirt.engine.ui.common.widget.uicommon.tasks.StepWidget.StepWidget(StepWidget.java:55) at org.ovirt.engine.ui.common.widget.uicommon.tasks.TaskWidget.$lambda$0(TaskWidget.java:82) at org.ovirt.engine.ui.common.widget.uicommon.tasks.TaskWidget$lambda$0$Type.accept(TaskWidget.java:82) at java.util.ArrayList.$forEach(ArrayList.java:172) [rt.jar:1.8.0_222-ea] at java.util.ArrayList.forEach(ArrayList.java:172) [rt.jar:1.8.0_222-ea] at org.ovirt.engine.ui.common.widget.uicommon.tasks.TaskWidget.TaskWidget(TaskWidget.java:55) at org.ovirt.engine.ui.webadmin.section.main.view.overlay.TasksView.$lambda$0(TasksView.java:45) at org.ovirt.engine.ui.webadmin.section.main.view.overlay.TasksView$lambda$0$Type.accept(TasksView.java:45) at java.util.ArrayList.$forEach(ArrayList.java:172) [rt.jar:1.8.0_222-ea] at java.util.ArrayList.forEach(ArrayList.java:172) [rt.jar:1.8.0_222-ea] at org.ovirt.engine.ui.webadmin.section.main.view.overlay.TasksView.$updateTaskStatus(TasksView.java:41) at org.ovirt.engine.ui.webadmin.section.main.presenter.overlay.TasksPresenterWidget$1.eventRaised(TasksPresenterWidget.java:66) at org.ovirt.engine.ui.uicompat.Event.$raise(Event.java:99) at org.ovirt.engine.ui.uicommonweb.models.SearchableListModel.$setItems(SearchableListModel.java:708) at org.ovirt.engine.ui.uicommonweb.models.events.TaskListModel.$lambda$0(TaskListModel.java:33) at org.ovirt.engine.ui.uicommonweb.models.events.TaskListModel$lambda$0$Type.onSuccess(TaskListModel.java:33) at org.ovirt.engine.ui.frontend.Frontend$1.$onSuccess(Frontend.java:227) [frontend.jar:] at org.ovirt.engine.ui.frontend.Frontend$1.onSuccess(Frontend.java:227) [frontend.jar:] at org.ovirt.engine.ui.frontend.communication.OperationProcessor$1.$onSuccess(OperationProcessor.java:133) [frontend.jar:] at org.ovirt.engine.ui.frontend.communication.OperationProcessor$1.onSuccess(OperationProcessor.java:133) [frontend.jar:] at org.ovirt.engine.ui.frontend.communication.GWTRPCCommunicationProvider$5$1.$onSuccess(GWTRPCCommunicationProvider.java:270) [frontend.jar:] at org.ovirt.engine.ui.frontend.communication.GWTRPCCommunicationProvider$5$1.onSuccess(GWTRPCCommunicationProvider.java:270) [frontend.jar:] at com.google.gwt.user.client.rpc.impl.RequestCallbackAdapter.onResponseReceived(RequestCallbackAdapter.java:198) [gwt-servlet.jar:] at com.google.gwt.http.client.Request.$fireOnResponseReceived(Request.java:233) [gwt-servlet.jar:] at com.google.gwt.http.client.RequestBuilder$1.onReadyStateChange(RequestBuilder.java:409) [gwt-servlet.jar:] at Unknown.onreadystatechange<(https://hostedenginesm3.lab.eng.blr.redhat.com/ovirt-engine/webadmin/?locale=en_US) at com.google.gwt.core.client.impl.Impl.apply(Impl.java:236) [gwt-servlet.jar:] at com.google.gwt.core.client.impl.Impl.entry0(Impl.java:275) [gwt-servlet.jar:] at Unknown.Tu/<(https://hostedenginesm3.lab.eng.blr.redhat.com/ovirt-engine/webadmin/?locale=en_US) at Unknown.anonymous(Unknown)
(In reply to Greg Sheremeta from comment #9) > > There are two unrelated NPEs. > > > > 1. StepWidget -- I'll fix. > > https://gerrit.ovirt.org/98815 I back-ported the patch: https://gerrit.ovirt.org/#/c/101870/, so now the NPE seen in comment #16 should be fixed. > > > > 2. something in UnitVmModel -- I need someone from virt to look, because I'm > > not familiar with that. @Andrej or Sharon, could one of you assist? This NPE seems to be fixed, since I can't see him reproduced in current logs.
Tested with ovirt-engine-4.3.6.3-0.1.el7.noarch. The issue is not seen now. Tested the below: ================ 1.Create a replica 3 (1*3) volume 2.Create vm's and pump IO to it. 3.Add bricks to the volume mentioned above, now its 2*3 4.Start the rebalance 5.Once the rebalance is completed,click on remove brick 6.Once the sync is completed , go to remove brick icon and click commit. 7.No exceptions seen which clicking on the volume Based on the above results marking the bug as verified.
This bugzilla is included in oVirt 4.3.6 release, published on September 26th 2019. Since the problem described in this bug report should be resolved in oVirt 4.3.6 release, it has been closed with a resolution of CURRENT RELEASE. If the solution does not work for you, please open a new bug report.