Bug 1845432 - [CNV&RHV] Communicatoin with CNV cluster spamming engine.log when token is expired
Summary: [CNV&RHV] Communicatoin with CNV cluster spamming engine.log when token is ex...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Enterprise Virtualization Manager
Classification: Red Hat
Component: ovirt-engine
Version: 4.4.0
Hardware: Unspecified
OS: Unspecified
medium
medium
Target Milestone: ovirt-4.4.3
: ---
Assignee: Artur Socha
QA Contact: Pavol Brilla
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-06-09 08:38 UTC by Pavol Brilla
Modified: 2020-11-24 13:09 UTC (History)
4 users (show)

Fixed In Version: rhv-4.4.3-2
Doc Type: No Doc Update
Doc Text:
Clone Of:
Environment:
Last Closed: 2020-11-24 13:09:21 UTC
oVirt Team: Infra
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHSA-2020:5179 0 None None None 2020-11-24 13:09:46 UTC
oVirt gerrit 110524 0 master MERGED cnv: prometheus failures logging improvements 2020-10-27 09:07:20 UTC
oVirt gerrit 110540 0 master MERGED cnv: PrometheusClient refactorings & unit tests 2020-10-27 09:07:20 UTC

Description Pavol Brilla 2020-06-09 08:38:46 UTC 
Description of problem:
I left env several days unattended ( token expired during that period), came back checked engine.log and I see lots of error about failed to retrieve kubevirt VMs for node

Version-Release number of selected component (if applicable):
Software Version:4.4.0.2-0.1.el8ev

How reproducible:
100

Steps to Reproduce:
1. Attach  CNV to RHV
2. Leave for couple days
3. Check engine.log - lots of errors about no ability to communicate with

Actual results:
Overflown engine.log

Expected results: 
not have new message every 1-2seconds

Additional info:
2020-06-09 10:29:37,565+02 ERROR [org.ovirt.engine.core.vdsbroker.kubevirt.PrometheusClient] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-29) [] failed to retrieve prometheus url for kubevirt provider (url = https://$(ENV):6443): UnknownHostException: $(ENV)
2020-06-09 10:29:37,565+02 ERROR [org.ovirt.engine.core.vdsbroker.kubevirt.KubevirtUtils] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-29) [] No prometheus URL provided. Statistics won't be fetched for provider 'cnv'
2020-06-09 10:29:37,574+02 ERROR [org.ovirt.engine.core.vdsbroker.kubevirt.PrometheusClient] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-5) [] failed to retrieve prometheus url for kubevirt provider (url = https://$(ENV):6443): UnknownHostException: $(ENV)
2020-06-09 10:29:37,574+02 ERROR [org.ovirt.engine.core.vdsbroker.kubevirt.KubevirtUtils] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-5) [] No prometheus URL provided. Statistics won't be fetched for provider 'cnv'
2020-06-09 10:29:37,598+02 ERROR [org.ovirt.engine.core.vdsbroker.kubevirt.PrometheusClient] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-79) [] failed to retrieve prometheus url for kubevirt provider (url = https://$(ENV):6443): UnknownHostException: $(ENV)
2020-06-09 10:29:37,598+02 ERROR [org.ovirt.engine.core.vdsbroker.kubevirt.KubevirtUtils] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-79) [] No prometheus URL provided. Statistics won't be fetched for provider 'cnv'
2020-06-09 10:29:37,612+02 ERROR [org.ovirt.engine.core.vdsbroker.kubevirt.PrometheusClient] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-36) [] failed to retrieve prometheus url for kubevirt provider (url = https://$(ENV):6443): UnknownHostException: $(ENV)
2020-06-09 10:29:37,613+02 ERROR [org.ovirt.engine.core.vdsbroker.kubevirt.KubevirtUtils] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-36) [] No prometheus URL provided. Statistics won't be fetched for provider 'cnv'
2020-06-09 10:29:37,982+02 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.kubevirt.KubevirtVmStatsRefresher] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-77) [] failed to retrieve kubevirt VMs for node talayan-pytest-z7j54-worker-bqpvn: UnknownHostException: $(ENV)
2020-06-09 10:29:37,982+02 INFO  [org.ovirt.engine.core.vdsbroker.monitoring.PollVmStatsRefresher] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-77) [] Failed to fetch vms info for host 'talayan-pytest-z7j54-worker-bqpvn'(4c95a664-4c31-43b3-9fd0-e8372436b96c) - skipping VMs monitoring.
2020-06-09 10:29:38,000+02 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.kubevirt.KubevirtVmStatsRefresher] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-46) [] failed to retrieve kubevirt VMs for node talayan-pytest-z7j54-worker-rp6lj: UnknownHostException: $(ENV)
2020-06-09 10:29:38,000+02 INFO  [org.ovirt.engine.core.vdsbroker.monitoring.PollVmStatsRefresher] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-46) [] Failed to fetch vms info for host 'talayan-pytest-z7j54-worker-rp6lj'(f8cae1b2-c32b-44d0-8e1c-022a60b22a8e) - skipping VMs monitoring.
2020-06-09 10:29:38,620+02 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.kubevirt.KubevirtVmStatsRefresher] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-35) [] failed to retrieve kubevirt VMs for node talayan-pytest-z7j54-worker-bnpcl: UnknownHostException: $(ENV)
2020-06-09 10:29:38,620+02 INFO  [org.ovirt.engine.core.vdsbroker.monitoring.PollVmStatsRefresher] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-35) [] Failed to fetch vms info for host 'talayan-pytest-z7j54-worker-bnpcl'(4126c591-964d-49eb-a2bc-21cac8f52757) - skipping VMs monitoring.
2020-06-09 10:29:38,674+02 ERROR [org.ovirt.engine.core.vdsbroker.kubevirt.PrometheusClient] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-18) [] failed to retrieve prometheus url for kubevirt provider (url = https://$(ENV):6443): UnknownHostException: $(ENV)
2020-06-09 10:29:38,674+02 ERROR [org.ovirt.engine.core.vdsbroker.kubevirt.KubevirtUtils] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-18) [] No prometheus URL provided. Statistics won't be fetched for provider 'cnv'
Comment 3 Pavol Brilla 2020-10-30 10:14:29 UTC 
Instead of spam, user can see failed token info in Events.


And engine.log will contain only: 
No prometheus URL provided. Statistics won't be fetched for provider 'rhvintegration' This error will not be logged again until connectivity is broken again after being successfully restored.

Software Version:4.4.3.8-0.1.el8ev
Comment 7 errata-xmlrpc 2020-11-24 13:09:21 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Low: Red Hat Virtualization security, bug fix, and enhancement update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2020:5179
Note You need to log in before you can comment on or make changes to this bug.