Created attachment 1012276 [details] Screenshot of graphs Description of problem: When I view the "Single Host Resource Usage (Over Time) (BR2A)" report, there is no information in the network usage graph (see attached screenshot). I am benchmarking on this host so there should be some data ;-) I also see this in the event log, so there definately is traffic. 2015-Apr-08, 16:48 Host test4.netbulae.test has network interface which exceeded the defined threshold [95%] (enp7s0f0: transmit rate[96%], receive rate [0%]) Version-Release number of selected component (if applicable): 3.5.2rc3
(In reply to Netbulae from comment #0) > Created attachment 1012276 [details] > Screenshot of graphs > > Description of problem: > > When I view the "Single Host Resource Usage (Over Time) (BR2A)" report, > there is no information in the network usage graph (see attached > screenshot). > > I am benchmarking on this host so there should be some data ;-) > > I also see this in the event log, so there definately is traffic. > > 2015-Apr-08, 16:48 > > Host test4.netbulae.test has network interface which exceeded the defined > threshold [95%] (enp7s0f0: transmit rate[96%], receive rate [0%]) > > Version-Release number of selected component (if applicable): > > 3.5.2rc3 Hi, I see the screenshot is from Apr 2nd and the data you are mentioning is from Apr 8th. Can you try running "Five Most Utilized Hosts (Over Time) (BR4)" for different time periods and see if you see any data there? Also, Perhaps something was wrong in the data collection during this day. Please attach the log files, Should be at /var/log/ovirt-engine-reports/server.log
Created attachment 1020476 [details] server.log
Created attachment 1020477 [details] Quarterly screenshot Created a new screenshot of the last quarter, still no data available
Created attachment 1020478 [details] Five Most Utilized Hosts (Over Time) (BR4)
Please attach the dwh logs as well : /var/log/ovirt-engine-dwh/ Thank you.
Created attachment 1020486 [details] ovirt-engine-dwhd.log
Hi, If you go to the ovirt_engine_history db and run select * from host_hourly_history and select * from host_daily_history do you see any data?
Yes, lots of data.... only there is no column for network. I have the exact same @ two different installs. One dedicated install and one self hosted. I attached the database dump from the self hosted install select * from host_hourly_history; history_id | history_datetime | host_id | host_status | minutes_in_status | memory_usage_percent | max_memory_usage | cpu_usage_percent | max_cpu_usage | ksm_cpu_percent | max_ksm_cpu_percent | active_vms | max_active_vms | total_vms | max_total_vms | total_vms_vcpus | max_total_vms_vcpus | cpu_load | max_cpu _load | system_cpu_usage_percent | max_system_cpu_usage_percent | user_cpu_usage_percent | max_user_cpu_usage_percent | swap_used_mb | max_swap_used_mb | host_configuration_ version | ksm_shared_memory_mb | max_ksm_shared_memory_mb ------------+------------------------+--------------------------------------+-------------+-------------------+----------------------+------------------+-------------------+ ---------------+-----------------+---------------------+------------+----------------+-----------+---------------+-----------------+---------------------+----------+-------- ------+--------------------------+------------------------------+------------------------+----------------------------+--------------+------------------+-------------------- --------+----------------------+-------------------------- 967 | 2015-03-29 03:00:00+02 | fd55f6ea-e57f-4ff2-9c7b-8dd9c262042a | 1 | 60.00 | 37 | 38 | 4 | 28 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 104 | 121 | 4 | 6 | 0 | 22 | 0 | 0 | 34 | 0 | 0 ovirt_engine_history=# select * from host_daily_history; history_id | history_datetime | host_id | host_status | minutes_in_status | memory_usage_percent | max_memory_usage | cpu_usage_percent | max_c pu_usage | ksm_cpu_percent | max_ksm_cpu_percent | active_vms | max_active_vms | total_vms | max_total_vms | total_vms_vcpus | max_total_vms_vcpus | cpu_load | max_cpu_load | system_cpu_usage_percent | max_system_cpu_usage_percent | user_cpu_usage_percent | max_user_cpu_usage_percent | swap_used_mb | max_swap_used_mb | host_configuration_versio n | ksm_shared_memory_mb | max_ksm_shared_memory_mb ------------+------------------+--------------------------------------+-------------+-------------------+----------------------+------------------+-------------------+------ ---------+-----------------+---------------------+------------+----------------+-----------+---------------+-----------------+---------------------+----------+-------------- +--------------------------+------------------------------+------------------------+----------------------------+--------------+------------------+-------------------------- --+----------------------+-------------------------- 1 | 2014-09-16 | fd55f6ea-e57f-4ff2-9c7b-8dd9c262042a | 1 | 686.00 | 33 | 36 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 10 | 40 | 0 | 0 | 1 | 1 | 0 | 0 | 1 7 | 0 | 0
Created attachment 1027583 [details] ovirt engine history dump
Alona, The data that being collected from the engine regarding hosts/vms network interface rx_rate tx_rate is zero. What can be the reason for that?
Can you also provide the engine db dump ?
Is the guest agent installed on the guest?
No the guest agent isn't installed. But that shouldn't matter because the missing graph is from the host, not the VM. Like in "Five Most Utilized Hosts (Over Time) (BR4)"
(In reply to Netbulae from comment #13) > No the guest agent isn't installed. But that shouldn't matter because the > missing graph is from the host, not the VM. > > Like in "Five Most Utilized Hosts (Over Time) (BR4)" So this is a RFE to add network info to BR4? Not a bug on data not displayed in any chart?
Well not exactly. The problem is that in any HOST report there is no data for any network traffic, while there is a graph for it. Check the screenshots, I added here: https://bugzilla.redhat.com/attachment.cgi?id=1020477 https://bugzilla.redhat.com/attachment.cgi?id=1020478 Also there is no data in the database (see post above). So the question is why does memory_usage_percent have data and there is no data for network traffic. In the database there aren't even fields to put the network traffic data in....
https://wiki.icinga.org/display/howtos/Debugging+JasperServer Can you debug the report with SQL executer queries and I will be able to use your dump to check the issue with the report run?
Created attachment 1062629 [details] Now only memory graph gets displayed
Created attachment 1062630 [details] jasper debug log as requested
The report in comment #17 is not empty only has very low values (0~). Try pointing to lower part of chart and see if you get a tooltip. I need the debug log for sql executor, this is missing in the current log.
Created attachment 1064686 [details] BR2A Daily screenshot
Created attachment 1064687 [details] BR2A Monthly screenshot
No tooltip, I generated some additional load and the CPU and running VM's show up in the Daily report. But when I switch it to monthly (the same host), the graph for running VM's and CPU load is still blank. I've put the jasper server in debug mode (/var/lib/ovirt-engine-reports/ovirt-engine-reports.war/WEB-INF/log4j.properties) and restarted it. But don't know how to run the "sql executor" to generate the debug info you need. Could
Look at comment #16 section 'Setting up web interface (without restart)'.
Created attachment 1064756 [details] Jasper log DEBUG was already set, so I ran the reports again. Please find the log attached.
There is a lot of DEBUG info, but not the SQL that was run for the report. Please clear the log, set 'SQL query executor' to DEBUG and run the report. In the log you will see the select created for report\input control, please add that once you have it.
Created attachment 1066818 [details] SQL I got it now, when setting it to DEBUG the setting doesn't stick. When I navigate away from the log settings page, it gets set back to WARN. I had to set it to DEBUG and then open a different window to run the report.
(In reply to Netbulae from comment #26) > Created attachment 1066818 [details] > SQL > > I got it now, when setting it to DEBUG the setting doesn't stick. When I > navigate away from the log settings page, it gets set back to WARN. > > I had to set it to DEBUG and then open a different window to run the report. I've looked at the logs and the query. You were running report on host 'd2176e64-cb8c-4a58-a7f3-957ea8b4e7c2' yet that host doesn't exist in the dump you provided. Can you upload the db dump for which the issue happens and that correlates with the log you provided?
Created attachment 1066827 [details] new ovirt_engine_history dump Now there is another issue, there is no history after last sunday (2015-08-23)
(In reply to Netbulae from comment #28) > Created attachment 1066827 [details] > new ovirt_engine_history dump > > Now there is another issue, there is no history after last sunday > (2015-08-23) Any errors in DWH? Is it running? The attachment is not a db dump, it's a select export output.
Created attachment 1067258 [details] real dump DWH is running fine. It appears data is still incoming (from the real dump) only 'select * from host_daily_history' doesn't show it My bad, find a real dump attached.
I have found the issue and will include it in oVirt 3.5.5, thanks for your report!
Tested br2a and br10a report. While trying to create br10a report: The server has encountered an error. Please excuse the inconvenience. Error Message Error filling report [...omitting Error Trace...] Error Message net.sf.jasperreports.engine.JRException: Error executing SQL statement for : Disk_usage [...omitting Error Trace...] Error Message org.postgresql.util.PSQLException: ERROR: column "calendar.the_date" must appear in the GROUP BY clause or be used in an aggregate function Position: 7980 Error Trace [...omitting Error Trace...] While trying to create br2a report: The server has encountered an error. Please excuse the inconvenience. Error Message Error filling report Error Trace [...omitting Error Trace...] Error Message net.sf.jasperreports.engine.JRException: Error executing SQL statement for : Interfaces Error Trace [...omitting Error Trace...] Error Message org.postgresql.util.PSQLException: ERROR: column "calendar.the_date" must appear in the GROUP BY clause or be used in an aggregate function Position: 5371 Error Trace [...omitting Error Trace...] Seems to me like a change in sql broke current implementation, If you believe this is unrelevant to this fix I will open a new blocker bug. What do you think? For now moving back to ASSIGNED Will add server log of reports in attachment.
Created attachment 1079914 [details] server log of reports of br2a and br10a report
*** Bug 1243662 has been marked as a duplicate of this bug. ***
verified in rhevm-reports-3.5.5-2.el6ev.noarch
oVirt 3.5.5 has been released including fixes for this issue.