Description of problem:

collectd is running on RHV-H, metrics-store shows hosts but does not show any VM data.

Initially collectd was failing, due to BZ 1717954 - this was resolved by reinstalling the host and removing /etc/collectd.d/libvirt.conf and restarting collectd. 

Following this collectd is running but with errors [1].

Version-Release number of selected component (if applicable):

rhvm-4.3.4.3-0.1


Actual results:
VM data is not visible in metrics-store

Expected results:
VM data should be in metrics-store

Additional info:
[1]
~~~
* collectd.service - Collectd statistics daemon
   Loaded: loaded (/usr/lib/systemd/system/collectd.service; enabled; vendor preset: disabled)
   Active: active (running) since Tue 2019-07-16 17:29:47 EDT; 5 days ago
     Docs: man:collectd(1)
           man:collectd.conf(5)
 Main PID: 70410 (collectd)
    Tasks: 11
   CGroup: /system.slice/collectd.service
           `-70410 /usr/sbin/collectd

Jul 20 10:42:07 04.removed.local collectd[70410]: read_file_contents: Reading file "/proc/85976/stat" failed.
Jul 20 15:13:47 04.removed.local collectd[70410]: read_file_contents: Reading file "/proc/54125/stat" failed.
Jul 20 20:28:17 04.removed.local collectd[70410]: read_file_contents: Reading file "/proc/41493/stat" failed.
Jul 20 22:35:07 04.removed.local collectd[70410]: read_file_contents: Reading file "/proc/970/stat" failed.
Jul 20 23:16:47 04.removed.local collectd[70410]: read_file_contents: Reading file "/proc/16790/stat" failed.
Jul 21 07:47:17 04.removed.local collectd[70410]: read_file_contents: Reading file "/proc/45178/stat" failed.
Jul 21 15:19:07 04.removed.local collectd[70410]: read_file_contents: Reading file "/proc/18713/stat" failed.
Jul 21 22:04:07 04.removed.local collectd[70410]: read_file_contents: Reading file "/proc/52281/stat" failed.
Jul 22 04:35:07 04.removed.local collectd[70410]: read_file_contents: Reading file "/proc/52740/stat" failed.
Jul 22 08:07:37 04.removed.local collectd[70410]: read_file_contents: Reading file "/proc/51040/stat" failed.
~~~


~~~
* collectd.service - Collectd statistics daemon
   Loaded: loaded (/usr/lib/systemd/system/collectd.service; enabled; vendor preset: disabled)
   Active: active (running) since Tue 2019-07-16 17:29:40 EDT; 5 days ago
     Docs: man:collectd(1)
           man:collectd.conf(5)
 Main PID: 80231 (collectd)
    Tasks: 11
   CGroup: /system.slice/collectd.service
           `-80231 /usr/sbin/collectd

Jul 16 17:29:40 02.removed.local collectd[80231]: plugin_load: plugin "aggregation" successfully loaded.
Jul 16 17:29:40 02.removed.local collectd[80231]: plugin_load: plugin "processes" successfully loaded.
Jul 16 17:29:40 02.removed.local collectd[80231]: plugin_load: plugin "write_syslog" successfully loaded.
Jul 16 17:29:40 02.removed.local collectd[80231]: write_syslog plugin: Invalid configuration option: MessageFormat.
Jul 16 17:29:40 02.removed.local collectd[80231]: Systemd detected, trying to signal readyness.
Jul 16 17:29:40 02.removed.local systemd[1]: Started Collectd statistics daemon.
Jul 16 17:29:40 02.removed.local collectd[80231]: virt plugin: reader virt-0 initialized
Jul 16 17:29:40 02.removed.local collectd[80231]: Initialization complete, entering read-loop.
Jul 20 11:37:40 02.removed.local collectd[80231]: write_syslog plugin: send failed with status 32 (Broken pipe)
Jul 20 11:37:40 02.removed.local collectd[80231]: write_syslog plugin: error with wr_send_message
~~~


~~~
* collectd.service - Collectd statistics daemon
   Loaded: loaded (/usr/lib/systemd/system/collectd.service; enabled; vendor preset: disabled)
   Active: active (running) since Tue 2019-07-16 17:30:25 EDT; 5 days ago
     Docs: man:collectd(1)
           man:collectd.conf(5)
 Main PID: 84138 (collectd)
    Tasks: 11
   CGroup: /system.slice/collectd.service
           `-84138 /usr/sbin/collectd

Jul 22 06:01:27 05.removed.local collectd[84138]: getting the disk params count: Domain not found: no domain with matching uuid 'e5bfe9f9-bca9-45aa-b17f-57fc8dc77b90' (removed)
Jul 22 06:01:27 05.removed.local collectd[84138]: virt plugin: lv_domain_block_info failed
Jul 22 06:01:27 05.removed.local collectd[84138]: virt failed to get stats for block device (vda) in domain removed
Jul 22 06:01:27 05.removed.local collectd[84138]: libvirt: QEMU Driver error : Domain not found: no domain with matching uuid 'e5bfe9f9-bca9-45aa-b17f-57fc8dc77b90' (removed)
Jul 22 06:01:27 05.removed.local collectd[84138]: getting the disk params count: Domain not found: no domain with matching uuid 'e5bfe9f9-bca9-45aa-b17f-57fc8dc77b90' (removed)
Jul 22 06:01:27 05.removed.local collectd[84138]: virt plugin: lv_domain_block_info failed
Jul 22 06:01:27 05.removed.local collectd[84138]: virt failed to get stats for block device (vdb) in domain removed
Jul 22 06:01:27 05.removed.local collectd[84138]: libvirt: QEMU Driver error : Domain not found: no domain with matching uuid 'e5bfe9f9-bca9-45aa-b17f-57fc8dc77b90' (removed)
Jul 22 06:01:27 05.removed.local collectd[84138]: virt plugin: virDomainInterfaceStats failed
Jul 22 06:01:27 05.removed.local collectd[84138]: virt failed to get interface stats for device (vnet1) in domain removed
~~~