Created attachment 1522390 [details]
zero for container_network_tcp_usage_total

Description of problem:
Cloned from https://jira.coreos.com/browse/MON-522


See the attached picture, container_network_tcp_usage_total are all zero.
It is the same for container_network_udp_usage_total


Checked from openshift-monitoring/kubelet/1 targets, zero for container_network_tcp_usage_total and container_network_udp_usage_total from 10250/metrics/cadvisor endpoints
 

Checked from ifconfig from one node, should not be zero for container_network_tcp_usage_total and container_network_udp_usage_total

$ ifconfig
enp0s31f6: flags=4099<UP,BROADCAST,MULTICAST> mtu 1500
ether 54:e1:ad:42:76:28 txqueuelen 1000 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
device interrupt 16 memory 0xec200000-ec220000

lo: flags=73<UP,LOOPBACK,RUNNING> mtu 65536
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10<host>
loop txqueuelen 1000 (Local Loopback)
RX packets 20 bytes 1736 (1.6 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 20 bytes 1736 (1.6 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

tun0: flags=4305<UP,POINTOPOINT,RUNNING,NOARP,MULTICAST> mtu 1360
inet 10.72.12.75 netmask 255.255.252.0 destination 10.72.12.75
inet6 fe80::1a99:ca46:c252:e11c prefixlen 64 scopeid 0x20<link>
unspec 00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00 txqueuelen 100 (UNSPEC)
RX packets 34014 bytes 23390808 (22.3 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 33895 bytes 10759728 (10.2 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

virbr0: flags=4099<UP,BROADCAST,MULTICAST> mtu 1500
inet 192.168.124.1 netmask 255.255.255.0 broadcast 192.168.124.255
ether 52:54:00:4f:23:11 txqueuelen 1000 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0

wlp58s0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 192.168.1.103 netmask 255.255.255.0 broadcast 192.168.1.255
inet6 fe80::5065:3d:fad9:6b31 prefixlen 64 scopeid 0x20<link>
ether f8:59:71:49:16:c8 txqueuelen 1000 (Ethernet)
RX packets 66255 bytes 62641848 (59.7 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 44760 bytes 15410190 (14.6 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0


Version-Release number of selected component (if applicable):
quay.io/openshift/origin-configmap-reloader:latest
quay.io/openshift/origin-grafana:latest
quay.io/openshift/origin-k8s-prometheus-adapter:latest
quay.io/openshift/origin-kube-rbac-proxy:latest
quay.io/openshift/origin-kube-state-metrics:latest
quay.io/openshift/origin-oauth-proxy:latest
quay.io/openshift/origin-prom-label-proxy:latest
quay.io/openshift/origin-prometheus-alertmanager:latest
quay.io/openshift/origin-prometheus-config-reloader:latest
quay.io/openshift/origin-prometheus-node-exporter:latest
quay.io/openshift/origin-prometheus-operator:latest
quay.io/openshift/origin-prometheus:latest
quay.io/openshift/origin-telemeter:latest
registry.svc.ci.openshift.org/ocp/4.0-art-latest-2019-01-18-115403@sha256:e947243a47f297cad62cfb3c9981a3e9a73aec50152af688b2472983175938aa


How reproducible:
Always

Steps to Reproduce:
1. Check container_network_tcp_usage_total and container_network_udp_usage_total in prometheus UI
2.
3.

Actual results:
zero for container_network_tcp_usage_total and container_network_udp_usage_total

Expected results:
Should not be zero for container_network_tcp_usage_total and container_network_udp_usage_total

Additional info: