Bug 1553047

Summary: [Tracker] volume metrics data doesn't refresh when pods are deleted
Product: [Red Hat Storage] Red Hat Gluster Storage Reporter: krishnaram Karthick <kramdoss>
Component: kubernetesAssignee: Humble Chirammal <hchiramm>
Status: CLOSED CURRENTRELEASE QA Contact: krishnaram Karthick <kramdoss>
Severity: high Docs Contact:
Priority: unspecified    
Version: cns-3.9CC: akhakhar, annair, hchiramm, jarrpa, kramdoss, madam, mzywusko, pprakash, rhs-bugs, rreddy, rtalur
Target Milestone: ---   
Target Release: CNS 3.9   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-04-17 15:30:33 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1542135    
Bug Blocks: 1526415    
Attachments:
Description Flags
volume_metrics none

Description krishnaram Karthick 2018-03-08 07:02:45 UTC 
Description of problem:
When volume metrics data is collected on a glusterfs mountpoint, data collection works as expected and the change in data is captured without any issues. However, when the pod is deleted, the data is not deleted from the pod even after the refresh interval of 6 hours. 


Version-Release number of selected component (if applicable):
oc version
oc v3.9.2
kubernetes v1.9.1+a0ce1bc657
features: Basic-Auth GSSAPI Kerberos SPNEGO

Server https://dhcp46-106.lab.eng.blr.redhat.com:8443
openshift v3.9.2
kubernetes v1.9.1+a0ce1bc657

How reproducible:
Always

Steps to Reproduce:
1. create an app pod with glusterfs mountpoint
2. check whether volume metrics details are collected in prometheus
3. delete the app pod and verify if prometheus doesn't show the information about the volume anymore.

Actual results:
details about the pod is not deleted frpm volume metrics

Expected results:
details anbout the pod should get deleted

Additional info:
Comment 2 Humble Chirammal 2018-03-08 07:04:42 UTC 
This is an issue in the controller which is fixed by  https://github.com/openshift/origin/pull/18637. The mentioned fix is tracked by https://bugzilla.redhat.com/show_bug.cgi?id=1542135
Comment 16 krishnaram Karthick 2018-03-14 09:44:51 UTC 
Created attachment 1407885 [details]
volume_metrics