Bug 1390715 - Failure to collect metrics on Azure instances created from uploaded image
Summary: Failure to collect metrics on Azure instances created from uploaded image
Keywords:
Status: CLOSED WORKSFORME
Alias: None
Product: Red Hat CloudForms Management Engine
Classification: Red Hat
Component: C&U Capacity and Utilization
Version: 5.7.0
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: GA
: cfme-future
Assignee: Daniel Berger
QA Contact: Jeff Teehan
URL:
Whiteboard: azure:c&u
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2016-11-01 17:44 UTC by jritenou
Modified: 2016-12-19 12:34 UTC (History)
5 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2016-11-08 19:29:20 UTC
Category: ---
Cloudforms Team: CFME Core
Target Upstream Version:


Attachments (Terms of Use)
EVM log from local appliance - cf-metrics-test is working example instance name, jr-azuredemo is non-working example. (6.32 MB, text/plain)
2016-11-01 17:44 UTC, jritenou
no flags Details
Screenshot of "metrics" item in azure portal (208.65 KB, image/png)
2016-11-04 17:37 UTC, jritenou
no flags Details
Screenshot of VM overview for instance unable to collect metrics info in CF (192.27 KB, image/png)
2016-11-04 17:37 UTC, jritenou
no flags Details

Description jritenou 2016-11-01 17:44:32 UTC
Created attachment 1216215 [details]
EVM log from local appliance - cf-metrics-test is working example instance name, jr-azuredemo is non-working example.

Description of problem: Testing expanded Azure metrics collection in CFME 4.2 beta, I found I can get metrics info from instances created from Azure marketplace images without issue.  On VMs created from a custom/uploaded image, however, CFME fails to capture metrics data. Basic metrics logging is enabled for instance, and Azure portal shows metrics info.


Version-Release number of selected component (if applicable): 5.7.0.7.1


How reproducible:  Seems to occur with any image I have created by uploading a local disk.  I have not tried deallocating a marketplace spawned VM, converting to an image, and creating a VM from that


Steps to Reproduce:
1. Upload custom disk to Azure using Azure CLI or powershell
2. Create VM & enable basic metrics under diagnostic settings
3. Wait for CFME to gather metrics information

Actual results: 

Metrics collection fails with "no metrics were captured" for instance in evm.log

Expected results: 

Metrics data gathered & visible in UI.  


Additional info:

Comment 2 Dave Johnson 2016-11-03 15:45:13 UTC
Jeff, can you would with Nandini to try and reproduce this one please

Comment 3 Jeff Teehan 2016-11-04 16:00:52 UTC
The diagnostic section isn't relevant.  You need to have the metrics collection enabled.  If you go to your VM, about three items up from diagnostics is metrics.  Try configuring it there.  If you don't see metrics on the VM overview tab, they are not running.

Comment 4 jritenou 2016-11-04 17:35:15 UTC
I thought that the "Metrics" blade item just displayed real time monitoring data and wasn't a configuration item?  Nothing is checked there by default for instances I built from an uploaded image, or the market place.  Metrics are visible in the vm overview tab on the Azure portal for the instance in question that is failing with "no metrics were captured" in CFME.  I'm attaching a couple screenshots to confirm I am looking at the right "metrics" component in the Azure portal.

Comment 5 jritenou 2016-11-04 17:37:06 UTC
Created attachment 1217474 [details]
Screenshot of "metrics" item in azure portal

Comment 6 jritenou 2016-11-04 17:37:58 UTC
Created attachment 1217475 [details]
Screenshot of VM overview for instance unable to collect metrics info in CF

Comment 8 Jeff Teehan 2016-11-07 17:11:51 UTC
I'm doing all the C&U troubleshooting on https://10.16.7.76  I'll make sure it stays running for a while.

Comment 9 Daniel Berger 2016-11-07 17:59:33 UTC
@jritenou, Please tell us more about the private image. Is it Windows or Linux? Is this the OS Disk or did you attach it as a data disk?

What was the command that you used to upload the image? Either the powershell or CLI command?

Comment 10 Daniel Berger 2016-11-07 18:10:02 UTC
Also, is the storage account that you're uploading the image to in the same resource group and/or region as the VM?

Comment 11 Jeff Teehan 2016-11-07 19:55:32 UTC
I'm reasonably sure this doesn't have anything to do with private vs marketplace images.  Will work with DanB on the diags storage logic PR.

In the meantime, if you want to check your marketplace vm diags settings and then try to replicate those on your private image VM, maybe that will be a workaround.  It is also possible that if you change the diags storage it isn't updating.  I'm working on a new suite of test cases to track all these possibilites.

Comment 12 Jeff Teehan 2016-11-08 19:26:08 UTC
Separating the Vm storage location from the diags storage location had no effect for me.  It still works.  I'm out of ideas without seeing the authors environment.

Comment 13 Jeff Teehan 2016-11-08 19:29:20 UTC
Per informal agreement, we're going to close this as works for me.  I'm quite happy to sit in on a bluejeans call and take a look at the users environment and check for obvious issues.


Note You need to log in before you can comment on or make changes to this bug.