Bug 1762417

Summary: [Regression] C&U data collection is broken for Azure in 5.10.12
Product: Red Hat CloudForms Management Engine Reporter: Nandini Chandra <nachandr>
Component: ProvidersAssignee: Adam Grare <agrare>
Status: CLOSED DUPLICATE QA Contact: Sudhir Mallamprabhakara <smallamp>
Severity: high Docs Contact: Red Hat CloudForms Documentation <cloudforms-docs>
Priority: unspecified    
Version: 5.10.12CC: jfrey, jhardy, obarenbo
Target Milestone: GAKeywords: Regression
Target Release: cfme-future   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2019-10-16 18:19:51 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
screen shot of automation run for Azure C&U tests for 5.10.11 none

Description Nandini Chandra 2019-10-16 17:00:53 UTC
Description of problem:
-----------------------
C&U is broken for Azure in 5.10.12.

The issue doesn't occur in 5.10.11 and 5.11.0.27.

Here's a snippet from evm.log:

[----] I, [2019-10-16T03:52:51.868934 #14530:e96f60]  INFO -- : MIQ(ManageIQ::Providers::Azure::CloudManager::Vm#just_perf_capture) [realtime] Capture for ManageIQ::Providers::Azure::CloudManager::Vm name: [nachandr-win], id: [19], start_time: [2019-10-16 00:00:00 UTC]...
[----] I, [2019-10-16T03:52:51.873815 #14530:e96f60]  INFO -- : MIQ(ManageIQ::Providers::Azure::CloudManager#with_provider_connection) Connecting through ManageIQ::Providers::Azure::CloudManager: [azure]
[----] I, [2019-10-16T03:52:54.626383 #14521:e96f60]  INFO -- : MIQ(ManageIQ::Providers::Azure::CloudManager#with_provider_connection) Connecting through ManageIQ::Providers::Azure::CloudManager: [azure]
[----] I, [2019-10-16T03:52:55.123851 #14530:e96f60]  INFO -- : MIQ(ManageIQ::Providers::Azure::CloudManager#with_provider_connection) Connecting through ManageIQ::Providers::Azure::CloudManager: [azure]
[----] I, [2019-10-16T03:52:55.536114 #3490:e96f60]  INFO -- : MIQ(ManageIQ::Providers::Azure::CloudManager#with_provider_connection) Connecting through ManageIQ::Providers::Azure::CloudManager: [azure]
[----] W, [2019-10-16T03:52:58.580312 #14521:e96f60]  WARN -- : MIQ(ManageIQ::Providers::Azure::CloudManager::MetricsCapture#perf_collect_metrics) Problem collecting metrics for nachandr-test/Automation. Region [eastus2] may not be supported.
[----] I, [2019-10-16T03:52:58.580601 #14521:e96f60]  INFO -- : Exception in realtime_block :total_time - Timings: {:capture_state=>0.0037398338317871094, :connect=>1.6689300537109375e-06, :capture_counters=>0.7431445121765137, :total_time=>7.634750843048096}
[----] E, [2019-10-16T03:52:58.582558 #14521:e96f60] ERROR -- : MIQ(MiqQueue#deliver) Message id: [24396], Error: [undefined method `[]' for true:TrueClass]
[----] E, [2019-10-16T03:52:58.582926 #14521:e96f60] ERROR -- : [NoMethodError]: undefined method `[]' for true:TrueClass  Method:[block (2 levels) in <class:LogProxy>]
[----] E, [2019-10-16T03:52:58.583127 #14521:e96f60] ERROR -- : /var/www/miq/vmdb/app/models/metric/ci_mixin/capture.rb:201:in `block in just_perf_capture'
/opt/rh/cfme-gemset/bundler/gems/cfme-gems-pending-4ccebc6545f4/lib/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store'
/opt/rh/cfme-gemset/bundler/gems/cfme-gems-pending-4ccebc6545f4/lib/gems/pending/util/extensions/miq-benchmark.rb:35:in `realtime_block'
/var/www/miq/vmdb/app/models/metric/ci_mixin/capture.rb:195:in `just_perf_capture'
/var/www/miq/vmdb/app/models/metric/ci_mixin/capture.rb:141:in `perf_capture'
/var/www/miq/vmdb/app/models/metric/ci_mixin/capture.rb:117:in `perf_capture_realtime'
/var/www/miq/vmdb/app/models/miq_queue.rb:455:in `block in dispatch_method'
/usr/share/ruby/timeout.rb:93:in `block in timeout'
/usr/share/ruby/timeout.rb:33:in `block in catch'
/usr/share/ruby/timeout.rb:33:in `catch'
/usr/share/ruby/timeout.rb:33:in `catch'
/usr/share/ruby/timeout.rb:108:in `timeout'
/var/www/miq/vmdb/app/models/miq_queue.rb:453:in `dispatch_method'
/var/www/miq/vmdb/app/models/miq_queue.rb:430:in `block in deliver'
/var/www/miq/vmdb/app/models/user.rb:275:in `with_user_group'
/var/www/miq/vmdb/app/models/miq_queue.rb:430:in `deliver'
/var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:104:in `deliver_queue_message'
/var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:137:in `deliver_message'
/var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:155:in `block in do_work'
/var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:149:in `loop'
/var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:149:in `do_work'
/var/www/miq/vmdb/app/models/miq_worker/runner.rb:329:in `block in do_work_loop'
/var/www/miq/vmdb/app/models/miq_worker/runner.rb:326:in `loop'
/var/www/miq/vmdb/app/models/miq_worker/runner.rb:326:in `do_work_loop'
/var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run'
/var/www/miq/vmdb/app/models/miq_worker/runner.rb:127:in `start'
/var/www/miq/vmdb/app/models/miq_worker/runner.rb:22:in `start_worker'
/var/www/miq/vmdb/app/models/miq_worker.rb:408:in `block in start_runner_via_fork'
/opt/rh/cfme-gemset/gems/nakayoshi_fork-0.0.4/lib/nakayoshi_fork.rb:23:in `fork'
/opt/rh/cfme-gemset/gems/nakayoshi_fork-0.0.4/lib/nakayoshi_fork.rb:23:in `fork'
/var/www/miq/vmdb/app/models/miq_worker.rb:406:in `start_runner_via_fork'
/var/www/miq/vmdb/app/models/miq_worker.rb:396:in `start_runner'
/var/www/miq/vmdb/app/models/miq_worker.rb:447:in `start'



Version-Release number of selected component (if applicable):
-------------------------------------------------------------
5.10.12


How reproducible:
----------------
Always


Steps to Reproduce:
-------------------
1.
2.
3.


Actual results:
--------------
C&U data collection is broken for Azure. 


Expected results:
-----------------
Successful C&U data collection from Azure


Additional info:
----------------

Comment 4 Adam Grare 2019-10-16 17:08:49 UTC
Hey Nandini, there were no changes to azure metrics collection between 5.10.11 and 5.10.12 (actually, there we no changes to the azure provider at all between 5.10.11 and 5.10.12):

commit efc7b57d34b34cc417fdf5782475b0348ded4afd (tag: 5.10.12.0, tag: 5.10.11.0)
Author: Adam Grare <agrare>
Date:   Thu Sep 19 15:42:38 2019 -0400

So I doubt this is a regression between 5.10.11 and 5.10.12.

Comment 5 Adam Grare 2019-10-16 17:16:30 UTC
Actually, isn't this just https://bugzilla.redhat.com/show_bug.cgi?id=1744845 but for 5.10?  There were a couple of bugs after the changes made to fix https://bugzilla.redhat.com/show_bug.cgi?id=1724415

Both https://bugzilla.redhat.com/show_bug.cgi?id=1744845 and https://bugzilla.redhat.com/show_bug.cgi?id=1747858 should be backported to 5.10.z

Comment 6 Nandini Chandra 2019-10-16 17:24:10 UTC
Adam,

I could double check, but our automation did pass on 5.10.11. I've attached a screen shot of the results from our automation run.

Comment 7 Nandini Chandra 2019-10-16 17:25:07 UTC
Created attachment 1626561 [details]
screen shot of automation run for Azure C&U tests for 5.10.11

Comment 8 Adam Grare 2019-10-16 17:28:41 UTC
I believe that is a testing environment anomaly, we had the same issue on that bz https://bugzilla.redhat.com/show_bug.cgi?id=1744845#c4
This only happens when you hit an exception during metrics collection.

Comment 9 Adam Grare 2019-10-16 18:19:51 UTC
Okay I'm going to mark this as a duplicate of https://bugzilla.redhat.com/show_bug.cgi?id=1744845 because it is the same error as that bz and the fix for that just needs to be backported to 5.10.z

*** This bug has been marked as a duplicate of bug 1744845 ***

Comment 10 Adam Grare 2019-10-16 18:21:10 UTC
Added the cfme-5.11.z? flag to https://bugzilla.redhat.com/show_bug.cgi?id=1744845 for backport