Bug 1378447 - Smart State analysis for a VM fail on timeout
Summary: Smart State analysis for a VM fail on timeout
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Red Hat CloudForms Management Engine
Classification: Red Hat
Component: SmartState Analysis
Version: 5.7.0
Hardware: Unspecified
OS: Unspecified
unspecified
urgent
Target Milestone: GA
: 5.7.0
Assignee: Satoe Imaishi
QA Contact: Satyajit Bulage
URL:
Whiteboard: smartstate:vm:appliance:build
: 1386741 1388982 1389026 1390581 (view as bug list)
Depends On:
Blocks: 1203269
TreeView+ depends on / blocked
 
Reported: 2016-09-22 12:30 UTC by Ilanit Stein
Modified: 2017-01-12 04:49 UTC (History)
16 users (show)

Fixed In Version: 5.7.0.11
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2017-01-11 19:57:19 UTC
Category: ---
Cloudforms Team: CFME Core
Target Upstream Version:


Attachments (Terms of Use)
evm.log (1.60 MB, application/x-gzip)
2016-09-23 14:18 UTC, Ilanit Stein
no flags Details
rhevm.log (357.49 KB, application/x-gzip)
2016-09-23 14:19 UTC, Ilanit Stein
no flags Details
automation.log (1.59 MB, application/x-gzip)
2016-09-23 14:20 UTC, Ilanit Stein
no flags Details

Description Ilanit Stein 2016-09-22 12:30:57 UTC
Description of problem:
Running Smart State analysis for a RHEVM-3.6 VM with NFS disk fail on timeout:

"job timed out after 3056.727610352 seconds of inactivity. Inactivity threshold [3000 seconds]"

Version-Release number of selected component (if applicable):
CFME-5.7.0.1.20160913164703_66caf07
RHEVM-3.6.8-0.1

How reproducible:
failed for 3 VM SSA trials.

Steps to Reproduce:
1.Perform all steps that should allow VM SSA
2.Try to run SSA for the VM

Actual results:
Under Settings->Tasks,
Task fail after timeout of 51 min. 

Expected results:
VM SSA should succeed.

Additional info:
For the same RHEVM-setup, VM SSA work fine.

Comment 2 Ilanit Stein 2016-09-22 12:48:30 UTC
From CFME appliance evm.log:


[----] I, [2016-09-22T08:08:43.767937 #3193:fab144]  INFO -- : EVM SmartState Analysis Initiated for VM [cfme-rhevm-5.7.0.1-1]
[----] W, [2016-09-22T08:08:43.768006 #3193:fab144]  WARN -- : User event logging is not available on [ManageIQ::Providers::Redhat::InfraManager] Name:[rhevm-36]
[----] I, [2016-09-22T08:08:43.772508 #3193:fab144]  INFO -- : MIQ(VmScan#call_scan) Enter
[----] I, [2016-09-22T08:08:43.802340 #3193:fab144]  INFO -- : MIQ(ManageIQ::Providers::Redhat::InfraManager::Vm#scan_metadata) category=[["accounts", "services", "software", "system", "vmconfig", "vmevents", "profiles"]] [Array]
[----] E, [2016-09-22T08:08:43.818152 #3193:fab144] ERROR -- : [NoMethodError]: undefined method `key?' for nil:NilClass  Method:[rescue in scan_metadata]
[----] E, [2016-09-22T08:08:43.818259 #3193:fab144] ERROR -- : /opt/rh/rh-ruby23/root/usr/share/ruby/ostruct.rb:176:in `respond_to_missing?'
/opt/rh/rh-ruby23/root/usr/share/gems/gems/psych-2.0.17/lib/psych/visitors/to_ruby.rb:381:in `respond_to?'
/opt/rh/rh-ruby23/root/usr/share/gems/gems/psych-2.0.17/lib/psych/visitors/to_ruby.rb:381:in `init_with'
/opt/rh/rh-ruby23/root/usr/share/gems/gems/psych-2.0.17/lib/psych/visitors/to_ruby.rb:374:in `revive'
/opt/rh/rh-ruby23/root/usr/share/gems/gems/psych-2.0.17/lib/psych/visitors/to_ruby.rb:208:in `visit_Psych_Nodes_Mapping'
/opt/rh/rh-ruby23/root/usr/share/gems/gems/psych-2.0.17/lib/psych/visitors/visitor.rb:16:in `visit'
/opt/rh/rh-ruby23/root/usr/share/gems/gems/psych-2.0.17/lib/psych/visitors/visitor.rb:6:in `accept'
/opt/rh/rh-ruby23/root/usr/share/gems/gems/psych-2.0.17/lib/psych/visitors/to_ruby.rb:32:in `accept'
/opt/rh/rh-ruby23/root/usr/share/gems/gems/psych-2.0.17/lib/psych/visitors/to_ruby.rb:330:in `block in register_empty'
. . .

Comment 3 Oved Ourfali 2016-09-22 12:50:59 UTC
Ilanit - does it work well for VMWare?
What about 5.6.2?

Comment 4 Moti Asayag 2016-09-22 13:00:07 UTC
Ilanit,
Please attach the evm.log to the bug.

Comment 5 Ilanit Stein 2016-09-23 14:18:14 UTC
Created attachment 1204174 [details]
evm.log

SSA in this log starts with
"EVM SmartState Analysis Initiated for VM [cfme-rhevm-5.7.0.1-1"

Comment 6 Ilanit Stein 2016-09-23 14:19:19 UTC
Created attachment 1204175 [details]
rhevm.log

Comment 7 Ilanit Stein 2016-09-23 14:20:24 UTC
Created attachment 1204189 [details]
automation.log

Comment 8 Ilanit Stein 2016-09-23 14:27:14 UTC
(In reply to Oved Ourfali from comment #3)
> Ilanit - does it work well for VMWare?
> What about 5.6.2?

Additional info:
For the same RHEVM-setup, VM SSA work fine - This is for CFME-5.6.2 (missed mentioning it in the description.

I didn't test it on VMWare.

Dave,
Do you know if VM SSA for VMWare, on CFME-5.7.0.1 work please?

Comment 10 Rich Oliveri 2016-10-28 15:33:23 UTC
This appears to be the same problem as:

https://bugzilla.redhat.com/show_bug.cgi?id=1389026
and
https://bugzilla.redhat.com/show_bug.cgi?id=1388982

Comment 11 Hui Song 2016-11-03 15:23:01 UTC
All these BZs are caused by a ruby bug: https://bugs.ruby-lang.org/issues/11884. We will prepare a solution for this.

Comment 13 Hui Song 2016-11-07 14:59:21 UTC
*** Bug 1389026 has been marked as a duplicate of this bug. ***

Comment 14 Hui Song 2016-11-07 15:01:16 UTC
*** Bug 1390581 has been marked as a duplicate of this bug. ***

Comment 15 Hui Song 2016-11-07 15:57:12 UTC
*** Bug 1386741 has been marked as a duplicate of this bug. ***

Comment 16 Hui Song 2016-11-07 15:58:09 UTC
*** Bug 1388982 has been marked as a duplicate of this bug. ***

Comment 19 Hui Song 2016-11-09 16:58:21 UTC
The issue is proved to be solved by the CFME-5.7.0.9 build. Changed STATUS into POST.

Comment 20 Hui Song 2016-11-09 19:39:41 UTC
The build doesn't have Ruby update yet. Changed status back to ON_DEV.

Comment 21 Hui Song 2016-11-11 14:46:27 UTC
Assign to Satoe for build to pack ruby of version 2.3.1.

Comment 22 Satoe Imaishi 2016-11-15 14:33:33 UTC
ruby 2.3.1 is released and will be included in today's build.

Comment 23 Satyajit Bulage 2016-11-16 08:51:13 UTC
SmartState Analysis is working fine now.

Verified Version:- 5.7.0.11-rc1.20161115160629_46cf4f1


Note You need to log in before you can comment on or make changes to this bug.