Bug 1649886

Summary: Network->Providers fails to refresh RHV Provider Network Manager with error
Product: Red Hat CloudForms Management Engine Reporter: Kedar Kulkarni <kkulkarn>
Component: ProvidersAssignee: Boriso <bodnopoz>
Status: CLOSED CURRENTRELEASE QA Contact: Angelina Vasileva <anikifor>
Severity: high Docs Contact: Red Hat CloudForms Documentation <cloudforms-docs>
Priority: high    
Version: 5.10.0CC: alkaplan, anikifor, bmidwood, bodnopoz, dholler, dmetzger, gekis, hkataria, hroy, jfrey, jhardy, jprause, kkulkarn, lavenel, maufart, mduarted, mperina, mpovolny, mshriver, obarenbo, pkliczew, sigbjorn, simaishi, tpapaioa
Target Milestone: GAKeywords: AutomationBlocker, TestOnly, ZStream
Target Release: 5.11.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: 5.11.0.5 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of:
: 1669023 (view as bug list) Environment:
Last Closed: 2019-12-13 15:16:20 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: Openstack Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1669023, 1692488, 1704905    
Attachments:
Description Flags
Screenshot
none
Screenshot none

Description Kedar Kulkarni 2018-11-14 17:19:58 UTC
Created attachment 1505746 [details]
Screenshot

Description of problem:
I added RHV provider to CFME, then I navigated to Network - > Providers, and in its status it shows error : "Unable to obtain a collection: 'security_groups' in a service: 'neutron' through API. Please, fix your OpenStack installation and Run Refresh again"

Version-Release number of selected component (if applicable):
5.10.0.20

How reproducible:
Believe 100%

Steps to Reproduce:
1.Add RHV provider in CFME Infrastructure Providers
2.Navigate to Network->Providers
3.Select RHV Network Provider and refresh it
4.Check last refresh status

Actual results:
Error as described above

Expected results:
Should not error, as RHV provider is not OpenStack provider, it should not complain about neutron.

Additional info:

Comment 3 Kedar Kulkarni 2018-11-14 17:41:46 UTC
Note: I could see it on 5.10.0.23 as well.

Comment 4 Alona Kaplan 2018-12-03 13:57:20 UTC
Hi Boris,

Is this same bug as the one we found - ovn-provider stopped supporting "limit" parameter?

Comment 5 Boriso 2018-12-04 05:22:53 UTC
I do not think so, the limit issue did not cause an error - it just did not get the right data.

Comment 6 Alona Kaplan 2018-12-04 07:19:49 UTC
Hi Kedar,

I couldn't reproduce the error.

Boris fixed some bugs in the network provider refresh.
Can you please check if the bug is still reproduced with the latest nightly build?

If you manage to reproduce the error, please attach the evm.log and the ovirt-provider-ovn.log.

Comment 7 Martin Perina 2018-12-10 08:50:11 UTC
Hi Kedar, any progress with reproduction on latest version?

Comment 8 Kedar Kulkarni 2018-12-13 21:00:31 UTC
Created attachment 1514227 [details]
Screenshot

I was able to reproduce it on 5.10.0.29.

Comment 9 Martin Perina 2018-12-19 08:13:52 UTC
(In reply to Kedar Kulkarni from comment #8)
> Created attachment 1514227 [details]
> Screenshot
> 
> I was able to reproduce it on 5.10.0.29.

Alona, could you please take a look?

Comment 10 Alona Kaplan 2018-12-20 07:46:23 UTC
Hi Kedar,

Please attach the evm.log and the ovirt-provider-ovn.log

Comment 11 Alona Kaplan 2018-12-20 07:47:47 UTC
(In reply to Alona Kaplan from comment #10)
> Hi Kedar,
> 
> Please attach the evm.log and the ovirt-provider-ovn.log

The ovirt-provider-ovn.log should be in DEBUG level.

Comment 12 Martin Perina 2019-01-04 13:42:01 UTC
(In reply to Alona Kaplan from comment #11)
> (In reply to Alona Kaplan from comment #10)
> > Hi Kedar,
> > 
> > Please attach the evm.log and the ovirt-provider-ovn.log
> 
> The ovirt-provider-ovn.log should be in DEBUG level.

Hi Kedar,

could you please attach requested logs?

Thanks

Martin

Comment 14 Piotr Kliczewski 2019-02-08 14:09:21 UTC
This BZ seems to be duplicate of BZ #1661874

Comment 15 Martin Perina 2019-02-08 17:27:22 UTC
*** Bug 1661874 has been marked as a duplicate of this bug. ***

Comment 19 Dominik Holler 2019-05-02 07:11:05 UTC
Is this a duplicate of https://github.com/ManageIQ/manageiq/issues/18457 ?

Comment 20 Miguel Duarte Barroso 2019-05-03 08:47:43 UTC
(replying to Dominik Holler, comment#19)
> Is this a duplicate of https://github.com/ManageIQ/manageiq/issues/18457 ?

I think so, but cannot say for sure, since there aren't attached logs, and thus I can't check the ovirt-provider-ovn version nor ovirt engine version.

Comment 21 Boriso 2019-05-05 14:15:34 UTC
It looks exactly like the same error...
#<Excon::Error::InternalServerError: Expected(200) <=> Actual(500 InternalServerError)
excon.error.response
  :body          => "{\n  \"error\": {\n    \"message\": \"Port_Group\",\n    \"code\": 500,\n    \"title\": \"Internal Server Error\"\n  }\n}\n"
  :cookies       => [
  ]
  :headers       => {
    "Connection"   => "close"
    "Content-Type" => "application/json"
    "Date"         => "Thu, 02 May 2019 12:23:49 GMT"
    "Server"       => "BaseHTTP/0.3 Python/2.7.5"
  }
  :host          => "env-rhv42-01-mgr.cfme2.lab.eng.rdu2.redhat.com"
  :local_address => "10.35.1.93"
  :local_port    => 41238
  :path          => "/v2.0/security-groups"
  :port          => 9696
  :reason_phrase => "Internal Server Error"
  :remote_ip     => "10.8.197.37"
  :status        => 500
  :status_line   => "HTTP/1.0 500 Internal Server Error\r\n"
>

Comment 22 Dominik Holler 2019-05-06 14:34:49 UTC
Would it be possible to unblock the CloudForms NetworkManager for ovirt-provider-ovn of RHV 4.2, even if /v2.0/security-groups returns 500?

Comment 23 Martin Perina 2019-05-07 14:27:06 UTC
Marku, as mentioned in the email, would it be possible to fix that issue in CFME OpenStack Provider?

Comment 24 Marek Aufart 2019-05-09 07:36:21 UTC
Hi, from OpenStack side, we do require security groups query in refresh. I don't think it makes sense ignore network security groups in OpenStack provider.

If RHV cannot respond to security groups query with at least empty response, I'd suggest make a temporary skip in ovirt provider (or we could add a switch to settings or somewhere which would keep current behaviour in OpenStack provider and allow ovirt provider skip these failures, but OpenStack provider doesn't seem to me as a right place).

Comment 25 Dominik Holler 2019-05-09 07:39:52 UTC
(In reply to Marek Aufart from comment #24)
> Hi, from OpenStack side, we do require security groups query in refresh. I
> don't think it makes sense ignore network security groups in OpenStack
> provider.
> 
> If RHV cannot respond to security groups query with at least empty response,

Please note that only the most recent releases of RHV 4.2.x are affected.
The behavior of old RHV 4.2.x and RHV 4.3 is like expected.

> I'd suggest make a temporary skip in ovirt provider (or we could add a
> switch to settings or somewhere which would keep current behaviour in
> OpenStack provider and allow ovirt provider skip these failures, but
> OpenStack provider doesn't seem to me as a right place).

Comment 29 CFME Bot 2019-05-17 02:41:41 UTC
New commit detected on ManageIQ/manageiq-providers-ovirt/master:

https://github.com/ManageIQ/manageiq-providers-ovirt/commit/9aecec67ac09448c8a4edb683cad0c60316d66f6
commit 9aecec67ac09448c8a4edb683cad0c60316d66f6
Author:     Adam Grare <agrare>
AuthorDate: Wed May 15 09:01:09 2019 -0400
Commit:     Adam Grare <agrare>
CommitDate: Wed May 15 09:01:09 2019 -0400

    Don't collect security groups in rhev refresh

    Skip collection of security groups in the network manager refresh.

    Fixes https://bugzilla.redhat.com/show_bug.cgi?id=1649886

 app/models/manageiq/providers/redhat/inventory/collector/network_manager.rb | 4 +
 1 file changed, 4 insertions(+)

Comment 30 Martin Perina 2019-05-17 07:53:02 UTC
Retargeting to 5.11 as we already have 5.10.5 clone BZ1669023

Comment 31 Angelina Vasileva 2019-05-29 08:20:19 UTC
Verified in CFME 5.11.0.5.20190521144849_d0a06e6 and RHV 4.2.8.5-0.1.el7ev.
Network manager is refreshed without errors.