Bug 1468275

Summary: [RFE] Trigger a refresh when adding/editing/deleting anything in CFME Block Storage(EBS)
Product: Red Hat CloudForms Management Engine Reporter: Satoe Imaishi <simaishi>
Component: ProvidersAssignee: Bronagh Sorota <bsorota>
Status: CLOSED ERRATA QA Contact: Matouš Mojžíš <mmojzis>
Severity: high Docs Contact:
Priority: high    
Version: 5.8.0CC: bascar, bsorota, cbudzilo, cpelland, dajohnso, gblomqui, jfrey, jhardy, mmojzis, obarenbo, simaishi, ssainkar
Target Milestone: GAKeywords: FutureFeature, ZStream
Target Release: 5.8.1   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard: ec2:storage
Fixed In Version: 5.8.1.2 Doc Type: Enhancement
Doc Text:
This release of Red Hat CloudForms includes an enhancement to event switchboard configuration for Amazon EBS volumes and snapshot events that triggers a storage manager refresh upon receiving the events. The following two CloudWatch event rules were configured on the AWS console to fire the EBS events using the CloudWatch service. The configuration parameters for each event are as follows: Service Name - EC2 Event Type - EBS Volume Notification Target - SNS Topic Topic - AWSConfig_topic and Service Name - EC2 Event Type - EBS Snapshot Notification Target - SNS Topic Topic - AWSConfig_topic See https://docs.aws.amazon.com/AmazonCloudWatch/latest/events/WhatIsCloudWatchEvents.html for more information on Amazon CloudWatch events.
Story Points: ---
Clone Of: 1449235 Environment:
Last Closed: 2017-08-02 17:33:18 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: CFME Core Target Upstream Version:
Embargoed:
Bug Depends On: 1449235    
Bug Blocks:    

Comment 2 CFME Bot 2017-07-06 14:18:17 UTC
New commit detected on ManageIQ/manageiq-content/fine:
https://github.com/ManageIQ/manageiq-content/commit/9729ab5bd8861f93784348f84e26c5ec8b0214b0

commit 9729ab5bd8861f93784348f84e26c5ec8b0214b0
Author:     Greg McCullough <gmccullo>
AuthorDate: Mon Jul 3 14:40:41 2017 -0400
Commit:     Satoe Imaishi <simaishi>
CommitDate: Thu Jul 6 10:14:41 2017 -0400

    Merge pull request #137 from bronaghs/aws_ebs_event_swithboard_support
    
    Event switchboard entries for Amazon EBS events.
    (cherry picked from commit df9c41a3de1bd0b3b6112db2339702218d228b11)
    
    https://bugzilla.redhat.com/show_bug.cgi?id=1468275

 .../System/Event/EmsEvent/Amazon.class/attachvolume.yaml     | 12 ++++++++++++
 .../System/Event/EmsEvent/Amazon.class/copysnapshot.yaml     | 12 ++++++++++++
 .../System/Event/EmsEvent/Amazon.class/createsnapshot.yaml   | 12 ++++++++++++
 .../System/Event/EmsEvent/Amazon.class/createvolume.yaml     | 12 ++++++++++++
 .../System/Event/EmsEvent/Amazon.class/deletesnapshot.yaml   | 12 ++++++++++++
 .../System/Event/EmsEvent/Amazon.class/deletevolume.yaml     | 12 ++++++++++++
 6 files changed, 72 insertions(+)
 create mode 100644 content/automate/ManageIQ/System/Event/EmsEvent/Amazon.class/attachvolume.yaml
 create mode 100644 content/automate/ManageIQ/System/Event/EmsEvent/Amazon.class/copysnapshot.yaml
 create mode 100644 content/automate/ManageIQ/System/Event/EmsEvent/Amazon.class/createsnapshot.yaml
 create mode 100644 content/automate/ManageIQ/System/Event/EmsEvent/Amazon.class/createvolume.yaml
 create mode 100644 content/automate/ManageIQ/System/Event/EmsEvent/Amazon.class/deletesnapshot.yaml
 create mode 100644 content/automate/ManageIQ/System/Event/EmsEvent/Amazon.class/deletevolume.yaml

Comment 3 Greg Blomquist 2017-07-07 14:00:21 UTC
https://github.com/ManageIQ/manageiq-content/pull/137 shows fine/backported.  Moving to POST.

Comment 4 Matouš Mojžíš 2017-07-19 11:45:16 UTC
I have some issues with verifying this BZ:
There are still events missing for Create volume and Detach volume.
Shall I create new BZ for that?
When I do something in AWS Console like adding a new snapshot or deleting a snapshot then refresh kicks off like in more than 30 minutes and that kick off can be triggered by something else.

Comment 8 Bronagh Sorota 2017-07-20 19:03:03 UTC
Matous,
Which events were you able to test?


Thanks
Bronagh

Comment 10 Dave Johnson 2017-07-26 17:46:04 UTC
In terms of this one, I believe we can move to verified per the overall summary that ebs events are now trigger refreshes.  With that said though, it sounds like we need to write an new BZ for the slowness of these events, is it completely on the AWS side and nothing we can do about it?  Is it all AWS events or only specific ones like EBS (that I believe CloudWatch sends)?

Comment 11 Matouš Mojžíš 2017-07-27 14:38:27 UTC
Okay,
only CloudWatch EBS Storage/Volume configuration is not working because of bug on the Amazon side.
I was able to configure CloudTrail + CloudWatch with Ladas and it works now very well(Events are coming in < 5 minutes).

Docs will be needed for this configuration.

Verified in 5.8.1.5. Autorefresh worked with CreateVolume/AttachVolume/DeleteVolume and CreateSnapshot/CopySnapshot/DeleteSnapshot.

Comment 12 Bronagh Sorota 2017-07-27 14:46:23 UTC
That great Matous. What is the bug on the AWS side? Can you review the doc text box in this BZ, is anything else needed?

Comment 15 errata-xmlrpc 2017-08-02 17:33:18 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2017:1758