We need to make sure custom alert notification plugins can be added, updated and removed from a JON install without introducing any instability. Could use one or versions of an example plugin (BZ-586103) to test this.
Closing this tracker.