Looks like this is just a UI bug causing the flash message to not be displayed, the cloud tenant does actually get deleted from Openstack when I attempt to reproduce. https://github.com/ManageIQ/manageiq-ui-classic/pull/2869