Description of problem:

When attempting to create a catalog item in the Global Region (Region 99) with Central Administration enabled, a provision request is submitted to the subordinate region, rather than saving the catalog item.  This was found when using an 'Amazon' catalog item, but I suspect it may be applicable to more than just Amazon.


Version-Release number of selected component (if applicable):

5.7.1.3


How reproducible:

100%


Steps to Reproduce:
1. Create Subordinate Region 1
2. Create Global Region 99
3. Configure Replication
4. Enable Central Administration
5. Create Catalog (Services > Catalogs) in Global Region
6. Create Catalog Item (Tested using Amazon Catalog Item type) in Global Region
7. Fill in Resource Information
8. Click Add

Actual results:

UI Spins and looks to timeout.  Catalog Item is not added.  User is dropped back to page to Add the catalog item.  Clicking Add again submits another provision request in the subordinate region.


Expected results:

Catalog item is successfully added to the Global Region.


Additional info:

The last time I attempted this, I received an 'error receiving data from server' error, but the provision request was still submitted.



Logs from production.log at the time the button was pressed:

[----] I, [2017-03-14T16:38:58.652001 #13450:144e944]  INFO -- : Completed 200 OK in 345ms (Views: 124.4ms | ActiveRecord: 0.0ms)
[----] I, [2017-03-14T16:39:03.953549 #13450:1450fc8]  INFO -- : Started POST "/miq_request/prov_field_changed/?tab_id=schedule" for 127.0.0.1 at 2017-03-14 16:39:03 -0400
[----] I, [2017-03-14T16:39:03.959601 #13450:1450fc8]  INFO -- : Processing by MiqRequestController#prov_field_changed as JS
[----] I, [2017-03-14T16:39:03.959721 #13450:1450fc8]  INFO -- :   Parameters: {"tab_id"=>"schedule"}
[----] I, [2017-03-14T16:39:04.397413 #13450:1450fc8]  INFO -- :   Rendered miq_request/_prov_dialog_fieldset.html.haml (0.3ms)
[----] I, [2017-03-14T16:39:04.399733 #13450:1450fc8]  INFO -- :   Rendered miq_request/_prov_field.html.haml (1.2ms)
[----] I, [2017-03-14T16:39:04.402284 #13450:1450fc8]  INFO -- :   Rendered miq_request/_prov_field.html.haml (1.1ms)
[----] I, [2017-03-14T16:39:04.404297 #13450:1450fc8]  INFO -- :   Rendered miq_request/_prov_field.html.haml (1.2ms)
[----] I, [2017-03-14T16:39:04.404512 #13450:1450fc8]  INFO -- :   Rendered miq_request/_prov_dialog_fieldset.html.haml (6.5ms)
[----] I, [2017-03-14T16:39:04.404665 #13450:1450fc8]  INFO -- :   Rendered shared/views/_prov_dialog.html.haml (8.9ms)
[----] I, [2017-03-14T16:39:04.405799 #13450:1450fc8]  INFO -- :   Rendered layouts/_flash_msg.html.haml (0.1ms)
[----] I, [2017-03-14T16:39:04.423685 #13450:1450fc8]  INFO -- : Completed 200 OK in 463ms (Views: 309.1ms | ActiveRecord: 0.0ms)
[----] I, [2017-03-14T16:39:08.241997 #13450:1451c0c]  INFO -- : Started POST "/catalog/servicetemplate_edit?button=add" for 127.0.0.1 at 2017-03-14 16:39:08 -0400
[----] I, [2017-03-14T16:39:08.247365 #13450:1451c0c]  INFO -- : Processing by CatalogController#servicetemplate_edit as JS
[----] I, [2017-03-14T16:39:08.247626 #13450:1451c0c]  INFO -- :   Parameters: {"ignore_form_changes"=>"", "name"=>"test", "description"=>"test", "catalog_id"=>"99000000000001", "dialog_id"=>"2000000000002", "fqname"=>"/Service/Provisioning/StateMachines/ServiceProvision_Template/CatalogItemInitialization", "reconfigure_fqname"=>"", "retire_fqname"=>"/Service/Retirement/StateMachines/ServiceRetirement/Default", "long_description"=>"", "service__number_of_vms"=>"1", "service__vm_name"=>"changeme", "environment__placement_auto"=>"true", "hardware__instance_type"=>"2000000000002", "hardware__guest_access_key_pair"=>"2000000000003", "hardware__monitoring"=>"basic", "customize__root_password"=>"[FILTERED]", "customize__addr_mode"=>"dhcp", "customize__hostname"=>"", "customize__subnet_mask"=>"", "customize__gateway"=>"", "customize__dns_servers"=>"", "customize__dns_suffixes"=>"", "customize__customization_template_script"=>"#cloud-config\nchpasswd:\n  list: |\n    root:<%= MiqPassword.decrypt(evm[:root_password]) %>\n  expire: False", "schedule__retirement"=>"0", "button"=>"add"}
[----] I, [2017-03-14T16:39:31.332995 #13466:1440074]  INFO -- : Started GET "/api" for 127.0.0.1 at 2017-03-14 16:39:31 -0400
[----] I, [2017-03-14T16:39:31.414657 #13466:1440074]  INFO -- : Processing by Api::ApiController#index as JSON
[----] I, [2017-03-14T16:39:32.491342 #13466:1440074]  INFO -- : Completed 200 OK in 1075ms (Views: 1.7ms | ActiveRecord: 0.0ms)
[----] I, [2017-03-14T16:40:31.219161 #13466:1440b14]  INFO -- : Started GET "/api" for 127.0.0.1 at 2017-03-14 16:40:31 -0400
[----] I, [2017-03-14T16:40:31.250093 #13466:1440b14]  INFO -- : Processing by Api::ApiController#index as JSON
[----] I, [2017-03-14T16:40:32.141901 #13466:1440b14]  INFO -- : Completed 200 OK in 890ms (Views: 26.7ms | ActiveRecord: 0.0ms)
[----] F, [2017-03-14T16:41:14.045504 #13450:1451c0c] FATAL -- : Error caught: [RuntimeError] Failed to send request to https://192.168.50.184/ - Net::ReadTimeout
/opt/rh/cfme-gemset/gems/manageiq-api-client-0.1.1/lib/manageiq/api/client/connection.rb:96:in `rescue in send_request'
/opt/rh/cfme-gemset/gems/manageiq-api-client-0.1.1/lib/manageiq/api/client/connection.rb:84:in `send_request'
/opt/rh/cfme-gemset/gems/manageiq-api-client-0.1.1/lib/manageiq/api/client/connection.rb:34:in `post'
/opt/rh/cfme-gemset/gems/manageiq-api-client-0.1.1/lib/manageiq/api/client/client.rb:65:in `post'
/opt/rh/cfme-gemset/gems/manageiq-api-client-0.1.1/lib/manageiq/api/client/collection.rb:167:in `exec_action'
/opt/rh/cfme-gemset/gems/manageiq-api-client-0.1.1/lib/manageiq/api/client/collection.rb:100:in `method_missing'
/var/www/miq/vmdb/app/models/mixins/inter_region_api_method_relay.rb:80:in `public_send'
/var/www/miq/vmdb/app/models/mixins/inter_region_api_method_relay.rb:80:in `exec_api_call'
/var/www/miq/vmdb/app/models/mixins/inter_region_api_method_relay.rb:45:in `block (2 levels) in api_relay_class_method'
/var/www/miq/vmdb/app/models/miq_request_workflow.rb:96:in `make_request'
/var/www/miq/vmdb/app/models/miq_provision_virt_workflow.rb:64:in `make_request'
/var/www/miq/vmdb/app/controllers/catalog_controller.rb:903:in `atomic_req_submit'
/var/www/miq/vmdb/app/controllers/catalog_controller.rb:107:in `atomic_st_edit'
/var/www/miq/vmdb/app/controllers/catalog_controller.rb:83:in `servicetemplate_edit'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/action_controller/metal/basic_implicit_render.rb:4:in `send_action'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/abstract_controller/base.rb:188:in `process_action'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/action_controller/metal/rendering.rb:30:in `process_action'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/abstract_controller/callbacks.rb:20:in `block in process_action'
/opt/rh/cfme-gemset/gems/activesupport-5.0.0.1/lib/active_support/callbacks.rb:126:in `call'
/opt/rh/cfme-gemset/gems/activesupport-5.0.0.1/lib/active_support/callbacks.rb:506:in `block (2 levels) in compile'
/opt/rh/cfme-gemset/gems/activesupport-5.0.0.1/lib/active_support/callbacks.rb:455:in `call'
/opt/rh/cfme-gemset/gems/activesupport-5.0.0.1/lib/active_support/callbacks.rb:101:in `__run_callbacks__'
/opt/rh/cfme-gemset/gems/activesupport-5.0.0.1/lib/active_support/callbacks.rb:750:in `_run_process_action_callbacks'
/opt/rh/cfme-gemset/gems/activesupport-5.0.0.1/lib/active_support/callbacks.rb:90:in `run_callbacks'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/abstract_controller/callbacks.rb:19:in `process_action'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/action_controller/metal/rescue.rb:20:in `process_action'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/action_controller/metal/instrumentation.rb:32:in `block in process_action'
/opt/rh/cfme-gemset/gems/activesupport-5.0.0.1/lib/active_support/notifications.rb:164:in `block in instrument'
/opt/rh/cfme-gemset/gems/activesupport-5.0.0.1/lib/active_support/notifications/instrumenter.rb:21:in `instrument'
/opt/rh/cfme-gemset/gems/activesupport-5.0.0.1/lib/active_support/notifications.rb:164:in `instrument'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/action_controller/metal/instrumentation.rb:30:in `process_action'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/action_controller/metal/params_wrapper.rb:248:in `process_action'
/opt/rh/cfme-gemset/gems/activerecord-5.0.0.1/lib/active_record/railties/controller_runtime.rb:18:in `process_action'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/abstract_controller/base.rb:126:in `process'
/opt/rh/cfme-gemset/gems/actionview-5.0.0.1/lib/action_view/rendering.rb:30:in `process'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/action_controller/metal.rb:190:in `dispatch'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/action_controller/metal.rb:262:in `dispatch'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/action_dispatch/routing/route_set.rb:50:in `dispatch'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/action_dispatch/routing/route_set.rb:32:in `serve'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/action_dispatch/journey/router.rb:39:in `block in serve'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/action_dispatch/journey/router.rb:26:in `each'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/action_dispatch/journey/router.rb:26:in `serve'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/action_dispatch/routing/route_set.rb:725:in `call'
/opt/rh/cfme-gemset/gems/secure_headers-3.0.3/lib/secure_headers/middleware.rb:10:in `call'
/opt/rh/cfme-gemset/gems/rack-2.0.1/lib/rack/etag.rb:25:in `call'
/opt/rh/cfme-gemset/gems/rack-2.0.1/lib/rack/conditional_get.rb:38:in `call'
/opt/rh/cfme-gemset/gems/rack-2.0.1/lib/rack/head.rb:12:in `call'
/opt/rh/cfme-gemset/gems/rack-2.0.1/lib/rack/session/abstract/id.rb:222:in `context'
/opt/rh/cfme-gemset/gems/rack-2.0.1/lib/rack/session/abstract/id.rb:216:in `call'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/action_dispatch/middleware/cookies.rb:613:in `call'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/action_dispatch/middleware/callbacks.rb:38:in `block in call'
/opt/rh/cfme-gemset/gems/activesupport-5.0.0.1/lib/active_support/callbacks.rb:97:in `__run_callbacks__'
/opt/rh/cfme-gemset/gems/activesupport-5.0.0.1/lib/active_support/callbacks.rb:750:in `_run_call_callbacks'
/opt/rh/cfme-gemset/gems/activesupport-5.0.0.1/lib/active_support/callbacks.rb:90:in `run_callbacks'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/action_dispatch/middleware/callbacks.rb:36:in `call'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/action_dispatch/middleware/remote_ip.rb:79:in `call'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/action_dispatch/middleware/debug_exceptions.rb:49:in `call'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/action_dispatch/middleware/show_exceptions.rb:31:in `call'
/opt/rh/cfme-gemset/gems/railties-5.0.0.1/lib/rails/rack/logger.rb:36:in `call_app'
/opt/rh/cfme-gemset/gems/railties-5.0.0.1/lib/rails/rack/logger.rb:26:in `call'
/opt/rh/cfme-gemset/gems/request_store-1.3.2/lib/request_store/middleware.rb:9:in `call'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/action_dispatch/middleware/request_id.rb:24:in `call'
/opt/rh/cfme-gemset/gems/rack-2.0.1/lib/rack/method_override.rb:22:in `call'
/opt/rh/cfme-gemset/gems/rack-2.0.1/lib/rack/runtime.rb:22:in `call'
/opt/rh/cfme-gemset/gems/activesupport-5.0.0.1/lib/active_support/cache/strategy/local_cache_middleware.rb:28:in `call'
/opt/rh/cfme-gemset/gems/actionpack-5.0.0.1/lib/action_dispatch/middleware/executor.rb:12:in `call'
/opt/rh/cfme-gemset/gems/rack-2.0.1/lib/rack/sendfile.rb:111:in `call'
/opt/rh/cfme-gemset/gems/railties-5.0.0.1/lib/rails/engine.rb:522:in `call'
/opt/rh/rh-ruby23/root/usr/share/gems/gems/puma-3.3.0/lib/puma/configuration.rb:224:in `call'
/opt/rh/rh-ruby23/root/usr/share/gems/gems/puma-3.3.0/lib/puma/server.rb:561:in `handle_request'
/opt/rh/rh-ruby23/root/usr/share/gems/gems/puma-3.3.0/lib/puma/server.rb:406:in `process_client'
/opt/rh/rh-ruby23/root/usr/share/gems/gems/puma-3.3.0/lib/puma/server.rb:271:in `block in run'
/opt/rh/rh-ruby23/root/usr/share/gems/gems/puma-3.3.0/lib/puma/thread_pool.rb:111:in `block in spawn_thread'