Description of problem: Service provisions are being executed in the wrong zone and triggering a "Terminating non responsive method with pid 19690" error. evm_20160317_1835_kbb0cfz4a01.log:[----] E, [2016-03-17T07:51:51.769172 #19307:db9e94] ERROR -- : Q-task_id([service_template_provision_task_1000000011404]) <AutomationEngine> Terminating non responsive method with pid 20929 evm_20160317_1835_kbb0cfz4a01.log:[----] E, [2016-03-17T11:56:16.084378 #18474:c69e90] ERROR -- : Q-task_id([service_template_provision_task_1000000011452]) <AutomationEngine> Terminating non responsive method with pid 6935 evm_20160317_1835_kbb0cfz4a01.log:[----] E, [2016-03-17T12:16:39.856908 #21189:8b1e88] ERROR -- : Q-task_id([service_template_provision_task_1000000011459]) <AutomationEngine> Terminating non responsive method with pid 11274 Version-Release number of selected component (if applicable): 5.4.3.1 How reproducible: Steps to Reproduce: 1. 2. 3. Actual results: Expected results: Additional info:
Created attachment 1137846 [details] Trigger for increasing queue message timeout Copy file to appliance and create the trigger with this command: psql -d vmdb_production < <path to file>
Created attachment 1138733 [details] from March 19 rails debug testing
Created attachment 1138734 [details] from March 19 Rails debug trace
Created attachment 1138738 [details] from March 19 rails debug testing
Created attachment 1138739 [details] from March 19 rails debug testing
Created attachment 1138756 [details] spreadsheet with rails debug query analyses
Created attachment 1138758 [details] message duration times
Created attachment 1138776 [details] combined evm and production debug lines for pid 11187
Created attachment 1138777 [details] combined evm and prduction debug lines for pid 19870
Created attachment 1138778 [details] combined evm and production debug lines for pid 24848
Created attachment 1138779 [details] combined evm and production debug log lines for pid 25316
https://github.com/ManageIQ/manageiq/pull/8172
New commit detected on ManageIQ/manageiq/master: https://github.com/ManageIQ/manageiq/commit/880f717434f23fc7d99540da64eb13ea11029188 commit 880f717434f23fc7d99540da64eb13ea11029188 Author: Lucy Fu <lufu> AuthorDate: Mon Apr 25 12:18:16 2016 -0400 Commit: Lucy Fu <lufu> CommitDate: Wed Apr 27 13:31:18 2016 -0400 Use the field value that has been returned. Use the field value that has been returned to avoid the extra calling to get_field. https://bugzilla.redhat.com/show_bug.cgi?id=1318825 app/controllers/miq_request_controller.rb | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-)
New commit detected on ManageIQ/manageiq/master: https://github.com/ManageIQ/manageiq/commit/428e6b0ab1691e0dc6585871de33dca6a5d5b6d1 commit 428e6b0ab1691e0dc6585871de33dca6a5d5b6d1 Author: Lucy Fu <lufu> AuthorDate: Mon Apr 25 12:23:26 2016 -0400 Commit: Lucy Fu <lufu> CommitDate: Wed Apr 27 13:31:18 2016 -0400 Add refresh_values option to get_field to turn off the calling to Rbac when it is not necessary. https://bugzilla.redhat.com/show_bug.cgi?id=1318825 app/models/miq_request_workflow.rb | 16 ++++++++-------- 1 file changed, 8 insertions(+), 8 deletions(-)
New commit detected on ManageIQ/manageiq/master: https://github.com/ManageIQ/manageiq/commit/bcded598b6781c4b07e41739d21f49a4582a6e9f commit bcded598b6781c4b07e41739d21f49a4582a6e9f Author: Lucy Fu <lufu> AuthorDate: Thu Apr 21 19:15:04 2016 -0400 Commit: Lucy Fu <lufu> CommitDate: Wed Apr 27 13:31:18 2016 -0400 MiqReqestWorkflow#validate does not need to call Rbac. https://bugzilla.redhat.com/show_bug.cgi?id=1318825 app/controllers/application_controller/miq_request_methods.rb | 6 ++---- app/models/miq_request_workflow.rb | 4 ++-- 2 files changed, 4 insertions(+), 6 deletions(-)
New commit detected on ManageIQ/manageiq/master: https://github.com/ManageIQ/manageiq/commit/0e407024425ce421f431baf11b60d153b28e6c30 commit 0e407024425ce421f431baf11b60d153b28e6c30 Author: Lucy Fu <lufu> AuthorDate: Mon Apr 25 15:23:41 2016 -0400 Commit: Lucy Fu <lufu> CommitDate: Wed Apr 27 13:31:18 2016 -0400 Refactor the call to validate_values so validate is called only once. https://bugzilla.redhat.com/show_bug.cgi?id=1318825 app/models/miq_host_provision_workflow.rb | 6 +++--- app/models/miq_provision_virt_workflow.rb | 6 +++--- app/models/miq_request_workflow.rb | 14 ++++++-------- spec/models/miq_request_workflow_spec.rb | 18 ++++++++++++++++++ 4 files changed, 30 insertions(+), 14 deletions(-)
New commit detected on ManageIQ/manageiq/master: https://github.com/ManageIQ/manageiq/commit/931c43751eadde6493018f514781f99d41b6d91f commit 931c43751eadde6493018f514781f99d41b6d91f Author: Lucy Fu <lufu> AuthorDate: Wed Apr 27 11:45:03 2016 -0400 Commit: Lucy Fu <lufu> CommitDate: Wed Apr 27 13:31:18 2016 -0400 Set placement_auto true from the start by default to reduce the method calls. Enforce placement_auto true from the start and set to false in ws_environment_fields if needed. This way lots of method calls about placement are reduced and some of which calls would even go to Rbac. https://bugzilla.redhat.com/show_bug.cgi?id=1318825 app/models/miq_provision_virt_workflow.rb | 7 +++---- 1 file changed, 3 insertions(+), 4 deletions(-)
New commit detected on ManageIQ/manageiq/master: https://github.com/ManageIQ/manageiq/commit/4e42e50c553041b791cd84c2adde5bd37e3c46ec commit 4e42e50c553041b791cd84c2adde5bd37e3c46ec Author: Lucy Fu <lufu> AuthorDate: Wed Apr 27 12:01:56 2016 -0400 Commit: Lucy Fu <lufu> CommitDate: Wed Apr 27 13:31:19 2016 -0400 Fix rubocop warnings in UI code. https://bugzilla.redhat.com/show_bug.cgi?id=1318825 app/controllers/application_controller/miq_request_methods.rb | 4 ++-- app/controllers/miq_request_controller.rb | 2 +- 2 files changed, 3 insertions(+), 3 deletions(-)
New commit detected on cfme/5.5.z: https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=c5d553c2e0b3ebcbda09a6f090809a4f63d8eec1 commit c5d553c2e0b3ebcbda09a6f090809a4f63d8eec1 Author: Lucy Fu <lufu> AuthorDate: Mon Apr 25 12:18:16 2016 -0400 Commit: Lucy Fu <lufu> CommitDate: Wed Apr 27 17:47:52 2016 -0400 Use the field value that has been returned. Use the field value that has been returned to avoid the extra calling to get_field. https://bugzilla.redhat.com/show_bug.cgi?id=1318825 app/controllers/miq_request_controller.rb | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-)
New commit detected on cfme/5.5.z: https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=5399f5dc77e73d2d8a92c2b6df27ca01a8fa144d commit 5399f5dc77e73d2d8a92c2b6df27ca01a8fa144d Author: Lucy Fu <lufu> AuthorDate: Mon Apr 25 12:23:26 2016 -0400 Commit: Lucy Fu <lufu> CommitDate: Wed Apr 27 17:48:04 2016 -0400 Add refresh_values option to get_field to turn off the calling to Rbac when it is not necessary. https://bugzilla.redhat.com/show_bug.cgi?id=1318825 app/models/miq_request_workflow.rb | 16 ++++++++-------- 1 file changed, 8 insertions(+), 8 deletions(-)
New commit detected on cfme/5.5.z: https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=8982c13f06d49816e16eaf9b8165e2994595dd7d commit 8982c13f06d49816e16eaf9b8165e2994595dd7d Author: Lucy Fu <lufu> AuthorDate: Thu Apr 21 19:15:04 2016 -0400 Commit: Lucy Fu <lufu> CommitDate: Wed Apr 27 17:48:14 2016 -0400 MiqReqestWorkflow#validate does not need to call Rbac. https://bugzilla.redhat.com/show_bug.cgi?id=1318825 app/controllers/application_controller/miq_request_methods.rb | 6 ++---- app/models/miq_request_workflow.rb | 4 ++-- 2 files changed, 4 insertions(+), 6 deletions(-)
New commit detected on cfme/5.5.z: https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=9cda847a60cbe0f27d5365645122455a32b2f598 commit 9cda847a60cbe0f27d5365645122455a32b2f598 Author: Lucy Fu <lufu> AuthorDate: Wed Apr 27 12:01:56 2016 -0400 Commit: Lucy Fu <lufu> CommitDate: Wed Apr 27 18:03:47 2016 -0400 Fix rubocop warnings in UI code. https://bugzilla.redhat.com/show_bug.cgi?id=1318825 app/controllers/application_controller/miq_request_methods.rb | 4 ++-- app/controllers/miq_request_controller.rb | 2 +- 2 files changed, 3 insertions(+), 3 deletions(-)
New commit detected on cfme/5.5.z: https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=d39596770faa5d11b5ccda2ddb0a77734c5d9ac6 commit d39596770faa5d11b5ccda2ddb0a77734c5d9ac6 Author: Lucy Fu <lufu> AuthorDate: Mon Apr 25 15:23:41 2016 -0400 Commit: Lucy Fu <lufu> CommitDate: Wed Apr 27 17:51:07 2016 -0400 Refactor the call to validate_values so validate is called only once. https://bugzilla.redhat.com/show_bug.cgi?id=1318825 app/models/miq_host_provision_workflow.rb | 6 +++--- app/models/miq_provision_virt_workflow.rb | 6 +++--- app/models/miq_request_workflow.rb | 14 ++++++-------- spec/models/miq_request_workflow_spec.rb | 18 ++++++++++++++++++ 4 files changed, 30 insertions(+), 14 deletions(-)
New commit detected on cfme/5.5.z: https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=41201ca9165751496e6e7113781bfee7ad7d27ab commit 41201ca9165751496e6e7113781bfee7ad7d27ab Author: Lucy Fu <lufu> AuthorDate: Thu Apr 28 09:16:33 2016 -0400 Commit: Lucy Fu <lufu> CommitDate: Thu Apr 28 09:16:33 2016 -0400 Set placement_auto true from the start by default to reduce the method calls. This way lots of method calls about placement are reduced and some of which calls would even go to Rbac. https://bugzilla.redhat.com/show_bug.cgi?id=1318825 app/models/miq_provision_virt_workflow.rb | 1 + 1 file changed, 1 insertion(+)
New commit detected on cfme/5.4.z: https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=9e76d35acd8fce720fd71727915804c51fcb2db5 commit 9e76d35acd8fce720fd71727915804c51fcb2db5 Author: Lucy Fu <lufu> AuthorDate: Thu Apr 28 11:23:03 2016 -0400 Commit: Lucy Fu <lufu> CommitDate: Fri Apr 29 15:32:42 2016 -0400 Use the field value that has been returned. Use the field value that has been returned to avoid the extra calling to get_field. https://bugzilla.redhat.com/show_bug.cgi?id=1318825 vmdb/app/controllers/miq_request_controller.rb | 5 ++--- 1 file changed, 2 insertions(+), 3 deletions(-)
New commit detected on cfme/5.4.z: https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=a83f9da6f65f8628209de470a8cbb66136d553cf commit a83f9da6f65f8628209de470a8cbb66136d553cf Author: Lucy Fu <lufu> AuthorDate: Thu Apr 28 11:29:08 2016 -0400 Commit: Lucy Fu <lufu> CommitDate: Fri Apr 29 15:32:42 2016 -0400 Add refresh_values option to get_field to turn off the calling to Rbac when it is not necessary. https://bugzilla.redhat.com/show_bug.cgi?id=1318825 vmdb/app/models/miq_request_workflow.rb | 16 ++++++++-------- 1 file changed, 8 insertions(+), 8 deletions(-)
New commit detected on cfme/5.4.z: https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=f0e7e3d3ea33766f95277beb30c09aff27000150 commit f0e7e3d3ea33766f95277beb30c09aff27000150 Author: Lucy Fu <lufu> AuthorDate: Thu Apr 28 11:34:04 2016 -0400 Commit: Lucy Fu <lufu> CommitDate: Fri Apr 29 15:32:42 2016 -0400 MiqReqestWorkflow#validate does not need to call Rbac. https://bugzilla.redhat.com/show_bug.cgi?id=1318825 .../app/controllers/application_controller/miq_request_methods.rb | 8 +++----- vmdb/app/models/miq_request_workflow.rb | 4 ++-- 2 files changed, 5 insertions(+), 7 deletions(-)
New commit detected on cfme/5.4.z: https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=04f67d0e7b1202e3506c7c8604b6d4073302e208 commit 04f67d0e7b1202e3506c7c8604b6d4073302e208 Author: Lucy Fu <lufu> AuthorDate: Thu Apr 28 11:44:02 2016 -0400 Commit: Lucy Fu <lufu> CommitDate: Fri Apr 29 15:32:43 2016 -0400 Refactor the call to validate_values so validate is called only once. https://bugzilla.redhat.com/show_bug.cgi?id=1318825 vmdb/app/models/miq_host_provision_workflow.rb | 6 +++--- vmdb/app/models/miq_provision_virt_workflow.rb | 6 +++--- vmdb/app/models/miq_request_workflow.rb | 16 +++++++--------- vmdb/spec/models/miq_request_workflow_spec.rb | 18 ++++++++++++++++++ 4 files changed, 31 insertions(+), 15 deletions(-)
New commit detected on cfme/5.4.z: https://code.engineering.redhat.com/gerrit/gitweb?p=cfme.git;a=commitdiff;h=ad1dde5eaece7c3eeb7deb41388ad075cd9c1429 commit ad1dde5eaece7c3eeb7deb41388ad075cd9c1429 Author: Lucy Fu <lufu> AuthorDate: Thu Apr 28 11:47:18 2016 -0400 Commit: Lucy Fu <lufu> CommitDate: Fri Apr 29 15:32:43 2016 -0400 Set placement_auto true from the start by default to reduce the method calls. This way lots of method calls about placement are reduced and some of which calls would even go to Rbac. https://bugzilla.redhat.com/show_bug.cgi?id=1318825 vmdb/app/models/miq_provision_virt_workflow.rb | 1 + 1 file changed, 1 insertion(+)
https://github.com/ManageIQ/manageiq/pull/8473
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2016:1348