Bug 1323951 - Replication doesnt work after 5.4.x > 5.5.3.2 upgrade
Summary: Replication doesnt work after 5.4.x > 5.5.3.2 upgrade
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat CloudForms Management Engine
Classification: Red Hat
Component: Replication
Version: 5.5.0
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: GA
: 5.6.0
Assignee: Nick Carboni
QA Contact: luke couzens
URL:
Whiteboard: upgrade:replication
Depends On:
Blocks: 1324991 1335968
TreeView+ depends on / blocked
 
Reported: 2016-04-05 07:22 UTC by Jan Krocil
Modified: 2019-10-10 11:47 UTC (History)
10 users (show)

Fixed In Version: 5.6.0.1
Doc Type: Bug Fix
Doc Text:
Clone Of:
: 1324991 (view as bug list)
Environment:
Last Closed: 2016-06-29 15:47:22 UTC
Category: ---
Cloudforms Team: ---
Target Upstream Version:
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2016:1348 0 normal SHIPPED_LIVE CFME 5.6.0 bug fixes and enhancement update 2016-06-29 18:50:04 UTC

Comment 5 Nick Carboni 2016-04-08 20:00:21 UTC 
Added a tool to fix this situation in https://github.com/ManageIQ/manageiq/pull/7834
Comment 6 CFME Bot 2016-04-13 01:36:06 UTC 
New commit detected on ManageIQ/manageiq/master:
https://github.com/ManageIQ/manageiq/commit/e698bb7af55b7e8df88443a22dd1a4f32625a44f

commit e698bb7af55b7e8df88443a22dd1a4f32625a44f
Author:     Nick Carboni <ncarboni>
AuthorDate: Fri Apr 8 15:18:13 2016 -0400
Commit:     Nick Carboni <ncarboni>
CommitDate: Mon Apr 11 09:18:45 2016 -0400

    Add a script to remove out of date rubyrep triggers
    
    When a table which is being replicated is renamed the rubyrep
    trigger should be dropped and recreated to ensure only rows
    referencing the new table are inserted into rr_pending_changes.
    
    If this is not done properly, triggers referencing the old table
    name will remain functional on the renamed table. This has been
    seen to cause the replicate process to time out when it happens with
    high-churn tables.
    
    https://bugzilla.redhat.com/show_bug.cgi?id=1323951

 tools/purge_duplicate_rubyrep_triggers.rb | 57 +++++++++++++++++++++++++++++++
 1 file changed, 57 insertions(+)
 create mode 100644 tools/purge_duplicate_rubyrep_triggers.rb
Comment 7 Nick Carboni 2016-04-13 12:22:24 UTC 
Is this script enough to consider this fixed or do we want to do more?

We talked about enhancing db:migrate to use similar logic to check for this kind of thing every time a database gets migrated.  I'm not sure if that's too heavy handed considering rubyrep is going away soon.

What do you think Gregg?
Comment 8 Jared Deubel 2016-04-14 14:55:04 UTC 
Nick, 
I think what you have is good. I don't see any other reason to change it.
Comment 9 Dave Johnson 2016-04-15 16:11:46 UTC 
jkrocil, probably something we want to start peeking at, this new script that is, resetting qe_test_coverage.
Comment 10 luke couzens 2016-06-02 22:18:22 UTC 
Question is this fixed in a 5.4 to 5.6.0.1 migration? as I don't believe its possible to go from 5.4 to 5.6beta2 or above with migration.

you get migration errors.

rr0

== 20151208150956 FixHostStorageReplicationOnUpgrade: migrating ===============
-- drop_trigger(:host_storages, :rr0_hosts_storages)
   -> 0.0017s
-- Deleting pending changes for hosts_storages
   -> 0.0017s
   -> 0 rows
-- Deleting sync state for hosts_storages
   -> 0.0014s
   -> 1 rows
Preparing Replication in Region (0)...
Exception caught: PG::UndefinedTable: ERROR:  relation "settings_changes" does not exist
LINE 8:                WHERE a.attrelid = '"settings_changes"'::regc...
                                          ^
:               SELECT a.attname, format_type(a.atttypid, a.atttypmod),
                     pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,
             (SELECT c.collname FROM pg_collation c, pg_type t
               WHERE c.oid = a.attcollation AND t.oid = a.atttypid AND a.attcollation <> t.typcollation),
                     col_description(a.attrelid, a.attnum) AS comment
                FROM pg_attribute a LEFT JOIN pg_attrdef d
                  ON a.attrelid = d.adrelid AND a.attnum = d.adnum
               WHERE a.attrelid = '"settings_changes"'::regclass
                 AND a.attnum > 0 AND NOT a.attisdropped
               ORDER BY a.attnum
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/postgresql/database_statements.rb:88:in `async_exec'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/postgresql/database_statements.rb:88:in `block in query'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/abstract_adapter.rb:566:in `block in log'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activesupport/lib/active_support/notifications/instrumenter.rb:21:in `instrument'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/abstract_adapter.rb:560:in `log'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/postgresql/database_statements.rb:87:in `query'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/postgresql_adapter.rb:739:in `column_definitions'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/postgresql/schema_statements.rb:227:in `columns'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/schema_cache.rb:56:in `columns'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/schema_cache.rb:62:in `columns_hash'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/model_schema.rb:354:in `load_schema!'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/attributes.rb:233:in `load_schema!'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/attribute_decorators.rb:28:in `load_schema!'
/var/www/miq/vmdb/lib/extensions/ar_virtual.rb:209:in `load_schema!'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/model_schema.rb:349:in `load_schema'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/model_schema.rb:266:in `attribute_types'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/model_schema.rb:282:in `type_for_attribute'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/table_metadata.rb:34:in `type'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/relation/predicate_builder.rb:165:in `build_bind_param'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/relation/predicate_builder.rb:124:in `block in create_binds_for_hash'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/relation/predicate_builder.rb:100:in `each'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/relation/predicate_builder.rb:100:in `create_binds_for_hash'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/relation/predicate_builder.rb:103:in `block in create_binds_for_hash'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/relation/predicate_builder.rb:100:in `each'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/relation/predicate_builder.rb:100:in `create_binds_for_hash'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/relation/predicate_builder.rb:36:in `create_binds'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/relation/where_clause_factory.rb:20:in `build'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/relation/query_methods.rb:632:in `where!'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/relation/query_methods.rb:625:in `where'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/associations/association_scope.rb:67:in `last_chain_scope'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/associations/association_scope.rb:124:in `add_constraints'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/associations/association_scope.rb:28:in `scope'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/associations/association_scope.rb:5:in `scope'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/associations/association.rb:97:in `association_scope'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/associations/association.rb:86:in `scope'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/associations/collection_association.rb:447:in `scope'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/associations/collection_proxy.rb:37:in `initialize'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/relation/delegation.rb:100:in `new'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/relation/delegation.rb:100:in `create'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/associations/collection_association.rb:47:in `reader'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/associations/builder/association.rb:111:in `settings_changes'
/var/www/miq/vmdb/lib/vmdb/settings/database_source.rb:15:in `load'
/opt/rh/cfme-gemset/bundler/gems/config-23ce4b89d31f/lib/config/options.rb:54:in `block in reload!'
/opt/rh/cfme-gemset/bundler/gems/config-23ce4b89d31f/lib/config/options.rb:53:in `each'
/opt/rh/cfme-gemset/bundler/gems/config-23ce4b89d31f/lib/config/options.rb:53:in `reload!'
/var/www/miq/vmdb/lib/patches/config_patch.rb:3:in `reload!'
/var/www/miq/vmdb/lib/vmdb/settings.rb:64:in `for_resource'
/var/www/miq/vmdb/lib/vmdb/config.rb:7:in `block in for_resource'
/var/www/miq/vmdb/lib/vmdb/config.rb:6:in `tap'
/var/www/miq/vmdb/lib/vmdb/config.rb:6:in `for_resource'
/var/www/miq/vmdb/app/models/miq_server/configuration_management.rb:9:in `get_config'
/var/www/miq/vmdb/app/models/miq_worker.rb:192:in `fetch_worker_settings_from_server'
/var/www/miq/vmdb/app/models/miq_worker.rb:227:in `worker_settings'
/var/www/miq/vmdb/lib/miq_rubyrep.rb:17:in `prepare_configuration'
/var/www/miq/vmdb/config/replication.conf:3:in `block in <top (required)>'
/opt/rh/cfme-gemset/bundler/gems/rubyrep-43e43856a4ce/lib/rubyrep/initializer.rb:36:in `run'
/var/www/miq/vmdb/config/replication.conf:3:in `<top (required)>'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activesupport/lib/active_support/dependencies.rb:287:in `load'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activesupport/lib/active_support/dependencies.rb:287:in `block in load'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activesupport/lib/active_support/dependencies.rb:259:in `load_dependency'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activesupport/lib/active_support/dependencies.rb:287:in `load'
/opt/rh/cfme-gemset/bundler/gems/rubyrep-43e43856a4ce/lib/rubyrep/prepare_replication_runner.rb:68:in `session'
/opt/rh/cfme-gemset/bundler/gems/rubyrep-43e43856a4ce/lib/rubyrep/prepare_replication_runner.rb:78:in `execute'
/opt/rh/cfme-gemset/bundler/gems/rubyrep-43e43856a4ce/lib/rubyrep/prepare_replication_runner.rb:90:in `run'
/opt/rh/cfme-gemset/bundler/gems/rubyrep-43e43856a4ce/lib/rubyrep/command_runner.rb:102:in `run'
/var/www/miq/vmdb/lib/tasks/evm_dbsync.rake:214:in `run_rr_command'
/var/www/miq/vmdb/lib/tasks/evm_dbsync.rake:79:in `block (3 levels) in <top (required)>'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/task.rb:240:in `call'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/task.rb:240:in `block in execute'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/task.rb:235:in `each'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/task.rb:235:in `execute'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
/opt/rh/rh-ruby22/root/usr/share/ruby/monitor.rb:211:in `mon_synchronize'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/task.rb:172:in `invoke_with_call_chain'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/task.rb:165:in `invoke'
/var/www/miq/vmdb/db/migrate/20151208150956_fix_host_storage_replication_on_upgrade.rb:44:in `run_for_replication_source'
/var/www/miq/vmdb/db/migrate/20151208150956_fix_host_storage_replication_on_upgrade.rb:15:in `up'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:791:in `exec_migration'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:772:in `block (2 levels) in migrate'
/opt/rh/rh-ruby22/root/usr/share/ruby/benchmark.rb:288:in `measure'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:771:in `block in migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/abstract/connection_pool.rb:398:in `with_connection'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:770:in `migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration/compatibility.rb:121:in `migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:950:in `migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1211:in `block in execute_migration_in_transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1279:in `block in ddl_transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/abstract/database_statements.rb:232:in `block in transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/abstract/transaction.rb:189:in `within_new_transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/abstract/database_statements.rb:232:in `transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/transactions.rb:211:in `transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1279:in `ddl_transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1210:in `execute_migration_in_transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1183:in `block in migrate_without_lock'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1182:in `each'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1182:in `migrate_without_lock'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1131:in `block in migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1298:in `with_advisory_lock'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1131:in `migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1005:in `up'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:983:in `migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/tasks/database_tasks.rb:161:in `migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/railties/databases.rake:58:in `block (2 levels) in <top (required)>'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/task.rb:240:in `call'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/task.rb:240:in `block in execute'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/task.rb:235:in `each'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/task.rb:235:in `execute'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/task.rb:179:in `block in invoke_with_call_chain'
/opt/rh/rh-ruby22/root/usr/share/ruby/monitor.rb:211:in `mon_synchronize'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/task.rb:172:in `invoke_with_call_chain'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/task.rb:165:in `invoke'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/application.rb:150:in `invoke_task'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/application.rb:106:in `block (2 levels) in top_level'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/application.rb:106:in `each'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/application.rb:106:in `block in top_level'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/application.rb:115:in `run_with_threads'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/application.rb:100:in `top_level'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/application.rb:78:in `block in run'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/application.rb:176:in `standard_exception_handling'
/opt/rh/cfme-gemset/gems/rake-10.5.0/lib/rake/application.rb:75:in `run'
/opt/rh/cfme-gemset/gems/rake-10.5.0/bin/rake:33:in `<top (required)>'
/opt/rh/cfme-gemset/bin/rake:23:in `load'
/opt/rh/cfme-gemset/bin/rake:23:in `<main>'

rr99

== 20151021174140 AssignTenantDefaultGroup: migrating =========================
-- adding default tenant groups
rake aborted!
StandardError: An error has occurred, this and all later migrations canceled:

99000000000001 is out of range for ActiveModel::Type::Integer with limit 4/opt/rh/cfme-gemset/gems/activemodel-5.0.0.rc1/lib/active_model/type/integer.rb:49:in `ensure_in_range'
/opt/rh/cfme-gemset/gems/activemodel-5.0.0.rc1/lib/active_model/type/integer.rb:27:in `serialize'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/attribute.rb:51:in `value_for_database'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/attribute.rb:63:in `forgetting_assignment'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activesupport/lib/active_support/core_ext/hash/transform_values.rb:16:in `block in transform_values'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activesupport/lib/active_support/core_ext/hash/transform_values.rb:15:in `each'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activesupport/lib/active_support/core_ext/hash/transform_values.rb:15:in `transform_values'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/attribute_set/builder.rb:25:in `transform_values'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/attribute_set.rb:90:in `map'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/attribute_methods/dirty.rb:131:in `store_original_attributes'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/attribute_methods/dirty.rb:55:in `changes_applied'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/attribute_methods/dirty.rb:31:in `block in save!'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/attribute_methods/dirty.rb:30:in `tap'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/attribute_methods/dirty.rb:30:in `save!'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/transactions.rb:324:in `block in save!'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/transactions.rb:395:in `block in with_transaction_returning_status'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/abstract/database_statements.rb:230:in `transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/transactions.rb:211:in `transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/transactions.rb:392:in `with_transaction_returning_status'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/transactions.rb:324:in `save!'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/suppressor.rb:45:in `save!'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/persistence.rb:279:in `block in update!'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/transactions.rb:395:in `block in with_transaction_returning_status'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/abstract/database_statements.rb:230:in `transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/transactions.rb:211:in `transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/transactions.rb:392:in `with_transaction_returning_status'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/persistence.rb:277:in `update!'
/var/www/miq/vmdb/db/migrate/20151021174140_assign_tenant_default_group.rb:5:in `add_default_miq_group'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/relation/delegation.rb:38:in `each'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/relation/delegation.rb:38:in `each'
/var/www/miq/vmdb/db/migrate/20151021174140_assign_tenant_default_group.rb:41:in `block in up'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:814:in `block in say_with_time'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:814:in `say_with_time'
/var/www/miq/vmdb/db/migrate/20151021174140_assign_tenant_default_group.rb:40:in `up'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:791:in `exec_migration'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:772:in `block (2 levels) in migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:771:in `block in migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/abstract/connection_pool.rb:398:in `with_connection'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:770:in `migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration/compatibility.rb:121:in `migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:950:in `migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1211:in `block in execute_migration_in_transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1279:in `block in ddl_transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/abstract/database_statements.rb:232:in `block in transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/abstract/transaction.rb:189:in `within_new_transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/abstract/database_statements.rb:232:in `transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/transactions.rb:211:in `transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1279:in `ddl_transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1210:in `execute_migration_in_transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1183:in `block in migrate_without_lock'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1182:in `each'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1182:in `migrate_without_lock'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1131:in `block in migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1298:in `with_advisory_lock'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1131:in `migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1005:in `up'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:983:in `migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/tasks/database_tasks.rb:161:in `migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/railties/databases.rake:58:in `block (2 levels) in <top (required)>'
ActiveModel::RangeError: 99000000000001 is out of range for ActiveModel::Type::Integer with limit 4
/opt/rh/cfme-gemset/gems/activemodel-5.0.0.rc1/lib/active_model/type/integer.rb:49:in `ensure_in_range'
/opt/rh/cfme-gemset/gems/activemodel-5.0.0.rc1/lib/active_model/type/integer.rb:27:in `serialize'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/attribute.rb:51:in `value_for_database'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/attribute.rb:63:in `forgetting_assignment'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activesupport/lib/active_support/core_ext/hash/transform_values.rb:16:in `block in transform_values'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activesupport/lib/active_support/core_ext/hash/transform_values.rb:15:in `each'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activesupport/lib/active_support/core_ext/hash/transform_values.rb:15:in `transform_values'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/attribute_set/builder.rb:25:in `transform_values'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/attribute_set.rb:90:in `map'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/attribute_methods/dirty.rb:131:in `store_original_attributes'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/attribute_methods/dirty.rb:55:in `changes_applied'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/attribute_methods/dirty.rb:31:in `block in save!'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/attribute_methods/dirty.rb:30:in `tap'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/attribute_methods/dirty.rb:30:in `save!'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/transactions.rb:324:in `block in save!'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/transactions.rb:395:in `block in with_transaction_returning_status'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/abstract/database_statements.rb:230:in `transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/transactions.rb:211:in `transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/transactions.rb:392:in `with_transaction_returning_status'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/transactions.rb:324:in `save!'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/suppressor.rb:45:in `save!'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/persistence.rb:279:in `block in update!'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/transactions.rb:395:in `block in with_transaction_returning_status'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/abstract/database_statements.rb:230:in `transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/transactions.rb:211:in `transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/transactions.rb:392:in `with_transaction_returning_status'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/persistence.rb:277:in `update!'
/var/www/miq/vmdb/db/migrate/20151021174140_assign_tenant_default_group.rb:5:in `add_default_miq_group'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/relation/delegation.rb:38:in `each'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/relation/delegation.rb:38:in `each'
/var/www/miq/vmdb/db/migrate/20151021174140_assign_tenant_default_group.rb:41:in `block in up'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:814:in `block in say_with_time'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:814:in `say_with_time'
/var/www/miq/vmdb/db/migrate/20151021174140_assign_tenant_default_group.rb:40:in `up'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:791:in `exec_migration'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:772:in `block (2 levels) in migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:771:in `block in migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/abstract/connection_pool.rb:398:in `with_connection'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:770:in `migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration/compatibility.rb:121:in `migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:950:in `migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1211:in `block in execute_migration_in_transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1279:in `block in ddl_transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/abstract/database_statements.rb:232:in `block in transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/abstract/transaction.rb:189:in `within_new_transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/connection_adapters/abstract/database_statements.rb:232:in `transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/transactions.rb:211:in `transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1279:in `ddl_transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1210:in `execute_migration_in_transaction'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1183:in `block in migrate_without_lock'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1182:in `each'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1182:in `migrate_without_lock'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1131:in `block in migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1298:in `with_advisory_lock'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1131:in `migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:1005:in `up'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/migration.rb:983:in `migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/tasks/database_tasks.rb:161:in `migrate'
/opt/rh/cfme-gemset/bundler/gems/rails-3f68565029fa/activerecord/lib/active_record/railties/databases.rake:58:in `block (2 levels) in <top (required)>'
Tasks: TOP => db:migrate
Comment 11 Nick Carboni 2016-06-03 12:40:47 UTC 
The fix for this issue was not a migration so if you are running into issues following https://access.redhat.com/articles/2327481 then that is likely a separate issue.
Comment 12 luke couzens 2016-06-07 17:48:47 UTC 
Nick, not sure I follow. I am unable to verify this BZ as I can't run through the rest of the migration documentation without the db:migrate task working?

Or am I not trying to verify replication is working after migration?
Comment 13 Nick Carboni 2016-06-07 18:19:39 UTC 
Right, I think I understand the issue here, but it needs its own BZ then that BZ would block verification of this one.

The problem is that when we try to get the replication worker config when doing "prepare_replication_without_sync" we are looking for the new config table which is created in a later migration.

I think the rake call in that migration should probably be removed or replaced with something else, but that fix has nothing to do with this BZ.
Comment 14 luke couzens 2016-06-09 08:18:38 UTC 
This BZ is currently blocked by https://bugzilla.redhat.com/show_bug.cgi?id=1344112
Comment 15 luke couzens 2016-06-23 14:56:39 UTC 
Verified in 5.6.0.12
Comment 17 errata-xmlrpc 2016-06-29 15:47:22 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2016:1348
Note You need to log in before you can comment on or make changes to this bug.