Bug 1613249 - [downstream clone - 4.2.5] Foreign key constraint violation on upgrade to 4.2.5
Summary: [downstream clone - 4.2.5] Foreign key constraint violation on upgrade to 4.2.5
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Enterprise Virtualization Manager
Classification: Red Hat
Component: ovirt-engine
Version: 2.1.0
Hardware: Unspecified
OS: Unspecified
urgent
urgent
Target Milestone: ovirt-4.2.5-1
: ---
Assignee: Daniel Erez
QA Contact: Jiri Belka
URL:
Whiteboard:
Depends On: 1609839
Blocks:
TreeView+ depends on / blocked
 
Reported: 2018-08-07 09:53 UTC by RHV bug bot
Modified: 2021-09-09 15:18 UTC (History)
20 users (show)

Fixed In Version: ovirt-engine-4.2.5.3
Doc Type: If docs needed, set a value
Doc Text:
Clone Of: 1609839
Environment:
Last Closed: 2018-08-16 15:11:08 UTC
oVirt Team: Storage
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker RHV-43244 0 None None None 2021-08-30 12:30:09 UTC
Red Hat Knowledge Base (Solution) 3551351 0 None None None 2018-08-07 09:55:28 UTC
Red Hat Product Errata RHBA-2018:2471 0 None None None 2018-08-16 15:11:15 UTC
oVirt gerrit 93466 0 master MERGED core: clean stale image_transfer on upgrade 2020-01-28 09:13:04 UTC
oVirt gerrit 93498 0 ovirt-engine-4.2 MERGED core: clean stale image_transfer on upgrade 2020-01-28 09:13:04 UTC
oVirt gerrit 93506 0 ovirt-engine-4.2.5.z MERGED core: clean stale image_transfer on upgrade 2020-01-28 09:13:04 UTC

Description RHV bug bot 2018-08-07 09:53:08 UTC
+++ This bug is a downstream clone. The original bug is: +++
+++   bug 1609839 +++
======================================================================

Description of problem:
I tried to update my RHV environment to version 4.2.5-5. In the process I hit a bug with DB migration, where it complained that /usr/share/ovirt-engine/dbscripts/upgrade/04_02_1210_add_foreign_key_to_image_transfers.sql instructions '*violates foreign key constraint "fk_image_transfers_commandentities"*'. I worked around this by simply
commenting the line in this file. It's ok on short term, but probably not on longer term.

Version-Release number of selected component (if applicable): 4.2.5-5


How reproducible: Always


Steps to Reproduce:
1. Configure RHV 4.2.5-5 packages repo
2. Update ovirt-engine-setup package
3. Run engine-setup

Actual results: It fails complaining that /usr/share/ovirt-engine/dbscripts/upgrade/04_02_1210_add_foreign_key_to_image_transfers.sql instructions '*violates foreign key constraint "fk_image_transfers_commandentities"*'


Expected results: It works.


Additional info:

(Originally by Fabien Dupont)

Comment 1 RHV bug bot 2018-08-07 09:53:22 UTC
Created attachment 1471574 [details]
engine-setup failure log

(Originally by Fabien Dupont)

Comment 3 RHV bug bot 2018-08-07 09:53:29 UTC
Fabien, note that non-d/s specific issues are supposed to be filed upstream - ovirt-engine “product”

(Originally by michal.skrivanek)

Comment 5 RHV bug bot 2018-08-07 09:53:45 UTC
*** Bug 1611673 has been marked as a duplicate of this bug. ***

(Originally by Daniel Erez)

Comment 6 RHV bug bot 2018-08-07 09:53:53 UTC
*** Bug 1611961 has been marked as a duplicate of this bug. ***

(Originally by Sandro Bonazzola)

Comment 11 RHV bug bot 2018-08-07 09:54:25 UTC
Same here trying to update from 4.2.3.7 to 4.2.5.2

It also fails apparently the rollback of the db

[ INFO  ] Backing up database localhost:engine to '/var/lib/ovirt-engine/backups/engine-20180803141347.gdQfiz.dump'.
[ INFO  ] Creating/refreshing Engine database schema
[ ERROR ] schema.sh: FATAL: Cannot execute sql command: --file=/usr/share/ovirt-engine/dbscripts/upgrade/04_02_1210_add_foreign_key_to_image_transfers.sql
[ ERROR ] Failed to execute stage 'Misc configuration': Engine schema refresh failed
[ INFO  ] Yum Performing yum transaction rollback

[ INFO  ] Restoring file '/var/lib/ovirt-engine/backups/engine-20180803141347.gdQfiz.dump' to database localhost:engine.
[ ERROR ] Errors while restoring engine database, please check the log file for details
[ INFO  ] Stage: Clean up
          Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20180803140934-1thg3k.log
[ INFO  ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20180803141603-setup.conf'
[WARNING] Rollback of DWH database started
          This might be a long process, but it should be safe to start the engine service before it finishes, if needed.
[ INFO  ] Clearing DWH database ovirt_engine_history
[ INFO  ] Restoring DWH database ovirt_engine_history
[ INFO  ] Restoring file '/var/lib/ovirt-engine-dwh/backups/dwh-20180803141340.cQoOU2.dump' to database localhost:ovirt_engine_history.
[ INFO  ] Stage: Pre-termination
[ INFO  ] Stage: Termination
[ ERROR ] Execution of setup failed
[root@ovirt ~]# 

at this time the image_transfers table is clearly the old one without the foreign key:

engine=# \d image_transfers
                        Table "public.image_transfers"
          Column           |           Type           |       Modifiers        
---------------------------+--------------------------+------------------------
 command_id                | uuid                     | not null
 command_type              | integer                  | not null
 phase                     | integer                  | not null
 last_updated              | timestamp with time zone | not null
 message                   | character varying        | 
 vds_id                    | uuid                     | 
 disk_id                   | uuid                     | 
 imaged_ticket_id          | uuid                     | 
 proxy_uri                 | character varying        | 
 signed_ticket             | character varying        | 
 bytes_sent                | bigint                   | 
 bytes_total               | bigint                   | 
 type                      | integer                  | not null default 0
 active                    | boolean                  | not null default false
 daemon_uri                | character varying        | 
 client_inactivity_timeout | integer                  | 
Indexes:
    "pk_image_transfers" PRIMARY KEY, btree (command_id)
    "idx_image_transfers_disk_id" btree (disk_id)


and contains

engine=# select * from image_transfers;
              command_id              | command_type | phase |        last_updated        |           m
essage           |                vds_id                |               disk_id                | imaged
_ticket_id |           proxy_uri            |                                                          
                                                                                                       
                                                                                          signed_ticket
                                                                                                       
                                                                                                       
                                                                                                       
                                                                                                       
                                                                                                       
                                                                                                       
                                                                                                       
                                                                                                       
                                                                                                       
                                                                                                       
                                                                                                       
                                                                                                       
                                                                                                       
                                                                                                       
                                                                                                       
                                              | bytes_sent | bytes_total | type | active | daemon_uri |
 client_inactivity_timeout 
--------------------------------------+--------------+-------+----------------------------+------------
-----------------+--------------------------------------+--------------------------------------+-------
-----------+--------------------------------+----------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------
----------------------------------------------+------------+-------------+------+--------+------------+
---------------------------
 7b0e8a09-d8e9-48c4-83af-fdd94268f355 |         1024 |     6 | 2017-12-05 23:09:05.307+00 | Pausing due
 to client error | 459f6e56-f813-4c73-9950-994a7de8dbb5 | 713df8c6-8a97-425f-a169-fa2b7104bdc4 |       
           | https://localhost:54323/images | eyJzYWx0IjoidHdLQWdwN0lnREU9IiwiZGF0YSI6IntcbiAgXCJuYmZcI
iA6IDE1MTI1MTQ5NzIsXG4gIFwiZXhwXCIgOiAxNTEyNTE4NTcyLFxuICBcImlhdFwiIDogMTUxMjUxNDk3MixcbiAgXCJ0cmFuc2Zl
ci10aWNrZXRcIiA6IFwiZTVjY2JiOWMtOTNlZS00MDRkLTgwOWItNDMzNzZkYTQ4ZmE3XCIsXG4gIFwiaW1hZ2VkLXVyaVwiIDogXCJ
odHRwczovL292aXJ0MDEubHV0d3luLm9yZzo1NDMyMlwiXG59Iiwic2lnbmF0dXJlIjoibiszZ0pUbmgyd1gxYzUzMWNsRWwza1c1Mk
5vSEhXOGhUZGxZZmN1T3JURlVveHlicVhwaTZTRVhsWERCN2tOOXZBT1dMb1NhT0t5TTRWT1I0VTl1djNLdldHNHlTVUp1YWhha3dFY
3J3UUJkOTFwQVkrVXM1ZGRLRkxlSTB2NkQ2eitBOEJXRkduUkpNdCtxemJUeTd5dm5wTnVXSkxIMXlFOXFRTHFDWEN4UEZTSkNHekpY
aTVveUZHQlNPTVNUdEtYbjVCS0gwejdGanR5akhZd3orMkRVM3Bxa0JESUp0dTZGRFZjeG9Gelp2bjR0amtla3M1WldvNS95NFYwekZ
pcE5PdWJIZXNGMlpvL2liVGIrQ0pLZ0xyOFBHNzE1VmhKbmxlQ1BLbE5zV2VkcVRDSEE4M3ZxOHpjdFMveWZCZU9seEgzZ3BEZktkS0
tDYjlVcHNRPT0iLCJkaWdlc3QiOiJzaGExIiwiY2VydGlmaWNhdGUiOiItLS0tLUJFR0lOIENFUlRJRklDQVRFLS0tLS1cbk1JSUVjR
ENDQTFpZ0F3SUJBZ0lDRUF3d0RRWUpLb1pJaHZjTkFRRUxCUUF3UXpFTE1Ba0dBMVVFQmhNQ1ZWTXhFekFSQmdOVkJBb1RcclxuQ214
MWRIZDViaTV2Y21jeEh6QWRCZ05WQkFNVEZtOTJhWEowTG14MWRIZDViaTV2Y21jdU16WTFPRGN3SGhjTk1UY3dPREkxTURneFxyXG5
NekF6V2hjTk1qSXdOek14TURneE16QXpXakE5TVFzd0NRWURWUVFHRXdKVlV6RVRNQkVHQTFVRUNoTUtiSFYwZDNsdUxtOXlaekVaXH
Jcbk1CY0dBMVVFQXhNUWIzWnBjblF1YkhWMGQzbHVMbTl5WnpDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnR
UJcclxuQUxUM3JjQnhaOXU4Zk9EN3JzdWFXeE9CMDNucHZHVnpBU1lQeWtBRm54QVBsanpNK21xSlczWjlUcnJBb3I4Ujg4b3ZGNi9C
K3QrUFxyXG5ic3BqZ1BGdGVNVWZ5ZDI2SEh1Wmw2bS9WSDg2MmlaS3owN1RNZndSZVF6bmNkYSt5dkhrWFNONEFEaXFVUmRhOFd0OEc
4MGlLUlVWXHJcbk00a2gvT3pUd0Zhd05ZZFhDcWVEckY4KzBFOFBWZFFNRG9vYnpxTjNTNWhCRDBJK291S284K0E5bkVlTzJxUW5KZ2
5OZHA1d25nTE1cclxuVFByRGhTUERQRS9WQ01FdnQ0WE5VcFJsVWswdlBWTm9wbmk1L0JUV0Z0RnFKNDRieWt4ejBDVE1lWGdZcDlYY
npmNi8yY0oxdzV5a1xyXG5ydkZvTExPUnlXR1g1TTlKaENTbzdrWlRHSDFqeEtMMjFwY1JJVk1DQXdFQUFhT0NBWEl3Z2dGdU1CMEdB
MVVkRGdRV0JCUXVjZGY2XHJcbkNlNXJuelpyeTVLYjhMcWFpRGJmN1RDQmhBWUlLd1lCQlFVSEFRRUVlREIyTUhRR0NDc0dBUVVGQnp
BQ2htaG9kSFJ3T2k4dmIzWnBcclxuY25RdWJIVjBkM2x1TG05eVp6bzRNQzl2ZG1seWRDMWxibWRwYm1VdmMyVnlkbWxqWlhNdmNHdH
BMWEpsYzI5MWNtTmxQM0psYzI5MVxyXG5jbU5sUFdOaExXTmxjblJwWm1sallYUmxKbVp2Y20xaGREMVlOVEE1TFZCRlRTMURRVEJzQ
mdOVkhTTUVaVEJqZ0JTQWRjc3NPN3hrXHJcbnkwQkdtNCtibGJOaDlmWmduYUZIcEVVd1F6RUxNQWtHQTFVRUJoTUNWVk14RXpBUkJn
TlZCQW9UQ214MWRIZDViaTV2Y21jeEh6QWRcclxuQmdOVkJBTVRGbTkyYVhKMExteDFkSGQ1Ymk1dmNtY3VNelkxT0RlQ0FoQUFNQWt
HQTFVZEV3UUNNQUF3RGdZRFZSMFBBUUgvQkFRRFxyXG5BZ1dnTUNBR0ExVWRKUUVCL3dRV01CUUdDQ3NHQVFVRkJ3TUJCZ2dyQmdFRk
JRY0RBakFiQmdOVkhSRUVGREFTZ2hCdmRtbHlkQzVzXHJcbmRYUjNlVzR1YjNKbk1BMEdDU3FHU0liM0RRRUJDd1VBQTRJQkFRQVloT
FJnb2h5dVE3SWRiaXhENTdlZDVJN1VINDFOTnFzK2M0SnVcclxuZXFiNG9XSGRtR1ZvWmR2dDBSTUNZRk4xU1p4YXRhMEcvSVFOUEtJ
VW9QeHhXZ1Fod3FaUHhsQjcwMnZFdk1YNmZIdjdoTFBma1kyWlxyXG5yL2ZpLzZ4SE5GQU05dDE5K3h5SjRrTHhPc2ZpWkdKWjF6aHF
5UEFlT3l2VFJieUtiaHh6Y29STlRmL1p0cmZ2M0xWTHhQcDJnU1hFXHJcbnZ5MnN1V2t6YUZFd000RW4rTXNuajBhZ3Ixb0RRamNLRW
twSjltc2pSMlJpb0xVVnRud3JpZU1XK2ljbnM0NjlpT3l1eWprY3M4a0lcclxuSkRGSXJ3aWg2MHJxVC9zSWlTSlAvQ2dXMGtYOU5Ra
GlvT2kraXo2WHZYSjRmNjVpZm1jeTNlaEhMcGZ6NVdQVWx1UlB0Vy96Z3pxcFxyXG4tLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tXG4i
LCJzaWduZWRGaWVsZHMiOiJzYWx0LGRhdGEsZGlnZXN0LHZhbGlkRnJvbSx2YWxpZFRvIiwidmFsaWRGcm9tIjoiMjAxNzEyMDUyMzA
yNTIiLCJ2YWxpZFRvIjoiMjAxNzEyMDYwMDAyNTIifQ== |          0 | 21478375424 |    0 | f      |            |
                          
(1 row)

engine=#  

Until fixed what would be the step to resolve, as also the restore of database failed?
The log of the db restore, where I can find it? to understand which state of the db I have now on disk... the old, the new, a partial restore or what...

can i simply delete the record and run again "engine-setup" or do "completely" roll back the db?

(Originally by gianluca.cecchi)

Comment 12 RHV bug bot 2018-08-07 09:54:33 UTC
the snippet of the failed engine db restore inside log file is:

2018-08-03 14:15:47,017+0200 INFO otopi.ovirt_engine_setup.engine_common.database database.restore:869 
Restoring file '/var/lib/ovirt-engine/backups/engine-20180803141347.gdQfiz.dump' to database localhost:
engine.
2018-08-03 14:15:47,017+0200 DEBUG otopi.plugins.ovirt_engine_setup.ovirt_engine.db.schema plugin.execu
tePipeRaw:481 executePipeRaw: [0] popen kw={'stdin': None, 'stdout': -1, 'preexec_fn': <function _enabl
eSignals at 0x35fab18>, 'env': {'PGPASSWORD': '', 'LESSOPEN': '||/usr/bin/lesspipe.sh %s', 'SSH_CLIENT'
: '192.168.1.211 56098 22', 'SELINUX_USE_CURRENT_RANGE': '', 'LOGNAME': 'root', 'USER': 'root', 'HOME':
 '/root', 'PATH': '/opt/rh/rh-postgresql95/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/b
in:/root/bin', 'LD_LIBRARY_PATH': '/opt/rh/rh-postgresql95/root/usr/lib64', 'LANG': 'en_US.UTF-8', 'TER
M': 'xterm-256color', 'SHELL': '/bin/bash', 'LIBRARY_PATH': '/opt/rh/rh-postgresql95/root/usr/lib64', '
SHLVL': '5', 'HISTSIZE': '1000', 'POSTGRESQLENV': 'COMMAND/pg_dump=str:/opt/rh/rh-postgresql95/root/usr
/bin/pg_dump          COMMAND/psql=str:/opt/rh/rh-postgresql95/root/usr/bin/psql          COMMAND/pg_re
store=str:/opt/rh/rh-postgresql95/root/usr/bin/pg_restore          COMMAND/postgresql-setup=str:/opt/rh
/rh-postgresql95/root/usr/bin/postgresql-setup          OVESETUP_PROVISIONING/postgresService=str:rh-po
stgresql95-postgresql          OVESETUP_PROVISIONING/postgresConf=str:/var/opt/rh/rh-postgresql95/lib/p
gsql/data/postgresql.conf          OVESETUP_PROVISIONING/postgresPgHba=str:/var/opt/rh/rh-postgresql95/
lib/pgsql/data/pg_hba.conf          OVESETUP_PROVISIONING/postgresPgVersion=str:/var/opt/rh/rh-postgres
ql95/lib/pgsql/data/PG_VERSION', 'MANPATH': '/opt/rh/rh-postgresql95/root/usr/share/man:', 'X_SCLS': 'r
h-postgresql95 ', 'XDG_RUNTIME_DIR': '/run/user/0', 'PYTHONPATH': '/usr/share/ovirt-engine/setup/bin/..
::', 'PGPASSFILE': '/tmp/tmpM8aXOE', 'SELINUX_ROLE_REQUESTED': '', 'MAIL': '/var/spool/mail/root', 'PKG
_CONFIG_PATH': '/opt/rh/rh-postgresql95/root/usr/lib64/pkgconfig', 'XDG_SESSION_ID': '4386', 'sclenv': 
'rh-postgresql95', 'LS_COLORS': 'rs=0:di=38;5;27:ln=38;5;51:mh=44;38;5;15:pi=40;38;5;11:so=38;5;13:do=3
8;5;5:bd=48;5;232;38;5;11:cd=48;5;232;38;5;3:or=48;5;232;38;5;9:mi=05;48;5;232;38;5;15:su=48;5;196;38;5
;15:sg=48;5;11;38;5;16:ca=48;5;196;38;5;226:tw=48;5;10;38;5;16:ow=48;5;10;38;5;21:st=48;5;21;38;5;15:ex

. . .

'XDG_CONFIG_DIRS': '/etc/opt/rh/rh-postgresql95/xdg:/etc/xdg', 'SSH_TTY': '/dev/pts/1', 'HOSTNAME': 'ovirt.lutwyn.org', 'JAVACONFDIRS': '/etc/opt/rh/rh-postgresql95/java:/etc/java', 'SELINUX_LEVEL_REQUESTED': '', 'HISTCONTROL': 'ignoredups', 'XDG_DATA_DIRS': '/opt/rh/rh-postgresql95/root/usr/share', 'PWD': '/root', 'CPATH': '/opt/rh/rh-postgresql95/root/usr/include', 'OTOPI_LOGFILE': '/var/log/ovirt-engine/setup/ovirt-engine-setup-20180803140934-1thg3k.log', 'SSH_CONNECTION': '192.168.1.211 56098 192.168.1.212 22', 'OTOPI_EXECDIR': '/root'}, 'close_fds': True, 'args': ['/opt/rh/rh-postgresql95/root/usr/bin/pg_restore', '-w', '-h', 'localhost', '-p', '5432', '-U', 'engine', '-d', 'engine', '--jobs=2', '/var/lib/ovirt-engine/backups/engine-20180803141347.gdQfiz.dump'], 'stderr': -1}
2018-08-03 14:15:47,041+0200 DEBUG otopi.plugins.ovirt_engine_setup.ovirt_engine.db.schema plugin.executePipeRaw:486 executePipeRaw: [0] pid pid=10100
2018-08-03 14:16:03,535+0200 DEBUG otopi.plugins.ovirt_engine_setup.ovirt_engine.db.schema plugin.executePipeRaw:603 executePipe-result: [0] ['/opt/rh/rh-postgresql95/root/usr/bin/pg_restore', '-w', '-h', 'localhost', '-p', '5432', '-U', 'engine', '-d', 'engine', '--jobs=2', '/var/lib/ovirt-engine/backups/engine-20180803141347.gdQfiz.dump'], rc=1
2018-08-03 14:16:03,536+0200 DEBUG otopi.ovirt_engine_setup.engine_common.database database.restore:922 db restore rc 1 stderr ['pg_restore: [archiver (db)] Error while PROCESSING TOC:', 'pg_restore: [archiver (db)] Error from TOC entry 7251; 0 0 COMMENT EXTENSION plpgsql ', 'pg_restore: [archiver (db)] could not execute query: ERROR:  must be owner of extension plpgsql', "    Command was: COMMENT ON EXTENSION plpgsql IS 'PL/pgSQL procedural language';", '', '', '', 'pg_restore: [archiver (db)] Error from TOC entry 7252; 0 0 COMMENT EXTENSION "uuid-ossp" ', 'pg_restore: [archiver (db)] could not execute query: ERROR:  must be owner of extension uuid-ossp', '    Command was: COMMENT ON EXTENSION "uuid-ossp" IS \'generate universally unique identifiers (UUIDs)\';', '', '', '', 'pg_restore: WARNING:  column "user_role_title" has type "unknown"', 'DETAIL:  Proceeding with relation creation anyway.', 'pg_restore: WARNING:  no privileges could be revoked for "public"', 'pg_restore: WARNING:  no privileges could be revoked for "public"', 'pg_restore: WARNING:  no privileges were granted for "public"', 'pg_restore: WARNING:  no privileges were granted for "public"', 'WARNING: errors ignored on restore: 2']
2018-08-03 14:16:03,536+0200 ERROR otopi.ovirt_engine_setup.engine_common.database database.restore:937 Errors while restoring engine database, please check the log file for details
2018-08-03 14:16:03,536+0200 DEBUG otopi.ovirt_engine_setup.engine_common.database database.restore:942 Errors unfiltered during restore:

pg_restore: [archiver (db)] Error from TOC entry 7252; 0 0 COMMENT EXTENSION "uuid-ossp" 
pg_restore: [archiver (db)] could not execute query: ERROR:  must be owner of extension uuid-ossp

2018-08-03 14:16:03,537+0200 DEBUG otopi.context context.dumpEnvironment:859 ENVIRONMENT DUMP - BEGIN
2018-08-03 14:16:03,537+0200 DEBUG otopi.context context.dumpEnvironment:869 ENV BASE/error=bool:'True'
2018-08-03 14:16:03,537+0200 DEBUG otopi.context context.dumpEnvironment:869 ENV BASE/exceptionInfo=list:'[(<type 'exceptions.RuntimeError'>, RuntimeError('Engine schema refresh failed',), <traceback object at 0x412ad40>)]'
2018-08-03 14:16:03,539+0200 DEBUG otopi.context context.dumpEnvironment:873 ENVIRONMENT DUMP - END
2018-08-03 14:16:03,539+0200 INFO otopi.context context.runSequence:741 Stage: Clean up
2018-08-03 14:16:03,539+0200 DEBUG otopi.context context.runSequence:745 STAGE cleanup
2018-08-03 14:16:03,541+0200 DEBUG otopi.context context._executeMethod:128 Stage cleanup METHOD otopi.plugins.otopi.dialog.answer_file.Plugin._generate_answer_file
2018-08-03 14:16:03,541+0200 DEBUG otopi.context context.dumpEnvironment:859 ENVIRONMENT DUMP - BEGIN
2018-08-03 14:16:03,542+0200 DEBUG otopi.context context.dumpEnvironment:869 ENV DIALOG/answerFileContent=str:'# OTOPI answer file, generated by human dialog
[environment:default]
QUESTION/1/ENGINE_VACUUM_FULL=str:yes
QUESTION/1/OVESETUP_CORE_ENGINE_STOP=str:ok
QUESTION/1/OVESETUP_DWH_PERFORM_BACKUP=str:yes
QUESTION/1/OVESETUP_UPDATE_FIREWALL=str:yes
QUESTION/1/OVESETUP_DIALOG_CONFIRM_SETTINGS=str:ok
QUESTION/1/DWH_VACUUM_FULL=str:yes
QUESTION/1/OVESETUP_RPMDISTRO_PACKAGE_UPGRADE=str:yes
'
2018-08-03 14:16:03,543+0200 DEBUG otopi.context context.dumpEnvironment:873 ENVIRONMENT DUMP - END
2018-08-03 14:16:03,544+0200 DEBUG otopi.context context._executeMethod:128 Stage cleanup METHOD otopi.plugins.ovirt_engine_common.base.core.misc.Plugin._cleanup

(Originally by gianluca.cecchi)

Comment 14 RHV bug bot 2018-08-07 09:54:49 UTC
Added "See also" to https://bugzilla.redhat.com/show_bug.cgi?id=1611617 since others seem to be hitting this as an interrelated issue

(Originally by Thom Carlin)

Comment 17 RHV bug bot 2018-08-07 09:55:10 UTC
Moving back to assigned, failing on master: https://ovirt-jira.atlassian.net/browse/OVIRT-2403

(Originally by Sandro Bonazzola)

Comment 19 Jiri Belka 2018-08-13 12:44:33 UTC
ok, successful update from 4.2.1.1-0.1 to 4.2.5.3-0.1

# egrep '[[:blank:]]+ovirt-engine-4\.' /var/log/yum.log  | tail -n2
Jan 16 11:02:14 Updated: ovirt-engine-4.2.1.1-0.1.el7.noarch
Aug 13 14:40:14 Updated: ovirt-engine-4.2.5.3-0.1.el7ev.noarch

Comment 21 errata-xmlrpc 2018-08-16 15:11:08 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2018:2471

Comment 22 Yedidyah Bar David 2018-12-03 11:05:12 UTC
Daniel - can you please describe how to reproduce current bug? I am pretty certain it does not always reproduce on any random upgrade - you need to have such stale lines in image_transfers . How to cause this to happen? Can't see this mentioned anywhere, including comment 19. A simple 'INSERT' might be enough for testing.

I am almost certain current bug is not fixed if going through 4.2.5, because the updated script is ignored then:

Skipping upgrade script /usr/share/ovirt-engine/
dbscripts/upgrade/04_02_1210_add_foreign_key_to_image_transfers.sql, its version 04021210 is <= current version 04021210

But: Perhaps this isn't really an issue. Because if you managed to upgrade to 4.2.5 (perhaps by manually removing stale lines), you already have the constraint, so should not anymore have such stale lines anyway. So not reopening for now.

I am now working on bug 1655482 and wonder if there is any point at all in keeping the fix for current bug in 4.3 - it might be enough to simply drop it altogether, see http://gerrit.ovirt.org/95931 . Logic is same as above - if you managed to get to latest 4.2, either through 4.2.5 (where you did not run the 'DELETE' but do have the constraint) or through 4.2.6+ (ran the 'DELETE' and also created the constraint), you do not need to first delete the lines anymore.

Comment 23 Daniel Erez 2018-12-03 11:33:02 UTC
(In reply to Yedidyah Bar David from comment #22)
> Daniel - can you please describe how to reproduce current bug? I am pretty
> certain it does not always reproduce on any random upgrade - you need to
> have such stale lines in image_transfers . How to cause this to happen?

The issue was better described in bug 1586126. We had an issue of 'zombie' image_transfers records (i.e. without correlated command_entities
records). It was caused due to lack of a foreign key constraint. So, when cleaning command_entities from database (e.g. by using our taskcleaner), the stale image_transfers records still exist in DB. Thus, we get the foreign key constraint violation.

> Can't see this mentioned anywhere, including comment 19. A simple 'INSERT'
> might be enough for testing.
> 
> I am almost certain current bug is not fixed if going through 4.2.5, because
> the updated script is ignored then:
> 
> Skipping upgrade script /usr/share/ovirt-engine/
> dbscripts/upgrade/04_02_1210_add_foreign_key_to_image_transfers.sql, its
> version 04021210 is <= current version 04021210
> 
> But: Perhaps this isn't really an issue. Because if you managed to upgrade
> to 4.2.5 (perhaps by manually removing stale lines), you already have the
> constraint, so should not anymore have such stale lines anyway. So not
> reopening for now.
> 
> I am now working on bug 1655482 and wonder if there is any point at all in
> keeping the fix for current bug in 4.3 - it might be enough to simply drop
> it altogether, see http://gerrit.ovirt.org/95931 . Logic is same as above -
> if you managed to get to latest 4.2, either through 4.2.5 (where you did not
> run the 'DELETE' but do have the constraint) or through 4.2.6+ (ran the
> 'DELETE' and also created the constraint), you do not need to first delete
> the lines anymore.

What about upgrading from 4.2 (<4.2.5) straight to 4.3? If there's any stale image_transfers record, then the constraint creation would fail.

Comment 24 Daniel Gur 2019-08-28 13:14:28 UTC
sync2jira

Comment 25 Daniel Gur 2019-08-28 13:19:31 UTC
sync2jira


Note You need to log in before you can comment on or make changes to this bug.