Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1455141

Summary:	OSP10 -> OSP11 upgrade fails while exectuing neutron-db-sync neutron-db-manage upgrade heads returned 1 instead of one of [0]
Product:	Red Hat OpenStack	Reporter:	Marius Cornea <mcornea>
Component:	python-networking-bigswitch	Assignee:	mathieu bultel <mbultel>
Status:	CLOSED ERRATA	QA Contact:	Marius Cornea <mcornea>
Severity:	urgent	Docs Contact:
Priority:	urgent
Version:	11.0 (Ocata)	CC:	amuller, dbecker, ihrachys, jschluet, lhh, mbultel, mburns, mcornea, morazi, rhel-osp-director-maint, sclewis, slinaber
Target Milestone:	async	Keywords:	Triaged, ZStream
Target Release:	11.0 (Ocata)
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:	python-networking-bigswitch-10.0.4-7.el7ost	Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2017-06-15 16:56:20 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Marius Cornea 2017-05-24 10:48:50 UTC

Description of problem:
OSP10 -> OSP11 upgrade fails while exectuing neutron-db-sync neutron-db-manage  upgrade heads returned 1 instead of one of [0]

Version-Release number of selected component (if applicable):
openstack-tripleo-heat-templates-6.0.0-12.el7ost.noarch.rpm  
openstack-neutron-10.0.1-3.el7ost.noarch.rpm   
python-networking-bigswitch-10.0.4-5.el7ost.noarch.rpm   

How reproducible:
100%

Steps to Reproduce:
1. Deploy OSP10 latest
2. Upgrade to OSP11 latest

Actual results:
Upgrade fails during major-upgrade-composable-steps.yaml, while running neutron-db-sync.

Expected results:
Upgrade doesn't fail.

Additional info:
I am currently deploying a reproducing environment to pick up the logs.

Comment 2 Marius Cornea 2017-05-24 12:44:50 UTC

Full trace:

[root@overcloud-controller-0 heat-admin]# neutron-db-manage  upgrade heads
INFO  [alembic.runtime.migration] Context impl MySQLImpl.
INFO  [alembic.runtime.migration] Will assume non-transactional DDL.
  Running upgrade for neutron ...
INFO  [alembic.runtime.migration] Context impl MySQLImpl.
INFO  [alembic.runtime.migration] Will assume non-transactional DDL.
  OK
INFO  [alembic.runtime.migration] Context impl MySQLImpl.
INFO  [alembic.runtime.migration] Will assume non-transactional DDL.
Traceback (most recent call last):
  File "/bin/neutron-db-manage", line 10, in <module>
    sys.exit(main())
  File "/usr/lib/python2.7/site-packages/neutron/db/migration/cli.py", line 686, in main
    return_val |= bool(CONF.command.func(config, CONF.command.name))
  File "/usr/lib/python2.7/site-packages/neutron/db/migration/cli.py", line 205, in do_upgrade
    run_sanity_checks(config, revision)
  File "/usr/lib/python2.7/site-packages/neutron/db/migration/cli.py", line 670, in run_sanity_checks
    script_dir.run_env()
  File "/usr/lib/python2.7/site-packages/alembic/script/base.py", line 407, in run_env
    util.load_python_file(self.dir, 'env.py')
  File "/usr/lib/python2.7/site-packages/alembic/util/pyfiles.py", line 93, in load_python_file
    module = load_module_py(module_id, path)
  File "/usr/lib/python2.7/site-packages/alembic/util/compat.py", line 79, in load_module_py
    mod = imp.load_source(module_id, path, fp)
  File "/usr/lib/python2.7/site-packages/networking_bigswitch/plugins/bigswitch/db/migration/alembic_migrations/env.py", line 86, in <module>
    run_migrations_online()
  File "/usr/lib/python2.7/site-packages/networking_bigswitch/plugins/bigswitch/db/migration/alembic_migrations/env.py", line 77, in run_migrations_online
    context.run_migrations()
  File "<string>", line 8, in run_migrations
  File "/usr/lib/python2.7/site-packages/alembic/runtime/environment.py", line 797, in run_migrations
    self.get_context().run_migrations(**kw)
  File "/usr/lib/python2.7/site-packages/alembic/runtime/migration.py", line 303, in run_migrations
    for step in self._migrations_fn(heads, self):
  File "/usr/lib/python2.7/site-packages/neutron/db/migration/cli.py", line 661, in check_sanity
    revision, rev, implicit_base=True):
  File "/usr/lib/python2.7/site-packages/alembic/script/revision.py", line 641, in _iterate_revisions
    requested_lowers = self.get_revisions(lower)
  File "/usr/lib/python2.7/site-packages/alembic/script/revision.py", line 298, in get_revisions
    return sum([self.get_revisions(id_elem) for id_elem in id_], ())
  File "/usr/lib/python2.7/site-packages/alembic/script/revision.py", line 303, in get_revisions
    for rev_id in resolved_id)
  File "/usr/lib/python2.7/site-packages/alembic/script/revision.py", line 303, in <genexpr>
    for rev_id in resolved_id)
  File "/usr/lib/python2.7/site-packages/alembic/script/revision.py", line 358, in _revision_for_ident
    resolved_id)
alembic.script.revision.ResolutionError: No such revision or branch 'f774eae87144'

Comment 3 Assaf Muller 2017-05-24 13:00:24 UTC

Mike Burns found bugs that may be relevant:

Related RHBZs that hit latest OSP 10 puddle:
https://bugzilla.redhat.com/show_bug.cgi?id=1454441
https://bugzilla.redhat.com/show_bug.cgi?id=1444536

And OSP 11 latest update:
https://bugzilla.redhat.com/show_bug.cgi?id=1445917

Comment 13 errata-xmlrpc 2017-06-15 16:56:20 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2017:1474