Bug 1425116

Summary: OSP10 -> OSP11 upgrade fails during aodh-dbsync
Product: Red Hat OpenStack Reporter: Marius Cornea <mcornea>
Component: openstack-aodhAssignee: Pradeep Kilambi <pkilambi>
Status: CLOSED ERRATA QA Contact: Sasha Smolyak <ssmolyak>
Severity: urgent Docs Contact:
Priority: unspecified    
Version: 11.0 (Ocata)CC: apevec, dbecker, fbaudin, jdanjou, jschluet, lhh, mburns, morazi, pkilambi, rhel-osp-director-maint
Target Milestone: rcKeywords: Triaged
Target Release: 11.0 (Ocata)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: openstack-aodh-4.0.0-2.el7ost Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2017-05-17 20:01:13 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---

Description Marius Cornea 2017-02-20 15:28:58 UTC
Description of problem:
OSP10 -> OSP11 overcloud upgrade fails during aodh-dbsync:
ProgrammingError: (pymysql.err.ProgrammingError) (1146, u"Table 'aodh.alarm_change' doesn't exist") [SQL: u'ALTER TABLE alarm_change ADD COLUMN timestamp_ts DATETIME(6)']


Version-Release number of selected component (if applicable):
openstack-aodh-evaluator-4.0.1-0.20170210160347.e062a0a.el7ost.noarch
openstack-aodh-common-4.0.1-0.20170210160347.e062a0a.el7ost.noarch
openstack-aodh-notifier-4.0.1-0.20170210160347.e062a0a.el7ost.noarch
openstack-aodh-listener-4.0.1-0.20170210160347.e062a0a.el7ost.noarch
openstack-aodh-api-4.0.1-0.20170210160347.e062a0a.el7ost.noarch

How reproducible:
100%

Steps to Reproduce:
1. Upgrade OSP10 overcloud to OSP11 overcloud

Actual results:
Overcloud upgrade fails:

    Error: /Stage[main]/Aodh::Db::Sync/Exec[aodh-db-sync]: Failed to call refresh: aodh-dbsync --config-file /etc/aodh/aodh.conf returned 1 instead of one of [0]
    Error: /Stage[main]/Aodh::Db::Sync/Exec[aodh-db-sync]: aodh-dbsync --config-file /etc/aodh/aodh.conf returned 1 instead of one of [0]
    Error: /Stage[main]/Gnocchi::Db::Sync/Exec[gnocchi-db-sync]: Failed to call refresh: gnocchi-upgrade --config-file /etc/gnocchi/gnocchi.conf --skip-storage returned 1 instead of one of [0]
    Error: /Stage[main]/Gnocchi::Db::Sync/Exec[gnocchi-db-sync]: gnocchi-upgrade --config-file /etc/gnocchi/gnocchi.conf --skip-storage returned 1 instead of one of [0]


Expected results:
aodh-dbsync --config-file /etc/aodh/aodh.conf gets run successfully

Additional info:
This is already fixed in upstream:
https://review.openstack.org/#/c/431055/

Comment 2 Mike Burns 2017-02-23 14:09:06 UTC
> Additional info:
> This is already fixed in upstream:
> https://review.openstack.org/#/c/431055/

It's fixed in upstream *master*.  It is not available in the stable/ocata branch.  Please work with the Telemetry team to get it backported to stable ocata.

Comment 5 errata-xmlrpc 2017-05-17 20:01:13 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2017:1245