Bug 2225011 - [OSP 16.2 -> 17.1] Undercloud upgrade fails on 'migrate existing introspection data' with lost connection to mysql.
Summary: [OSP 16.2 -> 17.1] Undercloud upgrade fails on 'migrate existing introspectio...
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: documentation
Version: 17.1 (Wallaby)
Hardware: Unspecified
OS: Unspecified
medium
medium
Target Milestone: ---
: ---
Assignee: kgilliga
QA Contact: RHOS Documentation Team
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2023-07-24 08:59 UTC by Ravi Singh
Modified: 2024-07-30 13:29 UTC (History)
5 users (show)

Fixed In Version:
Doc Type: No Doc Update
Doc Text:
Clone Of:
Environment:
Last Closed: 2024-07-30 13:29:14 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Issue Tracker OSP-26840 0 None None None 2023-07-24 09:01:37 UTC
Red Hat Knowledge Base (Solution) 7025512 0 None None None 2024-07-08 13:25:49 UTC

Description Ravi Singh 2023-07-24 08:59:38 UTC
Description of problem:

Re-run of undercloud upgrade(16.2->17.1) failed with following error:

+++
2023-07-19 08:15:18.869778 | 525400cf-381f-5864-38c7-00000000073e |      FATAL | migrate existing introspection data | undercloud | error={"changed": true, "cmd": "podman exec -u root ironic_inspector ironic-inspector-migrate-data --from swift --to database --config-file /etc/ironic-inspector/inspector.conf\n", "delta": "0:01:42.467282", "end": "2023-07-19 08:15:18.830981", "failed_when_result": true, "msg": "non-zero return code", "rc": 1, "start": "2023-07-19 08:13:36.363699", "stderr": "b\"(pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query')\\n(Background on this error at: http://sqlalche.me/e/e3q8)\"", "stderr_lines":["b\"(pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query')\\n(Background on this error at: http://sqlalche.me/e/e3q8)\""], "stdout": "", "stdout_lines": []}
+++

Version-Release number of selected component (if applicable):
17.1

How reproducible:
Everytime

Steps to Reproduce:

1. Run 1st time undercloud upgrade which failed with some reason(in this case it failed while pulling images due to wrong tagging).
2. Re-run undercloud upgrade  after fixing issue in step-1. Upgrade failed on

~~~
2023-07-19 08:15:18.869778 | 525400cf-381f-5864-38c7-00000000073e |      FATAL | migrate existing introspection data | undercloud | error={"changed": true, "cmd": "podman exec -u root ironic_inspector ironic-inspector-migrate-data --from swift --to database --config-file /etc/ironic-inspector/inspector.conf\n", "delta": "0:01:42.467282", "end": "2023-07-19 08:15:18.830981", "failed_when_result": true, "msg": "non-zero return code", "rc": 1, "start": "2023-07-19 08:13:36.363699", "stderr": "b\"(pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query')\\n(Background on this error at: http://sqlalche.me/e/e3q8)\"", "stderr_lines":["b\"(pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query')\\n(Background on this error at: http://sqlalche.me/e/e3q8)\""], "stdout": "", "stdout_lines": []}
~~~
3. Retart tripleo_mysql.service & upgrade passes.
Actual results:

Upgrade failed during re-run.

Expected results:

Should pass.

Additional info:


Note You need to log in before you can comment on or make changes to this bug.