Bug 1513902 - Resolve all failing heat_integrationtests on downstream
Summary: Resolve all failing heat_integrationtests on downstream
Keywords:
Status: CLOSED NEXTRELEASE
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-heat
Version: 12.0 (Pike)
Hardware: Unspecified
OS: Unspecified
low
low
Target Milestone: ---
: 12.0 (Pike)
Assignee: Rabi Mishra
QA Contact: Victor Voronkov
URL:
Whiteboard:
Depends On: 1651968
Blocks:
TreeView+ depends on / blocked
 
Reported: 2017-11-16 09:19 UTC by Ronnie Rasouli
Modified: 2018-12-13 19:21 UTC (History)
9 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2018-12-13 19:21:29 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)
tempest log from last run (11.71 MB, text/plain)
2017-11-16 09:19 UTC, Ronnie Rasouli
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Gerrithub.io 387289 0 None None None 2017-11-16 09:27:03 UTC

Description Ronnie Rasouli 2017-11-16 09:19:56 UTC
Created attachment 1353339 [details]
tempest log from last run

Description of problem:

Heat tempest automation testing is failing on downstream puddles, there appear to be several issues that breakes the downstream CI testing.


Version-Release number of selected component (if applicable):
RHOS12 

How reproducible:
100%

Steps to Reproduce:
1. deploy RHOS12
2. install tempest
3. prepare heat integration tests with the following playbook
https://github.com/rrasouli/rhos-capps-dfg/blob/master/heat_setup.yml
4. run the tempest 'ostestr --regex  ^heat_integrationtests'

Actual results:
heat_integrationtests.functional.test_aws_stack.AwsStackTest.test_nested_stack_adopt_fail
heat_integrationtests.functional.test_aws_stack.AwsStackTest.test_nested_stack_adopt_ok
heat_integrationtests.functional.test_event_sinks.ZaqarEventSinkTest.test_events
heat_integrationtests.functional.test_notifications.NotificationTest.test_asg_notifications
heat_integrationtests.functional.test_create_update.UpdateStackTest.test_stack_update_with_replacing_userdata
heat_integrationtests.functional.test_nova_server_networks.CreateServerTest.test_create_server_with_port
heat_integrationtests.functional.test_os_wait_condition.OSWaitCondition.test_create_stack_with_multi_signal_waitcondition
heat_integrationtests.functional.test_purge.PurgeTest.test_purge
heat_integrationtests.functional.test_reload_on_sighup.ReloadOnSighupTest.test_api_cloudwatch_on_sighup
heat_integrationtests.functional.test_reload_on_sighup.ReloadOnSighupTest.test_api_cfn_reload_on_sighup
heat_integrationtests.functional.test_reload_on_sighup.ReloadOnSighupTest.test_api_reload_on_sighup
heat_integrationtests.functional.test_resource_group.ResourceGroupAdoptTest.test_adopt
heat_integrationtests.functional.test_waitcondition.ZaqarWaitConditionTest.test_signal_queues
heat_integrationtests.scenario.test_base_resources.BasicResourcesTest.test_base_resources_integration
heat_integrationtests.functional.test_cancel_update.CancelUpdateTest.test_cancel_update_server_with_port
heat_integrationtests.functional.test_notifications.NotificationTest.test_basic_notifications
heat_integrationtests.functional.test_stack_tags.StackTagTest.test_hidden_stack
heat_integrationtests.functional.test_template_resource.TemplateResourceAdoptTest.test_adopt
heat_integrationtests.functional.test_software_config.ZaqarSignalTransportTest.test_signal_queues
heat_integrationtests.scenario.test_aodh_alarm.AodhAlarmTest.test_alarm
heat_integrationtests.functional.test_template_resource.TemplateResourceAdoptTest.test_abandon
heat_integrationtests.scenario.test_volumes.VolumeBackupRestoreIntegrationTest.test_cinder_volume_create_backup_restore
heat_integrationtests.scenario.test_server_cfn_init.CfnInitIntegrationTest.test_server_cfn_init
heat_integrationtests.scenario.test_server_software_config.SoftwareConfigIntegrationTest.test_server_software_config


Expected results:
All tests aligned with upstream tests

Additional info:

Comment 1 Ronnie Rasouli 2017-11-16 09:39:45 UTC
Removing configuration (adopt, abandon) and non supported functionality, Zaqar.

heat_integrationtests.functional.test_create_update.UpdateStackTest.test_stack_update_with_replacing_userdata

heat_integrationtests.functional.test_os_wait_condition.OSWaitCondition.test_create_stack_with_multi_signal_waitcondition

heat_integrationtests.functional.test_purge.PurgeTest.test_purge

heat_integrationtests.scenario.test_base_resources.BasicResourcesTest.test_base_resources_integration

heat_integrationtests.functional.test_cancel_update.CancelUpdateTest.test_cancel_update_server_with_port

heat_integrationtests.functional.test_stack_tags.StackTagTest.test_hidden_stack

heat_integrationtests.scenario.test_aodh_alarm.AodhAlarmTest.test_alarm

heat_integrationtests.scenario.test_server_cfn_init.CfnInitIntegrationTest.test_server_cfn_init

Comment 2 Uemit Seren 2018-03-28 11:12:51 UTC
The heat_integrationtests.functional.test_stack_tags.StackTagTest.test_hidden_stack fails due to the fact that hidden_stack_tags is not set in the heat.conf. If you set "hidden_stack_tags=hidden" in the heat.conf it should work fine.

Comment 3 Zane Bitter 2018-03-28 13:41:00 UTC
(In reply to Uemit Seren from comment #2)
> The
> heat_integrationtests.functional.test_stack_tags.StackTagTest.
> test_hidden_stack fails due to the fact that hidden_stack_tags is not set in
> the heat.conf. If you set "hidden_stack_tags=hidden" in the heat.conf it
> should work fine.

There's patches to resolve this upstream for future releases:

https://review.openstack.org/554517
https://review.openstack.org/554518

Comment 4 Emilien Macchi 2018-11-26 15:22:03 UTC
Victor, can you please take a look at this one?

Comment 5 Emilien Macchi 2018-12-13 19:21:29 UTC
Works in future releases and OSP12 is EOL very soon. Closing it.


Note You need to log in before you can comment on or make changes to this bug.