Bug 1513902

Summary: Resolve all failing heat_integrationtests on downstream
Product: Red Hat OpenStack Reporter: Ronnie Rasouli <rrasouli>
Component: openstack-heatAssignee: Rabi Mishra <ramishra>
Status: CLOSED NEXTRELEASE QA Contact: Victor Voronkov <vvoronko>
Severity: low Docs Contact:
Priority: low    
Version: 12.0 (Pike)CC: emacchi, mburns, rhel-osp-director-maint, sbaker, shardy, srevivo, therve, uemit.seren, vvoronko
Target Milestone: ---Keywords: Triaged, ZStream
Target Release: 12.0 (Pike)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-12-13 19:21:29 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1651968    
Bug Blocks:    
Attachments:
Description Flags
tempest log from last run none

Description Ronnie Rasouli 2017-11-16 09:19:56 UTC 
Created attachment 1353339 [details]
tempest log from last run

Description of problem:

Heat tempest automation testing is failing on downstream puddles, there appear to be several issues that breakes the downstream CI testing.


Version-Release number of selected component (if applicable):
RHOS12 

How reproducible:
100%

Steps to Reproduce:
1. deploy RHOS12
2. install tempest
3. prepare heat integration tests with the following playbook
https://github.com/rrasouli/rhos-capps-dfg/blob/master/heat_setup.yml
4. run the tempest 'ostestr --regex  ^heat_integrationtests'

Actual results:
heat_integrationtests.functional.test_aws_stack.AwsStackTest.test_nested_stack_adopt_fail
heat_integrationtests.functional.test_aws_stack.AwsStackTest.test_nested_stack_adopt_ok
heat_integrationtests.functional.test_event_sinks.ZaqarEventSinkTest.test_events
heat_integrationtests.functional.test_notifications.NotificationTest.test_asg_notifications
heat_integrationtests.functional.test_create_update.UpdateStackTest.test_stack_update_with_replacing_userdata
heat_integrationtests.functional.test_nova_server_networks.CreateServerTest.test_create_server_with_port
heat_integrationtests.functional.test_os_wait_condition.OSWaitCondition.test_create_stack_with_multi_signal_waitcondition
heat_integrationtests.functional.test_purge.PurgeTest.test_purge
heat_integrationtests.functional.test_reload_on_sighup.ReloadOnSighupTest.test_api_cloudwatch_on_sighup
heat_integrationtests.functional.test_reload_on_sighup.ReloadOnSighupTest.test_api_cfn_reload_on_sighup
heat_integrationtests.functional.test_reload_on_sighup.ReloadOnSighupTest.test_api_reload_on_sighup
heat_integrationtests.functional.test_resource_group.ResourceGroupAdoptTest.test_adopt
heat_integrationtests.functional.test_waitcondition.ZaqarWaitConditionTest.test_signal_queues
heat_integrationtests.scenario.test_base_resources.BasicResourcesTest.test_base_resources_integration
heat_integrationtests.functional.test_cancel_update.CancelUpdateTest.test_cancel_update_server_with_port
heat_integrationtests.functional.test_notifications.NotificationTest.test_basic_notifications
heat_integrationtests.functional.test_stack_tags.StackTagTest.test_hidden_stack
heat_integrationtests.functional.test_template_resource.TemplateResourceAdoptTest.test_adopt
heat_integrationtests.functional.test_software_config.ZaqarSignalTransportTest.test_signal_queues
heat_integrationtests.scenario.test_aodh_alarm.AodhAlarmTest.test_alarm
heat_integrationtests.functional.test_template_resource.TemplateResourceAdoptTest.test_abandon
heat_integrationtests.scenario.test_volumes.VolumeBackupRestoreIntegrationTest.test_cinder_volume_create_backup_restore
heat_integrationtests.scenario.test_server_cfn_init.CfnInitIntegrationTest.test_server_cfn_init
heat_integrationtests.scenario.test_server_software_config.SoftwareConfigIntegrationTest.test_server_software_config


Expected results:
All tests aligned with upstream tests

Additional info:
Comment 1 Ronnie Rasouli 2017-11-16 09:39:45 UTC 
Removing configuration (adopt, abandon) and non supported functionality, Zaqar.

heat_integrationtests.functional.test_create_update.UpdateStackTest.test_stack_update_with_replacing_userdata

heat_integrationtests.functional.test_os_wait_condition.OSWaitCondition.test_create_stack_with_multi_signal_waitcondition

heat_integrationtests.functional.test_purge.PurgeTest.test_purge

heat_integrationtests.scenario.test_base_resources.BasicResourcesTest.test_base_resources_integration

heat_integrationtests.functional.test_cancel_update.CancelUpdateTest.test_cancel_update_server_with_port

heat_integrationtests.functional.test_stack_tags.StackTagTest.test_hidden_stack

heat_integrationtests.scenario.test_aodh_alarm.AodhAlarmTest.test_alarm

heat_integrationtests.scenario.test_server_cfn_init.CfnInitIntegrationTest.test_server_cfn_init
Comment 2 Uemit Seren 2018-03-28 11:12:51 UTC 
The heat_integrationtests.functional.test_stack_tags.StackTagTest.test_hidden_stack fails due to the fact that hidden_stack_tags is not set in the heat.conf. If you set "hidden_stack_tags=hidden" in the heat.conf it should work fine.
Comment 3 Zane Bitter 2018-03-28 13:41:00 UTC 
(In reply to Uemit Seren from comment #2)
> The
> heat_integrationtests.functional.test_stack_tags.StackTagTest.
> test_hidden_stack fails due to the fact that hidden_stack_tags is not set in
> the heat.conf. If you set "hidden_stack_tags=hidden" in the heat.conf it
> should work fine.

There's patches to resolve this upstream for future releases:

https://review.openstack.org/554517
https://review.openstack.org/554518
Comment 4 Emilien Macchi 2018-11-26 15:22:03 UTC 
Victor, can you please take a look at this one?
Comment 5 Emilien Macchi 2018-12-13 19:21:29 UTC 
Works in future releases and OSP12 is EOL very soon. Closing it.