Bug 1228038

Summary: Several tests failed with tempest Overcloud on API tests
Product: [Community] RDO Reporter: mathieu bultel <mbultel>
Component: tempestAssignee: David Kranz <dkranz>
Status: CLOSED NOTABUG QA Contact: tkammer
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: KiloCC: whayutin
Target Milestone: ---   
Target Release: Kilo   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2015-08-17 20:36:06 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description mathieu bultel 2015-06-04 06:22:47 UTC 
After running instack-deploy-overcloud --tuskar on a virt environment on CentOS, the tempest execution on API tests result :


86/399 tests failed :

    test_aggregate_add_host_create_server_with_az[id-96be03c7-570d-409c-90f8-e4db3c646996]FAIL
    ServersAdminTestJSON)                                             FAIL
    ServersAdminNegativeTestJSON)                                     FAIL
    TenantUsagesTestJSON)                                             FAIL
    test_create_root_certificate[id-c070a441-b08e-447e-a733-905909535b1b]FAIL
    test_get_root_certificate[id-3ac273d0-92d2-4632-bdfc-afbc21d4606c]FAIL
    FloatingIPsTestJSON)                                              FAIL
    FloatingIPsNegativeTestJSON)                                      FAIL
    FloatingIPDetailsTestJSON)                                        FAIL
    test_delete_saving_image[id-aa06b52b-2db5-4807-b218-9441f75d74e3] FAIL
    test_create_image_from_deleted_server[id-6cd5a89d-5b47-46a7-93bc-3916f0d84973,negative]FAIL
    test_create_image_from_stopped_server[id-aaacd1d0-55a2-4ce8-818a-b5439df8adc9,negative]FAIL
    ImagesOneServerTestJSON)                                          FAIL
    ImagesOneServerNegativeTestJSON)                                  FAIL
    ListImageFiltersTestJSON)                                         FAIL
    SecurityGroupRulesTestJSON)                                       FAIL
    SecurityGroupRulesNegativeTestJSON)                               FAIL
    SecurityGroupsTestJSON)                                           FAIL
    SecurityGroupsNegativeTestJSON)                                   FAIL
    AttachInterfacesTestJSON)                                         FAIL
    ServersTestJSON)                                                  FAIL
    ServersTestManualDisk)                                            FAIL
    test_admin_delete_servers_of_others[id-73177903-6737-4f27-a60c-379e8ae8cf48]FAIL
    test_delete_server_while_in_error_state[id-99774678-e072-49d1-9d2a-49a59bc56063]FAIL
    test_delete_active_server[id-925fdfb4-5b13-47ea-ac8a-c36ae6fddb05]FAIL
    test_delete_server_while_in_attached_volume[id-d0f3f0d6-d9b6-4a32-8da4-23015dcab23c,volume]FAIL
    test_delete_server_while_in_pause_state[id-943bd6e8-4d7a-4904-be83-7a6cc2d4213b]FAIL
    test_delete_server_while_in_shelved_state[id-bb0cb402-09dd-4947-b6e5-5e7e1cfa61ad]FAIL
    test_delete_server_while_in_shutoff_state[id-546d368c-bb6c-4645-979a-83ed16f3a6be]FAIL
    test_delete_server_while_in_suspended_state[id-1f82ebd3-8253-4f4e-b93f-de9b7df56d8b]FAIL
    ServerDiskConfigTestJSON)                                         FAIL
    InstanceActionsTestJSON)                                          FAIL
    InstanceActionsNegativeTestJSON)                                  FAIL
    ListServerFiltersTestJSON)                                        FAIL
    ListServersNegativeTestJSON)                                      FAIL
    ServerActionsTestJSON)                                            FAIL
    ServerAddressesTestJSON)                                          FAIL
    ServerAddressesNegativeTestJSON)                                  FAIL
    ServerMetadataTestJSON)                                           FAIL
    ServerMetadataNegativeTestJSON)                                   FAIL
    ServerPasswordTestJSON)                                           FAIL
    ServerRescueTestJSON)                                             FAIL
    ServerRescueNegativeTestJSON)                                     FAIL
    test_create_server_with_ipv6_addr_only[id-38fb1d02-c3c5-41de-91d3-9bc2025a75eb]FAIL
    test_create_specify_keypair[id-f9e15296-d7f9-4e62-b53f-a04e89160833]FAIL
    test_create_with_existing_server_name[id-8fea6be7-065e-47cf-89b8-496e6f96c699]FAIL
    test_update_access_server_address[id-89b90870-bc13-4b73-96af-f9d4f2b70077]FAIL
    test_update_server_name[id-5e6ccff8-349d-4852-a8b3-055df7988dd2]  FAIL
    test_update_server_name_in_stop_state[id-6ac19cb1-27a3-40ec-b350-810bdc04c08e]FAIL
    ServersNegativeTestJSON)                                          FAIL
    VirtualInterfacesTestJSON)                                        FAIL
    AuthorizationTestJSON)                                            FAIL
    test_invalid_host_for_migration[id-7fb7856e-ae92-44c9-861a-af62d7830bcb,negative]FAIL
    AttachVolumeTestJSON)                                             FAIL
    RolesTestJSON)                                                    FAIL
    RolesNegativeTestJSON)                                            FAIL
    ServicesTestJSON)                                                 FAIL
    TenantsNegativeTestJSON)                                          FAIL
    TenantsTestJSON)                                                  FAIL
    TokensTestJSON)                                                   FAIL
    UsersTestJSON)                                                    FAIL
    UsersNegativeTestJSON)                                            FAIL
    CredentialsTestJSON)                                              FAIL
    DomainsTestJSON)                                                  FAIL
    EndPointsTestJSON)                                                FAIL
    EndpointsNegativeTestJSON)                                        FAIL
    GroupsV3TestJSON)                                                 FAIL
    ListProjectsTestJSON)                                             FAIL
    UsersV3TestJSON)                                                  FAIL
    PoliciesTestJSON)                                                 FAIL
    ProjectsTestJSON)                                                 FAIL
    ProjectsNegativeTestJSON)                                         FAIL
    RegionsTestJSON)                                                  FAIL
    RolesV3TestJSON)                                                  FAIL
    ServicesTestJSON)                                                 FAIL
    TokensV3TestJSON)                                                 FAIL
    TrustsV3TestJSON)                                                 FAIL
    UsersV3TestJSON)                                                  FAIL
    ExtensionTestJSON)                                                FAIL
    TokensTest)                                                       FAIL
    TokensV3Test)                                                     FAIL
    test_register_http_image[id-6d0e13a7-515b-460c-b91f-9f4793f09816] FAIL
    test_register_remote_image[id-69da74d9-68a9-404b-9664-ff7164ccb0f5]FAIL
    ListImagesTest)                                                   FAIL
    DHCPAgentSchedulersTestJSON)                                      FAIL
    test_delete_external_networks_with_floating_ip[id-82068503-2cf2-4ed4-b3be-ecb89432e4bb]FAIL
FAIL: tempest.api.compute.admin.test_aggregates.AggregatesAdminTestJSON.test_aggregate_add_host_create_server_with_az[id-96be03c7-570d-409c-90f8-e4db3c646996]
FAIL: setUpClass (tempest.api.compute.admin.test_servers.ServersAdminTestJSON)
FAIL: setUpClass (tempest.api.compute.admin.test_servers_negative.ServersAdminNegativeTestJSON)
FAIL: setUpClass (tempest.api.compute.admin.test_simple_tenant_usage.TenantUsagesTestJSON)
FAIL: tempest.api.compute.certificates.test_certificates.CertificatesV2TestJSON.test_create_root_certificate[id-c070a441-b08e-447e-a733-905909535b1b]
FAIL: tempest.api.compute.certificates.test_certificates.CertificatesV2TestJSON.test_get_root_certificate[id-3ac273d0-92d2-4632-bdfc-afbc21d4606c]
FAIL: setUpClass (tempest.api.compute.floating_ips.test_floating_ips_actions.FloatingIPsTestJSON)
FAIL: setUpClass (tempest.api.compute.floating_ips.test_floating_ips_actions_negative.FloatingIPsNegativeTestJSON)
FAIL: setUpClass (tempest.api.compute.floating_ips.test_list_floating_ips.FloatingIPDetailsTestJSON)
FAIL: tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image[id-aa06b52b-2db5-4807-b218-9441f75d74e3]
FAIL: tempest.api.compute.images.test_images_negative.ImagesNegativeTestJSON.test_create_image_from_deleted_server[id-6cd5a89d-5b47-46a7-93bc-3916f0d84973,negative]
FAIL: tempest.api.compute.images.test_images_negative.ImagesNegativeTestJSON.test_create_image_from_stopped_server[id-aaacd1d0-55a2-4ce8-818a-b5439df8adc9,negative]
FAIL: setUpClass (tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON)
FAIL: setUpClass (tempest.api.compute.images.test_images_oneserver_negative.ImagesOneServerNegativeTestJSON)
FAIL: setUpClass (tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON)
FAIL: setUpClass (tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON)
FAIL: setUpClass (tempest.api.compute.security_groups.test_security_group_rules_negative.SecurityGroupRulesNegativeTestJSON)
FAIL: setUpClass (tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON)
FAIL: setUpClass (tempest.api.compute.security_groups.test_security_groups_negative.SecurityGroupsNegativeTestJSON)
FAIL: setUpClass (tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON)
FAIL: setUpClass (tempest.api.compute.servers.test_create_server.ServersTestJSON)
FAIL: setUpClass (tempest.api.compute.servers.test_create_server.ServersTestManualDisk)
FAIL: tempest.api.compute.servers.test_delete_server.DeleteServersAdminTestJSON.test_admin_delete_servers_of_others[id-73177903-6737-4f27-a60c-379e8ae8cf48]
FAIL: tempest.api.compute.servers.test_delete_server.DeleteServersAdminTestJSON.test_delete_server_while_in_error_state[id-99774678-e072-49d1-9d2a-49a59bc56063]
FAIL: tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server[id-925fdfb4-5b13-47ea-ac8a-c36ae6fddb05]
FAIL: tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_server_while_in_attached_volume[id-d0f3f0d6-d9b6-4a32-8da4-23015dcab23c,volume]
FAIL: tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_server_while_in_pause_state[id-943bd6e8-4d7a-4904-be83-7a6cc2d4213b]
FAIL: tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_server_while_in_shelved_state[id-bb0cb402-09dd-4947-b6e5-5e7e1cfa61ad]
FAIL: tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_server_while_in_shutoff_state[id-546d368c-bb6c-4645-979a-83ed16f3a6be]
FAIL: tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_server_while_in_suspended_state[id-1f82ebd3-8253-4f4e-b93f-de9b7df56d8b]
FAIL: setUpClass (tempest.api.compute.servers.test_disk_config.ServerDiskConfigTestJSON)
FAIL: setUpClass (tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON)
FAIL: setUpClass (tempest.api.compute.servers.test_instance_actions_negative.InstanceActionsNegativeTestJSON)
FAIL: setUpClass (tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON)
FAIL: setUpClass (tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON)
FAIL: setUpClass (tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON)
FAIL: setUpClass (tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON)
FAIL: setUpClass (tempest.api.compute.servers.test_server_addresses_negative.ServerAddressesNegativeTestJSON)
FAIL: setUpClass (tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON)
FAIL: setUpClass (tempest.api.compute.servers.test_server_metadata_negative.ServerMetadataNegativeTestJSON)
FAIL: setUpClass (tempest.api.compute.servers.test_server_password.ServerPasswordTestJSON)
FAIL: setUpClass (tempest.api.compute.servers.test_server_rescue.ServerRescueTestJSON)
FAIL: setUpClass (tempest.api.compute.servers.test_server_rescue_negative.ServerRescueNegativeTestJSON)
FAIL: tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_ipv6_addr_only[id-38fb1d02-c3c5-41de-91d3-9bc2025a75eb]
FAIL: tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair[id-f9e15296-d7f9-4e62-b53f-a04e89160833]
FAIL: tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name[id-8fea6be7-065e-47cf-89b8-496e6f96c699]
FAIL: tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address[id-89b90870-bc13-4b73-96af-f9d4f2b70077]
FAIL: tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name[id-5e6ccff8-349d-4852-a8b3-055df7988dd2]
FAIL: tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name_in_stop_state[id-6ac19cb1-27a3-40ec-b350-810bdc04c08e]
FAIL: setUpClass (tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON)
FAIL: setUpClass (tempest.api.compute.servers.test_virtual_interfaces.VirtualInterfacesTestJSON)
FAIL: setUpClass (tempest.api.compute.test_authorization.AuthorizationTestJSON)
FAIL: tempest.api.compute.test_live_block_migration_negative.LiveBlockMigrationNegativeTestJSON.test_invalid_host_for_migration[id-7fb7856e-ae92-44c9-861a-af62d7830bcb,negative]
FAIL: setUpClass (tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v2.test_roles.RolesTestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v2.test_roles_negative.RolesNegativeTestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v2.test_services.ServicesTestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v2.test_tenant_negative.TenantsNegativeTestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v2.test_tenants.TenantsTestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v2.test_tokens.TokensTestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v2.test_users.UsersTestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v2.test_users_negative.UsersNegativeTestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v3.test_domains.DomainsTestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v3.test_endpoints_negative.EndpointsNegativeTestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v3.test_list_projects.ListProjectsTestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v3.test_list_users.UsersV3TestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v3.test_projects.ProjectsTestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v3.test_projects_negative.ProjectsNegativeTestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v3.test_regions.RegionsTestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v3.test_services.ServicesTestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v3.test_tokens.TokensV3TestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON)
FAIL: setUpClass (tempest.api.identity.admin.v3.test_users.UsersV3TestJSON)
FAIL: setUpClass (tempest.api.identity.test_extension.ExtensionTestJSON)
FAIL: setUpClass (tempest.api.identity.v2.test_tokens.TokensTest)
FAIL: setUpClass (tempest.api.identity.v3.test_tokens.TokensV3Test)
FAIL: tempest.api.image.v1.test_images.CreateRegisterImagesTest.test_register_http_image[id-6d0e13a7-515b-460c-b91f-9f4793f09816]
FAIL: tempest.api.image.v1.test_images.CreateRegisterImagesTest.test_register_remote_image[id-69da74d9-68a9-404b-9664-ff7164ccb0f5]
FAIL: setUpClass (tempest.api.image.v1.test_images.ListImagesTest)
FAIL: setUpClass (tempest.api.network.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON)
FAIL: tempest.api.network.admin.test_external_network_extension.ExternalNetworksTestJSON.test_delete_external_networks_with_floating_ip[id-82068503-2cf2-4ed4-b3be-ecb89432e4bb]

Ran 399 tests in 14321.236s

FAILED (failures=86)
Comment 1 David Kranz 2015-08-17 20:36:06 UTC 
These are not tempest bugs but are problems with configuration, or with rhel osp.