2018-02-26 04:58:09.892 60 INFO rally.api [-] Starting verification (UUID=73d7fef2-dc35-4cc7-b7a3-4de9f5b293f3) for deployment 'opnfv-rally' (UUID=16ad99ee-553a-478e-9033-f994b0459cc3) by verifier 'opnfv-tempest' (UUID=05e2691f-6e20-45e8-b29d-8b5e3358733b). 2018-02-26 04:58:10.470 60 INFO rally.task.context [-] Verification 05e2691f-6e20-45e8-b29d-8b5e3358733b | Context tempest@default setup() started 2018-02-26 04:58:11.563 60 INFO rally.task.context [-] Verification 05e2691f-6e20-45e8-b29d-8b5e3358733b | Context tempest@default setup() finished in 1.09 sec 2018-02-26 04:58:11.563 60 INFO rally.task.context [-] Verification 05e2691f-6e20-45e8-b29d-8b5e3358733b | Context testr@default setup() started 2018-02-26 04:58:11.565 60 INFO rally.task.context [-] Verification 05e2691f-6e20-45e8-b29d-8b5e3358733b | Context testr@default setup() finished in 1.77 msec 2018-02-26 04:58:17.330 60 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor ... success [0.612s] 2018-02-26 04:58:17.390 60 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.060s] 2018-02-26 04:58:23.156 60 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create ... success [0.848s] 2018-02-26 04:58:24.330 60 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list ... success [1.173s] 2018-02-26 04:58:32.598 60 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete ... success [2.379s] 2018-02-26 04:58:49.104 60 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip ... success [11.230s] 2018-02-26 04:58:53.673 60 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume ... skip: Volume service not enabled. 2018-02-26 04:59:15.843 60 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.081s] 2018-02-26 04:59:15.844 60 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s] 2018-02-26 04:59:52.718 60 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.080s] 2018-02-26 04:59:52.720 60 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s] 2018-02-26 05:01:14.732 60 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [46.650s] 2018-02-26 05:01:42.648 60 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses ... success [0.054s] 2018-02-26 05:01:42.753 60 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network ... success [0.104s] 2018-02-26 05:01:49.854 60 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_get_version_details ... success [0.450s] 2018-02-26 05:01:49.860 60 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.006s] 2018-02-26 05:01:51.259 60 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_services.ServicesTestJSON ... skip: Identity api v2 is not enabled 2018-02-26 05:01:51.259 60 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_users.UsersTestJSON ... skip: Identity api v2 is not enabled 2018-02-26 05:01:56.385 60 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON ... fail 2018-02-26 05:01:59.722 60 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists ... fail [0.025s] 2018-02-26 05:02:06.625 60 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON ... fail 2018-02-26 05:02:12.096 60 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON ... fail 2018-02-26 05:02:18.176 60 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON ... fail 2018-02-26 05:02:21.814 60 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy ... fail [0.081s] 2018-02-26 05:02:29.081 60 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON ... fail 2018-02-26 05:02:34.412 60 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON ... fail 2018-02-26 05:02:37.829 60 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service ... fail [0.111s] 2018-02-26 05:02:43.089 60 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all ... fail [0.027s] 2018-02-26 05:02:45.032 60 INFO opnfv-tempest [-] {0} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery ... skip: Identity api v2 is not enabled 2018-02-26 05:02:47.248 60 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.074s] 2018-02-26 05:02:47.269 60 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.021s] 2018-02-26 05:02:47.283 60 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.014s] 2018-02-26 05:02:47.288 60 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions ... success [0.005s] 2018-02-26 05:02:51.439 60 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.724s] 2018-02-26 05:02:51.949 60 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file ... success [0.509s] 2018-02-26 05:02:52.897 60 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [0.948s] 2018-02-26 05:02:58.355 60 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_versions.VersionsTest.test_list_versions ... success [0.005s] 2018-02-26 05:03:02.679 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions ... success [0.948s] 2018-02-26 05:03:19.712 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address ... success [2.790s] 2018-02-26 05:03:23.394 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip ... success [3.682s] 2018-02-26 05:03:38.342 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network ... success [2.823s] 2018-02-26 05:03:41.436 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port ... success [3.093s] 2018-02-26 05:03:49.205 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet ... success [7.769s] 2018-02-26 05:03:58.806 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network ... success [2.467s] 2018-02-26 05:04:01.725 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port ... success [2.918s] 2018-02-26 05:04:05.722 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet ... success [3.997s] 2018-02-26 05:04:21.394 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet ... success [4.191s] 2018-02-26 05:04:21.621 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility ... success [0.226s] 2018-02-26 05:04:21.763 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks ... success [0.142s] 2018-02-26 05:04:21.831 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets ... success [0.068s] 2018-02-26 05:04:21.962 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network ... success [0.130s] 2018-02-26 05:04:22.030 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet ... success [0.068s] 2018-02-26 05:04:33.282 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [4.136s] 2018-02-26 05:04:33.503 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.221s] 2018-02-26 05:04:33.665 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.162s] 2018-02-26 05:04:33.761 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.096s] 2018-02-26 05:04:33.890 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.129s] 2018-02-26 05:04:33.958 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.067s] 2018-02-26 05:04:44.920 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools ... success [3.787s] 2018-02-26 05:04:49.727 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups ... success [4.806s] 2018-02-26 05:04:51.272 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port ... success [1.545s] 2018-02-26 05:04:51.340 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports ... success [0.068s] 2018-02-26 05:04:51.402 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port ... success [0.062s] 2018-02-26 05:05:02.216 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [3.958s] 2018-02-26 05:05:07.202 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups ... success [4.986s] 2018-02-26 05:05:08.954 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [1.752s] 2018-02-26 05:05:09.023 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.069s] 2018-02-26 05:05:09.083 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.060s] 2018-02-26 05:05:29.985 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces ... success [15.294s] 2018-02-26 05:05:41.097 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id ... success [11.112s] 2018-02-26 05:05:51.422 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id ... success [10.324s] 2018-02-26 05:06:00.109 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router ... success [8.687s] 2018-02-26 05:06:26.465 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [15.242s] 2018-02-26 05:06:37.561 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [11.095s] 2018-02-26 05:06:47.535 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [9.973s] 2018-02-26 05:06:56.306 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [8.771s] 2018-02-26 05:07:08.974 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group ... success [1.108s] 2018-02-26 05:07:10.149 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule ... success [1.173s] 2018-02-26 05:07:10.239 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups ... success [0.092s] 2018-02-26 05:07:14.605 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.101s] 2018-02-26 05:07:15.824 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.218s] 2018-02-26 05:07:15.889 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.067s] 2018-02-26 05:07:19.851 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [0.722s] 2018-02-26 05:07:23.176 60 INFO opnfv-tempest [-] {0} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.005s] 2018-02-26 05:07:30.481 60 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest ... fail 2018-02-26 05:07:36.255 60 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_services.AccountTest ... fail 2018-02-26 05:07:40.303 60 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest ... fail 2018-02-26 05:07:44.357 60 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest ... fail 2018-02-26 05:07:48.567 60 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_object_services.ObjectTest ... fail 2018-02-26 05:07:48.567 60 INFO opnfv-tempest [-] {0} tempest.api.volume.test_versions.VersionsTest ... skip: VersionsTest skipped as Cinder is not available 2018-02-26 05:07:48.568 60 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest ... skip: VolumesActionsTest skipped as Cinder is not available 2018-02-26 05:07:48.568 60 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest ... skip: VolumesGetTest skipped as Cinder is not available 2018-02-26 05:07:48.568 60 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON ... skip: VolumesListTestJSON skipped as Cinder is not available 2018-02-26 05:09:36.540 60 INFO opnfv-tempest [-] {0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops ... success [104.547s] 2018-02-26 05:10:20.839 60 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops ... success [31.020s] 2018-02-26 05:11:28.544 60 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_multinode.TestServerMultinode.test_schedule_to_all_nodes ... success [38.241s] 2018-02-26 05:11:47.029 60 INFO rally.task.context [-] Verification 05e2691f-6e20-45e8-b29d-8b5e3358733b | Context testr@default cleanup() started 2018-02-26 05:11:47.029 60 INFO rally.task.context [-] Verification 05e2691f-6e20-45e8-b29d-8b5e3358733b | Context testr@default cleanup() finished in 0.40 msec 2018-02-26 05:11:47.029 60 INFO rally.task.context [-] Verification 05e2691f-6e20-45e8-b29d-8b5e3358733b | Context tempest@default cleanup() started 2018-02-26 05:11:47.946 60 INFO rally.task.context [-] Verification 05e2691f-6e20-45e8-b29d-8b5e3358733b | Context tempest@default cleanup() finished in 0.92 sec 2018-02-26 05:11:48.058 60 INFO rally.api [-] Verification (UUID=73d7fef2-dc35-4cc7-b7a3-4de9f5b293f3) has been successfully finished for deployment 'opnfv-rally' (UUID=16ad99ee-553a-478e-9033-f994b0459cc3)! ====== Totals ====== Ran: 109 tests in 794.015 sec. - Success: 73 - Skipped: 12 - Expected failures: 0 - Unexpected success: 0 - Failures: 24 Using verification (UUID=73d7fef2-dc35-4cc7-b7a3-4de9f5b293f3) as the default verification for the future operations.