2018-03-16 16:15:29.854 61 INFO rally.api [-] Starting verification (UUID=19d351eb-f34a-4a2d-9524-1615094a7647) for deployment 'opnfv-rally' (UUID=27e7782f-0fab-4b31-9e6f-2cbf73ebc0f9) by verifier 'opnfv-tempest' (UUID=4f3f880d-16a5-4fdd-8ba6-f97161ebc852). 2018-03-16 16:15:30.431 61 INFO rally.task.context [-] Verification 4f3f880d-16a5-4fdd-8ba6-f97161ebc852 | Context tempest@default setup() started 2018-03-16 16:15:31.551 61 INFO rally.task.context [-] Verification 4f3f880d-16a5-4fdd-8ba6-f97161ebc852 | Context tempest@default setup() finished in 1.12 sec 2018-03-16 16:15:31.551 61 INFO rally.task.context [-] Verification 4f3f880d-16a5-4fdd-8ba6-f97161ebc852 | Context testr@default setup() started 2018-03-16 16:15:31.553 61 INFO rally.task.context [-] Verification 4f3f880d-16a5-4fdd-8ba6-f97161ebc852 | Context testr@default setup() finished in 1.90 msec 2018-03-16 16:15:37.810 61 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor ... success [0.075s] 2018-03-16 16:15:38.111 61 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.301s] 2018-03-16 16:15:44.571 61 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create ... success [1.403s] 2018-03-16 16:15:46.468 61 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list ... success [1.896s] 2018-03-16 16:15:54.686 61 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete ... success [2.365s] 2018-03-16 16:16:10.968 61 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip ... success [10.747s] 2018-03-16 16:16:16.618 61 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume ... skip: Volume service not enabled. 2018-03-16 16:16:40.322 61 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.084s] 2018-03-16 16:16:40.323 61 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s] 2018-03-16 16:17:16.353 61 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.219s] 2018-03-16 16:17:16.354 61 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s] 2018-03-16 16:18:40.927 61 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [48.672s] 2018-03-16 16:19:06.573 61 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses ... success [0.057s] 2018-03-16 16:19:06.823 61 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network ... success [0.251s] 2018-03-16 16:19:14.195 61 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_get_version_details ... success [0.856s] 2018-03-16 16:19:14.206 61 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.011s] 2018-03-16 16:19:15.339 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_services.ServicesTestJSON ... skip: Identity api v2 is not enabled 2018-03-16 16:19:15.339 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_users.UsersTestJSON ... skip: Identity api v2 is not enabled 2018-03-16 16:19:20.408 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON ... fail 2018-03-16 16:19:23.816 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists ... fail [0.105s] 2018-03-16 16:19:30.732 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON ... fail 2018-03-16 16:19:35.777 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON ... fail 2018-03-16 16:19:40.961 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON ... fail 2018-03-16 16:19:44.367 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy ... fail [0.106s] 2018-03-16 16:19:51.399 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON ... fail 2018-03-16 16:19:56.677 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON ... fail 2018-03-16 16:20:00.118 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service ... fail [0.081s] 2018-03-16 16:20:05.418 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all ... fail [0.027s] 2018-03-16 16:20:07.483 61 INFO opnfv-tempest [-] {0} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery ... skip: Identity api v2 is not enabled 2018-03-16 16:20:09.698 61 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.020s] 2018-03-16 16:20:09.712 61 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.013s] 2018-03-16 16:20:09.726 61 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.014s] 2018-03-16 16:20:09.731 61 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions ... success [0.005s] 2018-03-16 16:20:13.747 61 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.595s] 2018-03-16 16:20:15.128 61 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file ... success [1.380s] 2018-03-16 16:20:16.203 61 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [1.075s] 2018-03-16 16:20:21.976 61 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_versions.VersionsTest.test_list_versions ... success [0.007s] 2018-03-16 16:20:26.004 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions ... success [0.672s] 2018-03-16 16:20:43.123 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address ... success [3.047s] 2018-03-16 16:20:47.233 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip ... success [4.110s] 2018-03-16 16:21:02.448 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network ... success [2.890s] 2018-03-16 16:21:05.381 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port ... success [2.931s] 2018-03-16 16:21:13.017 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet ... success [7.636s] 2018-03-16 16:21:22.863 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network ... success [2.697s] 2018-03-16 16:21:25.993 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port ... success [3.129s] 2018-03-16 16:21:30.439 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet ... success [4.445s] 2018-03-16 16:21:46.046 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet ... success [3.750s] 2018-03-16 16:21:46.244 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility ... success [0.197s] 2018-03-16 16:21:46.405 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks ... success [0.161s] 2018-03-16 16:21:46.501 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets ... success [0.095s] 2018-03-16 16:21:46.634 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network ... success [0.133s] 2018-03-16 16:21:46.702 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet ... success [0.067s] 2018-03-16 16:21:57.845 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [3.917s] 2018-03-16 16:21:58.041 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.195s] 2018-03-16 16:21:58.203 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.162s] 2018-03-16 16:21:58.300 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.096s] 2018-03-16 16:21:58.571 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.271s] 2018-03-16 16:21:58.640 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.068s] 2018-03-16 16:22:09.459 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools ... success [3.645s] 2018-03-16 16:22:13.943 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups ... success [4.483s] 2018-03-16 16:22:15.871 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port ... success [1.927s] 2018-03-16 16:22:15.937 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports ... success [0.067s] 2018-03-16 16:22:16.003 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port ... success [0.065s] 2018-03-16 16:22:27.825 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [4.444s] 2018-03-16 16:22:32.923 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups ... success [5.097s] 2018-03-16 16:22:35.004 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [2.080s] 2018-03-16 16:22:35.068 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.065s] 2018-03-16 16:22:35.145 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.076s] 2018-03-16 16:22:56.262 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces ... success [15.788s] 2018-03-16 16:23:07.257 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id ... success [10.994s] 2018-03-16 16:23:17.671 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id ... success [10.413s] 2018-03-16 16:23:26.692 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router ... success [9.022s] 2018-03-16 16:23:54.451 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [16.247s] 2018-03-16 16:24:05.795 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [11.344s] 2018-03-16 16:24:16.322 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [10.525s] 2018-03-16 16:24:25.237 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [8.914s] 2018-03-16 16:24:37.501 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group ... success [1.508s] 2018-03-16 16:24:38.675 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule ... success [1.172s] 2018-03-16 16:24:38.751 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups ... success [0.078s] 2018-03-16 16:24:43.279 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.156s] 2018-03-16 16:24:44.498 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.218s] 2018-03-16 16:24:44.703 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.206s] 2018-03-16 16:24:48.712 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [0.744s] 2018-03-16 16:24:52.268 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.006s] 2018-03-16 16:24:59.383 61 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest ... fail 2018-03-16 16:25:05.340 61 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_services.AccountTest ... fail 2018-03-16 16:25:09.233 61 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest ... fail 2018-03-16 16:25:13.110 61 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest ... fail 2018-03-16 16:25:17.108 61 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_object_services.ObjectTest ... fail 2018-03-16 16:25:17.108 61 INFO opnfv-tempest [-] {0} tempest.api.volume.test_versions.VersionsTest ... skip: VersionsTest skipped as Cinder is not available 2018-03-16 16:25:17.109 61 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest ... skip: VolumesActionsTest skipped as Cinder is not available 2018-03-16 16:25:17.109 61 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest ... skip: VolumesGetTest skipped as Cinder is not available 2018-03-16 16:25:17.110 61 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON ... skip: VolumesListTestJSON skipped as Cinder is not available 2018-03-16 16:27:08.686 61 INFO opnfv-tempest [-] {0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops ... success [108.260s] 2018-03-16 16:27:57.691 61 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops ... success [36.019s] 2018-03-16 16:29:05.024 61 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_multinode.TestServerMultinode.test_schedule_to_all_nodes ... success [37.544s] 2018-03-16 16:29:32.785 61 INFO opnfv-tempest [-] {0} neutron.tests.tempest.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_create_rbac_policy_with_target_tenant_none ... success [4.295s] 2018-03-16 16:29:36.103 61 INFO opnfv-tempest [-] {0} neutron.tests.tempest.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_create_rbac_policy_with_target_tenant_too_long_id ... success [3.319s] 2018-03-16 16:29:41.141 61 INFO opnfv-tempest [-] {0} neutron.tests.tempest.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_network_only_visible_to_policy_target ... success [5.036s] 2018-03-16 16:29:52.023 61 INFO opnfv-tempest [-] {0} neutron.tests.tempest.api.test_tag.TagFilterNetworkTestJSON.test_filter_network_tags ... success [1.312s] 2018-03-16 16:30:09.708 61 INFO opnfv-tempest [-] {0} neutron.tests.tempest.api.test_tag.TagFilterPortTestJSON.test_filter_port_tags ... success [0.743s] 2018-03-16 16:30:36.450 61 INFO opnfv-tempest [-] {0} neutron.tests.tempest.api.test_tag.TagFilterRouterTestJSON.test_filter_router_tags ... success [0.781s] 2018-03-16 16:31:00.729 61 INFO opnfv-tempest [-] {0} neutron.tests.tempest.api.test_tag.TagFilterSubnetTestJSON.test_filter_subnet_tags ... success [0.680s] 2018-03-16 16:31:19.767 61 INFO opnfv-tempest [-] {0} neutron.tests.tempest.api.test_tag.TagFilterSubnetpoolTestJSON.test_filter_subnetpool_tags ... success [0.323s] 2018-03-16 16:31:29.463 61 INFO opnfv-tempest [-] {0} neutron.tests.tempest.api.test_tag.TagNetworkTestJSON.test_network_tags ... success [1.976s] 2018-03-16 16:31:38.394 61 INFO opnfv-tempest [-] {0} neutron.tests.tempest.api.test_tag.TagPortTestJSON.test_port_tags ... success [1.210s] 2018-03-16 16:31:49.869 61 INFO opnfv-tempest [-] {0} neutron.tests.tempest.api.test_tag.TagRouterTestJSON.test_router_tags ... success [1.546s] 2018-03-16 16:31:59.690 61 INFO opnfv-tempest [-] {0} neutron.tests.tempest.api.test_tag.TagSubnetPoolTestJSON.test_subnetpool_tags ... success [0.867s] 2018-03-16 16:32:08.720 61 INFO opnfv-tempest [-] {0} neutron.tests.tempest.api.test_tag.TagSubnetTestJSON.test_subnet_tags ... success [1.317s] 2018-03-16 16:32:18.735 61 INFO opnfv-tempest [-] {0} neutron.tests.tempest.api.test_tag.UpdateTagsTest.test_update_tags_affects_only_updated_resource ... success [2.139s] 2018-03-16 16:32:23.471 61 INFO rally.task.context [-] Verification 4f3f880d-16a5-4fdd-8ba6-f97161ebc852 | Context testr@default cleanup() started 2018-03-16 16:32:23.472 61 INFO rally.task.context [-] Verification 4f3f880d-16a5-4fdd-8ba6-f97161ebc852 | Context testr@default cleanup() finished in 0.39 msec 2018-03-16 16:32:23.472 61 INFO rally.task.context [-] Verification 4f3f880d-16a5-4fdd-8ba6-f97161ebc852 | Context tempest@default cleanup() started 2018-03-16 16:32:24.281 61 INFO rally.task.context [-] Verification 4f3f880d-16a5-4fdd-8ba6-f97161ebc852 | Context tempest@default cleanup() finished in 0.81 sec 2018-03-16 16:32:24.345 61 INFO rally.api [-] Verification (UUID=19d351eb-f34a-4a2d-9524-1615094a7647) has been successfully finished for deployment 'opnfv-rally' (UUID=27e7782f-0fab-4b31-9e6f-2cbf73ebc0f9)! ====== Totals ====== Ran: 123 tests in 1003.107 sec. - Success: 87 - Skipped: 12 - Expected failures: 0 - Unexpected success: 0 - Failures: 24 Using verification (UUID=19d351eb-f34a-4a2d-9524-1615094a7647) as the default verification for the future operations.