2018-11-24 23:53:23.751 32 INFO rally.api [-] Starting verification (UUID=d0aa8e4f-222a-4661-b702-c0265a27a45e) for deployment 'opnfv-rally' (UUID=3c5e7c0a-17f7-46f0-a652-fc527048b3db) by verifier 'opnfv-tempest' (UUID=a594e08f-83fb-442c-8417-13734781f76d).
2018-11-24 23:53:25.677 32 INFO rally.task.context [-] Verification a594e08f-83fb-442c-8417-13734781f76d | Context tempest@default setup()  finished in 1.35 sec
2018-11-24 23:53:25.678 32 INFO rally.task.context [-] Verification a594e08f-83fb-442c-8417-13734781f76d | Context testr@default setup()  finished in 0.43 msec
2018-11-24 23:53:30.747 32 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor ... success [0.318s]
2018-11-24 23:53:30.804 32 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.057s]
2018-11-24 23:53:36.722 32 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create ... success [2.909s]
2018-11-24 23:53:42.429 32 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list ... success [5.705s]
2018-11-24 23:54:02.878 32 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete ... success [8.659s]
2018-11-24 23:54:07.273 32 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.130s]
2018-11-24 23:54:07.274 32 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s]
2018-11-24 23:54:14.606 32 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers ... success [0.121s]
2018-11-24 23:54:14.607 32 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details ... success [0.001s]
2018-11-24 23:54:16.868 32 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesUnderV243Test.test_add_remove_fixed_ip ... fail [32.326s]
2018-11-24 23:54:21.336 32 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v2.test_users.UsersTestJSON ... skip: Identity api v2 is not enabled
2018-11-24 23:54:27.888 32 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint ... success [0.882s]
2018-11-24 23:54:36.700 32 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete ... success [0.656s]
2018-11-24 23:54:41.453 32 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete ... success [4.934s]
2018-11-24 23:54:43.197 32 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.107s]
2018-11-24 23:54:43.199 32 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.002s]
2018-11-24 23:54:46.074 32 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy ... success [1.050s]
2018-11-24 23:54:50.384 32 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id ... success [0.329s]
2018-11-24 23:54:54.079 32 INFO opnfv-tempest [-] {1} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery ... skip: Identity api v2 is not enabled
2018-11-24 23:54:56.481 32 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list ... success [0.761s]
2018-11-24 23:55:01.036 32 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses ... success [0.303s]
2018-11-24 23:55:01.159 32 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network ... success [0.123s]
2018-11-24 23:55:06.477 32 INFO opnfv-tempest [-] {1} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools ... success [7.387s]
2018-11-24 23:55:07.451 32 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service ... success [1.563s]
2018-11-24 23:55:12.368 32 INFO opnfv-tempest [-] {3} tempest.api.compute.test_versions.TestVersions.test_get_version_details ... success [0.830s]
2018-11-24 23:55:12.377 32 INFO opnfv-tempest [-] {3} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.009s]
2018-11-24 23:55:14.326 32 INFO opnfv-tempest [-] {1} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups ... success [7.847s]
2018-11-24 23:55:14.371 32 INFO opnfv-tempest [-] {3} tempest.api.identity.admin.v2.test_services.ServicesTestJSON ... skip: Identity api v2 is not enabled
2018-11-24 23:55:17.145 32 INFO opnfv-tempest [-] {1} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port ... success [2.818s]
2018-11-24 23:55:17.221 32 INFO opnfv-tempest [-] {1} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports ... success [0.076s]
2018-11-24 23:55:17.540 32 INFO opnfv-tempest [-] {1} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port ... success [0.320s]
2018-11-24 23:55:18.819 32 INFO opnfv-tempest [-] {3} tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists ... success [0.604s]
2018-11-24 23:55:19.832 32 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all ... success [5.305s]
2018-11-24 23:55:24.060 32 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_versions.VersionsTest.test_list_versions ... success [0.006s]
2018-11-24 23:55:26.428 32 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [1.365s]
2018-11-24 23:55:26.503 32 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [2.115s]
2018-11-24 23:55:28.243 32 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file ... success [1.814s]
2018-11-24 23:55:30.137 32 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [3.631s]
2018-11-24 23:55:30.187 32 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.053s]
2018-11-24 23:55:30.339 32 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [2.096s]
2018-11-24 23:55:34.381 32 INFO opnfv-tempest [-] {1} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.014s]
2018-11-24 23:55:34.662 32 INFO opnfv-tempest [-] {1} tempest.api.network.test_versions.NetworksApiDiscovery.test_show_api_v2_details ... success [0.281s]
2018-11-24 23:55:39.131 32 INFO opnfv-tempest [-] {3} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [7.501s]
2018-11-24 23:55:39.788 32 INFO opnfv-tempest [-] {3} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.658s]
2018-11-24 23:55:39.886 32 INFO opnfv-tempest [-] {3} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.097s]
2018-11-24 23:55:40.190 32 INFO opnfv-tempest [-] {3} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.304s]
2018-11-24 23:55:40.339 32 INFO opnfv-tempest [-] {3} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.149s]
2018-11-24 23:55:40.392 32 INFO opnfv-tempest [-] {3} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.053s]
2018-11-24 23:55:42.012 32 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_account_services.AccountTest.test_list_account_metadata ... success [0.170s]
2018-11-24 23:55:42.032 32 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_account_services.AccountTest.test_list_containers ... success [0.020s]
2018-11-24 23:55:42.961 32 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [10.438s]
2018-11-24 23:55:44.787 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network ... success [6.911s]
2018-11-24 23:55:53.006 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port ... success [8.217s]
2018-11-24 23:56:00.499 32 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [8.583s]
2018-11-24 23:56:01.747 32 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_object_services.ObjectTest.test_create_object ... success [0.141s]
2018-11-24 23:56:01.823 32 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_object_services.ObjectTest.test_get_object ... success [0.076s]
2018-11-24 23:56:01.894 32 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_object_services.ObjectTest.test_list_object_metadata ... success [0.070s]
2018-11-24 23:56:02.176 32 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_object_services.ObjectTest.test_update_object_metadata ... success [0.282s]
2018-11-24 23:56:02.747 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet ... success [9.740s]
2018-11-24 23:56:04.047 32 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain ... success [1.154s]
2018-11-24 23:56:08.726 32 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups ... success [8.227s]
2018-11-24 23:56:11.493 32 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.170s]
2018-11-24 23:56:11.683 32 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.189s]
2018-11-24 23:56:11.854 32 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.170s]
2018-11-24 23:56:11.861 32 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions ... success [0.008s]
2018-11-24 23:56:11.893 32 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [3.167s]
2018-11-24 23:56:12.250 32 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.357s]
2018-11-24 23:56:12.320 32 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.070s]
2018-11-24 23:56:15.732 32 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.291s]
2018-11-24 23:56:19.088 32 INFO opnfv-tempest [-] {3} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.010s]
2018-11-24 23:56:23.136 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions ... success [6.999s]
2018-11-24 23:56:23.784 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet ... success [6.054s]
2018-11-24 23:56:24.140 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility ... success [0.356s]
2018-11-24 23:56:24.617 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks ... success [0.477s]
2018-11-24 23:56:24.666 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets ... success [0.048s]
2018-11-24 23:56:24.806 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network ... success [0.140s]
2018-11-24 23:56:25.329 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet ... success [0.523s]
2018-11-24 23:56:39.356 32 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_attach_detach_volume_to_instance ... success [15.127s]
2018-11-24 23:56:43.521 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address ... success [4.649s]
2018-11-24 23:56:49.024 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip ... success [5.502s]
2018-11-24 23:56:52.167 32 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [7.611s]
2018-11-24 23:56:54.418 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces ... success [22.229s]
2018-11-24 23:57:06.755 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id ... success [12.337s]
2018-11-24 23:57:07.163 32 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [14.993s]
2018-11-24 23:57:07.920 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network ... success [6.646s]
2018-11-24 23:57:15.119 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port ... success [7.197s]
2018-11-24 23:57:17.758 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id ... success [11.002s]
2018-11-24 23:57:23.348 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet ... success [8.228s]
2018-11-24 23:57:24.391 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router ... success [6.633s]
2018-11-24 23:57:31.882 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [2.113s]
2018-11-24 23:57:39.362 32 INFO opnfv-tempest [-] {2} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_large_object ... success [2.473s]
2018-11-24 23:57:42.081 32 INFO opnfv-tempest [-] {2} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_too_many_objects ... success [2.717s]
2018-11-24 23:57:44.661 32 INFO opnfv-tempest [-] {2} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_valid_object ... success [2.581s]
2018-11-24 23:57:57.855 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [24.448s]
2018-11-24 23:58:11.718 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [13.862s]
2018-11-24 23:58:23.146 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [11.429s]
2018-11-24 23:58:29.148 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [6.001s]
2018-11-24 23:58:37.691 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group ... success [2.502s]
2018-11-24 23:58:41.636 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule ... success [3.944s]
2018-11-24 23:58:41.679 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups ... success [0.046s]
2018-11-24 23:58:49.253 32 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest.test_admin_modify_quota ... success [1.037s]
2018-11-24 23:58:49.527 32 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest.test_upload_valid_object ... success [0.274s]
2018-11-24 23:58:59.941 32 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest.test_create_container ... success [2.210s]
2018-11-24 23:59:02.295 32 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest.test_list_container_contents ... success [2.353s]
2018-11-24 23:59:04.849 32 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest.test_list_container_metadata ... success [2.554s]
2018-11-24 23:59:07.140 32 INFO rally.task.context [-] Verification a594e08f-83fb-442c-8417-13734781f76d | Context testr@default cleanup() started
2018-11-24 23:59:07.140 32 INFO rally.task.context [-] Verification a594e08f-83fb-442c-8417-13734781f76d | Context testr@default cleanup() finished in 0.89 msec
2018-11-24 23:59:07.141 32 INFO rally.task.context [-] Verification a594e08f-83fb-442c-8417-13734781f76d | Context tempest@default cleanup() started
2018-11-24 23:59:08.096 32 INFO rally.task.context [-] Verification a594e08f-83fb-442c-8417-13734781f76d | Context tempest@default cleanup() finished in 0.95 sec
2018-11-24 23:59:08.161 32 INFO rally.api [-] Verification (UUID=d0aa8e4f-222a-4661-b702-c0265a27a45e) has been successfully finished for deployment 'opnfv-rally' (UUID=3c5e7c0a-17f7-46f0-a652-fc527048b3db)!

======
Totals
======

Ran: 107 tests in 336.848 sec.
 - Success: 101
 - Skipped: 5
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 1

Using verification (UUID=d0aa8e4f-222a-4661-b702-c0265a27a45e) as the default verification for the future operations.