2018-12-04 00:37:30.102 36 INFO rally.api [-] Starting verification (UUID=3531c89f-3981-4c39-bb8d-10f9cc6b0844) for deployment 'opnfv-rally' (UUID=22ce4b09-ae34-475c-92cb-0ebedaa71a8c) by verifier 'opnfv-tempest' (UUID=ae3988e7-1b9a-4a42-a38f-dc587eab5ea4).
2018-12-04 00:37:31.511 36 INFO rally.task.context [-] Verification ae3988e7-1b9a-4a42-a38f-dc587eab5ea4 | Context tempest@default setup()  finished in 0.87 sec
2018-12-04 00:37:31.514 36 INFO rally.task.context [-] Verification ae3988e7-1b9a-4a42-a38f-dc587eab5ea4 | Context testr@default setup()  finished in 2.78 msec
2018-12-04 00:37:33.597 36 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v2.test_users.UsersTestJSON ... skip: Identity api v2 is not enabled
2018-12-04 00:37:35.679 36 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor ... success [0.200s]
2018-12-04 00:37:35.722 36 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.043s]
2018-12-04 00:37:38.091 36 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete ... success [0.381s]
2018-12-04 00:37:41.922 36 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete ... success [4.626s]
2018-12-04 00:37:43.037 36 INFO opnfv-tempest [-] {3} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create ... success [1.648s]
2018-12-04 00:37:44.131 36 INFO opnfv-tempest [-] {3} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list ... success [1.093s]
2018-12-04 00:37:45.880 36 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint ... success [0.526s]
2018-12-04 00:37:45.926 36 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip ... success [8.716s]
2018-12-04 00:37:53.714 36 INFO opnfv-tempest [-] {2} tempest.api.compute.test_versions.TestVersions.test_get_version_details ... success [0.733s]
2018-12-04 00:37:53.723 36 INFO opnfv-tempest [-] {2} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.009s]
2018-12-04 00:37:55.796 36 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete ... success [3.210s]
2018-12-04 00:37:59.672 36 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy ... success [0.990s]
2018-12-04 00:38:03.353 36 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id ... success [0.190s]
2018-12-04 00:38:04.629 36 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.063s]
2018-12-04 00:38:04.630 36 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s]
2018-12-04 00:38:07.163 36 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list ... success [0.448s]
2018-12-04 00:38:11.323 36 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service ... success [0.908s]
2018-12-04 00:38:16.788 36 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers ... success [0.072s]
2018-12-04 00:38:16.789 36 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details ... success [0.001s]
2018-12-04 00:38:16.825 36 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.695s]
2018-12-04 00:38:17.316 36 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file ... success [0.489s]
2018-12-04 00:38:18.308 36 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [0.993s]
2018-12-04 00:38:19.582 36 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all ... success [4.340s]
2018-12-04 00:38:24.274 36 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_versions.VersionsTest.test_list_versions ... success [0.006s]
2018-12-04 00:38:27.472 36 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network ... success [2.798s]
2018-12-04 00:38:31.250 36 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port ... success [3.777s]
2018-12-04 00:38:36.665 36 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet ... success [5.585s]
2018-12-04 00:38:36.992 36 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility ... success [0.327s]
2018-12-04 00:38:37.280 36 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks ... success [0.288s]
2018-12-04 00:38:37.341 36 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets ... success [0.061s]
2018-12-04 00:38:37.469 36 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network ... success [0.127s]
2018-12-04 00:38:37.533 36 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet ... success [0.064s]
2018-12-04 00:38:37.674 36 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet ... success [6.424s]
2018-12-04 00:38:39.197 36 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.094s]
2018-12-04 00:38:39.199 36 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s]
2018-12-04 00:38:47.356 36 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.952s]
2018-12-04 00:38:48.898 36 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.539s]
2018-12-04 00:38:48.936 36 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.042s]
2018-12-04 00:38:49.585 36 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [4.428s]
2018-12-04 00:38:49.904 36 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.319s]
2018-12-04 00:38:50.033 36 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.128s]
2018-12-04 00:38:50.132 36 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.098s]
2018-12-04 00:38:50.434 36 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.302s]
2018-12-04 00:38:50.492 36 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.057s]
2018-12-04 00:38:50.493 36 INFO opnfv-tempest [-] {0} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery ... skip: Identity api v2 is not enabled
2018-12-04 00:38:52.922 36 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.086s]
2018-12-04 00:38:53.019 36 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.098s]
2018-12-04 00:38:53.109 36 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.089s]
2018-12-04 00:38:53.118 36 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions ... success [0.008s]
2018-12-04 00:38:54.996 36 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_account_services.AccountTest.test_list_account_metadata ... success [0.119s]
2018-12-04 00:38:55.015 36 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_account_services.AccountTest.test_list_containers ... success [0.019s]
2018-12-04 00:38:58.735 36 INFO opnfv-tempest [-] {0} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions ... success [2.493s]
2018-12-04 00:39:01.377 36 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [9.549s]
2018-12-04 00:39:07.814 36 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces ... success [11.873s]
2018-12-04 00:39:14.267 36 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_object_services.ObjectTest.test_create_object ... success [0.125s]
2018-12-04 00:39:14.318 36 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_object_services.ObjectTest.test_get_object ... success [0.051s]
2018-12-04 00:39:14.384 36 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_object_services.ObjectTest.test_list_object_metadata ... success [0.066s]
2018-12-04 00:39:14.461 36 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_object_services.ObjectTest.test_update_object_metadata ... success [0.077s]
2018-12-04 00:39:17.071 36 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address ... success [5.707s]
2018-12-04 00:39:17.654 36 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id ... success [9.839s]
2018-12-04 00:39:22.064 36 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip ... success [4.991s]
2018-12-04 00:39:23.446 36 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id ... success [5.792s]
2018-12-04 00:39:25.604 36 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses ... success [0.048s]
2018-12-04 00:39:25.696 36 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network ... success [0.092s]
2018-12-04 00:39:26.857 36 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.748s]
2018-12-04 00:39:27.616 36 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router ... success [4.169s]
2018-12-04 00:39:30.356 36 INFO opnfv-tempest [-] {3} tempest.api.identity.admin.v2.test_services.ServicesTestJSON ... skip: Identity api v2 is not enabled
2018-12-04 00:39:33.825 36 INFO opnfv-tempest [-] {3} tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists ... success [0.454s]
2018-12-04 00:39:34.056 36 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network ... success [2.699s]
2018-12-04 00:39:37.439 36 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port ... success [3.381s]
2018-12-04 00:39:40.910 36 INFO opnfv-tempest [-] {2} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.420s]
2018-12-04 00:39:41.707 36 INFO opnfv-tempest [-] {3} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain ... success [0.642s]
2018-12-04 00:39:43.435 36 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet ... success [5.997s]
2018-12-04 00:39:47.972 36 INFO opnfv-tempest [-] {2} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_large_object ... success [2.413s]
2018-12-04 00:39:50.615 36 INFO opnfv-tempest [-] {2} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_too_many_objects ... success [2.640s]
2018-12-04 00:39:52.819 36 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [4.018s]
2018-12-04 00:39:53.063 36 INFO opnfv-tempest [-] {2} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_valid_object ... success [2.449s]
2018-12-04 00:39:56.333 36 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools ... success [4.158s]
2018-12-04 00:39:56.904 36 INFO opnfv-tempest [-] {2} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.012s]
2018-12-04 00:39:58.272 36 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups ... success [5.451s]
2018-12-04 00:40:00.189 36 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [1.917s]
2018-12-04 00:40:00.232 36 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.043s]
2018-12-04 00:40:00.288 36 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.056s]
2018-12-04 00:40:01.742 36 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups ... success [5.408s]
2018-12-04 00:40:03.622 36 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port ... success [1.879s]
2018-12-04 00:40:03.677 36 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports ... success [0.054s]
2018-12-04 00:40:03.726 36 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port ... success [0.049s]
2018-12-04 00:40:06.599 36 INFO opnfv-tempest [-] {3} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group ... success [1.004s]
2018-12-04 00:40:08.420 36 INFO opnfv-tempest [-] {3} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule ... success [1.819s]
2018-12-04 00:40:08.704 36 INFO opnfv-tempest [-] {3} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups ... success [0.286s]
2018-12-04 00:40:22.022 36 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_attach_detach_volume_to_instance ... success [7.121s]
2018-12-04 00:40:22.187 36 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [13.737s]
2018-12-04 00:40:29.273 36 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [7.085s]
2018-12-04 00:40:30.945 36 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [5.095s]
2018-12-04 00:40:35.480 36 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [6.207s]
2018-12-04 00:40:38.750 36 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [7.803s]
2018-12-04 00:40:39.327 36 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [3.846s]
2018-12-04 00:40:50.989 36 INFO opnfv-tempest [-] {0} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.006s]
2018-12-04 00:40:56.511 36 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest.test_admin_modify_quota ... success [0.476s]
2018-12-04 00:40:56.634 36 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest.test_upload_valid_object ... success [0.123s]
2018-12-04 00:41:05.637 36 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest.test_create_container ... success [2.250s]
2018-12-04 00:41:07.961 36 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest.test_list_container_contents ... success [2.323s]
2018-12-04 00:41:10.364 36 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest.test_list_container_metadata ... success [2.404s]
2018-12-04 00:41:11.937 36 INFO rally.task.context [-] Verification ae3988e7-1b9a-4a42-a38f-dc587eab5ea4 | Context testr@default cleanup() started
2018-12-04 00:41:11.938 36 INFO rally.task.context [-] Verification ae3988e7-1b9a-4a42-a38f-dc587eab5ea4 | Context testr@default cleanup() finished in 0.42 msec
2018-12-04 00:41:11.938 36 INFO rally.task.context [-] Verification ae3988e7-1b9a-4a42-a38f-dc587eab5ea4 | Context tempest@default cleanup() started
2018-12-04 00:41:12.784 36 INFO rally.task.context [-] Verification ae3988e7-1b9a-4a42-a38f-dc587eab5ea4 | Context tempest@default cleanup() finished in 0.85 sec
2018-12-04 00:41:12.870 36 INFO rally.api [-] Verification (UUID=3531c89f-3981-4c39-bb8d-10f9cc6b0844) has been successfully finished for deployment 'opnfv-rally' (UUID=22ce4b09-ae34-475c-92cb-0ebedaa71a8c)!

======
Totals
======

Ran: 106 tests in 216.828 sec.
 - Success: 101
 - Skipped: 5
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 0

Using verification (UUID=3531c89f-3981-4c39-bb8d-10f9cc6b0844) as the default verification for the future operations.