2019-01-06 13:51:38.836 33 INFO rally.api [-] Starting verification (UUID=62abd1b5-1452-4e27-99ad-021f7c74b535) for deployment 'opnfv-rally' (UUID=fc32d14e-b4c3-4b63-9662-8a50eafef66b) by verifier 'opnfv-tempest' (UUID=9df4851f-0379-41cc-8197-38e931aeb744).
2019-01-06 13:51:40.072 33 INFO rally.task.context [-] Verification 9df4851f-0379-41cc-8197-38e931aeb744 | Context tempest@default setup()  finished in 0.67 sec
2019-01-06 13:51:40.073 33 INFO rally.task.context [-] Verification 9df4851f-0379-41cc-8197-38e931aeb744 | Context testr@default setup()  finished in 0.44 msec
2019-01-06 13:51:44.104 33 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor ... success [0.159s]
2019-01-06 13:51:44.150 33 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.046s]
2019-01-06 13:51:45.944 33 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create ... success [0.770s]
2019-01-06 13:51:47.433 33 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list ... success [1.488s]
2019-01-06 13:51:54.657 33 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete ... success [2.420s]
2019-01-06 13:52:06.443 33 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.056s]
2019-01-06 13:52:06.444 33 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s]
2019-01-06 13:52:10.355 33 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers ... success [0.060s]
2019-01-06 13:52:10.357 33 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details ... success [0.002s]
2019-01-06 13:52:19.617 33 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.076s]
2019-01-06 13:52:19.618 33 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s]
2019-01-06 13:52:23.340 33 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v2.test_users.UsersTestJSON ... skip: Identity api v2 is not enabled
2019-01-06 13:52:26.949 33 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint ... success [0.382s]
2019-01-06 13:52:29.010 33 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesUnderV243Test.test_add_remove_fixed_ip ... success [37.986s]
2019-01-06 13:52:29.047 33 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete ... success [0.199s]
2019-01-06 13:52:34.396 33 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete ... success [2.380s]
2019-01-06 13:52:34.462 33 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy ... success [0.734s]
2019-01-06 13:52:39.542 33 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id ... success [0.103s]
2019-01-06 13:52:40.306 33 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list ... success [0.217s]
2019-01-06 13:52:41.543 33 INFO opnfv-tempest [-] {1} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery ... skip: Identity api v2 is not enabled
2019-01-06 13:52:46.452 33 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service ... success [0.644s]
2019-01-06 13:52:46.491 33 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses ... success [0.042s]
2019-01-06 13:52:46.589 33 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network ... success [0.098s]
2019-01-06 13:52:50.312 33 INFO opnfv-tempest [-] {1} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools ... success [6.083s]
2019-01-06 13:52:53.841 33 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all ... success [3.087s]
2019-01-06 13:52:56.450 33 INFO opnfv-tempest [-] {1} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups ... success [6.138s]
2019-01-06 13:52:57.613 33 INFO opnfv-tempest [-] {3} tempest.api.compute.test_versions.TestVersions.test_get_version_details ... success [0.502s]
2019-01-06 13:52:57.621 33 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.568s]
2019-01-06 13:52:57.623 33 INFO opnfv-tempest [-] {3} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.010s]
2019-01-06 13:52:58.033 33 INFO opnfv-tempest [-] {1} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port ... success [1.583s]
2019-01-06 13:52:58.079 33 INFO opnfv-tempest [-] {1} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports ... success [0.046s]
2019-01-06 13:52:58.098 33 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file ... success [0.477s]
2019-01-06 13:52:58.131 33 INFO opnfv-tempest [-] {1} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port ... success [0.052s]
2019-01-06 13:52:58.531 33 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [0.432s]
2019-01-06 13:52:58.958 33 INFO opnfv-tempest [-] {3} tempest.api.identity.admin.v2.test_services.ServicesTestJSON ... skip: Identity api v2 is not enabled
2019-01-06 13:53:01.948 33 INFO opnfv-tempest [-] {3} tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists ... success [0.394s]
2019-01-06 13:53:02.669 33 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [0.764s]
2019-01-06 13:53:03.781 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network ... success [2.343s]
2019-01-06 13:53:04.180 33 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.508s]
2019-01-06 13:53:04.218 33 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.042s]
2019-01-06 13:53:05.139 33 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_versions.VersionsTest.test_list_versions ... success [0.007s]
2019-01-06 13:53:06.632 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port ... success [2.850s]
2019-01-06 13:53:06.869 33 INFO opnfv-tempest [-] {1} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.007s]
2019-01-06 13:53:06.990 33 INFO opnfv-tempest [-] {1} tempest.api.network.test_versions.NetworksApiDiscovery.test_show_api_v2_details ... success [0.121s]
2019-01-06 13:53:07.956 33 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_account_services.AccountTest ... skip: AccountTest skipped as swift is not available
2019-01-06 13:53:07.958 33 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_object_services.ObjectTest ... skip: ObjectTest skipped as swift is not available
2019-01-06 13:53:10.995 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet ... success [4.362s]
2019-01-06 13:53:13.055 33 INFO opnfv-tempest [-] {3} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [4.301s]
2019-01-06 13:53:13.298 33 INFO opnfv-tempest [-] {3} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.245s]
2019-01-06 13:53:13.396 33 INFO opnfv-tempest [-] {3} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.097s]
2019-01-06 13:53:13.436 33 INFO opnfv-tempest [-] {3} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.039s]
2019-01-06 13:53:13.527 33 INFO opnfv-tempest [-] {3} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.090s]
2019-01-06 13:53:13.580 33 INFO opnfv-tempest [-] {3} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.053s]
2019-01-06 13:53:14.208 33 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.039s]
2019-01-06 13:53:24.641 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet ... success [4.444s]
2019-01-06 13:53:24.811 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility ... success [0.171s]
2019-01-06 13:53:24.923 33 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [5.063s]
2019-01-06 13:53:24.962 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks ... success [0.150s]
2019-01-06 13:53:25.073 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets ... success [0.111s]
2019-01-06 13:53:25.170 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network ... success [0.097s]
2019-01-06 13:53:25.222 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet ... success [0.052s]
2019-01-06 13:53:30.029 33 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups ... success [5.105s]
2019-01-06 13:53:31.445 33 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [1.415s]
2019-01-06 13:53:31.500 33 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.055s]
2019-01-06 13:53:31.550 33 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.051s]
2019-01-06 13:53:35.498 33 INFO opnfv-tempest [-] {3} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.013s]
2019-01-06 13:53:46.247 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces ... success [15.200s]
2019-01-06 13:53:49.847 33 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_attach_detach_volume_to_instance ... success [10.329s]
2019-01-06 13:53:54.599 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id ... success [8.352s]
2019-01-06 13:53:59.787 33 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [6.043s]
2019-01-06 13:54:02.682 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id ... success [8.083s]
2019-01-06 13:54:05.781 33 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [74.573s]
2019-01-06 13:54:06.176 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router ... success [3.493s]
2019-01-06 13:54:08.969 33 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [9.179s]
2019-01-06 13:54:09.974 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [0.631s]
2019-01-06 13:54:10.952 33 INFO opnfv-tempest [-] {2} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest ... skip: ContainerQuotasTest skipped as swift is not available
2019-01-06 13:54:21.162 33 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain ... success [0.617s]
2019-01-06 13:54:25.692 33 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.091s]
2019-01-06 13:54:25.786 33 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.094s]
2019-01-06 13:54:25.818 33 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.032s]
2019-01-06 13:54:25.827 33 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions ... success [0.009s]
2019-01-06 13:54:29.876 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions ... success [1.269s]
2019-01-06 13:54:42.133 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address ... success [3.781s]
2019-01-06 13:54:46.994 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip ... success [4.859s]
2019-01-06 13:54:56.929 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network ... success [1.905s]
2019-01-06 13:55:00.086 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port ... success [3.156s]
2019-01-06 13:55:07.312 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet ... success [7.225s]
2019-01-06 13:55:27.960 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [14.856s]
2019-01-06 13:55:37.385 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [9.425s]
2019-01-06 13:55:45.786 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [8.402s]
2019-01-06 13:55:49.773 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [3.987s]
2019-01-06 13:55:53.748 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group ... success [0.849s]
2019-01-06 13:55:54.704 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule ... success [0.954s]
2019-01-06 13:55:54.752 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups ... success [0.051s]
2019-01-06 13:55:55.659 33 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest ... skip: AccountQuotasTest skipped as swift is not available
2019-01-06 13:55:55.660 33 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest ... skip: ContainerTest skipped as swift is not available
2019-01-06 13:55:56.256 33 INFO rally.task.context [-] Verification 9df4851f-0379-41cc-8197-38e931aeb744 | Context testr@default cleanup() started
2019-01-06 13:55:56.257 33 INFO rally.task.context [-] Verification 9df4851f-0379-41cc-8197-38e931aeb744 | Context testr@default cleanup() finished in 1.12 msec
2019-01-06 13:55:56.258 33 INFO rally.task.context [-] Verification 9df4851f-0379-41cc-8197-38e931aeb744 | Context tempest@default cleanup() started
2019-01-06 13:55:57.128 33 INFO rally.task.context [-] Verification 9df4851f-0379-41cc-8197-38e931aeb744 | Context tempest@default cleanup() finished in 0.87 sec
2019-01-06 13:55:57.295 33 INFO rally.api [-] Verification (UUID=62abd1b5-1452-4e27-99ad-021f7c74b535) has been successfully finished for deployment 'opnfv-rally' (UUID=fc32d14e-b4c3-4b63-9662-8a50eafef66b)!

======
Totals
======

Ran: 107 tests in 253.303 sec.
 - Success: 88
 - Skipped: 19
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 0

Using verification (UUID=62abd1b5-1452-4e27-99ad-021f7c74b535) as the default verification for the future operations.