2018-01-27 13:33:09.182 79 INFO rally.api [-] Starting verification (UUID=f3cb2c75-b33a-4d0e-abb6-61e4e1feaca5) for deployment 'opnfv-rally' (UUID=2cac689c-b8f7-4002-968b-3052979a0eaf) by verifier 'opnfv-tempest' (UUID=ba8cc73b-ac22-40b3-b05a-7f99ea48af0a).
2018-01-27 13:33:14.354 79 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor ... success [0.081s]
2018-01-27 13:33:14.440 79 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.082s]
2018-01-27 13:33:16.942 79 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create ... success [0.524s]
2018-01-27 13:33:17.978 79 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list ... success [1.036s]
2018-01-27 13:33:23.383 79 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete ... success [1.784s]
2018-01-27 13:33:37.257 79 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip ... success [10.615s]
2018-01-27 13:34:01.299 79 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.101s]
2018-01-27 13:34:01.300 79 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s]
2018-01-27 13:34:32.622 79 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.110s]
2018-01-27 13:34:32.622 79 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s]
2018-01-27 13:35:33.285 79 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [30.933s]
2018-01-27 13:35:57.330 79 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses ... success [0.071s]
2018-01-27 13:35:57.486 79 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network ... success [0.154s]
2018-01-27 13:36:03.398 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_services.ServicesTestJSON ... skip: Identity api v2 is not enabled
2018-01-27 13:36:03.398 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_users.UsersTestJSON ... skip: Identity api v2 is not enabled
2018-01-27 13:36:04.560 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete ... success [0.120s]
2018-01-27 13:36:07.082 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists ... success [0.031s]
2018-01-27 13:36:09.549 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain ... success [0.330s]
2018-01-27 13:36:12.480 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint ... success [0.184s]
2018-01-27 13:36:16.316 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete ... success [1.304s]
2018-01-27 13:36:18.752 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy ... success [0.124s]
2018-01-27 13:36:20.754 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id ... success [0.090s]
2018-01-27 13:36:23.257 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list ... success [0.170s]
2018-01-27 13:36:26.309 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service ... success [0.157s]
2018-01-27 13:36:29.942 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all ... success [1.208s]
2018-01-27 13:36:31.201 79 INFO opnfv-tempest [-] {0} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery ... skip: Identity api v2 is not enabled
2018-01-27 13:36:31.844 79 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.026s]
2018-01-27 13:36:31.866 79 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.022s]
2018-01-27 13:36:31.882 79 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.016s]
2018-01-27 13:36:33.524 79 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.485s]
2018-01-27 13:36:33.916 79 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file ... success [0.392s]
2018-01-27 13:36:34.349 79 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [0.433s]
2018-01-27 13:36:37.028 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions ... success [0.997s]
2018-01-27 13:36:48.010 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address ... success [3.009s]
2018-01-27 13:36:52.325 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip ... success [4.311s]
2018-01-27 13:37:01.841 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network ... success [2.193s]
2018-01-27 13:37:05.214 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port ... success [3.371s]
2018-01-27 13:37:11.638 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet ... success [6.420s]
2018-01-27 13:37:18.018 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network ... success [2.337s]
2018-01-27 13:37:21.388 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port ... success [3.370s]
2018-01-27 13:37:24.259 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet ... success [2.870s]
2018-01-27 13:37:37.089 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet ... success [4.173s]
2018-01-27 13:37:37.322 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility ... success [0.234s]
2018-01-27 13:37:37.522 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks ... success [0.198s]
2018-01-27 13:37:37.606 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets ... success [0.084s]
2018-01-27 13:37:37.748 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network ... success [0.141s]
2018-01-27 13:37:37.829 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet ... success [0.081s]
2018-01-27 13:37:47.052 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [4.271s]
2018-01-27 13:37:47.264 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.212s]
2018-01-27 13:37:47.410 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.146s]
2018-01-27 13:37:47.496 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.084s]
2018-01-27 13:37:47.649 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.153s]
2018-01-27 13:37:47.721 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.072s]
2018-01-27 13:37:56.709 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools ... success [4.155s]
2018-01-27 13:38:02.216 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups ... success [5.506s]
2018-01-27 13:38:04.066 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port ... success [1.848s]
2018-01-27 13:38:04.169 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports ... success [0.102s]
2018-01-27 13:38:04.259 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port ... success [0.091s]
2018-01-27 13:38:13.292 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [4.355s]
2018-01-27 13:38:19.125 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups ... success [5.833s]
2018-01-27 13:38:21.046 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [1.919s]
2018-01-27 13:38:21.149 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.102s]
2018-01-27 13:38:21.238 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.088s]
2018-01-27 13:38:35.077 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces ... success [10.179s]
2018-01-27 13:38:41.104 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id ... success [6.031s]
2018-01-27 13:38:46.000 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id ... success [4.892s]
2018-01-27 13:38:49.702 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router ... success [3.702s]
2018-01-27 13:39:10.792 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [10.478s]
2018-01-27 13:39:16.851 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [6.059s]
2018-01-27 13:39:22.203 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [5.351s]
2018-01-27 13:39:25.902 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [3.699s]
2018-01-27 13:39:36.838 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group ... success [0.873s]
2018-01-27 13:39:37.893 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule ... success [1.054s]
2018-01-27 13:39:37.975 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups ... success [0.080s]
2018-01-27 13:39:39.953 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [0.746s]
2018-01-27 13:39:41.518 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.561s]
2018-01-27 13:39:41.594 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.080s]
2018-01-27 13:39:43.474 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [0.725s]
2018-01-27 13:39:44.689 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.007s]
2018-01-27 13:39:45.254 79 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest ... skip: AccountQuotasTest skipped as swift is not available
2018-01-27 13:39:45.255 79 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_services.AccountTest ... skip: AccountTest skipped as swift is not available
2018-01-27 13:39:45.257 79 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest ... skip: ContainerQuotasTest skipped as swift is not available
2018-01-27 13:39:45.258 79 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest ... skip: ContainerTest skipped as swift is not available
2018-01-27 13:39:45.259 79 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_object_services.ObjectTest ... skip: ObjectTest skipped as swift is not available
2018-01-27 13:39:58.989 79 INFO opnfv-tempest [-] {0} tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list ... success [4.457s]
2018-01-27 13:40:07.113 79 INFO opnfv-tempest [-] {0} tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show ... success [8.103s]
2018-01-27 13:40:07.133 79 INFO opnfv-tempest [-] {0} tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template ... success [0.023s]
2018-01-27 13:40:28.228 79 INFO opnfv-tempest [-] {0} tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list ... success [0.543s]
2018-01-27 13:40:28.527 79 INFO opnfv-tempest [-] {0} tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata ... success [0.298s]
2018-01-27 13:40:28.834 79 INFO opnfv-tempest [-] {0} tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config ... success [0.307s]
2018-01-27 13:40:29.138 79 INFO opnfv-tempest [-] {0} tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate ... success [0.302s]
2018-01-27 13:40:29.547 79 INFO opnfv-tempest [-] {0} tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change ... success [0.407s]
2018-01-27 13:40:29.923 79 INFO opnfv-tempest [-] {0} tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change ... success [0.376s]
2018-01-27 13:40:52.654 79 INFO opnfv-tempest [-] {0} tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources ... success [2.389s]
2018-01-27 13:40:52.686 79 INFO opnfv-tempest [-] {0} tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds ... success [0.032s]
2018-01-27 13:41:17.157 79 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance ... success [10.344s]
2018-01-27 13:41:40.297 79 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance ... success [15.738s]
2018-01-27 13:41:59.120 79 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete ... success [13.707s]
2018-01-27 13:42:13.917 79 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image ... success [14.796s]
2018-01-27 13:42:26.514 79 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete ... success [11.115s]
2018-01-27 13:42:41.493 79 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image ... success [14.976s]
2018-01-27 13:42:48.098 79 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list ... success [0.072s]
2018-01-27 13:43:00.756 79 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list ... success [0.077s]
2018-01-27 13:44:17.073 79 INFO opnfv-tempest [-] {0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops ... success [68.753s]
2018-01-27 13:44:54.061 79 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops ... success [31.021s]
2018-01-27 13:45:40.462 79 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_multinode.TestServerMultinode.test_schedule_to_all_nodes ... success [30.569s]
2018-01-27 13:48:03.519 79 INFO opnfv-tempest [-] {0} tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern ... success [126.848s]
2018-01-27 13:50:11.590 79 INFO opnfv-tempest [-] {0} tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern ... success [116.956s]
2018-01-27 13:50:18.026 79 INFO rally.api [-] Verification (UUID=f3cb2c75-b33a-4d0e-abb6-61e4e1feaca5) has been successfully finished for deployment 'opnfv-rally' (UUID=2cac689c-b8f7-4002-968b-3052979a0eaf)!

Congratulations! Verification doesn't have failed tests! :)

======
Totals
======

Ran: 119 tests in 1017.833 sec.
 - Success: 100
 - Skipped: 19
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 0

Using verification (UUID=f3cb2c75-b33a-4d0e-abb6-61e4e1feaca5) as the default verification for the future operations.