2018-01-03 01:35:52.487 79 INFO rally.api [-] Starting verification (UUID=f0d93b3a-536b-4f0e-b646-c28f7cec0949) for deployment 'opnfv-rally' (UUID=445c1d1d-507f-438f-abe2-9d96c52f3400) by verifier 'opnfv-tempest' (UUID=f5b8b64a-ea06-454d-b678-431535657d69).
2018-01-03 01:35:57.450 79 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor ... success [0.141s]
2018-01-03 01:35:57.632 79 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.183s]
2018-01-03 01:36:02.263 79 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create ... success [1.186s]
2018-01-03 01:36:04.550 79 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list ... success [2.286s]
2018-01-03 01:36:13.881 79 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete ... success [4.359s]
2018-01-03 01:36:28.805 79 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip ... success [10.293s]
2018-01-03 01:36:56.906 79 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.155s]
2018-01-03 01:36:56.908 79 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s]
2018-01-03 01:37:36.587 79 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.197s]
2018-01-03 01:37:36.589 79 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s]
2018-01-03 01:38:37.283 79 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [22.254s]
2018-01-03 01:39:03.703 79 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses ... success [0.108s]
2018-01-03 01:39:03.978 79 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network ... success [0.275s]
2018-01-03 01:39:09.843 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services ... success [0.387s]
2018-01-03 01:39:13.697 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user ... success [0.458s]
2018-01-03 01:39:17.427 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete ... success [0.213s]
2018-01-03 01:39:21.185 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists ... success [0.031s]
2018-01-03 01:39:24.952 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain ... success [0.595s]
2018-01-03 01:39:29.964 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint ... success [0.362s]
2018-01-03 01:39:35.624 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete ... success [2.101s]
2018-01-03 01:39:39.434 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy ... success [0.233s]
2018-01-03 01:39:42.783 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id ... success [0.118s]
2018-01-03 01:39:46.837 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list ... success [0.209s]
2018-01-03 01:39:51.802 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service ... success [0.215s]
2018-01-03 01:39:56.654 79 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all ... success [1.487s]
2018-01-03 01:39:59.937 79 INFO opnfv-tempest [-] {0} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.085s]
2018-01-03 01:40:00.017 79 INFO opnfv-tempest [-] {0} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.078s]
2018-01-03 01:40:00.081 79 INFO opnfv-tempest [-] {0} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.063s]
2018-01-03 01:40:01.858 79 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.028s]
2018-01-03 01:40:01.884 79 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.026s]
2018-01-03 01:40:01.905 79 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.020s]
2018-01-03 01:40:04.524 79 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.773s]
2018-01-03 01:40:05.460 79 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file ... success [0.935s]
2018-01-03 01:40:06.482 79 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [1.019s]
2018-01-03 01:40:12.323 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions ... success [2.840s]
2018-01-03 01:40:29.735 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address ... success [3.272s]
2018-01-03 01:40:34.470 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip ... success [4.733s]
2018-01-03 01:40:46.416 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network ... success [2.729s]
2018-01-03 01:40:50.364 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port ... success [3.945s]
2018-01-03 01:40:56.502 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet ... success [6.137s]
2018-01-03 01:41:03.549 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network ... success [2.514s]
2018-01-03 01:41:08.055 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port ... success [4.504s]
2018-01-03 01:41:11.922 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet ... success [3.866s]
2018-01-03 01:41:26.147 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet ... success [6.025s]
2018-01-03 01:41:26.484 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility ... success [0.336s]
2018-01-03 01:41:26.773 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks ... success [0.289s]
2018-01-03 01:41:26.967 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets ... success [0.192s]
2018-01-03 01:41:27.268 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network ... success [0.300s]
2018-01-03 01:41:27.467 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet ... success [0.199s]
2018-01-03 01:41:39.582 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [5.675s]
2018-01-03 01:41:39.981 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.399s]
2018-01-03 01:41:40.272 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.290s]
2018-01-03 01:41:40.509 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.236s]
2018-01-03 01:41:40.711 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.202s]
2018-01-03 01:41:40.877 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.165s]
2018-01-03 01:41:52.847 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools ... success [4.867s]
2018-01-03 01:41:59.411 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups ... success [6.563s]
2018-01-03 01:42:01.925 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port ... success [2.512s]
2018-01-03 01:42:02.154 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports ... success [0.229s]
2018-01-03 01:42:02.382 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port ... success [0.227s]
2018-01-03 01:42:13.830 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [5.724s]
2018-01-03 01:42:20.500 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups ... success [6.669s]
2018-01-03 01:42:22.824 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [2.322s]
2018-01-03 01:42:22.950 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.125s]
2018-01-03 01:42:23.164 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.214s]
2018-01-03 01:42:44.646 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces ... success [16.845s]
2018-01-03 01:42:57.462 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id ... success [12.814s]
2018-01-03 01:43:09.517 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id ... success [12.055s]
2018-01-03 01:43:20.574 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router ... success [11.054s]
2018-01-03 01:43:51.259 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [16.014s]
2018-01-03 01:44:03.093 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [11.834s]
2018-01-03 01:44:13.819 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [10.724s]
2018-01-03 01:44:21.848 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [8.028s]
2018-01-03 01:44:37.881 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group ... success [1.473s]
2018-01-03 01:44:39.931 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule ... success [2.046s]
2018-01-03 01:44:40.102 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups ... success [0.174s]
2018-01-03 01:44:43.151 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.377s]
2018-01-03 01:44:45.681 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [2.529s]
2018-01-03 01:44:45.826 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.146s]
2018-01-03 01:44:48.855 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.350s]
2018-01-03 01:44:50.767 79 INFO opnfv-tempest [-] {0} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.047s]
2018-01-03 01:44:52.047 79 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest ... skip: AccountQuotasTest skipped as swift is not available
2018-01-03 01:44:52.048 79 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_services.AccountTest ... skip: AccountTest skipped as swift is not available
2018-01-03 01:44:52.049 79 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest ... skip: ContainerQuotasTest skipped as swift is not available
2018-01-03 01:44:52.050 79 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest ... skip: ContainerTest skipped as swift is not available
2018-01-03 01:44:52.050 79 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_object_services.ObjectTest ... skip: ObjectTest skipped as swift is not available
2018-01-03 01:45:11.522 79 INFO opnfv-tempest [-] {0} tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list ... success [3.729s]
2018-01-03 01:45:23.254 79 INFO opnfv-tempest [-] {0} tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show ... success [11.695s]
2018-01-03 01:45:23.318 79 INFO opnfv-tempest [-] {0} tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template ... success [0.069s]
2018-01-03 01:46:01.728 79 INFO opnfv-tempest [-] {0} tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list ... success [1.576s]
2018-01-03 01:46:02.503 79 INFO opnfv-tempest [-] {0} tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata ... success [0.776s]
2018-01-03 01:46:03.398 79 INFO opnfv-tempest [-] {0} tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config ... success [0.892s]
2018-01-03 01:46:04.313 79 INFO opnfv-tempest [-] {0} tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate ... success [0.915s]
2018-01-03 01:46:05.360 79 INFO opnfv-tempest [-] {0} tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change ... success [1.044s]
2018-01-03 01:46:06.378 79 INFO opnfv-tempest [-] {0} tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change ... success [1.017s]
2018-01-03 01:46:45.704 79 INFO opnfv-tempest [-] {0} tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources ... success [3.258s]
2018-01-03 01:46:45.770 79 INFO opnfv-tempest [-] {0} tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds ... success [0.069s]
2018-01-03 01:47:19.277 79 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance ... success [9.661s]
2018-01-03 01:47:39.632 79 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance ... success [9.608s]
2018-01-03 01:48:05.455 79 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete ... success [17.716s]
2018-01-03 01:48:24.370 79 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image ... success [18.914s]
2018-01-03 01:48:43.523 79 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete ... success [17.229s]
2018-01-03 01:49:01.652 79 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image ... success [18.126s]
2018-01-03 01:49:09.686 79 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list ... success [0.144s]
2018-01-03 01:49:30.860 79 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list ... success [0.136s]
2018-01-03 01:51:01.935 79 INFO opnfv-tempest [-] {0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops ... success [75.388s]
2018-01-03 01:51:51.637 79 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops ... success [39.631s]
2018-01-03 01:52:40.474 79 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_multinode.TestServerMultinode.test_schedule_to_all_nodes ... success [23.832s]
2018-01-03 01:55:00.969 79 INFO opnfv-tempest [-] {0} tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern ... success [114.711s]
2018-01-03 01:57:17.155 79 INFO opnfv-tempest [-] {0} tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern ... success [117.808s]
2018-01-03 01:57:28.198 79 INFO rally.api [-] Verification (UUID=f0d93b3a-536b-4f0e-b646-c28f7cec0949) has been successfully finished for deployment 'opnfv-rally' (UUID=445c1d1d-507f-438f-abe2-9d96c52f3400)!

Congratulations! Verification doesn't have failed tests! :)

======
Totals
======

Ran: 119 tests in 1280.680 sec.
 - Success: 105
 - Skipped: 14
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 0

Using verification (UUID=f0d93b3a-536b-4f0e-b646-c28f7cec0949) as the default verification for the future operations.