2018-10-25 00:08:24.950 37 INFO rally.api [-] Starting verification (UUID=1a83abba-c1b8-4ebf-9f7f-8b8f8af40063) for deployment 'opnfv-rally' (UUID=655914b4-317d-438c-aa68-d271ff9868df) by verifier 'opnfv-tempest' (UUID=cf7800a3-41fe-4ee1-ba91-2ebda07fc1a7).
2018-10-25 00:08:27.110 37 INFO rally.task.context [-] Verification cf7800a3-41fe-4ee1-ba91-2ebda07fc1a7 | Context tempest@default setup()  finished in 1.39 sec
2018-10-25 00:08:27.113 37 INFO rally.task.context [-] Verification cf7800a3-41fe-4ee1-ba91-2ebda07fc1a7 | Context testr@default setup()  finished in 2.30 msec
2018-10-25 00:08:29.475 37 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v2.test_users.UsersTestJSON ... skip: Identity api v2 is not enabled
2018-10-25 00:08:32.265 37 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor ... success [0.320s]
2018-10-25 00:08:32.883 37 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.618s]
2018-10-25 00:08:34.600 37 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete ... success [0.396s]
2018-10-25 00:08:40.940 37 INFO opnfv-tempest [-] {3} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create ... success [1.854s]
2018-10-25 00:08:43.417 37 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete ... success [9.636s]
2018-10-25 00:08:43.827 37 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint ... success [0.661s]
2018-10-25 00:08:45.356 37 INFO opnfv-tempest [-] {3} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list ... success [4.415s]
2018-10-25 00:08:52.192 37 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip ... success [18.241s]
2018-10-25 00:08:55.562 37 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete ... success [3.683s]
2018-10-25 00:09:02.952 37 INFO opnfv-tempest [-] {2} tempest.api.compute.test_versions.TestVersions.test_get_version_details ... success [1.094s]
2018-10-25 00:09:02.962 37 INFO opnfv-tempest [-] {2} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.010s]
2018-10-25 00:09:03.806 37 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id ... success [0.243s]
2018-10-25 00:09:09.622 37 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy ... success [0.916s]
2018-10-25 00:09:11.783 37 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service ... success [0.930s]
2018-10-25 00:09:12.592 37 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.332s]
2018-10-25 00:09:12.593 37 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s]
2018-10-25 00:09:18.302 37 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [1.412s]
2018-10-25 00:09:19.164 37 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list ... success [0.743s]
2018-10-25 00:09:19.177 37 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file ... success [0.876s]
2018-10-25 00:09:20.384 37 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [1.206s]
2018-10-25 00:09:28.084 37 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers ... success [0.283s]
2018-10-25 00:09:28.087 37 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details ... success [0.002s]
2018-10-25 00:09:29.506 37 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network ... success [3.410s]
2018-10-25 00:09:32.350 37 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all ... success [4.787s]
2018-10-25 00:09:33.996 37 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port ... success [4.488s]
2018-10-25 00:09:37.959 37 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_versions.VersionsTest.test_list_versions ... success [0.007s]
2018-10-25 00:09:40.692 37 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet ... success [6.697s]
2018-10-25 00:09:51.443 37 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [2.055s]
2018-10-25 00:09:52.673 37 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet ... success [6.241s]
2018-10-25 00:09:53.338 37 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility ... success [0.666s]
2018-10-25 00:09:53.449 37 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks ... success [0.111s]
2018-10-25 00:09:53.504 37 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [2.058s]
2018-10-25 00:09:53.514 37 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets ... success [0.064s]
2018-10-25 00:09:53.788 37 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.287s]
2018-10-25 00:09:53.880 37 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network ... success [0.365s]
2018-10-25 00:09:53.945 37 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet ... success [0.065s]
2018-10-25 00:09:54.559 37 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.314s]
2018-10-25 00:09:54.561 37 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s]
2018-10-25 00:09:55.267 37 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_account_services.AccountTest ... skip: AccountTest skipped as swift is not available
2018-10-25 00:09:55.268 37 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_object_services.ObjectTest ... skip: ObjectTest skipped as swift is not available
2018-10-25 00:10:05.833 37 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.316s]
2018-10-25 00:10:09.337 37 INFO opnfv-tempest [-] {0} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery ... skip: Identity api v2 is not enabled
2018-10-25 00:10:11.171 37 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [6.275s]
2018-10-25 00:10:11.931 37 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.130s]
2018-10-25 00:10:12.059 37 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.127s]
2018-10-25 00:10:12.107 37 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.935s]
2018-10-25 00:10:12.219 37 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.159s]
2018-10-25 00:10:12.228 37 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions ... success [0.010s]
2018-10-25 00:10:12.479 37 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.371s]
2018-10-25 00:10:12.558 37 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.079s]
2018-10-25 00:10:12.932 37 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.374s]
2018-10-25 00:10:12.994 37 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.062s]
2018-10-25 00:10:19.836 37 INFO opnfv-tempest [-] {0} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions ... success [3.332s]
2018-10-25 00:10:37.044 37 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces ... success [15.229s]
2018-10-25 00:10:37.560 37 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address ... success [4.575s]
2018-10-25 00:10:44.265 37 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip ... success [6.703s]
2018-10-25 00:10:44.925 37 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id ... success [7.879s]
2018-10-25 00:10:52.021 37 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id ... success [7.095s]
2018-10-25 00:10:58.164 37 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router ... success [6.145s]
2018-10-25 00:11:00.505 37 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network ... success [3.875s]
2018-10-25 00:11:04.957 37 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port ... success [4.451s]
2018-10-25 00:11:13.711 37 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet ... success [8.752s]
2018-10-25 00:11:21.732 37 INFO opnfv-tempest [-] {2} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.724s]
2018-10-25 00:11:23.748 37 INFO opnfv-tempest [-] {2} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest ... skip: ContainerQuotasTest skipped as swift is not available
2018-10-25 00:11:26.131 37 INFO opnfv-tempest [-] {2} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.014s]
2018-10-25 00:11:28.884 37 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [80.475s]
2018-10-25 00:11:32.570 37 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools ... success [6.629s]
2018-10-25 00:11:39.863 37 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups ... success [7.292s]
2018-10-25 00:11:42.114 37 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port ... success [2.251s]
2018-10-25 00:11:42.194 37 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports ... success [0.081s]
2018-10-25 00:11:42.293 37 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port ... success [0.099s]
2018-10-25 00:11:59.292 37 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses ... success [0.072s]
2018-10-25 00:11:59.787 37 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network ... success [0.495s]
2018-10-25 00:12:05.336 37 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [15.000s]
2018-10-25 00:12:09.930 37 INFO opnfv-tempest [-] {3} tempest.api.identity.admin.v2.test_services.ServicesTestJSON ... skip: Identity api v2 is not enabled
2018-10-25 00:12:14.045 37 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [8.708s]
2018-10-25 00:12:14.324 37 INFO opnfv-tempest [-] {3} tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists ... success [0.515s]
2018-10-25 00:12:21.406 37 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [7.359s]
2018-10-25 00:12:22.839 37 INFO opnfv-tempest [-] {3} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain ... success [0.918s]
2018-10-25 00:12:26.681 37 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [5.275s]
2018-10-25 00:12:38.475 37 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [6.234s]
2018-10-25 00:12:46.640 37 INFO opnfv-tempest [-] {0} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.007s]
2018-10-25 00:12:46.717 37 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups ... success [8.241s]
2018-10-25 00:12:48.552 37 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest ... skip: AccountQuotasTest skipped as swift is not available
2018-10-25 00:12:48.554 37 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest ... skip: ContainerTest skipped as swift is not available
2018-10-25 00:12:49.030 37 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [2.313s]
2018-10-25 00:12:49.423 37 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.393s]
2018-10-25 00:12:49.513 37 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.091s]
2018-10-25 00:12:59.030 37 INFO opnfv-tempest [-] {3} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group ... success [2.563s]
2018-10-25 00:13:01.957 37 INFO opnfv-tempest [-] {3} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule ... success [2.924s]
2018-10-25 00:13:02.055 37 INFO opnfv-tempest [-] {3} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups ... success [0.101s]
2018-10-25 00:13:25.645 37 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_attach_detach_volume_to_instance ... success [16.873s]
2018-10-25 00:13:42.381 37 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [10.108s]
2018-10-25 00:13:56.904 37 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [14.521s]
2018-10-25 00:13:59.305 37 INFO rally.task.context [-] Verification cf7800a3-41fe-4ee1-ba91-2ebda07fc1a7 | Context testr@default cleanup() started
2018-10-25 00:13:59.306 37 INFO rally.task.context [-] Verification cf7800a3-41fe-4ee1-ba91-2ebda07fc1a7 | Context testr@default cleanup() finished in 0.82 msec
2018-10-25 00:13:59.306 37 INFO rally.task.context [-] Verification cf7800a3-41fe-4ee1-ba91-2ebda07fc1a7 | Context tempest@default cleanup() started
2018-10-25 00:14:00.494 37 INFO rally.task.context [-] Verification cf7800a3-41fe-4ee1-ba91-2ebda07fc1a7 | Context tempest@default cleanup() finished in 1.19 sec
2018-10-25 00:14:00.646 37 INFO rally.api [-] Verification (UUID=1a83abba-c1b8-4ebf-9f7f-8b8f8af40063) has been successfully finished for deployment 'opnfv-rally' (UUID=655914b4-317d-438c-aa68-d271ff9868df)!

======
Totals
======

Ran: 106 tests in 327.495 sec.
 - Success: 87
 - Skipped: 19
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 0

Using verification (UUID=1a83abba-c1b8-4ebf-9f7f-8b8f8af40063) as the default verification for the future operations.