2018-09-02 00:45:25.063 49 INFO rally.api [-] Starting verification (UUID=4b5dc650-1308-4acc-a9a9-268a91ca7ba7) for deployment 'opnfv-rally' (UUID=9af6bdf5-f699-4fd1-96dc-d4cc19c2adb5) by verifier 'opnfv-tempest' (UUID=f93bd0d8-0fca-4af8-a99e-d12e4b40fea5).
2018-09-02 00:45:25.888 49 WARNING oslo_config.cfg [-] Option "swift_operator_role" from group "tempest" is deprecated. Use option "swift_operator_role" from group "openstack".
2018-09-02 00:45:26.073 49 WARNING oslo_config.cfg [-] Option "img_name_regex" from group "tempest" is deprecated. Use option "img_name_regex" from group "openstack".
2018-09-02 00:45:27.294 49 INFO rally.task.context [-] Verification f93bd0d8-0fca-4af8-a99e-d12e4b40fea5 | Context tempest@default setup()  finished in 1.72 sec
2018-09-02 00:45:27.297 49 INFO rally.task.context [-] Verification f93bd0d8-0fca-4af8-a99e-d12e4b40fea5 | Context testr@default setup()  finished in 2.72 msec
2018-09-02 00:45:29.908 49 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v2.test_users.UsersTestJSON ... skip: Identity api v2 is not enabled
2018-09-02 00:45:32.572 49 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor ... success [0.246s]
2018-09-02 00:45:32.617 49 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.045s]
2018-09-02 00:45:35.551 49 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete ... success [0.766s]
2018-09-02 00:45:39.433 49 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete ... success [4.924s]
2018-09-02 00:45:40.720 49 INFO opnfv-tempest [-] {3} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create ... success [1.650s]
2018-09-02 00:45:42.135 49 INFO opnfv-tempest [-] {3} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list ... success [1.413s]
2018-09-02 00:45:45.253 49 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint ... success [1.075s]
2018-09-02 00:45:45.700 49 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip ... success [11.719s]
2018-09-02 00:45:54.826 49 INFO opnfv-tempest [-] {2} tempest.api.compute.test_versions.TestVersions.test_get_version_details ... success [0.864s]
2018-09-02 00:45:54.836 49 INFO opnfv-tempest [-] {2} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.009s]
2018-09-02 00:45:59.463 49 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete ... success [5.445s]
2018-09-02 00:46:02.284 49 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy ... success [0.893s]
2018-09-02 00:46:05.358 49 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.091s]
2018-09-02 00:46:05.360 49 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s]
2018-09-02 00:46:08.494 49 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id ... success [0.616s]
2018-09-02 00:46:12.660 49 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list ... success [0.857s]
2018-09-02 00:46:16.181 49 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers ... success [0.075s]
2018-09-02 00:46:16.182 49 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details ... success [0.001s]
2018-09-02 00:46:17.645 49 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service ... success [1.054s]
2018-09-02 00:46:23.331 49 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.589s]
2018-09-02 00:46:24.241 49 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file ... success [0.909s]
2018-09-02 00:46:26.071 49 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [1.829s]
2018-09-02 00:46:26.564 49 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all ... success [4.808s]
2018-09-02 00:46:32.278 49 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_versions.VersionsTest.test_list_versions ... success [0.006s]
2018-09-02 00:46:36.878 49 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network ... success [4.473s]
2018-09-02 00:46:40.676 49 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port ... success [3.797s]
2018-09-02 00:46:45.751 49 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.131s]
2018-09-02 00:46:45.753 49 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s]
2018-09-02 00:46:46.256 49 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet ... success [5.580s]
2018-09-02 00:46:47.658 49 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet ... success [7.218s]
2018-09-02 00:46:48.579 49 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility ... success [0.921s]
2018-09-02 00:46:48.679 49 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks ... success [0.099s]
2018-09-02 00:46:48.744 49 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets ... success [0.065s]
2018-09-02 00:46:49.113 49 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network ... success [0.369s]
2018-09-02 00:46:49.159 49 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet ... success [0.046s]
2018-09-02 00:46:56.562 49 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.610s]
2018-09-02 00:46:57.346 49 INFO opnfv-tempest [-] {0} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery ... skip: Identity api v2 is not enabled
2018-09-02 00:46:58.983 49 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [2.417s]
2018-09-02 00:46:59.028 49 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.049s]
2018-09-02 00:47:00.040 49 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.207s]
2018-09-02 00:47:00.220 49 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.179s]
2018-09-02 00:47:00.384 49 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.163s]
2018-09-02 00:47:00.391 49 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions ... success [0.008s]
2018-09-02 00:47:02.653 49 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [4.868s]
2018-09-02 00:47:02.832 49 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.179s]
2018-09-02 00:47:02.924 49 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.092s]
2018-09-02 00:47:02.966 49 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.042s]
2018-09-02 00:47:03.072 49 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.105s]
2018-09-02 00:47:03.136 49 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.064s]
2018-09-02 00:47:04.168 49 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [10.906s]
2018-09-02 00:47:06.414 49 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_account_services.AccountTest.test_list_account_metadata ... success [0.154s]
2018-09-02 00:47:06.435 49 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_account_services.AccountTest.test_list_containers ... success [0.021s]
2018-09-02 00:47:08.018 49 INFO opnfv-tempest [-] {0} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions ... success [3.585s]
2018-09-02 00:47:22.475 49 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces ... success [13.089s]
2018-09-02 00:47:25.883 49 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_object_services.ObjectTest.test_create_object ... success [0.133s]
2018-09-02 00:47:25.958 49 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address ... success [3.943s]
2018-09-02 00:47:25.983 49 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_object_services.ObjectTest.test_get_object ... success [0.100s]
2018-09-02 00:47:26.069 49 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_object_services.ObjectTest.test_list_object_metadata ... success [0.086s]
2018-09-02 00:47:26.179 49 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_object_services.ObjectTest.test_update_object_metadata ... success [0.109s]
2018-09-02 00:47:29.956 49 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id ... success [7.480s]
2018-09-02 00:47:30.450 49 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses ... success [0.050s]
2018-09-02 00:47:30.556 49 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network ... success [0.106s]
2018-09-02 00:47:34.227 49 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip ... success [8.267s]
2018-09-02 00:47:34.504 49 INFO opnfv-tempest [-] {3} tempest.api.identity.admin.v2.test_services.ServicesTestJSON ... skip: Identity api v2 is not enabled
2018-09-02 00:47:35.985 49 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id ... success [6.028s]
2018-09-02 00:47:38.651 49 INFO opnfv-tempest [-] {3} tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists ... success [0.173s]
2018-09-02 00:47:39.237 49 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.861s]
2018-09-02 00:47:41.273 49 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router ... success [5.288s]
2018-09-02 00:47:47.458 49 INFO opnfv-tempest [-] {3} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain ... success [1.194s]
2018-09-02 00:47:47.581 49 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network ... success [2.380s]
2018-09-02 00:47:51.552 49 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port ... success [3.970s]
2018-09-02 00:47:54.479 49 INFO opnfv-tempest [-] {2} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [0.785s]
2018-09-02 00:47:57.757 49 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet ... success [6.205s]
2018-09-02 00:47:59.675 49 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [5.212s]
2018-09-02 00:48:01.732 49 INFO opnfv-tempest [-] {2} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_large_object ... success [2.409s]
2018-09-02 00:48:04.388 49 INFO opnfv-tempest [-] {2} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_too_many_objects ... success [2.654s]
2018-09-02 00:48:04.644 49 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups ... success [4.968s]
2018-09-02 00:48:06.339 49 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [1.694s]
2018-09-02 00:48:06.399 49 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.061s]
2018-09-02 00:48:06.441 49 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.041s]
2018-09-02 00:48:06.941 49 INFO opnfv-tempest [-] {2} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_valid_object ... success [2.553s]
2018-09-02 00:48:11.343 49 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools ... success [4.630s]
2018-09-02 00:48:11.374 49 INFO opnfv-tempest [-] {2} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.011s]
2018-09-02 00:48:15.024 49 INFO opnfv-tempest [-] {3} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group ... success [1.469s]
2018-09-02 00:48:16.041 49 INFO opnfv-tempest [-] {3} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule ... success [1.015s]
2018-09-02 00:48:16.341 49 INFO opnfv-tempest [-] {3} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups ... success [0.304s]
2018-09-02 00:48:16.565 49 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups ... success [5.222s]
2018-09-02 00:48:18.525 49 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port ... success [1.960s]
2018-09-02 00:48:18.570 49 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports ... success [0.044s]
2018-09-02 00:48:18.633 49 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port ... success [0.064s]
2018-09-02 00:48:36.709 49 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_attach_detach_volume_to_instance ... success [15.781s]
2018-09-02 00:48:36.850 49 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [12.497s]
2018-09-02 00:48:44.390 49 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [7.539s]
2018-09-02 00:48:49.396 49 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [7.994s]
2018-09-02 00:48:50.140 49 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [5.748s]
2018-09-02 00:48:54.430 49 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [4.291s]
2018-09-02 00:48:57.393 49 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [7.993s]
2018-09-02 00:49:06.389 49 INFO opnfv-tempest [-] {0} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.006s]
2018-09-02 00:49:12.925 49 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest.test_admin_modify_quota ... success [0.640s]
2018-09-02 00:49:13.094 49 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest.test_upload_valid_object ... success [0.170s]
2018-09-02 00:49:23.104 49 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest.test_create_container ... success [2.227s]
2018-09-02 00:49:25.509 49 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest.test_list_container_contents ... success [2.403s]
2018-09-02 00:49:27.971 49 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest.test_list_container_metadata ... success [2.462s]
2018-09-02 00:49:29.513 49 INFO rally.task.context [-] Verification f93bd0d8-0fca-4af8-a99e-d12e4b40fea5 | Context testr@default cleanup() started
2018-09-02 00:49:29.514 49 INFO rally.task.context [-] Verification f93bd0d8-0fca-4af8-a99e-d12e4b40fea5 | Context testr@default cleanup() finished in 0.93 msec
2018-09-02 00:49:29.515 49 INFO rally.task.context [-] Verification f93bd0d8-0fca-4af8-a99e-d12e4b40fea5 | Context tempest@default cleanup() started
2018-09-02 00:49:30.292 49 INFO rally.task.context [-] Verification f93bd0d8-0fca-4af8-a99e-d12e4b40fea5 | Context tempest@default cleanup() finished in 0.78 sec
2018-09-02 00:49:30.355 49 INFO rally.api [-] Verification (UUID=4b5dc650-1308-4acc-a9a9-268a91ca7ba7) has been successfully finished for deployment 'opnfv-rally' (UUID=9af6bdf5-f699-4fd1-96dc-d4cc19c2adb5)!

======
Totals
======

Ran: 106 tests in 238.067 sec.
 - Success: 101
 - Skipped: 5
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 0

Using verification (UUID=4b5dc650-1308-4acc-a9a9-268a91ca7ba7) as the default verification for the future operations.