2018-12-08 06:45:40.667 33 INFO rally.api [-] Starting verification (UUID=cc1f222d-9bee-41c6-b098-59726174cd5d) for deployment 'opnfv-rally' (UUID=e22db5cd-822c-4c4e-855f-8a999245227c) by verifier 'opnfv-tempest' (UUID=1bde3f55-ceb4-4f7e-93e1-cfc360eb7d5d).
2018-12-08 06:45:42.492 33 INFO rally.task.context [-] Verification 1bde3f55-ceb4-4f7e-93e1-cfc360eb7d5d | Context tempest@default setup()  finished in 1.27 sec
2018-12-08 06:45:42.493 33 INFO rally.task.context [-] Verification 1bde3f55-ceb4-4f7e-93e1-cfc360eb7d5d | Context testr@default setup()  finished in 0.61 msec
2018-12-08 06:45:44.649 33 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v2.test_users.UsersTestJSON ... skip: Identity api v2 is not enabled
2018-12-08 06:45:47.391 33 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor ... success [0.413s]
2018-12-08 06:45:47.492 33 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.101s]
2018-12-08 06:45:50.405 33 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete ... success [0.578s]
2018-12-08 06:45:54.516 33 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete ... success [5.710s]
2018-12-08 06:45:54.925 33 INFO opnfv-tempest [-] {3} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create ... success [1.491s]
2018-12-08 06:45:57.171 33 INFO opnfv-tempest [-] {3} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list ... success [2.246s]
2018-12-08 06:46:01.066 33 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint ... success [0.852s]
2018-12-08 06:46:01.952 33 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip ... success [13.040s]
2018-12-08 06:46:12.403 33 INFO opnfv-tempest [-] {2} tempest.api.compute.test_versions.TestVersions.test_get_version_details ... success [0.820s]
2018-12-08 06:46:12.411 33 INFO opnfv-tempest [-] {2} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.009s]
2018-12-08 06:46:13.907 33 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete ... success [4.594s]
2018-12-08 06:46:19.110 33 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy ... success [1.193s]
2018-12-08 06:46:22.233 33 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id ... success [0.279s]
2018-12-08 06:46:23.998 33 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.096s]
2018-12-08 06:46:24.000 33 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s]
2018-12-08 06:46:28.986 33 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list ... success [0.802s]
2018-12-08 06:46:31.492 33 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service ... success [1.312s]
2018-12-08 06:46:32.210 33 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers ... success [0.082s]
2018-12-08 06:46:32.211 33 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details ... success [0.001s]
2018-12-08 06:46:37.829 33 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.718s]
2018-12-08 06:46:39.860 33 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file ... success [2.030s]
2018-12-08 06:46:40.608 33 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [0.747s]
2018-12-08 06:46:43.633 33 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all ... success [5.486s]
2018-12-08 06:46:48.948 33 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_versions.VersionsTest.test_list_versions ... success [0.006s]
2018-12-08 06:46:50.905 33 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network ... success [3.404s]
2018-12-08 06:46:55.218 33 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port ... success [4.312s]
2018-12-08 06:47:01.375 33 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet ... success [6.157s]
2018-12-08 06:47:02.352 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet ... success [5.737s]
2018-12-08 06:47:02.522 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility ... success [0.170s]
2018-12-08 06:47:02.642 33 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.096s]
2018-12-08 06:47:02.643 33 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s]
2018-12-08 06:47:02.674 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks ... success [0.152s]
2018-12-08 06:47:02.740 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets ... success [0.065s]
2018-12-08 06:47:02.869 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network ... success [0.128s]
2018-12-08 06:47:02.925 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet ... success [0.056s]
2018-12-08 06:47:12.274 33 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.396s]
2018-12-08 06:47:14.872 33 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [2.595s]
2018-12-08 06:47:14.914 33 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.045s]
2018-12-08 06:47:16.089 33 INFO opnfv-tempest [-] {0} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery ... skip: Identity api v2 is not enabled
2018-12-08 06:47:17.710 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [5.497s]
2018-12-08 06:47:18.094 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.384s]
2018-12-08 06:47:18.216 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.122s]
2018-12-08 06:47:18.277 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.061s]
2018-12-08 06:47:18.386 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.109s]
2018-12-08 06:47:18.435 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.048s]
2018-12-08 06:47:18.761 33 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.174s]
2018-12-08 06:47:18.994 33 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.232s]
2018-12-08 06:47:19.083 33 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.089s]
2018-12-08 06:47:19.091 33 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions ... success [0.008s]
2018-12-08 06:47:22.421 33 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_account_services.AccountTest.test_list_account_metadata ... success [0.143s]
2018-12-08 06:47:22.437 33 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_account_services.AccountTest.test_list_containers ... success [0.016s]
2018-12-08 06:47:24.682 33 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [11.509s]
2018-12-08 06:47:25.902 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions ... success [2.885s]
2018-12-08 06:47:41.411 33 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_object_services.ObjectTest.test_create_object ... success [0.164s]
2018-12-08 06:47:41.472 33 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_object_services.ObjectTest.test_get_object ... success [0.061s]
2018-12-08 06:47:41.524 33 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_object_services.ObjectTest.test_list_object_metadata ... success [0.052s]
2018-12-08 06:47:41.613 33 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_object_services.ObjectTest.test_update_object_metadata ... success [0.089s]
2018-12-08 06:47:42.890 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces ... success [17.977s]
2018-12-08 06:47:44.382 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address ... success [5.501s]
2018-12-08 06:47:50.867 33 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses ... success [0.053s]
2018-12-08 06:47:50.973 33 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network ... success [0.107s]
2018-12-08 06:47:52.033 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip ... success [7.650s]
2018-12-08 06:47:54.238 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id ... success [11.346s]
2018-12-08 06:47:55.154 33 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.301s]
2018-12-08 06:47:56.680 33 INFO opnfv-tempest [-] {3} tempest.api.identity.admin.v2.test_services.ServicesTestJSON ... skip: Identity api v2 is not enabled
2018-12-08 06:48:01.347 33 INFO opnfv-tempest [-] {3} tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists ... success [0.493s]
2018-12-08 06:48:03.710 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id ... success [9.474s]
2018-12-08 06:48:06.083 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network ... success [3.381s]
2018-12-08 06:48:08.539 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router ... success [4.827s]
2018-12-08 06:48:09.461 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port ... success [3.377s]
2018-12-08 06:48:09.517 33 INFO opnfv-tempest [-] {3} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain ... success [0.877s]
2018-12-08 06:48:13.855 33 INFO opnfv-tempest [-] {2} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [0.744s]
2018-12-08 06:48:16.632 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet ... success [7.170s]
2018-12-08 06:48:22.101 33 INFO opnfv-tempest [-] {2} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_large_object ... success [2.767s]
2018-12-08 06:48:22.706 33 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [6.017s]
2018-12-08 06:48:24.745 33 INFO opnfv-tempest [-] {2} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_too_many_objects ... success [2.642s]
2018-12-08 06:48:27.243 33 INFO opnfv-tempest [-] {2} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_valid_object ... success [2.498s]
2018-12-08 06:48:27.970 33 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups ... success [5.263s]
2018-12-08 06:48:30.716 33 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [2.746s]
2018-12-08 06:48:30.771 33 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.055s]
2018-12-08 06:48:30.814 33 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.044s]
2018-12-08 06:48:32.038 33 INFO opnfv-tempest [-] {2} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.013s]
2018-12-08 06:48:32.167 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools ... success [6.790s]
2018-12-08 06:48:36.827 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups ... success [4.659s]
2018-12-08 06:48:37.143 33 INFO opnfv-tempest [-] {3} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group ... success [1.371s]
2018-12-08 06:48:38.487 33 INFO opnfv-tempest [-] {3} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule ... success [1.341s]
2018-12-08 06:48:38.534 33 INFO opnfv-tempest [-] {3} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups ... success [0.050s]
2018-12-08 06:48:38.741 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port ... success [1.915s]
2018-12-08 06:48:38.795 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports ... success [0.054s]
2018-12-08 06:48:39.081 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port ... success [0.286s]
2018-12-08 06:48:52.791 33 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_attach_detach_volume_to_instance ... success [9.411s]
2018-12-08 06:49:03.048 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [18.953s]
2018-12-08 06:49:03.313 33 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [5.928s]
2018-12-08 06:49:11.323 33 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [8.007s]
2018-12-08 06:49:13.443 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [10.394s]
2018-12-08 06:49:22.282 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [8.839s]
2018-12-08 06:49:26.497 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [4.215s]
2018-12-08 06:49:31.374 33 INFO opnfv-tempest [-] {0} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.006s]
2018-12-08 06:49:37.875 33 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest.test_admin_modify_quota ... success [0.447s]
2018-12-08 06:49:38.040 33 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest.test_upload_valid_object ... success [0.165s]
2018-12-08 06:49:47.550 33 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest.test_create_container ... success [2.194s]
2018-12-08 06:49:49.937 33 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest.test_list_container_contents ... success [2.386s]
2018-12-08 06:49:52.196 33 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest.test_list_container_metadata ... success [2.258s]
2018-12-08 06:49:53.900 33 INFO rally.task.context [-] Verification 1bde3f55-ceb4-4f7e-93e1-cfc360eb7d5d | Context testr@default cleanup() started
2018-12-08 06:49:53.901 33 INFO rally.task.context [-] Verification 1bde3f55-ceb4-4f7e-93e1-cfc360eb7d5d | Context testr@default cleanup() finished in 0.98 msec
2018-12-08 06:49:53.902 33 INFO rally.task.context [-] Verification 1bde3f55-ceb4-4f7e-93e1-cfc360eb7d5d | Context tempest@default cleanup() started
2018-12-08 06:49:54.911 33 INFO rally.task.context [-] Verification 1bde3f55-ceb4-4f7e-93e1-cfc360eb7d5d | Context tempest@default cleanup() finished in 1.01 sec
2018-12-08 06:49:54.989 33 INFO rally.api [-] Verification (UUID=cc1f222d-9bee-41c6-b098-59726174cd5d) has been successfully finished for deployment 'opnfv-rally' (UUID=e22db5cd-822c-4c4e-855f-8a999245227c)!

======
Totals
======

Ran: 106 tests in 247.556 sec.
 - Success: 101
 - Skipped: 5
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 0

Using verification (UUID=cc1f222d-9bee-41c6-b098-59726174cd5d) as the default verification for the future operations.