2018-10-13 17:14:26.067 32 INFO rally.api [-] Starting verification (UUID=d6f2d267-03e8-468e-ab0f-a5516ce2470f) for deployment 'opnfv-rally' (UUID=0f1e6ba0-bdc0-406a-b957-9b96f326bef3) by verifier 'opnfv-tempest' (UUID=a0093829-42d6-422f-9abd-f0d4ed069165).
2018-10-13 17:14:27.770 32 INFO rally.task.context [-] Verification a0093829-42d6-422f-9abd-f0d4ed069165 | Context tempest@default setup()  finished in 1.14 sec
2018-10-13 17:14:27.773 32 INFO rally.task.context [-] Verification a0093829-42d6-422f-9abd-f0d4ed069165 | Context testr@default setup()  finished in 2.67 msec
2018-10-13 17:14:32.650 32 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor ... success [0.332s]
2018-10-13 17:14:32.697 32 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.047s]
2018-10-13 17:14:35.485 32 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create ... success [1.417s]
2018-10-13 17:14:38.295 32 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list ... success [2.809s]
2018-10-13 17:14:52.310 32 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete ... success [4.876s]
2018-10-13 17:14:58.519 32 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.174s]
2018-10-13 17:14:58.520 32 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s]
2018-10-13 17:15:04.745 32 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers ... success [0.190s]
2018-10-13 17:15:04.746 32 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details ... success [0.001s]
2018-10-13 17:15:14.092 32 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v2.test_users.UsersTestJSON ... skip: Identity api v2 is not enabled
2018-10-13 17:15:19.568 32 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesUnderV243Test.test_add_remove_fixed_ip ... success [34.444s]
2018-10-13 17:15:20.420 32 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint ... success [0.947s]
2018-10-13 17:15:25.324 32 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.156s]
2018-10-13 17:15:25.325 32 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s]
2018-10-13 17:15:28.642 32 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete ... success [0.800s]
2018-10-13 17:15:34.092 32 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete ... success [5.047s]
2018-10-13 17:15:37.546 32 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy ... success [1.132s]
2018-10-13 17:15:42.115 32 INFO opnfv-tempest [-] {1} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id ... success [0.329s]
2018-10-13 17:15:44.705 32 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses ... success [0.062s]
2018-10-13 17:15:44.841 32 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network ... success [0.136s]
2018-10-13 17:15:45.470 32 INFO opnfv-tempest [-] {1} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery ... skip: Identity api v2 is not enabled
2018-10-13 17:15:47.644 32 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list ... success [0.880s]
2018-10-13 17:15:54.980 32 INFO opnfv-tempest [-] {3} tempest.api.compute.test_versions.TestVersions.test_get_version_details ... success [0.884s]
2018-10-13 17:15:54.989 32 INFO opnfv-tempest [-] {3} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.010s]
2018-10-13 17:15:56.368 32 INFO opnfv-tempest [-] {1} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools ... success [6.220s]
2018-10-13 17:15:56.912 32 INFO opnfv-tempest [-] {3} tempest.api.identity.admin.v2.test_services.ServicesTestJSON ... skip: Identity api v2 is not enabled
2018-10-13 17:15:57.583 32 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service ... success [1.423s]
2018-10-13 17:16:01.638 32 INFO opnfv-tempest [-] {3} tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists ... success [0.497s]
2018-10-13 17:16:02.140 32 INFO opnfv-tempest [-] {1} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups ... success [5.772s]
2018-10-13 17:16:04.596 32 INFO opnfv-tempest [-] {1} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port ... success [2.456s]
2018-10-13 17:16:04.647 32 INFO opnfv-tempest [-] {1} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports ... success [0.052s]
2018-10-13 17:16:04.693 32 INFO opnfv-tempest [-] {1} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port ... success [0.045s]
2018-10-13 17:16:06.525 32 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_versions.VersionsTest.test_list_versions ... success [0.006s]
2018-10-13 17:16:09.728 32 INFO opnfv-tempest [-] {2} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all ... success [5.236s]
2018-10-13 17:16:11.982 32 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.555s]
2018-10-13 17:16:13.877 32 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.892s]
2018-10-13 17:16:13.931 32 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.057s]
2018-10-13 17:16:15.653 32 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.510s]
2018-10-13 17:16:16.337 32 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [10.534s]
2018-10-13 17:16:16.635 32 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file ... success [0.982s]
2018-10-13 17:16:17.268 32 INFO opnfv-tempest [-] {3} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [5.244s]
2018-10-13 17:16:17.596 32 INFO opnfv-tempest [-] {3} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.328s]
2018-10-13 17:16:17.697 32 INFO opnfv-tempest [-] {3} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.101s]
2018-10-13 17:16:17.937 32 INFO opnfv-tempest [-] {3} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.238s]
2018-10-13 17:16:18.025 32 INFO opnfv-tempest [-] {1} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.007s]
2018-10-13 17:16:18.267 32 INFO opnfv-tempest [-] {3} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.331s]
2018-10-13 17:16:18.335 32 INFO opnfv-tempest [-] {1} tempest.api.network.test_versions.NetworksApiDiscovery.test_show_api_v2_details ... success [0.310s]
2018-10-13 17:16:18.439 32 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [1.803s]
2018-10-13 17:16:18.646 32 INFO opnfv-tempest [-] {3} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.378s]
2018-10-13 17:16:25.344 32 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_account_services.AccountTest.test_list_account_metadata ... success [0.190s]
2018-10-13 17:16:25.360 32 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_account_services.AccountTest.test_list_containers ... success [0.016s]
2018-10-13 17:16:28.346 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network ... success [3.601s]
2018-10-13 17:16:33.250 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port ... success [4.904s]
2018-10-13 17:16:34.467 32 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain ... success [0.998s]
2018-10-13 17:16:35.545 32 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [7.499s]
2018-10-13 17:16:38.740 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet ... success [5.488s]
2018-10-13 17:16:41.396 32 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.165s]
2018-10-13 17:16:41.547 32 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.151s]
2018-10-13 17:16:41.681 32 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.132s]
2018-10-13 17:16:41.688 32 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions ... success [0.008s]
2018-10-13 17:16:41.790 32 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups ... success [6.244s]
2018-10-13 17:16:44.076 32 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [2.284s]
2018-10-13 17:16:44.125 32 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.050s]
2018-10-13 17:16:44.180 32 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.055s]
2018-10-13 17:16:44.871 32 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_object_services.ObjectTest.test_create_object ... success [0.151s]
2018-10-13 17:16:44.930 32 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_object_services.ObjectTest.test_get_object ... success [0.059s]
2018-10-13 17:16:45.004 32 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_object_services.ObjectTest.test_list_object_metadata ... success [0.074s]
2018-10-13 17:16:45.098 32 INFO opnfv-tempest [-] {1} tempest.api.object_storage.test_object_services.ObjectTest.test_update_object_metadata ... success [0.093s]
2018-10-13 17:16:47.359 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions ... success [1.747s]
2018-10-13 17:16:49.285 32 INFO opnfv-tempest [-] {3} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.011s]
2018-10-13 17:16:54.879 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet ... success [5.465s]
2018-10-13 17:16:55.336 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility ... success [0.457s]
2018-10-13 17:16:55.454 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks ... success [0.118s]
2018-10-13 17:16:55.502 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets ... success [0.047s]
2018-10-13 17:16:55.864 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network ... success [0.361s]
2018-10-13 17:16:55.924 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet ... success [0.060s]
2018-10-13 17:16:58.299 32 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.339s]
2018-10-13 17:17:03.138 32 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_attach_detach_volume_to_instance ... success [9.166s]
2018-10-13 17:17:05.482 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address ... success [4.839s]
2018-10-13 17:17:12.374 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip ... success [6.890s]
2018-10-13 17:17:13.940 32 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [6.516s]
2018-10-13 17:17:20.034 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces ... success [17.114s]
2018-10-13 17:17:22.210 32 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [8.268s]
2018-10-13 17:17:26.326 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network ... success [3.098s]
2018-10-13 17:17:30.601 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id ... success [10.568s]
2018-10-13 17:17:30.661 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port ... success [4.335s]
2018-10-13 17:17:37.422 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet ... success [6.760s]
2018-10-13 17:17:39.812 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id ... success [9.210s]
2018-10-13 17:17:44.835 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router ... success [5.023s]
2018-10-13 17:17:50.197 32 INFO opnfv-tempest [-] {2} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [0.853s]
2018-10-13 17:17:57.240 32 INFO opnfv-tempest [-] {2} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_large_object ... success [2.318s]
2018-10-13 17:17:59.763 32 INFO opnfv-tempest [-] {2} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_too_many_objects ... success [2.521s]
2018-10-13 17:18:01.322 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [16.756s]
2018-10-13 17:18:02.595 32 INFO opnfv-tempest [-] {2} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest.test_upload_valid_object ... success [2.832s]
2018-10-13 17:18:10.969 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [9.646s]
2018-10-13 17:18:19.699 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [8.731s]
2018-10-13 17:18:23.681 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [3.980s]
2018-10-13 17:18:29.455 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group ... success [1.623s]
2018-10-13 17:18:30.571 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule ... success [1.114s]
2018-10-13 17:18:30.619 32 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups ... success [0.050s]
2018-10-13 17:18:37.563 32 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest.test_admin_modify_quota ... success [0.923s]
2018-10-13 17:18:37.705 32 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest.test_upload_valid_object ... success [0.142s]
2018-10-13 17:18:47.451 32 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest.test_create_container ... success [2.215s]
2018-10-13 17:18:49.776 32 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest.test_list_container_contents ... success [2.324s]
2018-10-13 17:18:52.039 32 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest.test_list_container_metadata ... success [2.263s]
2018-10-13 17:18:53.968 32 INFO rally.task.context [-] Verification a0093829-42d6-422f-9abd-f0d4ed069165 | Context testr@default cleanup() started
2018-10-13 17:18:53.969 32 INFO rally.task.context [-] Verification a0093829-42d6-422f-9abd-f0d4ed069165 | Context testr@default cleanup() finished in 0.95 msec
2018-10-13 17:18:53.969 32 INFO rally.task.context [-] Verification a0093829-42d6-422f-9abd-f0d4ed069165 | Context tempest@default cleanup() started
2018-10-13 17:18:54.880 32 INFO rally.task.context [-] Verification a0093829-42d6-422f-9abd-f0d4ed069165 | Context tempest@default cleanup() finished in 0.91 sec
2018-10-13 17:18:54.959 32 INFO rally.api [-] Verification (UUID=d6f2d267-03e8-468e-ab0f-a5516ce2470f) has been successfully finished for deployment 'opnfv-rally' (UUID=0f1e6ba0-bdc0-406a-b957-9b96f326bef3)!

======
Totals
======

Ran: 107 tests in 262.103 sec.
 - Success: 102
 - Skipped: 5
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 0

Using verification (UUID=d6f2d267-03e8-468e-ab0f-a5516ce2470f) as the default verification for the future operations.