2018-03-13 18:50:17.291 9959 INFO rally.api [-] Starting verification (UUID=e9a487ac-7b8b-424c-8b21-eb204c25bb6f) for deployment 'opnfv-rally' (UUID=ae7246eb-c651-4d51-89e1-9da7d18f887c) by verifier 'opnfv-tempest' (UUID=fc98c980-6449-42b1-b076-e7b57d73ec57).
2018-03-13 18:50:17.831 9959 INFO rally.task.context [-] Verification fc98c980-6449-42b1-b076-e7b57d73ec57 | Context tempest@default setup()  started
2018-03-13 18:50:20.076 9959 INFO rally.task.context [-] Verification fc98c980-6449-42b1-b076-e7b57d73ec57 | Context tempest@default setup()  finished in 2.24 sec
2018-03-13 18:50:20.077 9959 INFO rally.task.context [-] Verification fc98c980-6449-42b1-b076-e7b57d73ec57 | Context testr@default setup()  started
2018-03-13 18:50:20.080 9959 INFO rally.task.context [-] Verification fc98c980-6449-42b1-b076-e7b57d73ec57 | Context testr@default setup()  finished in 2.93 msec
2018-03-13 18:50:25.532 9959 INFO opnfv-tempest [-] {12} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.012s]
2018-03-13 18:50:25.703 9959 INFO opnfv-tempest [-] {8} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.203s]
2018-03-13 18:50:25.749 9959 INFO opnfv-tempest [-] {14} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.315s]
2018-03-13 18:50:26.275 9959 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [0.800s]
2018-03-13 18:50:26.441 9959 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.166s]
2018-03-13 18:50:29.465 9959 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.186s]
2018-03-13 18:50:32.283 9959 INFO opnfv-tempest [-] {14} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [2.500s]
2018-03-13 18:50:32.596 9959 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [3.129s]
2018-03-13 18:50:33.827 9959 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [1.231s]
2018-03-13 18:50:35.035 9959 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [1.206s]
2018-03-13 18:50:35.649 9959 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [3.766s]
2018-03-13 18:50:36.801 9959 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [1.765s]
2018-03-13 18:50:37.300 9959 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [1.651s]
2018-03-13 18:50:37.508 9959 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action ... success [0.075s]
2018-03-13 18:50:39.293 9959 INFO opnfv-tempest [-] {6} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [2.085s]
2018-03-13 18:50:39.910 9959 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [3.108s]
2018-03-13 18:50:40.459 9959 INFO opnfv-tempest [-] {6} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [1.167s]
2018-03-13 18:50:41.673 9959 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [1.762s]
2018-03-13 18:50:41.848 9959 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.175s]
2018-03-13 18:50:41.872 9959 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.024s]
2018-03-13 18:50:42.355 9959 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions ... success [4.846s]
2018-03-13 18:50:42.897 9959 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [1.023s]
2018-03-13 18:50:42.915 9959 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.019s]
2018-03-13 18:50:48.565 9959 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor ... success [0.692s]
2018-03-13 18:50:48.566 9959 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image ... skip [0.000s]: Need distinct images to run this test
2018-03-13 18:50:49.337 9959 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name ... success [0.772s]
2018-03-13 18:50:49.776 9959 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status ... success [0.438s]
2018-03-13 18:50:50.264 9959 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results ... success [0.488s]
2018-03-13 18:50:50.338 9959 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_active_status ... success [0.073s]
2018-03-13 18:50:50.418 9959 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor ... success [0.078s]
2018-03-13 18:50:50.419 9959 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image ... skip [0.000s]: Need distinct images to run this test
2018-03-13 18:50:50.499 9959 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit ... success [0.080s]
2018-03-13 18:50:50.583 9959 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name ... success [0.084s]
2018-03-13 18:50:50.747 9959 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard ... success [0.163s]
2018-03-13 18:50:52.299 9959 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date ... success [0.072s]
2018-03-13 18:50:52.311 9959 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date ... success [0.011s]
2018-03-13 18:50:52.447 9959 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count ... success [0.135s]
2018-03-13 18:50:52.459 9959 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value ... success [0.012s]
2018-03-13 18:50:52.472 9959 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string ... success [0.012s]
2018-03-13 18:50:52.502 9959 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor ... success [0.030s]
2018-03-13 18:50:52.567 9959 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image ... success [0.064s]
2018-03-13 18:50:52.633 9959 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name ... success [0.065s]
2018-03-13 18:50:53.106 9959 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted ... success [0.472s]
2018-03-13 18:50:53.124 9959 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing ... success [0.018s]
2018-03-13 18:50:53.196 9959 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server ... success [0.071s]
2018-03-13 18:50:56.486 9959 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image ... success [1.890s]
2018-03-13 18:50:59.543 9959 INFO opnfv-tempest [-] {5} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image ... success [21.590s]
2018-03-13 18:51:01.025 9959 INFO opnfv-tempest [-] {5} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name ... success [1.486s]
2018-03-13 18:51:02.469 9959 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.187s]
2018-03-13 18:51:02.779 9959 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name ... success [0.310s]
2018-03-13 18:51:02.854 9959 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name ... success [0.075s]
2018-03-13 18:51:03.023 9959 INFO opnfv-tempest [-] {7} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions ... success [0.166s]
2018-03-13 18:51:03.569 9959 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination ... success [0.713s]
2018-03-13 18:51:03.968 9959 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params ... success [0.398s]
2018-03-13 18:51:04.267 9959 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination ... success [0.298s]
2018-03-13 18:51:04.482 9959 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status ... success [0.216s]
2018-03-13 18:51:04.834 9959 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status ... success [0.351s]
2018-03-13 18:51:05.051 9959 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata ... success [0.216s]
2018-03-13 18:51:05.123 9959 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details ... success [0.072s]
2018-03-13 18:51:05.182 9959 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata ... success [0.059s]
2018-03-13 18:51:05.429 9959 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone ... success [0.246s]
2018-03-13 18:51:05.530 9959 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status ... success [0.101s]
2018-03-13 18:51:05.777 9959 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone ... success [0.246s]
2018-03-13 18:51:05.827 9959 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status ... success [0.050s]
2018-03-13 18:51:06.297 9959 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port ... success [3.659s]
2018-03-13 18:51:07.102 9959 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [4.475s]
2018-03-13 18:51:11.158 9959 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [4.055s]
2018-03-13 18:51:12.052 9959 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [5.753s]
2018-03-13 18:51:13.922 9959 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [1.870s]
2018-03-13 18:51:14.128 9959 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.205s]
2018-03-13 18:51:14.181 9959 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields ... success [0.052s]
2018-03-13 18:51:14.393 9959 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.211s]
2018-03-13 18:51:14.597 9959 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields ... success [0.203s]
2018-03-13 18:51:15.318 9959 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [4.160s]
2018-03-13 18:51:21.602 9959 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [6.283s]
2018-03-13 18:51:25.481 9959 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [3.877s]
2018-03-13 18:51:28.200 9959 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [2.719s]
2018-03-13 18:51:29.604 9959 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name ... success [2.643s]
2018-03-13 18:51:29.677 9959 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.073s]
2018-03-13 18:51:30.431 9959 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail ... success [0.753s]
2018-03-13 18:51:30.531 9959 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus ... success [0.098s]
2018-03-13 18:51:30.533 9959 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s]
2018-03-13 18:51:31.861 9959 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [3.661s]
2018-03-13 18:51:38.331 9959 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [6.468s]
2018-03-13 18:51:42.257 9959 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [3.925s]
2018-03-13 18:51:42.515 9959 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.258s]
2018-03-13 18:51:42.661 9959 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.145s]
2018-03-13 18:51:43.026 9959 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.365s]
2018-03-13 18:51:43.226 9959 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.199s]
2018-03-13 18:51:43.332 9959 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.105s]
2018-03-13 18:51:43.441 9959 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.109s]
2018-03-13 18:51:43.498 9959 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.056s]
2018-03-13 18:51:43.550 9959 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.051s]
2018-03-13 18:51:44.375 9959 INFO opnfv-tempest [-] {5} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON.test_get_availability_zone_list ... success [0.169s]
2018-03-13 18:51:49.424 9959 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [5.873s]
2018-03-13 18:52:02.365 9959 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete ... success [4.257s]
2018-03-13 18:52:08.905 9959 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot ... success [6.540s]
2018-03-13 18:52:13.536 9959 INFO rally.task.context [-] Verification fc98c980-6449-42b1-b076-e7b57d73ec57 | Context testr@default cleanup() started
2018-03-13 18:52:13.536 9959 INFO rally.task.context [-] Verification fc98c980-6449-42b1-b076-e7b57d73ec57 | Context testr@default cleanup() finished in 0.52 msec
2018-03-13 18:52:13.537 9959 INFO rally.task.context [-] Verification fc98c980-6449-42b1-b076-e7b57d73ec57 | Context tempest@default cleanup() started
2018-03-13 18:52:14.580 9959 INFO rally.task.context [-] Verification fc98c980-6449-42b1-b076-e7b57d73ec57 | Context tempest@default cleanup() finished in 1.04 sec
2018-03-13 18:52:14.648 9959 INFO rally.api [-] Verification (UUID=e9a487ac-7b8b-424c-8b21-eb204c25bb6f) has been successfully finished for deployment 'opnfv-rally' (UUID=ae7246eb-c651-4d51-89e1-9da7d18f887c)!

======
Totals
======

Ran: 97 tests in 105.438 sec.
 - Success: 95
 - Skipped: 2
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 0

Using verification (UUID=e9a487ac-7b8b-424c-8b21-eb204c25bb6f) as the default verification for the future operations.