2018-05-08 15:20:59.755 11241 INFO rally.api [-] Starting verification (UUID=851a8428-e86d-4c69-9942-a71b12606256) for deployment 'opnfv-rally' (UUID=54c6acb3-e846-4772-a388-cc69c24cd341) by verifier 'opnfv-tempest' (UUID=3b441fdf-e24b-4267-ba84-bc56794bf7a5).
2018-05-08 15:21:00.295 11241 INFO rally.task.context [-] Verification 3b441fdf-e24b-4267-ba84-bc56794bf7a5 | Context tempest@default setup()  started
2018-05-08 15:21:04.561 11241 INFO rally.task.context [-] Verification 3b441fdf-e24b-4267-ba84-bc56794bf7a5 | Context tempest@default setup()  finished in 4.27 sec
2018-05-08 15:21:04.561 11241 INFO rally.task.context [-] Verification 3b441fdf-e24b-4267-ba84-bc56794bf7a5 | Context testr@default setup()  started
2018-05-08 15:21:04.564 11241 INFO rally.task.context [-] Verification 3b441fdf-e24b-4267-ba84-bc56794bf7a5 | Context testr@default setup()  finished in 2.99 msec
2018-05-08 15:21:11.432 11241 INFO opnfv-tempest [-] {12} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.013s]
2018-05-08 15:21:11.488 11241 INFO opnfv-tempest [-] {8} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.214s]
2018-05-08 15:21:12.207 11241 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [0.770s]
2018-05-08 15:21:12.392 11241 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.185s]
2018-05-08 15:21:15.918 11241 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.174s]
2018-05-08 15:21:20.224 11241 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [4.303s]
2018-05-08 15:21:22.922 11241 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [2.698s]
2018-05-08 15:21:24.241 11241 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [1.318s]
2018-05-08 15:21:24.342 11241 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [3.615s]
2018-05-08 15:21:25.743 11241 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [1.400s]
2018-05-08 15:21:25.866 11241 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [1.624s]
2018-05-08 15:21:30.741 11241 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [4.873s]
2018-05-08 15:21:30.919 11241 INFO opnfv-tempest [-] {6} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [4.429s]
2018-05-08 15:21:31.986 11241 INFO opnfv-tempest [-] {6} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [1.066s]
2018-05-08 15:21:32.102 11241 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [1.361s]
2018-05-08 15:21:32.680 11241 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.577s]
2018-05-08 15:21:32.841 11241 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.161s]
2018-05-08 15:21:33.002 11241 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.161s]
2018-05-08 15:21:33.170 11241 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.167s]
2018-05-08 15:21:39.881 11241 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor ... success [0.504s]
2018-05-08 15:21:39.908 11241 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date ... success [0.071s]
2018-05-08 15:21:39.919 11241 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date ... success [0.011s]
2018-05-08 15:21:40.079 11241 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count ... success [0.158s]
2018-05-08 15:21:40.091 11241 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value ... success [0.012s]
2018-05-08 15:21:40.103 11241 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string ... success [0.012s]
2018-05-08 15:21:40.137 11241 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor ... success [0.034s]
2018-05-08 15:21:40.203 11241 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image ... success [0.064s]
2018-05-08 15:21:40.264 11241 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name ... success [0.061s]
2018-05-08 15:21:40.510 11241 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted ... success [0.245s]
2018-05-08 15:21:40.526 11241 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing ... success [0.016s]
2018-05-08 15:21:40.530 11241 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image ... success [0.648s]
2018-05-08 15:21:40.592 11241 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server ... success [0.066s]
2018-05-08 15:21:41.029 11241 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name ... success [0.499s]
2018-05-08 15:21:41.850 11241 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status ... success [0.820s]
2018-05-08 15:21:42.371 11241 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results ... success [0.521s]
2018-05-08 15:21:42.445 11241 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_active_status ... success [0.074s]
2018-05-08 15:21:42.535 11241 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor ... success [0.089s]
2018-05-08 15:21:42.608 11241 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image ... success [0.073s]
2018-05-08 15:21:42.677 11241 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit ... success [0.068s]
2018-05-08 15:21:42.749 11241 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name ... success [0.071s]
2018-05-08 15:21:42.888 11241 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard ... success [0.139s]
2018-05-08 15:21:51.825 11241 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.041s]
2018-05-08 15:21:51.901 11241 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name ... success [3.116s]
2018-05-08 15:21:52.006 11241 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.105s]
2018-05-08 15:21:52.036 11241 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name ... success [0.210s]
2018-05-08 15:21:52.084 11241 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name ... success [0.048s]
2018-05-08 15:21:52.506 11241 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail ... success [0.499s]
2018-05-08 15:21:52.605 11241 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus ... success [0.097s]
2018-05-08 15:21:52.607 11241 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s]
2018-05-08 15:21:53.144 11241 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination ... success [1.058s]
2018-05-08 15:21:53.529 11241 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params ... success [0.385s]
2018-05-08 15:21:54.455 11241 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination ... success [0.925s]
2018-05-08 15:21:54.493 11241 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status ... success [0.038s]
2018-05-08 15:21:54.557 11241 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status ... success [0.063s]
2018-05-08 15:21:54.943 11241 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata ... success [0.385s]
2018-05-08 15:21:55.139 11241 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details ... success [0.196s]
2018-05-08 15:21:55.351 11241 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata ... success [0.211s]
2018-05-08 15:21:55.575 11241 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone ... success [0.223s]
2018-05-08 15:21:55.965 11241 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status ... success [0.390s]
2018-05-08 15:21:56.013 11241 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone ... success [0.048s]
2018-05-08 15:21:56.064 11241 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status ... success [0.051s]
2018-05-08 15:21:57.925 11241 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [4.470s]
2018-05-08 15:22:02.351 11241 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [4.424s]
2018-05-08 15:22:07.092 11241 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [4.741s]
2018-05-08 15:22:11.357 11241 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [4.264s]
2018-05-08 15:22:15.412 11241 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [4.055s]
2018-05-08 15:22:19.243 11241 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [3.830s]
2018-05-08 15:22:23.037 11241 INFO opnfv-tempest [-] {7} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions ... success [0.233s]
2018-05-08 15:22:24.399 11241 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [5.155s]
2018-05-08 15:22:30.480 11241 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [6.079s]
2018-05-08 15:22:33.805 11241 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [3.324s]
2018-05-08 15:22:34.373 11241 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.568s]
2018-05-08 15:22:34.486 11241 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.112s]
2018-05-08 15:22:34.712 11241 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.225s]
2018-05-08 15:22:34.770 11241 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.057s]
2018-05-08 15:22:35.023 11241 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.252s]
2018-05-08 15:22:35.116 11241 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.092s]
2018-05-08 15:22:35.173 11241 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.057s]
2018-05-08 15:22:35.637 11241 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.463s]
2018-05-08 15:22:36.016 11241 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.630s]
2018-05-08 15:22:36.287 11241 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.270s]
2018-05-08 15:22:36.500 11241 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [0.213s]
2018-05-08 15:22:36.888 11241 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [0.387s]
2018-05-08 15:22:37.337 11241 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [0.449s]
2018-05-08 15:22:37.786 11241 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [0.447s]
2018-05-08 15:22:40.594 11241 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [4.956s]
2018-05-08 15:22:46.254 11241 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.361s]
2018-05-08 15:22:48.922 11241 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [2.667s]
2018-05-08 15:22:53.798 11241 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [4.871s]
2018-05-08 15:22:54.898 11241 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [1.101s]
2018-05-08 15:22:56.320 11241 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete ... success [5.815s]
2018-05-08 15:22:57.065 11241 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [2.165s]
2018-05-08 15:22:57.822 11241 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [0.756s]
2018-05-08 15:23:00.370 11241 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [2.545s]
2018-05-08 15:23:00.420 11241 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.052s]
2018-05-08 15:23:08.920 11241 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot ... success [12.595s]
2018-05-08 15:23:15.067 11241 INFO rally.task.context [-] Verification 3b441fdf-e24b-4267-ba84-bc56794bf7a5 | Context testr@default cleanup() started
2018-05-08 15:23:15.067 11241 INFO rally.task.context [-] Verification 3b441fdf-e24b-4267-ba84-bc56794bf7a5 | Context testr@default cleanup() finished in 0.54 msec
2018-05-08 15:23:15.067 11241 INFO rally.task.context [-] Verification 3b441fdf-e24b-4267-ba84-bc56794bf7a5 | Context tempest@default cleanup() started
2018-05-08 15:23:16.143 11241 INFO rally.task.context [-] Verification 3b441fdf-e24b-4267-ba84-bc56794bf7a5 | Context tempest@default cleanup() finished in 1.08 sec
2018-05-08 15:23:16.224 11241 INFO rally.api [-] Verification (UUID=851a8428-e86d-4c69-9942-a71b12606256) has been successfully finished for deployment 'opnfv-rally' (UUID=54c6acb3-e846-4772-a388-cc69c24cd341)!

======
Totals
======

Ran: 96 tests in 120.290 sec.
 - Success: 96
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 0

Using verification (UUID=851a8428-e86d-4c69-9942-a71b12606256) as the default verification for the future operations.