2018-03-31 07:52:09.331 9833 INFO rally.api [-] Starting verification (UUID=86e0c85b-d3fa-4b1a-a38b-aa4382cca79b) for deployment 'opnfv-rally' (UUID=81608762-7920-403f-86c0-6c3fd0888bb3) by verifier 'opnfv-tempest' (UUID=6325314c-9db7-4541-9782-856d5ef33dab).
2018-03-31 07:52:09.832 9833 INFO rally.task.context [-] Verification 6325314c-9db7-4541-9782-856d5ef33dab | Context tempest@default setup()  started
2018-03-31 07:52:13.288 9833 INFO rally.task.context [-] Verification 6325314c-9db7-4541-9782-856d5ef33dab | Context tempest@default setup()  finished in 3.46 sec
2018-03-31 07:52:13.288 9833 INFO rally.task.context [-] Verification 6325314c-9db7-4541-9782-856d5ef33dab | Context testr@default setup()  started
2018-03-31 07:52:13.291 9833 INFO rally.task.context [-] Verification 6325314c-9db7-4541-9782-856d5ef33dab | Context testr@default setup()  finished in 3.07 msec
2018-03-31 07:52:19.840 9833 INFO opnfv-tempest [-] {12} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.012s]
2018-03-31 07:52:20.169 9833 INFO opnfv-tempest [-] {8} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.218s]
2018-03-31 07:52:20.462 9833 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.582s]
2018-03-31 07:52:20.538 9833 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.075s]
2018-03-31 07:52:21.474 9833 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [1.751s]
2018-03-31 07:52:21.647 9833 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.173s]
2018-03-31 07:52:24.376 9833 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.081s]
2018-03-31 07:52:24.460 9833 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.083s]
2018-03-31 07:52:24.532 9833 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.072s]
2018-03-31 07:52:24.543 9833 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.180s]
2018-03-31 07:52:30.798 9833 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [6.253s]
2018-03-31 07:52:33.183 9833 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [2.385s]
2018-03-31 07:52:33.590 9833 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [5.290s]
2018-03-31 07:52:33.749 9833 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.559s]
2018-03-31 07:52:33.926 9833 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.177s]
2018-03-31 07:52:34.140 9833 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [0.957s]
2018-03-31 07:52:34.347 9833 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [0.757s]
2018-03-31 07:52:35.021 9833 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [0.877s]
2018-03-31 07:52:35.873 9833 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [1.945s]
2018-03-31 07:52:36.039 9833 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.166s]
2018-03-31 07:52:36.198 9833 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.158s]
2018-03-31 07:52:36.563 9833 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [1.543s]
2018-03-31 07:52:37.905 9833 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [1.341s]
2018-03-31 07:52:38.664 9833 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.759s]
2018-03-31 07:52:38.833 9833 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.168s]
2018-03-31 07:52:38.854 9833 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.021s]
2018-03-31 07:52:38.878 9833 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.024s]
2018-03-31 07:52:38.908 9833 INFO opnfv-tempest [-] {6} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [2.132s]
2018-03-31 07:52:40.256 9833 INFO opnfv-tempest [-] {6} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [1.347s]
2018-03-31 07:52:49.090 9833 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date ... success [0.081s]
2018-03-31 07:52:49.101 9833 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date ... success [0.011s]
2018-03-31 07:52:49.244 9833 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count ... success [0.142s]
2018-03-31 07:52:49.254 9833 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value ... success [0.011s]
2018-03-31 07:52:49.269 9833 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string ... success [0.014s]
2018-03-31 07:52:49.301 9833 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor ... success [0.031s]
2018-03-31 07:52:49.366 9833 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image ... success [0.065s]
2018-03-31 07:52:49.429 9833 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name ... success [0.062s]
2018-03-31 07:52:49.798 9833 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted ... success [0.368s]
2018-03-31 07:52:49.812 9833 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing ... success [0.014s]
2018-03-31 07:52:49.891 9833 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server ... success [0.079s]
2018-03-31 07:53:00.617 9833 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.188s]
2018-03-31 07:53:00.657 9833 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name ... success [0.040s]
2018-03-31 07:53:00.885 9833 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name ... success [0.227s]
2018-03-31 07:53:01.609 9833 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination ... success [0.723s]
2018-03-31 07:53:01.851 9833 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params ... success [0.241s]
2018-03-31 07:53:02.204 9833 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination ... success [0.352s]
2018-03-31 07:53:02.384 9833 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status ... success [0.179s]
2018-03-31 07:53:02.577 9833 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status ... success [0.193s]
2018-03-31 07:53:02.640 9833 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata ... success [0.062s]
2018-03-31 07:53:02.688 9833 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details ... success [0.047s]
2018-03-31 07:53:02.730 9833 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata ... success [0.041s]
2018-03-31 07:53:02.963 9833 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone ... success [0.233s]
2018-03-31 07:53:03.050 9833 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status ... success [0.085s]
2018-03-31 07:53:03.099 9833 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone ... success [0.049s]
2018-03-31 07:53:03.148 9833 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status ... success [0.049s]
2018-03-31 07:53:07.201 9833 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [4.006s]
2018-03-31 07:53:11.492 9833 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [4.290s]
2018-03-31 07:53:15.566 9833 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [4.073s]
2018-03-31 07:53:19.135 9833 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [3.568s]
2018-03-31 07:53:23.748 9833 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [4.612s]
2018-03-31 07:53:28.297 9833 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [4.549s]
2018-03-31 07:53:31.602 9833 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [3.304s]
2018-03-31 07:53:38.519 9833 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [6.916s]
2018-03-31 07:53:42.195 9833 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [3.674s]
2018-03-31 07:53:42.303 9833 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.108s]
2018-03-31 07:53:42.446 9833 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.143s]
2018-03-31 07:53:42.498 9833 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.051s]
2018-03-31 07:53:42.572 9833 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.073s]
2018-03-31 07:53:42.688 9833 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.116s]
2018-03-31 07:53:42.785 9833 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.096s]
2018-03-31 07:53:42.836 9833 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.050s]
2018-03-31 07:53:43.030 9833 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.193s]
2018-03-31 07:53:49.164 9833 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [6.133s]
2018-03-31 07:53:52.443 9833 INFO opnfv-tempest [-] {10} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume ... success [73.877s]
2018-03-31 07:54:07.047 9833 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete ... success [7.029s]
2018-03-31 07:54:22.347 9833 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot ... success [15.298s]
2018-03-31 07:54:31.151 9833 INFO opnfv-tempest [-] {10} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_list_get_volume_attachments ... success [38.702s]
2018-03-31 07:54:52.487 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size ... success [0.162s]
2018-03-31 07:54:53.053 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id ... success [0.567s]
2018-03-31 07:54:53.236 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid ... success [0.181s]
2018-03-31 07:54:53.406 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type ... success [0.169s]
2018-03-31 07:54:53.572 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative ... success [0.165s]
2018-03-31 07:54:53.722 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero ... success [0.149s]
2018-03-31 07:54:53.914 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size ... success [0.192s]
2018-03-31 07:54:53.950 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id ... success [0.035s]
2018-03-31 07:54:54.097 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id ... success [0.147s]
2018-03-31 07:54:54.132 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id ... success [0.034s]
2018-03-31 07:54:54.303 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id ... success [0.169s]
2018-03-31 07:54:54.871 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status ... success [0.567s]
2018-03-31 07:54:55.449 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name ... success [0.577s]
2018-03-31 07:54:55.649 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status ... success [0.199s]
2018-03-31 07:54:55.689 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name ... success [0.039s]
2018-03-31 07:54:57.560 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_negative_volume_status ... success [1.870s]
2018-03-31 07:54:58.129 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_nonexistent_volume_id ... success [0.568s]
2018-03-31 07:54:58.322 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_unreserve_volume_with_nonexistent_volume_id ... success [0.192s]
2018-03-31 07:54:58.477 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id ... success [0.155s]
2018-03-31 07:54:58.516 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id ... success [0.038s]
2018-03-31 07:54:58.551 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id ... success [0.034s]
2018-03-31 07:54:58.734 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id ... success [0.183s]
2018-03-31 07:54:58.771 9833 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id ... success [0.036s]
2018-03-31 07:55:01.988 9833 INFO rally.task.context [-] Verification 6325314c-9db7-4541-9782-856d5ef33dab | Context testr@default cleanup() started
2018-03-31 07:55:01.988 9833 INFO rally.task.context [-] Verification 6325314c-9db7-4541-9782-856d5ef33dab | Context testr@default cleanup() finished in 0.51 msec
2018-03-31 07:55:01.988 9833 INFO rally.task.context [-] Verification 6325314c-9db7-4541-9782-856d5ef33dab | Context tempest@default cleanup() started
2018-03-31 07:55:03.257 9833 INFO rally.task.context [-] Verification 6325314c-9db7-4541-9782-856d5ef33dab | Context tempest@default cleanup() finished in 1.27 sec
2018-03-31 07:55:03.324 9833 INFO rally.api [-] Verification (UUID=86e0c85b-d3fa-4b1a-a38b-aa4382cca79b) has been successfully finished for deployment 'opnfv-rally' (UUID=81608762-7920-403f-86c0-6c3fd0888bb3)!

======
Totals
======

Ran: 100 tests in 161.118 sec.
 - Success: 100
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 0

Using verification (UUID=86e0c85b-d3fa-4b1a-a38b-aa4382cca79b) as the default verification for the future operations.