2018-06-21 10:23:50.547 11244 INFO rally.api [-] Starting verification (UUID=3152bfc1-2a89-415b-a898-6e42edaaa00a) for deployment 'opnfv-rally' (UUID=20ca501b-8d04-4df3-92a0-acf50bc7a56b) by verifier 'opnfv-tempest' (UUID=529c88cf-6723-4efc-b5b6-b2f8402db11b).
2018-06-21 10:23:51.069 11244 INFO rally.task.context [-] Verification 529c88cf-6723-4efc-b5b6-b2f8402db11b | Context tempest@default setup()  started
2018-06-21 10:23:52.936 11244 INFO rally.task.context [-] Verification 529c88cf-6723-4efc-b5b6-b2f8402db11b | Context tempest@default setup()  finished in 1.87 sec
2018-06-21 10:23:52.937 11244 INFO rally.task.context [-] Verification 529c88cf-6723-4efc-b5b6-b2f8402db11b | Context testr@default setup()  started
2018-06-21 10:23:52.940 11244 INFO rally.task.context [-] Verification 529c88cf-6723-4efc-b5b6-b2f8402db11b | Context testr@default setup()  finished in 3.14 msec
2018-06-21 10:23:58.783 11244 INFO opnfv-tempest [-] {12} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.011s]
2018-06-21 10:23:59.320 11244 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.200s]
2018-06-21 10:23:59.376 11244 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.056s]
2018-06-21 10:23:59.389 11244 INFO opnfv-tempest [-] {14} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.307s]
2018-06-21 10:23:59.809 11244 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.737s]
2018-06-21 10:23:59.893 11244 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [0.817s]
2018-06-21 10:24:00.068 11244 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.174s]
2018-06-21 10:24:01.543 11244 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [1.733s]
2018-06-21 10:24:02.745 11244 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.167s]
2018-06-21 10:24:03.884 11244 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.071s]
2018-06-21 10:24:03.968 11244 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.083s]
2018-06-21 10:24:04.039 11244 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.071s]
2018-06-21 10:24:05.510 11244 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [2.763s]
2018-06-21 10:24:05.923 11244 INFO opnfv-tempest [-] {14} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.904s]
2018-06-21 10:24:06.521 11244 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [1.010s]
2018-06-21 10:24:08.351 11244 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [1.829s]
2018-06-21 10:24:09.111 11244 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_with_nonexistent_volume_id ... success [0.171s]
2018-06-21 10:24:09.306 11244 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_without_passing_volume_id ... success [0.194s]
2018-06-21 10:24:10.250 11244 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.163s]
2018-06-21 10:24:10.413 11244 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.162s]
2018-06-21 10:24:10.474 11244 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [2.122s]
2018-06-21 10:24:11.676 11244 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [1.261s]
2018-06-21 10:24:11.718 11244 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action ... success [0.055s]
2018-06-21 10:24:11.830 11244 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.155s]
2018-06-21 10:24:11.844 11244 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.015s]
2018-06-21 10:24:12.989 11244 INFO opnfv-tempest [-] {6} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [1.595s]
2018-06-21 10:24:13.393 11244 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [2.918s]
2018-06-21 10:24:14.608 11244 INFO opnfv-tempest [-] {6} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [1.617s]
2018-06-21 10:24:15.190 11244 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [1.798s]
2018-06-21 10:24:15.257 11244 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions ... success [3.537s]
2018-06-21 10:24:15.604 11244 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.413s]
2018-06-21 10:24:15.632 11244 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.027s]
2018-06-21 10:24:15.657 11244 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.024s]
2018-06-21 10:24:15.830 11244 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.172s]
2018-06-21 10:24:24.163 11244 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image ... success [1.637s]
2018-06-21 10:24:29.287 11244 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.176s]
2018-06-21 10:24:29.504 11244 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name ... success [0.216s]
2018-06-21 10:24:29.688 11244 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name ... success [0.184s]
2018-06-21 10:24:30.375 11244 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination ... success [0.684s]
2018-06-21 10:24:30.475 11244 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params ... success [0.099s]
2018-06-21 10:24:31.227 11244 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination ... success [0.752s]
2018-06-21 10:24:31.263 11244 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status ... success [0.037s]
2018-06-21 10:24:31.313 11244 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status ... success [0.049s]
2018-06-21 10:24:31.528 11244 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata ... success [0.213s]
2018-06-21 10:24:31.579 11244 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details ... success [0.051s]
2018-06-21 10:24:31.626 11244 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata ... success [0.046s]
2018-06-21 10:24:31.989 11244 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone ... success [0.362s]
2018-06-21 10:24:32.204 11244 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status ... success [0.214s]
2018-06-21 10:24:32.253 11244 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone ... success [0.049s]
2018-06-21 10:24:32.301 11244 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status ... success [0.048s]
2018-06-21 10:24:34.173 11244 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port ... success [3.472s]
2018-06-21 10:24:38.866 11244 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [4.692s]
2018-06-21 10:24:41.090 11244 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [2.223s]
2018-06-21 10:24:41.292 11244 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.202s]
2018-06-21 10:24:41.340 11244 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields ... success [0.047s]
2018-06-21 10:24:41.396 11244 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.056s]
2018-06-21 10:24:41.490 11244 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields ... success [0.093s]
2018-06-21 10:24:45.250 11244 INFO opnfv-tempest [-] {15} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server ... success [20.247s]
2018-06-21 10:25:51.873 11244 INFO opnfv-tempest [-] {15} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [66.625s]
2018-06-21 10:26:01.920 11244 INFO opnfv-tempest [-] {10} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume ... success [116.195s]
2018-06-21 10:26:23.702 11244 INFO opnfv-tempest [-] {15} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server ... success [31.823s]
2018-06-21 10:26:30.872 11244 INFO opnfv-tempest [-] {10} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_list_get_volume_attachments ... success [28.942s]
2018-06-21 10:26:42.051 11244 INFO opnfv-tempest [-] {15} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server ... success [18.347s]
2018-06-21 10:26:46.725 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size ... success [0.157s]
2018-06-21 10:26:46.900 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id ... success [0.175s]
2018-06-21 10:26:47.081 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid ... success [0.180s]
2018-06-21 10:26:47.246 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type ... success [0.164s]
2018-06-21 10:26:47.259 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative ... success [0.013s]
2018-06-21 10:26:47.274 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero ... success [0.015s]
2018-06-21 10:26:47.492 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size ... success [0.216s]
2018-06-21 10:26:47.526 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id ... success [0.034s]
2018-06-21 10:26:47.679 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id ... success [0.152s]
2018-06-21 10:26:47.867 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id ... success [0.188s]
2018-06-21 10:26:47.877 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id ... success [0.010s]
2018-06-21 10:26:47.926 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status ... success [0.048s]
2018-06-21 10:26:47.974 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name ... success [0.047s]
2018-06-21 10:26:48.160 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status ... success [0.184s]
2018-06-21 10:26:48.200 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name ... success [0.039s]
2018-06-21 10:26:48.870 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_negative_volume_status ... success [0.670s]
2018-06-21 10:26:49.041 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_nonexistent_volume_id ... success [0.171s]
2018-06-21 10:26:49.076 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_unreserve_volume_with_nonexistent_volume_id ... success [0.034s]
2018-06-21 10:26:49.235 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id ... success [0.158s]
2018-06-21 10:26:49.268 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id ... success [0.033s]
2018-06-21 10:26:49.447 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id ... success [0.178s]
2018-06-21 10:26:49.482 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id ... success [0.034s]
2018-06-21 10:26:49.518 11244 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id ... success [0.036s]
2018-06-21 10:27:03.370 11244 INFO opnfv-tempest [-] {15} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [7.360s]
2018-06-21 10:27:13.431 11244 INFO opnfv-tempest [-] {15} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_as_clone ... success [10.057s]
2018-06-21 10:27:24.786 11244 INFO opnfv-tempest [-] {15} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [11.354s]
2018-06-21 10:27:28.170 11244 INFO rally.task.context [-] Verification 529c88cf-6723-4efc-b5b6-b2f8402db11b | Context testr@default cleanup() started
2018-06-21 10:27:28.170 11244 INFO rally.task.context [-] Verification 529c88cf-6723-4efc-b5b6-b2f8402db11b | Context testr@default cleanup() finished in 0.59 msec
2018-06-21 10:27:28.171 11244 INFO rally.task.context [-] Verification 529c88cf-6723-4efc-b5b6-b2f8402db11b | Context tempest@default cleanup() started
2018-06-21 10:27:29.081 11244 INFO rally.task.context [-] Verification 529c88cf-6723-4efc-b5b6-b2f8402db11b | Context tempest@default cleanup() finished in 0.91 sec
2018-06-21 10:27:29.160 11244 INFO rally.api [-] Verification (UUID=3152bfc1-2a89-415b-a898-6e42edaaa00a) has been successfully finished for deployment 'opnfv-rally' (UUID=20ca501b-8d04-4df3-92a0-acf50bc7a56b)!

======
Totals
======

Ran: 89 tests in 207.738 sec.
 - Success: 89
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 0

Using verification (UUID=3152bfc1-2a89-415b-a898-6e42edaaa00a) as the default verification for the future operations.