2018-07-10 18:34:58.010 10976 INFO rally.api [-] Starting verification (UUID=1a4e38f3-ae9c-492b-a891-48e6eb9dd01e) for deployment 'opnfv-rally' (UUID=b7fb76c4-18af-4d76-b1ef-e1c579a6b0b1) by verifier 'opnfv-tempest' (UUID=d97d61e5-ba8e-4e74-b142-1ba62cd3ee65).
2018-07-10 18:34:58.578 10976 INFO rally.task.context [-] Verification d97d61e5-ba8e-4e74-b142-1ba62cd3ee65 | Context tempest@default setup()  started
2018-07-10 18:35:00.311 10976 INFO rally.task.context [-] Verification d97d61e5-ba8e-4e74-b142-1ba62cd3ee65 | Context tempest@default setup()  finished in 1.73 sec
2018-07-10 18:35:00.312 10976 INFO rally.task.context [-] Verification d97d61e5-ba8e-4e74-b142-1ba62cd3ee65 | Context testr@default setup()  started
2018-07-10 18:35:00.315 10976 INFO rally.task.context [-] Verification d97d61e5-ba8e-4e74-b142-1ba62cd3ee65 | Context testr@default setup()  finished in 3.14 msec
2018-07-10 18:35:06.395 10976 INFO opnfv-tempest [-] {12} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.013s]
2018-07-10 18:35:06.728 10976 INFO opnfv-tempest [-] {14} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.310s]
2018-07-10 18:35:06.738 10976 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.224s]
2018-07-10 18:35:06.746 10976 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [0.608s]
2018-07-10 18:35:06.795 10976 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.057s]
2018-07-10 18:35:06.926 10976 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.180s]
2018-07-10 18:35:10.270 10976 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.160s]
2018-07-10 18:35:10.752 10976 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.071s]
2018-07-10 18:35:10.829 10976 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.077s]
2018-07-10 18:35:10.897 10976 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.068s]
2018-07-10 18:35:12.509 10976 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [2.236s]
2018-07-10 18:35:12.965 10976 INFO opnfv-tempest [-] {14} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [2.649s]
2018-07-10 18:35:13.650 10976 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [1.142s]
2018-07-10 18:35:14.327 10976 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON ... fail
2018-07-10 18:35:14.662 10976 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [1.011s]
2018-07-10 18:35:15.037 10976 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.162s]
2018-07-10 18:35:15.840 10976 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.802s]
2018-07-10 18:35:15.968 10976 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [1.304s]
2018-07-10 18:35:16.364 10976 INFO opnfv-tempest [-] {6} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [1.867s]
2018-07-10 18:35:17.036 10976 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [1.194s]
2018-07-10 18:35:17.086 10976 INFO opnfv-tempest [-] {6} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [0.722s]
2018-07-10 18:35:17.181 10976 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.146s]
2018-07-10 18:35:17.342 10976 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.160s]
2018-07-10 18:35:19.166 10976 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [3.196s]
2018-07-10 18:35:20.285 10976 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [1.119s]
2018-07-10 18:35:20.529 10976 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.244s]
2018-07-10 18:35:20.553 10976 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.024s]
2018-07-10 18:35:20.714 10976 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.160s]
2018-07-10 18:35:20.862 10976 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.148s]
2018-07-10 18:35:27.567 10976 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.384s]
2018-07-10 18:35:27.777 10976 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.210s]
2018-07-10 18:35:27.990 10976 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [0.212s]
2018-07-10 18:35:28.474 10976 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [0.483s]
2018-07-10 18:35:28.877 10976 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [0.402s]
2018-07-10 18:35:29.300 10976 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [0.422s]
2018-07-10 18:35:30.846 10976 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.182s]
2018-07-10 18:35:30.884 10976 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name ... success [0.038s]
2018-07-10 18:35:30.933 10976 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name ... success [0.048s]
2018-07-10 18:35:31.608 10976 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination ... success [0.675s]
2018-07-10 18:35:31.930 10976 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params ... success [0.321s]
2018-07-10 18:35:32.568 10976 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination ... success [0.637s]
2018-07-10 18:35:32.611 10976 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status ... success [0.044s]
2018-07-10 18:35:32.813 10976 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status ... success [0.200s]
2018-07-10 18:35:32.862 10976 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata ... success [0.050s]
2018-07-10 18:35:32.913 10976 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details ... success [0.051s]
2018-07-10 18:35:32.967 10976 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata ... success [0.052s]
2018-07-10 18:35:33.057 10976 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone ... success [0.089s]
2018-07-10 18:35:33.145 10976 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status ... success [0.087s]
2018-07-10 18:35:33.192 10976 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone ... success [0.048s]
2018-07-10 18:35:33.241 10976 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status ... success [0.048s]
2018-07-10 18:35:36.291 10976 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.688s]
2018-07-10 18:35:38.059 10976 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [1.768s]
2018-07-10 18:35:42.144 10976 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [4.080s]
2018-07-10 18:35:43.654 10976 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [1.514s]
2018-07-10 18:35:45.818 10976 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [2.161s]
2018-07-10 18:35:46.870 10976 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [1.052s]
2018-07-10 18:35:48.621 10976 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.748s]
2018-07-10 18:35:48.720 10976 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.101s]
2018-07-10 18:35:50.436 10976 INFO rally.task.context [-] Verification d97d61e5-ba8e-4e74-b142-1ba62cd3ee65 | Context testr@default cleanup() started
2018-07-10 18:35:50.437 10976 INFO rally.task.context [-] Verification d97d61e5-ba8e-4e74-b142-1ba62cd3ee65 | Context testr@default cleanup() finished in 0.70 msec
2018-07-10 18:35:50.438 10976 INFO rally.task.context [-] Verification d97d61e5-ba8e-4e74-b142-1ba62cd3ee65 | Context tempest@default cleanup() started
2018-07-10 18:35:51.316 10976 INFO rally.task.context [-] Verification d97d61e5-ba8e-4e74-b142-1ba62cd3ee65 | Context tempest@default cleanup() finished in 0.88 sec
2018-07-10 18:35:51.386 10976 INFO rally.api [-] Verification (UUID=1a4e38f3-ae9c-492b-a891-48e6eb9dd01e) has been successfully finished for deployment 'opnfv-rally' (UUID=b7fb76c4-18af-4d76-b1ef-e1c579a6b0b1)!

======
Totals
======

Ran: 62 tests in 44.468 sec.
 - Success: 57
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 5

Using verification (UUID=1a4e38f3-ae9c-492b-a891-48e6eb9dd01e) as the default verification for the future operations.