2018-07-07 10:05:37.495 9694 INFO rally.api [-] Starting verification (UUID=ed67efcd-1ce4-410e-a316-da1e63dc317f) for deployment 'opnfv-rally' (UUID=5e7937eb-33f0-4f4b-8d60-e637f12561b9) by verifier 'opnfv-tempest' (UUID=d4b0c5a3-570c-48c0-bd6e-5a5d5516fc98).
2018-07-07 10:05:37.991 9694 INFO rally.task.context [-] Verification d4b0c5a3-570c-48c0-bd6e-5a5d5516fc98 | Context tempest@default setup()  started
2018-07-07 10:05:40.711 9694 INFO rally.task.context [-] Verification d4b0c5a3-570c-48c0-bd6e-5a5d5516fc98 | Context tempest@default setup()  finished in 2.72 sec
2018-07-07 10:05:40.711 9694 INFO rally.task.context [-] Verification d4b0c5a3-570c-48c0-bd6e-5a5d5516fc98 | Context testr@default setup()  started
2018-07-07 10:05:40.714 9694 INFO rally.task.context [-] Verification d4b0c5a3-570c-48c0-bd6e-5a5d5516fc98 | Context testr@default setup()  finished in 3.21 msec
2018-07-07 10:05:48.556 9694 INFO opnfv-tempest [-] {14} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.317s]
2018-07-07 10:05:48.585 9694 INFO opnfv-tempest [-] {12} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.011s]
2018-07-07 10:05:48.600 9694 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.205s]
2018-07-07 10:05:48.656 9694 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.056s]
2018-07-07 10:05:48.933 9694 INFO opnfv-tempest [-] {8} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.308s]
2018-07-07 10:05:53.342 9694 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.097s]
2018-07-07 10:05:53.367 9694 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.206s]
2018-07-07 10:05:53.517 9694 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.174s]
2018-07-07 10:05:53.599 9694 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.081s]
2018-07-07 10:05:54.802 9694 INFO opnfv-tempest [-] {14} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.658s]
2018-07-07 10:05:56.278 9694 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [2.909s]
2018-07-07 10:05:57.190 9694 INFO opnfv-tempest [-] {10} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON ... fail
2018-07-07 10:05:57.198 9694 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [0.921s]
2018-07-07 10:05:58.749 9694 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON ... fail
2018-07-07 10:05:58.788 9694 INFO opnfv-tempest [-] {15} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON ... fail
2018-07-07 10:05:59.072 9694 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [1.873s]
2018-07-07 10:05:59.116 9694 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.144s]
2018-07-07 10:05:59.280 9694 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.164s]
2018-07-07 10:05:59.346 9694 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [3.165s]
2018-07-07 10:06:00.420 9694 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [1.073s]
2018-07-07 10:06:00.686 9694 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [1.613s]
2018-07-07 10:06:01.079 9694 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [1.797s]
2018-07-07 10:06:01.087 9694 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.008s]
2018-07-07 10:06:01.248 9694 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.160s]
2018-07-07 10:06:01.976 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size ... success [0.181s]
2018-07-07 10:06:02.554 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id ... success [0.578s]
2018-07-07 10:06:02.729 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid ... success [0.174s]
2018-07-07 10:06:02.885 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type ... success [0.155s]
2018-07-07 10:06:03.046 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative ... success [0.160s]
2018-07-07 10:06:03.231 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero ... success [0.185s]
2018-07-07 10:06:03.874 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size ... success [0.642s]
2018-07-07 10:06:04.049 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id ... success [0.174s]
2018-07-07 10:06:04.059 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id ... success [0.010s]
2018-07-07 10:06:04.188 9694 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [3.500s]
2018-07-07 10:06:04.526 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id ... success [0.466s]
2018-07-07 10:06:04.940 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id ... success [0.413s]
2018-07-07 10:06:05.147 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status ... success [0.206s]
2018-07-07 10:06:05.325 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name ... success [0.178s]
2018-07-07 10:06:05.513 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status ... success [0.187s]
2018-07-07 10:06:05.716 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name ... success [0.202s]
2018-07-07 10:06:06.596 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_negative_volume_status ... success [0.880s]
2018-07-07 10:06:06.631 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_nonexistent_volume_id ... success [0.034s]
2018-07-07 10:06:06.663 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_unreserve_volume_with_nonexistent_volume_id ... success [0.032s]
2018-07-07 10:06:06.803 9694 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action ... success [0.055s]
2018-07-07 10:06:06.824 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id ... success [0.159s]
2018-07-07 10:06:06.854 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id ... success [0.030s]
2018-07-07 10:06:06.890 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id ... success [0.032s]
2018-07-07 10:06:06.891 9694 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [2.700s]
2018-07-07 10:06:06.920 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id ... success [0.033s]
2018-07-07 10:06:06.954 9694 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id ... success [0.034s]
2018-07-07 10:06:07.481 9694 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.592s]
2018-07-07 10:06:07.505 9694 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.024s]
2018-07-07 10:06:07.524 9694 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.018s]
2018-07-07 10:06:07.689 9694 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.165s]
2018-07-07 10:06:11.709 9694 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions ... success [4.904s]
2018-07-07 10:06:13.740 9694 INFO opnfv-tempest [-] {15} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [12.684s]
2018-07-07 10:06:17.892 9694 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor ... success [0.539s]
2018-07-07 10:06:18.444 9694 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image ... success [0.551s]
2018-07-07 10:06:19.112 9694 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name ... success [0.668s]
2018-07-07 10:06:19.772 9694 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status ... success [0.659s]
2018-07-07 10:06:20.126 9694 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results ... success [0.353s]
2018-07-07 10:06:20.198 9694 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_active_status ... success [0.072s]
2018-07-07 10:06:20.277 9694 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor ... success [0.077s]
2018-07-07 10:06:20.343 9694 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image ... success [0.065s]
2018-07-07 10:06:20.414 9694 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit ... success [0.071s]
2018-07-07 10:06:20.483 9694 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name ... success [0.066s]
2018-07-07 10:06:20.640 9694 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard ... success [0.157s]
2018-07-07 10:06:21.835 9694 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image ... success [2.094s]
2018-07-07 10:06:27.614 9694 INFO opnfv-tempest [-] {15} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_as_clone ... success [13.871s]
2018-07-07 10:06:31.941 9694 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port ... success [3.179s]
2018-07-07 10:06:37.363 9694 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [5.421s]
2018-07-07 10:06:39.919 9694 INFO opnfv-tempest [-] {7} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions ... success [0.155s]
2018-07-07 10:06:40.352 9694 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [2.988s]
2018-07-07 10:06:40.717 9694 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.365s]
2018-07-07 10:06:40.919 9694 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields ... success [0.201s]
2018-07-07 10:06:41.106 9694 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.186s]
2018-07-07 10:06:41.148 9694 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields ... success [0.042s]
2018-07-07 10:06:44.471 9694 INFO opnfv-tempest [-] {15} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [16.853s]
2018-07-07 10:06:45.063 9694 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.567s]
2018-07-07 10:06:45.298 9694 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.235s]
2018-07-07 10:06:45.490 9694 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [0.191s]
2018-07-07 10:06:45.926 9694 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [0.433s]
2018-07-07 10:06:46.314 9694 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [0.387s]
2018-07-07 10:06:46.918 9694 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [0.604s]
2018-07-07 10:06:55.372 9694 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.721s]
2018-07-07 10:06:56.889 9694 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [1.516s]
2018-07-07 10:07:00.059 9694 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [3.166s]
2018-07-07 10:07:01.177 9694 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [1.121s]
2018-07-07 10:07:02.830 9694 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [1.650s]
2018-07-07 10:07:04.000 9694 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [1.171s]
2018-07-07 10:07:05.937 9694 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.933s]
2018-07-07 10:07:06.121 9694 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.187s]
2018-07-07 10:07:07.767 9694 INFO rally.task.context [-] Verification d4b0c5a3-570c-48c0-bd6e-5a5d5516fc98 | Context testr@default cleanup() started
2018-07-07 10:07:07.768 9694 INFO rally.task.context [-] Verification d4b0c5a3-570c-48c0-bd6e-5a5d5516fc98 | Context testr@default cleanup() finished in 0.68 msec
2018-07-07 10:07:07.768 9694 INFO rally.task.context [-] Verification d4b0c5a3-570c-48c0-bd6e-5a5d5516fc98 | Context tempest@default cleanup() started
2018-07-07 10:07:08.800 9694 INFO rally.task.context [-] Verification d4b0c5a3-570c-48c0-bd6e-5a5d5516fc98 | Context tempest@default cleanup() finished in 1.03 sec
2018-07-07 10:07:08.885 9694 INFO rally.api [-] Verification (UUID=ed67efcd-1ce4-410e-a316-da1e63dc317f) has been successfully finished for deployment 'opnfv-rally' (UUID=5e7937eb-33f0-4f4b-8d60-e637f12561b9)!

======
Totals
======

Ran: 100 tests in 79.697 sec.
 - Success: 89
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 11

Using verification (UUID=ed67efcd-1ce4-410e-a316-da1e63dc317f) as the default verification for the future operations.