2018-04-23 10:36:51.937 11130 INFO rally.api [-] Starting verification (UUID=3662d484-cf0b-4e4c-bcb4-d5b984212f0e) for deployment 'opnfv-rally' (UUID=0b733abd-8e60-418a-a0cb-0b298419470c) by verifier 'opnfv-tempest' (UUID=f9d4ddd9-b5d8-4831-9971-953bc9a25c76).
2018-04-23 10:36:52.460 11130 INFO rally.task.context [-] Verification f9d4ddd9-b5d8-4831-9971-953bc9a25c76 | Context tempest@default setup()  started
2018-04-23 10:36:55.206 11130 INFO rally.task.context [-] Verification f9d4ddd9-b5d8-4831-9971-953bc9a25c76 | Context tempest@default setup()  finished in 2.75 sec
2018-04-23 10:36:55.207 11130 INFO rally.task.context [-] Verification f9d4ddd9-b5d8-4831-9971-953bc9a25c76 | Context testr@default setup()  started
2018-04-23 10:36:55.210 11130 INFO rally.task.context [-] Verification f9d4ddd9-b5d8-4831-9971-953bc9a25c76 | Context testr@default setup()  finished in 3.32 msec
2018-04-23 10:37:01.548 11130 INFO opnfv-tempest [-] {12} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.011s]
2018-04-23 10:37:01.656 11130 INFO opnfv-tempest [-] {8} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.241s]
2018-04-23 10:37:02.537 11130 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [0.970s]
2018-04-23 10:37:02.698 11130 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.161s]
2018-04-23 10:37:05.095 11130 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password ... success [3.509s]
2018-04-23 10:37:05.601 11130 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.166s]
2018-04-23 10:37:09.627 11130 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [4.024s]
2018-04-23 10:37:11.087 11130 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [2.788s]
2018-04-23 10:37:11.347 11130 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [1.721s]
2018-04-23 10:37:12.122 11130 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [1.035s]
2018-04-23 10:37:12.568 11130 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [1.219s]
2018-04-23 10:37:13.841 11130 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [1.273s]
2018-04-23 10:37:16.984 11130 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [3.140s]
2018-04-23 10:37:17.509 11130 INFO opnfv-tempest [-] {6} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [1.963s]
2018-04-23 10:37:18.630 11130 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [1.646s]
2018-04-23 10:37:18.916 11130 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.286s]
2018-04-23 10:37:19.060 11130 INFO opnfv-tempest [-] {6} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [1.550s]
2018-04-23 10:37:19.077 11130 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.161s]
2018-04-23 10:37:19.246 11130 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.168s]
2018-04-23 10:37:19.264 11130 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.018s]
2018-04-23 10:37:19.515 11130 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server ... success [18.020s]
2018-04-23 10:37:20.504 11130 INFO opnfv-tempest [-] {10} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON ... fail
2018-04-23 10:37:22.058 11130 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair ... success [16.960s]
2018-04-23 10:37:24.175 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size ... success [0.017s]
2018-04-23 10:37:24.456 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id ... success [0.280s]
2018-04-23 10:37:24.667 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid ... success [0.209s]
2018-04-23 10:37:24.839 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type ... success [0.172s]
2018-04-23 10:37:24.988 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative ... success [0.148s]
2018-04-23 10:37:25.146 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero ... success [0.157s]
2018-04-23 10:37:25.197 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size ... success [0.050s]
2018-04-23 10:37:25.373 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id ... success [0.176s]
2018-04-23 10:37:25.522 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id ... success [0.148s]
2018-04-23 10:37:25.700 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id ... success [0.178s]
2018-04-23 10:37:25.852 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id ... success [0.150s]
2018-04-23 10:37:26.052 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status ... success [0.200s]
2018-04-23 10:37:26.096 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name ... success [0.043s]
2018-04-23 10:37:26.289 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status ... success [0.193s]
2018-04-23 10:37:26.571 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name ... success [0.281s]
2018-04-23 10:37:27.122 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_negative_volume_status ... success [0.551s]
2018-04-23 10:37:27.311 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_nonexistent_volume_id ... success [0.188s]
2018-04-23 10:37:27.493 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_unreserve_volume_with_nonexistent_volume_id ... success [0.182s]
2018-04-23 10:37:27.655 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id ... success [0.161s]
2018-04-23 10:37:27.688 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id ... success [0.033s]
2018-04-23 10:37:27.875 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id ... success [0.186s]
2018-04-23 10:37:27.919 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id ... success [0.044s]
2018-04-23 10:37:28.113 11130 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id ... success [0.193s]
2018-04-23 10:37:33.462 11130 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.038s]
2018-04-23 10:37:33.631 11130 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name ... success [0.169s]
2018-04-23 10:37:33.681 11130 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name ... success [0.050s]
2018-04-23 10:37:34.235 11130 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination ... success [0.552s]
2018-04-23 10:37:34.598 11130 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params ... success [0.362s]
2018-04-23 10:37:35.001 11130 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination ... success [0.402s]
2018-04-23 10:37:35.040 11130 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status ... success [0.039s]
2018-04-23 10:37:35.239 11130 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status ... success [0.198s]
2018-04-23 10:37:35.289 11130 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata ... success [0.049s]
2018-04-23 10:37:35.338 11130 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details ... success [0.048s]
2018-04-23 10:37:35.381 11130 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata ... success [0.043s]
2018-04-23 10:37:35.458 11130 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone ... success [0.076s]
2018-04-23 10:37:35.703 11130 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status ... success [0.245s]
2018-04-23 10:37:35.753 11130 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone ... success [0.050s]
2018-04-23 10:37:35.802 11130 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status ... success [0.048s]
2018-04-23 10:37:37.832 11130 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name ... success [2.192s]
2018-04-23 10:37:39.710 11130 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit ... success [1.876s]
2018-04-23 10:37:40.336 11130 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name ... success [18.275s]
2018-04-23 10:37:41.706 11130 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 ... success [1.995s]
2018-04-23 10:37:43.482 11130 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor ... success [1.776s]
2018-04-23 10:37:43.939 11130 INFO opnfv-tempest [-] {5} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image ... success [27.793s]
2018-04-23 10:37:44.787 11130 INFO opnfv-tempest [-] {5} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name ... success [0.851s]
2018-04-23 10:37:44.903 11130 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image ... success [1.420s]
2018-04-23 10:37:46.275 11130 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid ... success [1.371s]
2018-04-23 10:37:46.665 11130 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit ... success [0.390s]
2018-04-23 10:37:47.348 11130 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id ... success [0.681s]
2018-04-23 10:37:47.865 11130 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address ... success [7.528s]
2018-04-23 10:37:48.016 11130 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server ... success [0.667s]
2018-04-23 10:37:49.486 11130 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address ... success [1.468s]
2018-04-23 10:37:50.186 11130 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server ... success [0.701s]
2018-04-23 10:37:50.740 11130 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_deleted_server ... success [0.553s]
2018-04-23 10:37:51.158 11130 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server ... success [0.418s]
2018-04-23 10:37:52.730 11130 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank ... success [1.570s]
2018-04-23 10:37:53.675 11130 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server ... success [0.945s]
2018-04-23 10:37:54.248 11130 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server ... success [0.573s]
2018-04-23 10:37:54.788 11130 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 ... success [0.539s]
2018-04-23 10:37:55.472 11130 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name ... success [0.683s]
2018-04-23 10:38:05.825 11130 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk ... fail
2018-04-23 10:38:07.969 11130 INFO opnfv-tempest [-] {5} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON.test_get_availability_zone_list ... success [0.166s]
2018-04-23 10:38:45.666 11130 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name ... success [57.788s]
2018-04-23 10:38:49.812 11130 INFO opnfv-tempest [-] {2} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas ... success [0.334s]
2018-04-23 10:38:50.189 11130 INFO opnfv-tempest [-] {2} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas ... success [0.376s]
2018-04-23 10:39:05.017 11130 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_image_schema ... success [0.542s]
2018-04-23 10:39:05.184 11130 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_images_schema ... success [0.166s]
2018-04-23 10:39:05.389 11130 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_container_format ... success [0.204s]
2018-04-23 10:39:05.572 11130 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_disk_format ... success [0.183s]
2018-04-23 10:39:05.748 11130 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_limit ... success [0.174s]
2018-04-23 10:39:05.966 11130 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_min_max_size ... success [0.218s]
2018-04-23 10:39:06.708 11130 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_size ... success [0.741s]
2018-04-23 10:39:06.756 11130 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_status ... success [0.047s]
2018-04-23 10:39:06.955 11130 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_visibility ... success [0.198s]
2018-04-23 10:39:07.096 11130 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_no_params ... success [0.140s]
2018-04-23 10:39:19.198 11130 INFO rally.task.context [-] Verification f9d4ddd9-b5d8-4831-9971-953bc9a25c76 | Context testr@default cleanup() started
2018-04-23 10:39:19.199 11130 INFO rally.task.context [-] Verification f9d4ddd9-b5d8-4831-9971-953bc9a25c76 | Context testr@default cleanup() finished in 0.75 msec
2018-04-23 10:39:19.199 11130 INFO rally.task.context [-] Verification f9d4ddd9-b5d8-4831-9971-953bc9a25c76 | Context tempest@default cleanup() started
2018-04-23 10:39:20.493 11130 INFO rally.task.context [-] Verification f9d4ddd9-b5d8-4831-9971-953bc9a25c76 | Context tempest@default cleanup() finished in 1.29 sec
2018-04-23 10:39:20.568 11130 INFO rally.api [-] Verification (UUID=3662d484-cf0b-4e4c-bcb4-d5b984212f0e) has been successfully finished for deployment 'opnfv-rally' (UUID=0b733abd-8e60-418a-a0cb-0b298419470c)!

======
Totals
======

Ran: 103 tests in 127.681 sec.
 - Success: 96
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 7

Using verification (UUID=3662d484-cf0b-4e4c-bcb4-d5b984212f0e) as the default verification for the future operations.