2018-03-31 14:33:33.624 9831 INFO rally.api [-] Starting verification (UUID=067e919a-add3-4301-830a-51917cf581cf) for deployment 'opnfv-rally' (UUID=ac2252d9-2886-4be4-9ac0-97adc3eb5cce) by verifier 'opnfv-tempest' (UUID=4af33ba2-e7c8-4c59-8b5e-5e37d515d27e).
2018-03-31 14:33:34.120 9831 INFO rally.task.context [-] Verification 4af33ba2-e7c8-4c59-8b5e-5e37d515d27e | Context tempest@default setup()  started
2018-03-31 14:33:35.508 9831 INFO rally.task.context [-] Verification 4af33ba2-e7c8-4c59-8b5e-5e37d515d27e | Context tempest@default setup()  finished in 1.39 sec
2018-03-31 14:33:35.508 9831 INFO rally.task.context [-] Verification 4af33ba2-e7c8-4c59-8b5e-5e37d515d27e | Context testr@default setup()  started
2018-03-31 14:33:35.510 9831 INFO rally.task.context [-] Verification 4af33ba2-e7c8-4c59-8b5e-5e37d515d27e | Context testr@default setup()  finished in 1.66 msec
2018-03-31 14:33:42.293 9831 INFO opnfv-tempest [-] {12} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.013s]
2018-03-31 14:33:42.462 9831 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.254s]
2018-03-31 14:33:42.532 9831 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.070s]
2018-03-31 14:33:42.584 9831 INFO opnfv-tempest [-] {14} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.341s]
2018-03-31 14:33:42.683 9831 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.404s]
2018-03-31 14:33:42.858 9831 INFO opnfv-tempest [-] {8} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.364s]
2018-03-31 14:33:45.823 9831 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password ... success [3.619s]
2018-03-31 14:33:46.850 9831 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [4.166s]
2018-03-31 14:33:47.881 9831 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.152s]
2018-03-31 14:33:47.993 9831 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.112s]
2018-03-31 14:33:48.110 9831 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.116s]
2018-03-31 14:33:48.373 9831 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.212s]
2018-03-31 14:33:50.207 9831 INFO opnfv-tempest [-] {14} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.913s]
2018-03-31 14:33:51.523 9831 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [3.147s]
2018-03-31 14:33:53.352 9831 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [2.320s]
2018-03-31 14:33:53.634 9831 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [2.111s]
2018-03-31 14:33:53.809 9831 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.162s]
2018-03-31 14:33:53.824 9831 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.014s]
2018-03-31 14:33:54.004 9831 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [0.179s]
2018-03-31 14:33:54.011 9831 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.006s]
2018-03-31 14:33:54.021 9831 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [0.669s]
2018-03-31 14:33:54.172 9831 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.161s]
2018-03-31 14:33:54.277 9831 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [0.642s]
2018-03-31 14:33:54.881 9831 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [0.602s]
2018-03-31 14:33:56.077 9831 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_with_nonexistent_volume_id ... success [0.184s]
2018-03-31 14:33:56.362 9831 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_without_passing_volume_id ... success [0.284s]
2018-03-31 14:33:56.447 9831 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [1.565s]
2018-03-31 14:33:58.765 9831 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [2.318s]
2018-03-31 14:33:58.905 9831 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.139s]
2018-03-31 14:33:58.942 9831 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.036s]
2018-03-31 14:33:58.975 9831 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.034s]
2018-03-31 14:33:59.066 9831 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.089s]
2018-03-31 14:34:01.892 9831 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair ... success [16.065s]
2018-03-31 14:34:17.338 9831 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name ... success [9.575s]
2018-03-31 14:34:17.413 9831 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.075s]
2018-03-31 14:34:17.640 9831 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail ... success [0.226s]
2018-03-31 14:34:17.780 9831 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus ... success [0.139s]
2018-03-31 14:34:17.781 9831 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s]
2018-03-31 14:34:36.405 9831 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name ... success [34.506s]
2018-03-31 14:34:40.574 9831 INFO opnfv-tempest [-] {15} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server ... success [30.632s]
2018-03-31 14:34:47.315 9831 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address ... success [10.906s]
2018-03-31 14:34:53.673 9831 INFO opnfv-tempest [-] {15} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [13.101s]
2018-03-31 14:35:00.868 9831 INFO opnfv-tempest [-] {10} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume ... success [66.203s]
2018-03-31 14:35:01.140 9831 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.406s]
2018-03-31 14:35:01.348 9831 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.208s]
2018-03-31 14:35:01.570 9831 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [0.222s]
2018-03-31 14:35:01.995 9831 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [0.424s]
2018-03-31 14:35:02.586 9831 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [0.590s]
2018-03-31 14:35:04.131 9831 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [1.544s]
2018-03-31 14:35:13.663 9831 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.311s]
2018-03-31 14:35:14.539 9831 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [0.876s]
2018-03-31 14:35:18.417 9831 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [3.873s]
2018-03-31 14:35:19.816 9831 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [1.402s]
2018-03-31 14:35:21.666 9831 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [1.848s]
2018-03-31 14:35:22.564 9831 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [0.898s]
2018-03-31 14:35:23.775 9831 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.209s]
2018-03-31 14:35:23.818 9831 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.045s]
2018-03-31 14:35:33.042 9831 INFO opnfv-tempest [-] {10} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_list_get_volume_attachments ... success [32.167s]
2018-03-31 14:35:40.819 9831 INFO opnfv-tempest [-] {15} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server ... success [47.139s]
2018-03-31 14:35:46.883 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size ... success [0.169s]
2018-03-31 14:35:47.047 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id ... success [0.164s]
2018-03-31 14:35:47.228 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid ... success [0.180s]
2018-03-31 14:35:47.400 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type ... success [0.172s]
2018-03-31 14:35:47.551 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative ... success [0.150s]
2018-03-31 14:35:47.702 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero ... success [0.151s]
2018-03-31 14:35:47.752 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size ... success [0.050s]
2018-03-31 14:35:47.788 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id ... success [0.035s]
2018-03-31 14:35:47.944 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id ... success [0.154s]
2018-03-31 14:35:47.978 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id ... success [0.034s]
2018-03-31 14:35:47.988 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id ... success [0.009s]
2018-03-31 14:35:48.034 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status ... success [0.045s]
2018-03-31 14:35:48.080 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name ... success [0.046s]
2018-03-31 14:35:48.268 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status ... success [0.187s]
2018-03-31 14:35:48.304 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name ... success [0.036s]
2018-03-31 14:35:48.475 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_negative_volume_status ... success [0.170s]
2018-03-31 14:35:48.510 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_nonexistent_volume_id ... success [0.034s]
2018-03-31 14:35:48.542 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_unreserve_volume_with_nonexistent_volume_id ... success [0.032s]
2018-03-31 14:35:48.552 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id ... success [0.009s]
2018-03-31 14:35:48.584 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id ... success [0.031s]
2018-03-31 14:35:48.618 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id ... success [0.034s]
2018-03-31 14:35:48.651 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id ... success [0.032s]
2018-03-31 14:35:48.686 9831 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id ... success [0.035s]
2018-03-31 14:36:00.428 9831 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name ... success [73.099s]
2018-03-31 14:36:05.345 9831 INFO opnfv-tempest [-] {2} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas ... success [0.282s]
2018-03-31 14:36:05.684 9831 INFO opnfv-tempest [-] {2} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas ... success [0.338s]
2018-03-31 14:36:07.954 9831 INFO opnfv-tempest [-] {15} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server ... success [27.132s]
2018-03-31 14:36:26.254 9831 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_image_schema ... success [0.009s]
2018-03-31 14:36:26.395 9831 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_images_schema ... success [0.140s]
2018-03-31 14:36:26.441 9831 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_container_format ... success [0.046s]
2018-03-31 14:36:26.631 9831 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_disk_format ... success [0.190s]
2018-03-31 14:36:26.666 9831 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_limit ... success [0.034s]
2018-03-31 14:36:26.716 9831 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_min_max_size ... success [0.049s]
2018-03-31 14:36:26.762 9831 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_size ... success [0.046s]
2018-03-31 14:36:26.809 9831 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_status ... success [0.046s]
2018-03-31 14:36:26.849 9831 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_visibility ... success [0.039s]
2018-03-31 14:36:26.893 9831 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_no_params ... success [0.043s]
2018-03-31 14:36:30.208 9831 INFO opnfv-tempest [-] {15} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [7.800s]
2018-03-31 14:36:42.036 9831 INFO opnfv-tempest [-] {15} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_as_clone ... success [11.825s]
2018-03-31 14:36:58.668 9831 INFO opnfv-tempest [-] {15} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [16.630s]
2018-03-31 14:37:01.610 9831 INFO rally.task.context [-] Verification 4af33ba2-e7c8-4c59-8b5e-5e37d515d27e | Context testr@default cleanup() started
2018-03-31 14:37:01.611 9831 INFO rally.task.context [-] Verification 4af33ba2-e7c8-4c59-8b5e-5e37d515d27e | Context testr@default cleanup() finished in 0.61 msec
2018-03-31 14:37:01.611 9831 INFO rally.task.context [-] Verification 4af33ba2-e7c8-4c59-8b5e-5e37d515d27e | Context tempest@default cleanup() started
2018-03-31 14:37:03.008 9831 INFO rally.task.context [-] Verification 4af33ba2-e7c8-4c59-8b5e-5e37d515d27e | Context tempest@default cleanup() finished in 1.40 sec
2018-03-31 14:37:03.088 9831 INFO rally.api [-] Verification (UUID=067e919a-add3-4301-830a-51917cf581cf) has been successfully finished for deployment 'opnfv-rally' (UUID=ac2252d9-2886-4be4-9ac0-97adc3eb5cce)!

======
Totals
======

Ran: 99 tests in 199.149 sec.
 - Success: 99
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 0

Using verification (UUID=067e919a-add3-4301-830a-51917cf581cf) as the default verification for the future operations.