2018-12-18 15:16:54.767 12674 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=fe693d0c-2853-4a54-bf79-f23b041815c7) for deployment 'opnfv-rally' (UUID=e5c932f3-6d3d-4f12-8977-ac0fbc72e444).
2018-12-18 15:16:56.048 12674 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=fe693d0c-2853-4a54-bf79-f23b041815c7) has been successfully configured for deployment 'opnfv-rally' (UUID=e5c932f3-6d3d-4f12-8977-ac0fbc72e444)!
2018-12-18 15:17:02.066 12679 INFO rally.api [-] Starting verification (UUID=1a90e5f1-5864-4da4-af78-7fed9dc5e339) for deployment 'opnfv-rally' (UUID=e5c932f3-6d3d-4f12-8977-ac0fbc72e444) by verifier 'opnfv-tempest' (UUID=fe693d0c-2853-4a54-bf79-f23b041815c7).
2018-12-18 15:17:03.690 12679 INFO rally.task.context [-] Verification fe693d0c-2853-4a54-bf79-f23b041815c7 | Context tempest@default setup()  finished in 1.09 sec
2018-12-18 15:17:03.694 12679 INFO rally.task.context [-] Verification fe693d0c-2853-4a54-bf79-f23b041815c7 | Context testr@default setup()  finished in 2.90 msec
2018-12-18 15:17:07.992 12679 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.227s]
2018-12-18 15:17:08.037 12679 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.045s]
2018-12-18 15:17:08.075 12679 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.252s]
2018-12-18 15:17:21.904 12679 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server ... success [10.246s]
2018-12-18 15:17:29.560 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image ... success [11.188s]
2018-12-18 15:17:31.040 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name ... success [1.484s]
2018-12-18 15:17:33.394 12679 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor ... success [0.387s]
2018-12-18 15:17:34.158 12679 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image ... success [0.762s]
2018-12-18 15:17:34.703 12679 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name ... success [0.546s]
2018-12-18 15:17:35.296 12679 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status ... success [0.592s]
2018-12-18 15:17:35.593 12679 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date ... success [0.077s]
2018-12-18 15:17:35.605 12679 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date ... success [0.012s]
2018-12-18 15:17:35.716 12679 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results ... success [0.420s]
2018-12-18 15:17:35.774 12679 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count ... success [0.169s]
2018-12-18 15:17:35.786 12679 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value ... success [0.011s]
2018-12-18 15:17:35.806 12679 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string ... success [0.019s]
2018-12-18 15:17:35.807 12679 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_active_status ... success [0.089s]
2018-12-18 15:17:35.826 12679 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor ... success [0.021s]
2018-12-18 15:17:35.873 12679 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor ... success [0.067s]
2018-12-18 15:17:35.890 12679 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image ... success [0.063s]
2018-12-18 15:17:35.939 12679 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image ... success [0.066s]
2018-12-18 15:17:35.974 12679 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name ... success [0.084s]
2018-12-18 15:17:36.005 12679 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit ... success [0.066s]
2018-12-18 15:17:36.087 12679 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name ... success [0.081s]
2018-12-18 15:17:36.261 12679 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard ... success [0.174s]
2018-12-18 15:17:36.317 12679 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted ... success [0.343s]
2018-12-18 15:17:36.330 12679 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing ... success [0.013s]
2018-12-18 15:17:36.399 12679 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server ... success [0.068s]
2018-12-18 15:17:38.918 12679 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name ... success [1.395s]
2018-12-18 15:17:38.991 12679 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.073s]
2018-12-18 15:17:39.181 12679 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail ... success [0.190s]
2018-12-18 15:17:39.277 12679 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus ... success [0.094s]
2018-12-18 15:17:39.278 12679 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s]
2018-12-18 15:17:42.430 12679 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.184s]
2018-12-18 15:17:42.635 12679 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.205s]
2018-12-18 15:17:43.796 12679 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [1.160s]
2018-12-18 15:17:43.970 12679 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.174s]
2018-12-18 15:17:44.157 12679 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.187s]
2018-12-18 15:17:46.044 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action ... success [0.050s]
2018-12-18 15:17:48.139 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions ... success [2.094s]
2018-12-18 15:17:49.791 12679 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image ... success [1.811s]
2018-12-18 15:17:57.937 12679 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.363s]
2018-12-18 15:17:58.185 12679 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.248s]
2018-12-18 15:17:58.386 12679 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [0.200s]
2018-12-18 15:17:58.735 12679 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [0.348s]
2018-12-18 15:17:59.158 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [4.074s]
2018-12-18 15:17:59.234 12679 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [0.498s]
2018-12-18 15:17:59.658 12679 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [0.424s]
2018-12-18 15:18:02.979 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [3.820s]
2018-12-18 15:18:03.496 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name ... success [1.373s]
2018-12-18 15:18:04.435 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit ... success [0.938s]
2018-12-18 15:18:05.840 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 ... success [1.404s]
2018-12-18 15:18:07.024 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [4.045s]
2018-12-18 15:18:07.075 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor ... success [1.235s]
2018-12-18 15:18:08.098 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image ... success [1.021s]
2018-12-18 15:18:09.480 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid ... success [1.382s]
2018-12-18 15:18:09.878 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit ... success [0.399s]
2018-12-18 15:18:10.541 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id ... success [0.661s]
2018-12-18 15:18:10.825 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [3.800s]
2018-12-18 15:18:11.633 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server ... success [1.092s]
2018-12-18 15:18:13.122 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address ... success [1.488s]
2018-12-18 15:18:13.743 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server ... success [0.621s]
2018-12-18 15:18:14.510 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_deleted_server ... success [0.767s]
2018-12-18 15:18:14.804 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [3.978s]
2018-12-18 15:18:15.489 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server ... success [0.978s]
2018-12-18 15:18:16.468 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank ... success [0.977s]
2018-12-18 15:18:17.337 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server ... success [0.869s]
2018-12-18 15:18:17.936 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server ... success [0.599s]
2018-12-18 15:18:18.376 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 ... success [0.439s]
2018-12-18 15:18:19.124 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name ... success [0.747s]
2018-12-18 15:18:19.605 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [4.802s]
2018-12-18 15:18:23.873 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [4.267s]
2018-12-18 15:18:24.808 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas ... success [0.418s]
2018-12-18 15:18:25.227 12679 INFO opnfv-tempest [-] {0} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas ... success [0.418s]
2018-12-18 15:18:28.844 12679 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.113s]
2018-12-18 15:18:28.947 12679 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.102s]
2018-12-18 15:18:28.966 12679 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name ... success [3.111s]
2018-12-18 15:18:29.029 12679 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.063s]
2018-12-18 15:18:29.038 12679 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.091s]
2018-12-18 15:18:29.787 12679 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail ... success [0.758s]
2018-12-18 15:18:29.883 12679 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus ... success [0.094s]
2018-12-18 15:18:29.884 12679 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s]
2018-12-18 15:18:29.975 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [6.101s]
2018-12-18 15:18:33.825 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [3.850s]
2018-12-18 15:18:34.263 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.439s]
2018-12-18 15:18:34.363 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.099s]
2018-12-18 15:18:34.459 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.096s]
2018-12-18 15:18:34.712 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.253s]
2018-12-18 15:18:35.262 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.550s]
2018-12-18 15:18:35.406 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.143s]
2018-12-18 15:18:35.607 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.201s]
2018-12-18 15:18:35.665 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.057s]
2018-12-18 15:18:35.733 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.068s]
2018-12-18 15:18:39.942 12679 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_image_schema ... success [0.009s]
2018-12-18 15:18:39.953 12679 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_images_schema ... success [0.010s]
2018-12-18 15:18:40.087 12679 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_container_format ... success [0.134s]
2018-12-18 15:18:40.122 12679 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_disk_format ... success [0.035s]
2018-12-18 15:18:40.168 12679 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_limit ... success [0.046s]
2018-12-18 15:18:40.371 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [4.637s]
2018-12-18 15:18:40.699 12679 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_min_max_size ... success [0.530s]
2018-12-18 15:18:40.947 12679 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_size ... success [0.248s]
2018-12-18 15:18:40.993 12679 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_status ... success [0.045s]
2018-12-18 15:18:41.045 12679 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_visibility ... success [0.052s]
2018-12-18 15:18:41.102 12679 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_no_params ... success [0.056s]
2018-12-18 15:18:51.652 12679 INFO opnfv-tempest [-] {0} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions ... success [0.209s]
2018-12-18 15:19:01.557 12679 INFO opnfv-tempest [-] {0} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [2.233s]
2018-12-18 15:19:02.741 12679 INFO opnfv-tempest [-] {0} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [1.185s]
2018-12-18 15:19:08.428 12679 INFO opnfv-tempest [-] {0} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.013s]
2018-12-18 15:19:13.157 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [23.803s]
2018-12-18 15:19:17.983 12679 INFO opnfv-tempest [-] {3} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume ... success [61.193s]
2018-12-18 15:19:20.818 12679 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [8.438s]
2018-12-18 15:19:26.368 12679 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server ... success [11.709s]
2018-12-18 15:19:30.881 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [17.723s]
2018-12-18 15:19:31.000 12679 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_as_clone ... success [10.180s]
2018-12-18 15:19:34.979 12679 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [8.611s]
2018-12-18 15:19:42.391 12679 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [11.389s]
2018-12-18 15:19:46.417 12679 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_with_nonexistent_volume_id ... success [0.207s]
2018-12-18 15:19:46.531 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [15.650s]
2018-12-18 15:19:47.066 12679 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_without_passing_volume_id ... success [0.649s]
2018-12-18 15:19:54.548 12679 INFO opnfv-tempest [-] {3} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_list_get_volume_attachments ... success [36.557s]
2018-12-18 15:19:57.035 12679 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server ... success [22.051s]
2018-12-18 15:19:58.959 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [12.426s]
2018-12-18 15:20:13.686 12679 INFO opnfv-tempest [-] {3} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.329s]
2018-12-18 15:20:15.610 12679 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server ... success [18.575s]
2018-12-18 15:20:19.282 12679 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [0.985s]
2018-12-18 15:20:19.544 12679 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.262s]
2018-12-18 15:20:28.429 12679 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port ... success [3.453s]
2018-12-18 15:20:36.531 12679 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [8.102s]
2018-12-18 15:20:37.959 12679 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password ... success [3.184s]
2018-12-18 15:20:38.518 12679 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [1.987s]
2018-12-18 15:20:38.761 12679 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.242s]
2018-12-18 15:20:38.982 12679 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields ... success [0.221s]
2018-12-18 15:20:39.782 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_update_delete_extra_route ... success [40.820s]
2018-12-18 15:20:47.061 12679 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair ... success [9.097s]
2018-12-18 15:20:50.342 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_update_router_admin_state ... success [10.562s]
2018-12-18 15:21:00.017 12679 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_port_list_filter_by_router_id ... success [21.033s]
2018-12-18 15:21:00.235 12679 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.220s]
2018-12-18 15:21:00.459 12679 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields ... success [0.223s]
2018-12-18 15:21:03.226 12679 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name ... success [16.163s]
2018-12-18 15:21:09.264 12679 INFO opnfv-tempest [-] {3} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.658s]
2018-12-18 15:21:10.087 12679 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address ... success [6.861s]
2018-12-18 15:21:14.099 12679 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size ... success [0.195s]
2018-12-18 15:21:14.813 12679 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id ... success [0.714s]
2018-12-18 15:21:15.442 12679 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid ... success [0.628s]
2018-12-18 15:21:15.648 12679 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type ... success [0.206s]
2018-12-18 15:21:15.838 12679 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative ... success [0.190s]
2018-12-18 15:21:15.849 12679 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero ... success [0.010s]
2018-12-18 15:21:15.912 12679 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size ... success [0.063s]
2018-12-18 15:21:16.522 12679 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id ... success [0.610s]
2018-12-18 15:21:16.713 12679 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id ... success [0.191s]
2018-12-18 15:21:16.749 12679 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id ... success [0.035s]
2018-12-18 15:21:16.941 12679 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id ... success [0.192s]
2018-12-18 15:21:17.169 12679 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status ... success [0.226s]
2018-12-18 15:21:17.392 12679 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name ... success [0.224s]
2018-12-18 15:21:18.039 12679 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status ... success [0.646s]
2018-12-18 15:21:18.680 12679 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name ... success [0.640s]
2018-12-18 15:21:18.688 12679 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id ... success [0.008s]
2018-12-18 15:21:18.723 12679 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id ... success [0.035s]
2018-12-18 15:21:19.334 12679 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id ... success [0.611s]
2018-12-18 15:21:19.649 12679 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id ... success [0.314s]
2018-12-18 15:21:19.683 12679 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id ... success [0.034s]
2018-12-18 15:21:27.245 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.865s]
2018-12-18 15:21:28.670 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [1.424s]
2018-12-18 15:21:30.000 12679 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete ... success [5.250s]
2018-12-18 15:21:32.846 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [4.173s]
2018-12-18 15:21:33.461 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [0.617s]
2018-12-18 15:21:35.091 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [1.628s]
2018-12-18 15:21:36.544 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [1.452s]
2018-12-18 15:21:37.645 12679 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot ... success [7.643s]
2018-12-18 15:21:38.263 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.716s]
2018-12-18 15:21:38.305 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.045s]
2018-12-18 15:21:42.018 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.188s]
2018-12-18 15:21:43.162 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [1.142s]
2018-12-18 15:21:44.284 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [1.122s]
2018-12-18 15:21:45.340 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [1.055s]
2018-12-18 15:21:46.551 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [1.210s]
2018-12-18 15:21:48.504 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [1.952s]
2018-12-18 15:21:49.249 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [0.744s]
2018-12-18 15:21:49.329 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.081s]
2018-12-18 15:21:49.347 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.018s]
2018-12-18 15:21:49.366 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.019s]
2018-12-18 15:21:49.381 12679 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.015s]
2018-12-18 15:21:55.387 12679 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [2.063s]
2018-12-18 15:21:56.541 12679 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [1.154s]
2018-12-18 15:22:04.390 12679 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name ... success [54.289s]
2018-12-18 15:22:06.683 12679 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.222s]
2018-12-18 15:22:06.902 12679 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name ... success [0.219s]
2018-12-18 15:22:07.141 12679 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name ... success [0.239s]
2018-12-18 15:22:07.967 12679 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination ... success [0.825s]
2018-12-18 15:22:08.089 12679 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params ... success [0.120s]
2018-12-18 15:22:08.483 12679 INFO opnfv-tempest [-] {2} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.012s]
2018-12-18 15:22:08.981 12679 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination ... success [0.892s]
2018-12-18 15:22:09.019 12679 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status ... success [0.038s]
2018-12-18 15:22:09.273 12679 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status ... success [0.253s]
2018-12-18 15:22:09.518 12679 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata ... success [0.245s]
2018-12-18 15:22:09.587 12679 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details ... success [0.069s]
2018-12-18 15:22:09.630 12679 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata ... success [0.042s]
2018-12-18 15:22:10.068 12679 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone ... success [0.436s]
2018-12-18 15:22:10.333 12679 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status ... success [0.265s]
2018-12-18 15:22:10.580 12679 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone ... success [0.247s]
2018-12-18 15:22:10.649 12679 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status ... success [0.069s]
2018-12-18 15:22:13.388 12679 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [1.160s]
2018-12-18 15:22:14.830 12679 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [1.442s]
2018-12-18 15:22:33.691 12679 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_add_router_interfaces_on_overlapping_subnets_returns_400 ... success [8.672s]
2018-12-18 15:22:33.942 12679 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_delete_non_existent_router_returns_404 ... success [0.252s]
2018-12-18 15:22:34.528 12679 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_add_gateway_invalid_network_returns_404 ... success [0.586s]
2018-12-18 15:22:36.885 12679 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_add_gateway_net_not_external_returns_400 ... success [2.356s]
2018-12-18 15:22:42.236 12679 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_remove_interface_in_use_returns_409 ... success [5.350s]
2018-12-18 15:22:42.296 12679 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_show_non_existent_router_returns_404 ... success [0.060s]
2018-12-18 15:22:42.551 12679 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_update_non_existent_router_returns_404 ... success [0.255s]
2018-12-18 15:23:04.257 12679 INFO opnfv-tempest [-] {2} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.006s]
2018-12-18 15:23:08.228 12679 INFO opnfv-tempest [-] {2} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON.test_get_availability_zone_list ... success [0.173s]
2018-12-18 15:23:14.842 12679 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_bootable ... success [1.784s]
2018-12-18 15:23:15.815 12679 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_readonly_update ... success [0.973s]
2018-12-18 15:23:40.024 12679 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_upload ... success [24.205s]
2018-12-18 15:23:53.100 12679 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_details_with_params ... success [0.839s]
2018-12-18 15:23:53.524 12679 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_with_params ... success [0.424s]
2018-12-18 15:24:02.934 12679 INFO rally.task.context [-] Verification fe693d0c-2853-4a54-bf79-f23b041815c7 | Context testr@default cleanup() started
2018-12-18 15:24:02.935 12679 INFO rally.task.context [-] Verification fe693d0c-2853-4a54-bf79-f23b041815c7 | Context testr@default cleanup() finished in 0.89 msec
2018-12-18 15:24:02.935 12679 INFO rally.task.context [-] Verification fe693d0c-2853-4a54-bf79-f23b041815c7 | Context tempest@default cleanup() started
2018-12-18 15:24:03.889 12679 INFO rally.task.context [-] Verification fe693d0c-2853-4a54-bf79-f23b041815c7 | Context tempest@default cleanup() finished in 0.95 sec
2018-12-18 15:24:03.972 12679 INFO rally.api [-] Verification (UUID=1a90e5f1-5864-4da4-af78-7fed9dc5e339) has been successfully finished for deployment 'opnfv-rally' (UUID=e5c932f3-6d3d-4f12-8977-ac0fbc72e444)!
2018-12-18 15:24:07.009 12718 INFO rally.api [-] Building 'html' report for the following verification(s): '1a90e5f1-5864-4da4-af78-7fed9dc5e339'
2018-12-18 15:24:07.026 12718 INFO rally.api [-] The report has been successfully built.