2018-11-02 20:25:05.098 17733 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=c28a3190-f0bd-4880-98dc-154a09b05dcc) for deployment 'opnfv-rally' (UUID=b3488d6f-f06c-4e94-ac77-8e0fb7fab280).
2018-11-02 20:25:06.085 17733 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=c28a3190-f0bd-4880-98dc-154a09b05dcc) has been successfully configured for deployment 'opnfv-rally' (UUID=b3488d6f-f06c-4e94-ac77-8e0fb7fab280)!
2018-11-02 20:25:11.996 17738 INFO rally.api [-] Starting verification (UUID=58e8f4aa-2729-4776-b57d-608fa785ba71) for deployment 'opnfv-rally' (UUID=b3488d6f-f06c-4e94-ac77-8e0fb7fab280) by verifier 'opnfv-tempest' (UUID=c28a3190-f0bd-4880-98dc-154a09b05dcc).
2018-11-02 20:25:13.589 17738 INFO rally.task.context [-] Verification c28a3190-f0bd-4880-98dc-154a09b05dcc | Context tempest@default setup()  finished in 1.03 sec
2018-11-02 20:25:13.593 17738 INFO rally.task.context [-] Verification c28a3190-f0bd-4880-98dc-154a09b05dcc | Context testr@default setup()  finished in 2.80 msec
2018-11-02 20:25:17.883 17738 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.291s]
2018-11-02 20:25:17.943 17738 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.240s]
2018-11-02 20:25:17.997 17738 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.054s]
2018-11-02 20:25:35.502 17738 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server ... success [13.397s]
2018-11-02 20:25:40.196 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image ... success [12.993s]
2018-11-02 20:25:41.353 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name ... success [1.159s]
2018-11-02 20:25:46.966 17738 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor ... success [0.851s]
2018-11-02 20:25:47.465 17738 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image ... success [0.498s]
2018-11-02 20:25:48.097 17738 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name ... success [0.632s]
2018-11-02 20:25:49.179 17738 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status ... success [1.081s]
2018-11-02 20:25:49.972 17738 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results ... success [0.793s]
2018-11-02 20:25:50.037 17738 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_active_status ... success [0.064s]
2018-11-02 20:25:50.108 17738 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor ... success [0.071s]
2018-11-02 20:25:50.196 17738 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image ... success [0.088s]
2018-11-02 20:25:50.257 17738 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit ... success [0.060s]
2018-11-02 20:25:50.325 17738 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name ... success [0.068s]
2018-11-02 20:25:50.567 17738 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard ... success [0.241s]
2018-11-02 20:25:52.031 17738 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date ... success [0.068s]
2018-11-02 20:25:52.042 17738 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date ... success [0.011s]
2018-11-02 20:25:52.175 17738 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count ... success [0.133s]
2018-11-02 20:25:52.186 17738 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value ... success [0.011s]
2018-11-02 20:25:52.198 17738 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string ... success [0.011s]
2018-11-02 20:25:52.225 17738 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor ... success [0.026s]
2018-11-02 20:25:52.287 17738 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image ... success [0.062s]
2018-11-02 20:25:52.349 17738 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name ... success [0.061s]
2018-11-02 20:25:52.706 17738 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted ... success [0.357s]
2018-11-02 20:25:52.720 17738 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing ... success [0.013s]
2018-11-02 20:25:52.779 17738 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server ... success [0.059s]
2018-11-02 20:25:59.224 17738 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.186s]
2018-11-02 20:25:59.432 17738 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.208s]
2018-11-02 20:25:59.573 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action ... success [0.054s]
2018-11-02 20:25:59.940 17738 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name ... success [16.157s]
2018-11-02 20:26:00.040 17738 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.101s]
2018-11-02 20:26:00.406 17738 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail ... success [0.365s]
2018-11-02 20:26:00.503 17738 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus ... success [0.096s]
2018-11-02 20:26:00.505 17738 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s]
2018-11-02 20:26:00.544 17738 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [1.110s]
2018-11-02 20:26:00.722 17738 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.178s]
2018-11-02 20:26:00.947 17738 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.225s]
2018-11-02 20:26:03.020 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions ... success [3.445s]
2018-11-02 20:26:07.129 17738 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image ... success [1.659s]
2018-11-02 20:26:17.800 17738 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.511s]
2018-11-02 20:26:18.229 17738 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.428s]
2018-11-02 20:26:18.486 17738 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [0.257s]
2018-11-02 20:26:19.600 17738 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [1.114s]
2018-11-02 20:26:20.014 17738 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [0.413s]
2018-11-02 20:26:20.515 17738 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [0.501s]
2018-11-02 20:26:21.098 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [6.612s]
2018-11-02 20:26:22.363 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name ... success [0.970s]
2018-11-02 20:26:23.605 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit ... success [1.241s]
2018-11-02 20:26:25.197 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 ... success [1.591s]
2018-11-02 20:26:26.181 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor ... success [0.984s]
2018-11-02 20:26:26.815 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [5.717s]
2018-11-02 20:26:27.508 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image ... success [1.326s]
2018-11-02 20:26:28.311 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid ... success [0.803s]
2018-11-02 20:26:28.890 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit ... success [0.578s]
2018-11-02 20:26:29.141 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id ... success [0.251s]
2018-11-02 20:26:29.947 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server ... success [0.805s]
2018-11-02 20:26:30.308 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [3.492s]
2018-11-02 20:26:30.980 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address ... success [1.032s]
2018-11-02 20:26:31.385 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server ... success [0.405s]
2018-11-02 20:26:32.054 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_deleted_server ... success [0.669s]
2018-11-02 20:26:32.993 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server ... success [0.939s]
2018-11-02 20:26:33.773 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank ... success [0.778s]
2018-11-02 20:26:34.557 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server ... success [0.784s]
2018-11-02 20:26:34.942 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server ... success [0.385s]
2018-11-02 20:26:35.696 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 ... success [0.753s]
2018-11-02 20:26:35.921 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [5.612s]
2018-11-02 20:26:36.088 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name ... success [0.391s]
2018-11-02 20:26:39.835 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [3.914s]
2018-11-02 20:26:42.049 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas ... success [0.430s]
2018-11-02 20:26:42.510 17738 INFO opnfv-tempest [-] {0} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas ... success [0.461s]
2018-11-02 20:26:43.797 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [3.962s]
2018-11-02 20:26:44.599 17738 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name ... success [2.578s]
2018-11-02 20:26:44.663 17738 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.064s]
2018-11-02 20:26:45.234 17738 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail ... success [0.571s]
2018-11-02 20:26:45.326 17738 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus ... success [0.091s]
2018-11-02 20:26:45.327 17738 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s]
2018-11-02 20:26:46.903 17738 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.092s]
2018-11-02 20:26:47.000 17738 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.096s]
2018-11-02 20:26:47.108 17738 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.108s]
2018-11-02 20:26:48.509 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [4.712s]
2018-11-02 20:26:58.005 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [9.494s]
2018-11-02 20:27:01.347 17738 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_image_schema ... success [0.189s]
2018-11-02 20:27:01.355 17738 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_images_schema ... success [0.008s]
2018-11-02 20:27:01.404 17738 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_container_format ... success [0.048s]
2018-11-02 20:27:01.722 17738 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_disk_format ... success [0.319s]
2018-11-02 20:27:01.963 17738 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_limit ... success [0.240s]
2018-11-02 20:27:02.402 17738 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_min_max_size ... success [0.438s]
2018-11-02 20:27:02.647 17738 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_size ... success [0.245s]
2018-11-02 20:27:02.869 17738 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_status ... success [0.222s]
2018-11-02 20:27:02.910 17738 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_visibility ... success [0.040s]
2018-11-02 20:27:03.133 17738 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_no_params ... success [0.223s]
2018-11-02 20:27:03.605 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [5.600s]
2018-11-02 20:27:03.827 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.222s]
2018-11-02 20:27:04.109 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.282s]
2018-11-02 20:27:04.420 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.311s]
2018-11-02 20:27:04.479 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.058s]
2018-11-02 20:27:04.540 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.061s]
2018-11-02 20:27:04.831 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.290s]
2018-11-02 20:27:05.111 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.280s]
2018-11-02 20:27:05.177 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.065s]
2018-11-02 20:27:05.416 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.238s]
2018-11-02 20:27:14.091 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [8.674s]
2018-11-02 20:27:16.215 17738 INFO opnfv-tempest [-] {0} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions ... success [0.625s]
2018-11-02 20:27:27.961 17738 INFO opnfv-tempest [-] {0} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [2.470s]
2018-11-02 20:27:31.098 17738 INFO opnfv-tempest [-] {0} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [3.137s]
2018-11-02 20:27:37.190 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [12.778s]
2018-11-02 20:27:38.972 17738 INFO opnfv-tempest [-] {0} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.013s]
2018-11-02 20:27:39.101 17738 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server ... success [11.103s]
2018-11-02 20:27:45.218 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [8.028s]
2018-11-02 20:27:51.514 17738 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [8.568s]
2018-11-02 20:27:51.593 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [6.374s]
2018-11-02 20:27:55.496 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [3.903s]
2018-11-02 20:28:00.971 17738 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_as_clone ... success [9.455s]
2018-11-02 20:28:14.223 17738 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [13.250s]
2018-11-02 20:28:19.576 17738 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_with_nonexistent_volume_id ... success [0.227s]
2018-11-02 20:28:19.804 17738 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_without_passing_volume_id ... success [0.228s]
2018-11-02 20:28:21.431 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_update_delete_extra_route ... success [25.930s]
2018-11-02 20:28:23.722 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_update_router_admin_state ... success [2.294s]
2018-11-02 20:29:02.702 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [2.162s]
2018-11-02 20:29:04.349 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [1.646s]
2018-11-02 20:29:08.366 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [4.012s]
2018-11-02 20:29:09.369 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [1.007s]
2018-11-02 20:29:11.638 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [2.267s]
2018-11-02 20:29:12.981 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [1.343s]
2018-11-02 20:29:15.496 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [2.511s]
2018-11-02 20:29:15.539 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.046s]
2018-11-02 20:29:19.279 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.206s]
2018-11-02 20:29:21.501 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [2.220s]
2018-11-02 20:29:22.533 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [1.032s]
2018-11-02 20:29:23.373 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [0.840s]
2018-11-02 20:29:25.052 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [1.677s]
2018-11-02 20:29:26.925 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [1.872s]
2018-11-02 20:29:27.902 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [0.977s]
2018-11-02 20:29:28.163 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.262s]
2018-11-02 20:29:28.412 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.249s]
2018-11-02 20:29:28.633 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.221s]
2018-11-02 20:29:28.649 17738 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.015s]
2018-11-02 20:29:32.465 17738 INFO opnfv-tempest [-] {3} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume ... success [179.788s]
2018-11-02 20:29:35.335 17738 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [1.808s]
2018-11-02 20:29:36.153 17738 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [0.818s]
2018-11-02 20:29:47.275 17738 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.222s]
2018-11-02 20:29:47.506 17738 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name ... success [0.231s]
2018-11-02 20:29:47.754 17738 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name ... success [0.247s]
2018-11-02 20:29:48.796 17738 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination ... success [1.041s]
2018-11-02 20:29:49.119 17738 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params ... success [0.323s]
2018-11-02 20:29:49.356 17738 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [130.254s]
2018-11-02 20:29:49.902 17738 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination ... success [0.782s]
2018-11-02 20:29:49.946 17738 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status ... success [0.044s]
2018-11-02 20:29:50.163 17738 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status ... success [0.217s]
2018-11-02 20:29:50.231 17738 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata ... success [0.067s]
2018-11-02 20:29:50.517 17738 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details ... success [0.286s]
2018-11-02 20:29:50.559 17738 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata ... success [0.042s]
2018-11-02 20:29:50.838 17738 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone ... success [0.278s]
2018-11-02 20:29:50.927 17738 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status ... success [0.088s]
2018-11-02 20:29:50.999 17738 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone ... success [0.072s]
2018-11-02 20:29:51.260 17738 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status ... success [0.261s]
2018-11-02 20:30:07.301 17738 INFO opnfv-tempest [-] {3} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_list_get_volume_attachments ... success [34.827s]
2018-11-02 20:30:09.363 17738 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server ... success [20.003s]
2018-11-02 20:30:24.104 17738 INFO opnfv-tempest [-] {3} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.328s]
2018-11-02 20:30:28.758 17738 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [0.722s]
2018-11-02 20:30:28.778 17738 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.020s]
2018-11-02 20:30:38.168 17738 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port ... success [3.718s]
2018-11-02 20:30:44.575 17738 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [6.407s]
2018-11-02 20:30:47.263 17738 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [2.687s]
2018-11-02 20:30:47.336 17738 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.072s]
2018-11-02 20:30:47.418 17738 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields ... success [0.082s]
2018-11-02 20:30:59.840 17738 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_port_list_filter_by_router_id ... success [12.420s]
2018-11-02 20:31:00.174 17738 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.334s]
2018-11-02 20:31:00.252 17738 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields ... success [0.078s]
2018-11-02 20:31:09.327 17738 INFO opnfv-tempest [-] {3} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.621s]
2018-11-02 20:31:15.980 17738 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size ... success [0.010s]
2018-11-02 20:31:16.182 17738 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id ... success [0.202s]
2018-11-02 20:31:16.786 17738 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server ... success [67.411s]
2018-11-02 20:31:16.806 17738 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid ... success [0.623s]
2018-11-02 20:31:17.028 17738 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type ... success [0.221s]
2018-11-02 20:31:17.244 17738 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative ... success [0.216s]
2018-11-02 20:31:17.855 17738 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero ... success [0.611s]
2018-11-02 20:31:17.904 17738 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size ... success [0.049s]
2018-11-02 20:31:18.118 17738 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id ... success [0.213s]
2018-11-02 20:31:18.127 17738 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id ... success [0.009s]
2018-11-02 20:31:18.351 17738 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id ... success [0.224s]
2018-11-02 20:31:18.361 17738 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id ... success [0.009s]
2018-11-02 20:31:18.599 17738 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status ... success [0.237s]
2018-11-02 20:31:18.835 17738 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name ... success [0.236s]
2018-11-02 20:31:19.439 17738 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status ... success [0.604s]
2018-11-02 20:31:19.663 17738 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name ... success [0.224s]
2018-11-02 20:31:19.860 17738 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id ... success [0.197s]
2018-11-02 20:31:19.905 17738 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id ... success [0.044s]
2018-11-02 20:31:19.943 17738 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id ... success [0.038s]
2018-11-02 20:31:19.983 17738 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id ... success [0.039s]
2018-11-02 20:31:20.210 17738 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id ... success [0.227s]
2018-11-02 20:31:32.614 17738 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete ... success [4.566s]
2018-11-02 20:31:34.466 17738 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password ... success [3.207s]
2018-11-02 20:31:38.088 17738 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot ... success [5.472s]
2018-11-02 20:31:43.649 17738 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair ... success [9.180s]
2018-11-02 20:31:59.408 17738 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name ... success [15.756s]
2018-11-02 20:32:06.977 17738 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address ... success [7.570s]
2018-11-02 20:33:01.842 17738 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name ... success [54.851s]
2018-11-02 20:33:06.463 17738 INFO opnfv-tempest [-] {2} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.012s]
2018-11-02 20:33:11.538 17738 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [1.131s]
2018-11-02 20:33:13.345 17738 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [1.807s]
2018-11-02 20:33:29.152 17738 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_add_router_interfaces_on_overlapping_subnets_returns_400 ... success [8.419s]
2018-11-02 20:33:29.399 17738 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_delete_non_existent_router_returns_404 ... success [0.248s]
2018-11-02 20:33:29.967 17738 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_add_gateway_invalid_network_returns_404 ... success [0.568s]
2018-11-02 20:33:32.037 17738 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_add_gateway_net_not_external_returns_400 ... success [2.070s]
2018-11-02 20:33:36.410 17738 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_remove_interface_in_use_returns_409 ... success [4.372s]
2018-11-02 20:33:36.458 17738 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_show_non_existent_router_returns_404 ... success [0.048s]
2018-11-02 20:33:36.702 17738 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_update_non_existent_router_returns_404 ... success [0.245s]
2018-11-02 20:33:58.514 17738 INFO opnfv-tempest [-] {2} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.005s]
2018-11-02 20:34:02.495 17738 INFO opnfv-tempest [-] {2} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON.test_get_availability_zone_list ... success [0.206s]
2018-11-02 20:34:08.477 17738 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_bootable ... success [1.513s]
2018-11-02 20:34:09.363 17738 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_readonly_update ... success [0.885s]
2018-11-02 20:34:29.324 17738 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_upload ... success [19.959s]
2018-11-02 20:34:42.309 17738 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_details_with_params ... success [0.449s]
2018-11-02 20:34:43.065 17738 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_with_params ... success [0.757s]
2018-11-02 20:34:50.642 17738 INFO rally.task.context [-] Verification c28a3190-f0bd-4880-98dc-154a09b05dcc | Context testr@default cleanup() started
2018-11-02 20:34:50.643 17738 INFO rally.task.context [-] Verification c28a3190-f0bd-4880-98dc-154a09b05dcc | Context testr@default cleanup() finished in 1.24 msec
2018-11-02 20:34:50.644 17738 INFO rally.task.context [-] Verification c28a3190-f0bd-4880-98dc-154a09b05dcc | Context tempest@default cleanup() started
2018-11-02 20:34:51.573 17738 INFO rally.task.context [-] Verification c28a3190-f0bd-4880-98dc-154a09b05dcc | Context tempest@default cleanup() finished in 0.93 sec
2018-11-02 20:34:51.715 17738 INFO rally.api [-] Verification (UUID=58e8f4aa-2729-4776-b57d-608fa785ba71) has been successfully finished for deployment 'opnfv-rally' (UUID=b3488d6f-f06c-4e94-ac77-8e0fb7fab280)!
2018-11-02 20:34:54.704 17777 INFO rally.api [-] Building 'html' report for the following verification(s): '58e8f4aa-2729-4776-b57d-608fa785ba71'
2018-11-02 20:34:54.743 17777 INFO rally.api [-] The report has been successfully built.