2018-11-06 21:23:13.501 10117 INFO rally.api [-] Starting verification (UUID=814b5405-39f0-4a4e-8cb3-8c728c7e45f8) for deployment 'opnfv-rally' (UUID=3c2578c0-dbe5-4619-a43e-f7547d1a7873) by verifier 'opnfv-tempest' (UUID=ffa34b8d-a0f1-4153-8cc6-99038b2b8290).
2018-11-06 21:23:14.125 10117 INFO rally.task.context [-] Verification ffa34b8d-a0f1-4153-8cc6-99038b2b8290 | Context tempest@default setup()  started
2018-11-06 21:23:14.385 10117 WARNING oslo_config.cfg [-] Option "swift_operator_role" from group "tempest" is deprecated. Use option "swift_operator_role" from group "openstack".
2018-11-06 21:23:15.082 10117 INFO rally.task.context [-] Verification ffa34b8d-a0f1-4153-8cc6-99038b2b8290 | Context tempest@default setup()  finished in 0.96 sec
2018-11-06 21:23:15.082 10117 INFO rally.task.context [-] Verification ffa34b8d-a0f1-4153-8cc6-99038b2b8290 | Context testr@default setup()  started
2018-11-06 21:23:15.085 10117 INFO rally.task.context [-] Verification ffa34b8d-a0f1-4153-8cc6-99038b2b8290 | Context testr@default setup()  finished in 3.35 msec
2018-11-06 21:23:19.996 10117 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.196s]
2018-11-06 21:23:20.045 10117 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.049s]
2018-11-06 21:23:21.870 10117 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password ... success [2.157s]
2018-11-06 21:23:23.897 10117 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.442s]
2018-11-06 21:23:30.522 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server ... success [10.869s]
2018-11-06 21:23:35.761 10117 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair ... success [13.887s]
2018-11-06 21:23:41.513 10117 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date ... success [0.061s]
2018-11-06 21:23:41.523 10117 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date ... success [0.010s]
2018-11-06 21:23:41.653 10117 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count ... success [0.130s]
2018-11-06 21:23:41.666 10117 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value ... success [0.013s]
2018-11-06 21:23:41.677 10117 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string ... success [0.011s]
2018-11-06 21:23:41.715 10117 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor ... success [0.036s]
2018-11-06 21:23:41.782 10117 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image ... success [0.066s]
2018-11-06 21:23:41.844 10117 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name ... success [0.062s]
2018-11-06 21:23:42.132 10117 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted ... success [0.287s]
2018-11-06 21:23:42.147 10117 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing ... success [0.014s]
2018-11-06 21:23:42.219 10117 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server ... success [0.072s]
2018-11-06 21:23:43.102 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action ... success [0.054s]
2018-11-06 21:23:46.889 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions ... success [3.785s]
2018-11-06 21:23:50.804 10117 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.012s]
2018-11-06 21:23:54.564 10117 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.076s]
2018-11-06 21:23:54.636 10117 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.071s]
2018-11-06 21:23:54.713 10117 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.077s]
2018-11-06 21:23:57.503 10117 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name ... success [21.738s]
2018-11-06 21:23:58.810 10117 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.140s]
2018-11-06 21:23:58.970 10117 INFO opnfv-tempest [-] {1} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image ... success [30.613s]
2018-11-06 21:23:58.986 10117 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.176s]
2018-11-06 21:23:59.728 10117 INFO opnfv-tempest [-] {1} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name ... success [0.762s]
2018-11-06 21:24:00.023 10117 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [1.036s]
2018-11-06 21:24:00.032 10117 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.009s]
2018-11-06 21:24:00.046 10117 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.014s]
2018-11-06 21:24:09.738 10117 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address ... success [12.235s]
2018-11-06 21:24:10.827 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [3.688s]
2018-11-06 21:24:13.175 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor ... success [0.841s]
2018-11-06 21:24:13.586 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image ... success [0.410s]
2018-11-06 21:24:13.969 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name ... success [0.383s]
2018-11-06 21:24:14.552 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status ... success [0.582s]
2018-11-06 21:24:15.421 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results ... success [0.868s]
2018-11-06 21:24:15.491 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_active_status ... success [0.070s]
2018-11-06 21:24:15.566 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor ... success [0.074s]
2018-11-06 21:24:15.634 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image ... success [0.068s]
2018-11-06 21:24:15.700 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit ... success [0.065s]
2018-11-06 21:24:15.768 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name ... success [0.067s]
2018-11-06 21:24:15.904 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard ... success [0.136s]
2018-11-06 21:24:16.120 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [5.293s]
2018-11-06 21:24:20.174 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [4.053s]
2018-11-06 21:24:25.114 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [4.940s]
2018-11-06 21:24:25.678 10117 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON ... fail
2018-11-06 21:24:29.464 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [4.349s]
2018-11-06 21:24:33.548 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [4.084s]
2018-11-06 21:24:36.771 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [3.222s]
2018-11-06 21:24:42.916 10117 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestManualDisk ... fail
2018-11-06 21:24:43.387 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [6.615s]
2018-11-06 21:24:47.059 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [3.671s]
2018-11-06 21:24:47.301 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.243s]
2018-11-06 21:24:47.400 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.098s]
2018-11-06 21:24:47.589 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.188s]
2018-11-06 21:24:47.659 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.069s]
2018-11-06 21:24:47.851 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.191s]
2018-11-06 21:24:48.086 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.235s]
2018-11-06 21:24:48.139 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.053s]
2018-11-06 21:24:48.333 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.192s]
2018-11-06 21:24:52.330 10117 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.533s]
2018-11-06 21:24:52.565 10117 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.235s]
2018-11-06 21:24:52.794 10117 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [0.228s]
2018-11-06 21:24:53.208 10117 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [0.413s]
2018-11-06 21:24:53.660 10117 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [0.452s]
2018-11-06 21:24:53.884 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [5.550s]
2018-11-06 21:24:54.142 10117 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [0.481s]
2018-11-06 21:24:54.460 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON ... fail
2018-11-06 21:25:00.707 10117 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.998s]
2018-11-06 21:25:02.103 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.157s]
2018-11-06 21:25:03.619 10117 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [2.911s]
2018-11-06 21:25:03.862 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [1.757s]
2018-11-06 21:25:04.702 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [0.840s]
2018-11-06 21:25:05.519 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name ... success [1.010s]
2018-11-06 21:25:05.792 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [1.089s]
2018-11-06 21:25:06.554 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit ... success [1.035s]
2018-11-06 21:25:07.493 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [1.700s]
2018-11-06 21:25:07.566 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 ... success [1.011s]
2018-11-06 21:25:08.630 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor ... success [1.063s]
2018-11-06 21:25:09.014 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [1.519s]
2018-11-06 21:25:09.245 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image ... success [0.614s]
2018-11-06 21:25:10.255 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid ... success [1.009s]
2018-11-06 21:25:10.334 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [1.319s]
2018-11-06 21:25:10.413 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.081s]
2018-11-06 21:25:10.768 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit ... success [0.513s]
2018-11-06 21:25:10.786 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.372s]
2018-11-06 21:25:10.806 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.020s]
2018-11-06 21:25:10.824 10117 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.018s]
2018-11-06 21:25:11.294 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id ... success [0.526s]
2018-11-06 21:25:11.994 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server ... success [0.699s]
2018-11-06 21:25:12.315 10117 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.723s]
2018-11-06 21:25:12.720 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address ... success [0.725s]
2018-11-06 21:25:13.676 10117 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [1.360s]
2018-11-06 21:25:13.727 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server ... success [1.007s]
2018-11-06 21:25:14.573 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_deleted_server ... success [0.844s]
2018-11-06 21:25:15.117 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server ... success [0.543s]
2018-11-06 21:25:16.170 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank ... success [1.052s]
2018-11-06 21:25:16.666 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server ... success [0.496s]
2018-11-06 21:25:17.205 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server ... success [0.538s]
2018-11-06 21:25:17.297 10117 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [1.528s]
2018-11-06 21:25:17.467 10117 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [3.787s]
2018-11-06 21:25:17.618 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 ... success [0.412s]
2018-11-06 21:25:17.976 10117 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name ... success [0.357s]
2018-11-06 21:25:18.027 10117 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [0.730s]
2018-11-06 21:25:18.270 10117 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [0.805s]
2018-11-06 21:25:20.283 10117 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [2.011s]
2018-11-06 21:25:21.722 10117 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [1.439s]
2018-11-06 21:25:21.933 10117 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name ... success [72.183s]
2018-11-06 21:25:24.270 10117 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [2.543s]
2018-11-06 21:25:24.347 10117 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.081s]
2018-11-06 21:25:25.023 10117 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image ... success [1.401s]
2018-11-06 21:25:26.797 10117 INFO opnfv-tempest [-] {2} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas ... success [0.293s]
2018-11-06 21:25:27.168 10117 INFO opnfv-tempest [-] {2} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas ... success [0.372s]
2018-11-06 21:25:27.645 10117 INFO opnfv-tempest [-] {1} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON.test_get_availability_zone_list ... success [0.155s]
2018-11-06 21:25:31.013 10117 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete ... success [5.962s]
2018-11-06 21:25:33.752 10117 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_bootable ... success [0.703s]
2018-11-06 21:25:34.329 10117 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_readonly_update ... success [0.576s]
2018-11-06 21:25:34.380 10117 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port ... success [3.954s]
2018-11-06 21:25:37.568 10117 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot ... success [6.553s]
2018-11-06 21:25:40.550 10117 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [6.168s]
2018-11-06 21:25:41.259 10117 INFO opnfv-tempest [-] {2} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON ... fail
2018-11-06 21:25:43.296 10117 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [2.745s]
2018-11-06 21:25:43.495 10117 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.200s]
2018-11-06 21:25:43.609 10117 INFO opnfv-tempest [-] {2} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.310s]
2018-11-06 21:25:43.904 10117 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields ... success [0.409s]
2018-11-06 21:25:44.116 10117 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.211s]
2018-11-06 21:25:44.157 10117 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields ... success [0.042s]
2018-11-06 21:25:50.505 10117 INFO opnfv-tempest [-] {3} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions ... success [0.151s]
2018-11-06 21:26:01.796 10117 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_image_schema ... success [0.009s]
2018-11-06 21:26:01.803 10117 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_images_schema ... success [0.008s]
2018-11-06 21:26:01.856 10117 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [8.035s]
2018-11-06 21:26:02.004 10117 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_container_format ... success [0.200s]
2018-11-06 21:26:02.265 10117 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_disk_format ... success [0.260s]
2018-11-06 21:26:02.448 10117 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_limit ... success [0.183s]
2018-11-06 21:26:02.646 10117 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_min_max_size ... success [0.196s]
2018-11-06 21:26:02.836 10117 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_size ... success [0.189s]
2018-11-06 21:26:02.879 10117 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_status ... success [0.042s]
2018-11-06 21:26:02.922 10117 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_visibility ... success [0.043s]
2018-11-06 21:26:03.050 10117 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_no_params ... success [0.127s]
2018-11-06 21:26:13.325 10117 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_as_clone ... success [11.462s]
2018-11-06 21:26:13.417 10117 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_upload ... success [39.081s]
2018-11-06 21:26:17.793 10117 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [0.551s]
2018-11-06 21:26:17.961 10117 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.168s]
2018-11-06 21:26:23.210 10117 INFO opnfv-tempest [-] {2} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.267s]
2018-11-06 21:26:25.224 10117 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [11.898s]
2018-11-06 21:26:26.885 10117 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_details_with_params ... success [0.223s]
2018-11-06 21:26:27.374 10117 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_with_params ... success [0.489s]
2018-11-06 21:26:31.363 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [1.181s]
2018-11-06 21:26:31.930 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [0.568s]
2018-11-06 21:26:44.894 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.172s]
2018-11-06 21:26:44.932 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name ... success [0.037s]
2018-11-06 21:26:45.124 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name ... success [0.193s]
2018-11-06 21:26:45.531 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination ... success [0.405s]
2018-11-06 21:26:45.632 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params ... success [0.101s]
2018-11-06 21:26:46.185 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination ... success [0.551s]
2018-11-06 21:26:46.372 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status ... success [0.187s]
2018-11-06 21:26:46.437 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status ... success [0.065s]
2018-11-06 21:26:46.493 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata ... success [0.055s]
2018-11-06 21:26:46.545 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details ... success [0.051s]
2018-11-06 21:26:46.727 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata ... success [0.181s]
2018-11-06 21:26:46.959 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone ... success [0.231s]
2018-11-06 21:26:47.036 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status ... success [0.076s]
2018-11-06 21:26:47.086 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone ... success [0.050s]
2018-11-06 21:26:47.138 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status ... success [0.051s]
2018-11-06 21:26:54.157 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size ... success [0.167s]
2018-11-06 21:26:54.182 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id ... success [0.024s]
2018-11-06 21:26:54.359 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid ... success [0.177s]
2018-11-06 21:26:54.378 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type ... success [0.018s]
2018-11-06 21:26:54.537 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative ... success [0.159s]
2018-11-06 21:26:54.700 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero ... success [0.162s]
2018-11-06 21:26:54.777 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size ... success [0.076s]
2018-11-06 21:26:54.949 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id ... success [0.172s]
2018-11-06 21:26:55.113 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id ... success [0.163s]
2018-11-06 21:26:55.295 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id ... success [0.182s]
2018-11-06 21:26:55.440 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id ... success [0.145s]
2018-11-06 21:26:55.484 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status ... success [0.043s]
2018-11-06 21:26:55.532 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name ... success [0.047s]
2018-11-06 21:26:55.714 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status ... success [0.182s]
2018-11-06 21:26:55.750 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name ... success [0.035s]
2018-11-06 21:26:55.909 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id ... success [0.158s]
2018-11-06 21:26:55.942 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id ... success [0.033s]
2018-11-06 21:26:55.976 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id ... success [0.033s]
2018-11-06 21:26:56.008 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id ... success [0.032s]
2018-11-06 21:26:56.044 10117 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id ... success [0.036s]
2018-11-06 21:31:37.103 10117 INFO opnfv-tempest [-] {1} tearDownClass (tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON) ... fail
2018-11-06 21:31:39.255 10117 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_with_nonexistent_volume_id ... success [0.169s]
2018-11-06 21:31:39.433 10117 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_without_passing_volume_id ... success [0.178s]
2018-11-06 21:31:42.012 10117 INFO rally.task.context [-] Verification ffa34b8d-a0f1-4153-8cc6-99038b2b8290 | Context testr@default cleanup() started
2018-11-06 21:31:42.012 10117 INFO rally.task.context [-] Verification ffa34b8d-a0f1-4153-8cc6-99038b2b8290 | Context testr@default cleanup() finished in 0.44 msec
2018-11-06 21:31:42.012 10117 INFO rally.task.context [-] Verification ffa34b8d-a0f1-4153-8cc6-99038b2b8290 | Context tempest@default cleanup() started
2018-11-06 21:31:42.824 10117 INFO rally.task.context [-] Verification ffa34b8d-a0f1-4153-8cc6-99038b2b8290 | Context tempest@default cleanup() finished in 0.81 sec
2018-11-06 21:31:42.893 10117 INFO rally.api [-] Verification (UUID=814b5405-39f0-4a4e-8cb3-8c728c7e45f8) has been successfully finished for deployment 'opnfv-rally' (UUID=3c2578c0-dbe5-4619-a43e-f7547d1a7873)!

======
Totals
======

Ran: 200 tests in 501.559 sec.
 - Success: 184
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 16

Using verification (UUID=814b5405-39f0-4a4e-8cb3-8c728c7e45f8) as the default verification for the future operations.