2018-10-12 11:18:48.337 245 INFO rally.api [-] Starting verification (UUID=2707fb12-4450-4ce0-ba14-d0c73099f0c7) for deployment 'opnfv-rally' (UUID=2da3a86f-8bbe-4b32-923d-dfe70c9dbc19) by verifier 'opnfv-tempest' (UUID=8d262b5e-249e-4812-9dbd-79aa64d3dc7c).
2018-10-12 11:18:48.840 245 INFO rally.task.context [-] Verification 8d262b5e-249e-4812-9dbd-79aa64d3dc7c | Context tempest@default setup()  started
2018-10-12 11:18:49.101 245 WARNING oslo_config.cfg [-] Option "swift_operator_role" from group "tempest" is deprecated. Use option "swift_operator_role" from group "openstack".
2018-10-12 11:18:49.794 245 INFO rally.task.context [-] Verification 8d262b5e-249e-4812-9dbd-79aa64d3dc7c | Context tempest@default setup()  finished in 0.95 sec
2018-10-12 11:18:49.795 245 INFO rally.task.context [-] Verification 8d262b5e-249e-4812-9dbd-79aa64d3dc7c | Context testr@default setup()  started
2018-10-12 11:18:49.798 245 INFO rally.task.context [-] Verification 8d262b5e-249e-4812-9dbd-79aa64d3dc7c | Context testr@default setup()  finished in 3.21 msec
2018-10-12 11:18:55.120 245 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.199s]
2018-10-12 11:18:55.193 245 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.073s]
2018-10-12 11:18:56.940 245 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password ... success [1.952s]
2018-10-12 11:18:58.669 245 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.235s]
2018-10-12 11:19:04.966 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server ... success [10.019s]
2018-10-12 11:19:13.631 245 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair ... success [16.687s]
2018-10-12 11:19:20.615 245 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date ... success [0.062s]
2018-10-12 11:19:20.626 245 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date ... success [0.011s]
2018-10-12 11:19:20.772 245 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count ... success [0.145s]
2018-10-12 11:19:20.784 245 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value ... success [0.011s]
2018-10-12 11:19:20.796 245 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string ... success [0.011s]
2018-10-12 11:19:20.826 245 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor ... success [0.030s]
2018-10-12 11:19:21.074 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action ... success [0.066s]
2018-10-12 11:19:21.891 245 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image ... success [1.063s]
2018-10-12 11:19:21.951 245 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name ... success [0.059s]
2018-10-12 11:19:22.246 245 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted ... success [0.294s]
2018-10-12 11:19:22.262 245 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing ... success [0.016s]
2018-10-12 11:19:22.327 245 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server ... success [0.065s]
2018-10-12 11:19:24.411 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions ... success [3.335s]
2018-10-12 11:19:28.072 245 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.009s]
2018-10-12 11:19:30.650 245 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name ... success [17.015s]
2018-10-12 11:19:31.648 245 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.065s]
2018-10-12 11:19:31.690 245 INFO opnfv-tempest [-] {1} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image ... success [28.305s]
2018-10-12 11:19:31.736 245 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.088s]
2018-10-12 11:19:31.814 245 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.078s]
2018-10-12 11:19:32.773 245 INFO opnfv-tempest [-] {1} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name ... success [1.089s]
2018-10-12 11:19:35.557 245 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.158s]
2018-10-12 11:19:35.702 245 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.144s]
2018-10-12 11:19:36.428 245 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [0.724s]
2018-10-12 11:19:36.570 245 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.143s]
2018-10-12 11:19:36.718 245 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.147s]
2018-10-12 11:19:41.408 245 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address ... success [10.758s]
2018-10-12 11:19:50.404 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor ... success [0.545s]
2018-10-12 11:19:50.799 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image ... success [0.394s]
2018-10-12 11:19:51.225 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name ... success [0.425s]
2018-10-12 11:19:51.583 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [8.007s]
2018-10-12 11:19:52.070 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status ... success [0.845s]
2018-10-12 11:19:52.391 245 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON ... fail
2018-10-12 11:19:52.774 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results ... success [0.704s]
2018-10-12 11:19:52.860 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_active_status ... success [0.084s]
2018-10-12 11:19:52.944 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor ... success [0.084s]
2018-10-12 11:19:53.015 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image ... success [0.070s]
2018-10-12 11:19:53.092 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit ... success [0.076s]
2018-10-12 11:19:53.160 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name ... success [0.067s]
2018-10-12 11:19:53.309 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard ... success [0.148s]
2018-10-12 11:19:58.650 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [7.066s]
2018-10-12 11:20:03.302 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [4.651s]
2018-10-12 11:20:05.058 245 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestManualDisk ... fail
2018-10-12 11:20:07.993 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [4.690s]
2018-10-12 11:20:12.751 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [4.756s]
2018-10-12 11:20:13.895 245 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.439s]
2018-10-12 11:20:14.142 245 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.246s]
2018-10-12 11:20:14.379 245 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [0.236s]
2018-10-12 11:20:14.864 245 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [0.484s]
2018-10-12 11:20:15.300 245 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [0.435s]
2018-10-12 11:20:16.044 245 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [0.744s]
2018-10-12 11:20:18.134 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [5.382s]
2018-10-12 11:20:19.583 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON ... fail
2018-10-12 11:20:22.233 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [4.099s]
2018-10-12 11:20:22.258 245 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.823s]
2018-10-12 11:20:24.574 245 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [2.314s]
2018-10-12 11:20:28.894 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [6.660s]
2018-10-12 11:20:31.044 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name ... success [0.672s]
2018-10-12 11:20:32.131 245 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.847s]
2018-10-12 11:20:32.151 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit ... success [1.107s]
2018-10-12 11:20:33.035 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 ... success [0.882s]
2018-10-12 11:20:33.721 245 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [1.589s]
2018-10-12 11:20:34.211 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor ... success [1.175s]
2018-10-12 11:20:35.198 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [6.303s]
2018-10-12 11:20:35.306 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.108s]
2018-10-12 11:20:35.350 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image ... success [1.139s]
2018-10-12 11:20:35.445 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.138s]
2018-10-12 11:20:35.534 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.089s]
2018-10-12 11:20:35.599 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.064s]
2018-10-12 11:20:35.710 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.110s]
2018-10-12 11:20:35.808 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.098s]
2018-10-12 11:20:35.878 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.070s]
2018-10-12 11:20:35.932 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.053s]
2018-10-12 11:20:36.101 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid ... success [0.749s]
2018-10-12 11:20:36.906 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit ... success [0.804s]
2018-10-12 11:20:37.499 245 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [3.772s]
2018-10-12 11:20:37.605 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id ... success [0.700s]
2018-10-12 11:20:38.412 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server ... success [0.806s]
2018-10-12 11:20:38.672 245 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [1.177s]
2018-10-12 11:20:39.209 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address ... success [0.795s]
2018-10-12 11:20:39.764 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server ... success [0.555s]
2018-10-12 11:20:40.636 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_deleted_server ... success [0.872s]
2018-10-12 11:20:41.432 245 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [2.756s]
2018-10-12 11:20:41.464 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server ... success [0.827s]
2018-10-12 11:20:42.215 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank ... success [0.750s]
2018-10-12 11:20:42.463 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [6.530s]
2018-10-12 11:20:42.907 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server ... success [0.691s]
2018-10-12 11:20:43.334 245 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [1.901s]
2018-10-12 11:20:43.419 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server ... success [0.512s]
2018-10-12 11:20:43.789 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 ... success [0.369s]
2018-10-12 11:20:44.183 245 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name ... success [0.394s]
2018-10-12 11:20:44.919 245 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.584s]
2018-10-12 11:20:45.115 245 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.199s]
2018-10-12 11:20:48.920 245 INFO opnfv-tempest [-] {1} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON.test_get_availability_zone_list ... success [0.182s]
2018-10-12 11:20:50.070 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.161s]
2018-10-12 11:20:50.252 245 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name ... success [68.827s]
2018-10-12 11:20:51.376 245 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image ... success [1.064s]
2018-10-12 11:20:51.549 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [1.477s]
2018-10-12 11:20:52.710 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [1.160s]
2018-10-12 11:20:53.845 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [1.134s]
2018-10-12 11:20:54.471 245 INFO opnfv-tempest [-] {2} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas ... success [0.318s]
2018-10-12 11:20:54.808 245 INFO opnfv-tempest [-] {2} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas ... success [0.337s]
2018-10-12 11:20:55.064 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [1.219s]
2018-10-12 11:20:55.457 245 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_bootable ... success [0.766s]
2018-10-12 11:20:56.365 245 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_readonly_update ... success [0.908s]
2018-10-12 11:20:56.577 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [1.510s]
2018-10-12 11:20:58.357 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [1.780s]
2018-10-12 11:20:58.583 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.226s]
2018-10-12 11:20:58.613 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.029s]
2018-10-12 11:20:58.772 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.159s]
2018-10-12 11:20:58.933 245 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.160s]
2018-10-12 11:21:01.493 245 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port ... success [4.867s]
2018-10-12 11:21:05.771 245 INFO opnfv-tempest [-] {2} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON ... fail
2018-10-12 11:21:06.056 245 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [1.617s]
2018-10-12 11:21:06.884 245 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [0.829s]
2018-10-12 11:21:07.646 245 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [6.153s]
2018-10-12 11:21:08.140 245 INFO opnfv-tempest [-] {2} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.321s]
2018-10-12 11:21:10.543 245 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [2.895s]
2018-10-12 11:21:10.740 245 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.197s]
2018-10-12 11:21:10.817 245 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields ... success [0.075s]
2018-10-12 11:21:11.017 245 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.200s]
2018-10-12 11:21:11.212 245 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields ... success [0.194s]
2018-10-12 11:21:17.957 245 INFO opnfv-tempest [-] {3} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions ... success [0.221s]
2018-10-12 11:21:20.754 245 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete ... success [6.501s]
2018-10-12 11:21:26.626 245 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot ... success [5.871s]
2018-10-12 11:21:26.987 245 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_image_schema ... success [0.009s]
2018-10-12 11:21:27.136 245 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_images_schema ... success [0.149s]
2018-10-12 11:21:27.176 245 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_container_format ... success [0.039s]
2018-10-12 11:21:27.364 245 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_disk_format ... success [0.188s]
2018-10-12 11:21:27.398 245 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_limit ... success [0.034s]
2018-10-12 11:21:27.743 245 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_min_max_size ... success [0.343s]
2018-10-12 11:21:28.095 245 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_size ... success [0.352s]
2018-10-12 11:21:28.286 245 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_status ... success [0.189s]
2018-10-12 11:21:28.326 245 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_visibility ... success [0.039s]
2018-10-12 11:21:28.367 245 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_no_params ... success [0.041s]
2018-10-12 11:21:28.620 245 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [7.191s]
2018-10-12 11:21:36.125 245 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_upload ... success [39.753s]
2018-10-12 11:21:38.229 245 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_as_clone ... success [9.606s]
2018-10-12 11:21:42.337 245 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [0.838s]
2018-10-12 11:21:42.504 245 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.167s]
2018-10-12 11:21:48.049 245 INFO opnfv-tempest [-] {2} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.982s]
2018-10-12 11:21:50.560 245 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_details_with_params ... success [0.224s]
2018-10-12 11:21:50.770 245 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_with_params ... success [0.210s]
2018-10-12 11:21:52.415 245 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [14.181s]
2018-10-12 11:21:57.105 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [1.241s]
2018-10-12 11:21:57.818 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [0.712s]
2018-10-12 11:22:03.009 245 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_with_nonexistent_volume_id ... success [0.170s]
2018-10-12 11:22:03.202 245 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_without_passing_volume_id ... success [0.192s]
2018-10-12 11:22:10.818 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.038s]
2018-10-12 11:22:10.860 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name ... success [0.042s]
2018-10-12 11:22:10.917 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name ... success [0.056s]
2018-10-12 11:22:11.522 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination ... success [0.603s]
2018-10-12 11:22:11.754 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params ... success [0.231s]
2018-10-12 11:22:12.212 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination ... success [0.458s]
2018-10-12 11:22:12.258 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status ... success [0.046s]
2018-10-12 11:22:12.454 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status ... success [0.196s]
2018-10-12 11:22:12.506 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata ... success [0.051s]
2018-10-12 11:22:12.559 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details ... success [0.053s]
2018-10-12 11:22:12.602 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata ... success [0.043s]
2018-10-12 11:22:12.678 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone ... success [0.074s]
2018-10-12 11:22:12.909 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status ... success [0.230s]
2018-10-12 11:22:12.958 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone ... success [0.048s]
2018-10-12 11:22:13.155 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status ... success [0.197s]
2018-10-12 11:22:19.898 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size ... success [0.169s]
2018-10-12 11:22:20.072 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id ... success [0.173s]
2018-10-12 11:22:20.254 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid ... success [0.182s]
2018-10-12 11:22:20.405 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type ... success [0.151s]
2018-10-12 11:22:20.567 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative ... success [0.161s]
2018-10-12 11:22:20.729 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero ... success [0.161s]
2018-10-12 11:22:20.803 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size ... success [0.074s]
2018-10-12 11:22:20.976 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id ... success [0.172s]
2018-10-12 11:22:20.986 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id ... success [0.009s]
2018-10-12 11:22:21.017 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id ... success [0.031s]
2018-10-12 11:22:21.171 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id ... success [0.153s]
2018-10-12 11:22:21.217 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status ... success [0.045s]
2018-10-12 11:22:21.409 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name ... success [0.191s]
2018-10-12 11:22:21.445 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status ... success [0.036s]
2018-10-12 11:22:21.481 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name ... success [0.035s]
2018-10-12 11:22:21.492 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id ... success [0.009s]
2018-10-12 11:22:21.526 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id ... success [0.034s]
2018-10-12 11:22:21.558 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id ... success [0.031s]
2018-10-12 11:22:21.592 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id ... success [0.033s]
2018-10-12 11:22:21.771 245 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id ... success [0.179s]
2018-10-12 11:22:24.978 245 INFO rally.task.context [-] Verification 8d262b5e-249e-4812-9dbd-79aa64d3dc7c | Context testr@default cleanup() started
2018-10-12 11:22:24.979 245 INFO rally.task.context [-] Verification 8d262b5e-249e-4812-9dbd-79aa64d3dc7c | Context testr@default cleanup() finished in 0.44 msec
2018-10-12 11:22:24.979 245 INFO rally.task.context [-] Verification 8d262b5e-249e-4812-9dbd-79aa64d3dc7c | Context tempest@default cleanup() started
2018-10-12 11:22:25.827 245 INFO rally.task.context [-] Verification 8d262b5e-249e-4812-9dbd-79aa64d3dc7c | Context tempest@default cleanup() finished in 0.85 sec
2018-10-12 11:22:25.916 245 INFO rally.api [-] Verification (UUID=2707fb12-4450-4ce0-ba14-d0c73099f0c7) has been successfully finished for deployment 'opnfv-rally' (UUID=2da3a86f-8bbe-4b32-923d-dfe70c9dbc19)!

======
Totals
======

Ran: 200 tests in 208.685 sec.
 - Success: 184
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 16

Using verification (UUID=2707fb12-4450-4ce0-ba14-d0c73099f0c7) as the default verification for the future operations.