2018-10-06 16:11:20.582 10938 INFO rally.api [-] Starting verification (UUID=368b1865-07f9-49a0-9678-eb8c779a119d) for deployment 'opnfv-rally' (UUID=7a639e70-ac39-41ff-a43b-6f79b6219abe) by verifier 'opnfv-tempest' (UUID=bc09daf4-15f7-4d9d-bf8d-024a56df078d).
2018-10-06 16:11:21.070 10938 INFO rally.task.context [-] Verification bc09daf4-15f7-4d9d-bf8d-024a56df078d | Context tempest@default setup()  started
2018-10-06 16:11:21.314 10938 WARNING oslo_config.cfg [-] Option "swift_operator_role" from group "tempest" is deprecated. Use option "swift_operator_role" from group "openstack".
2018-10-06 16:11:22.309 10938 INFO rally.task.context [-] Verification bc09daf4-15f7-4d9d-bf8d-024a56df078d | Context tempest@default setup()  finished in 1.24 sec
2018-10-06 16:11:22.309 10938 INFO rally.task.context [-] Verification bc09daf4-15f7-4d9d-bf8d-024a56df078d | Context testr@default setup()  started
2018-10-06 16:11:22.312 10938 INFO rally.task.context [-] Verification bc09daf4-15f7-4d9d-bf8d-024a56df078d | Context testr@default setup()  finished in 3.12 msec
2018-10-06 16:11:27.315 10938 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.209s]
2018-10-06 16:11:27.376 10938 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.062s]
2018-10-06 16:11:29.844 10938 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password ... success [2.856s]
2018-10-06 16:11:31.606 10938 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.348s]
2018-10-06 16:11:40.928 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server ... success [13.812s]
2018-10-06 16:11:45.512 10938 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair ... success [15.662s]
2018-10-06 16:11:49.536 10938 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date ... success [0.060s]
2018-10-06 16:11:49.547 10938 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date ... success [0.011s]
2018-10-06 16:11:49.672 10938 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count ... success [0.125s]
2018-10-06 16:11:49.684 10938 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value ... success [0.011s]
2018-10-06 16:11:49.695 10938 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string ... success [0.011s]
2018-10-06 16:11:49.725 10938 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor ... success [0.029s]
2018-10-06 16:11:49.792 10938 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image ... success [0.067s]
2018-10-06 16:11:49.856 10938 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name ... success [0.063s]
2018-10-06 16:11:50.282 10938 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted ... success [0.426s]
2018-10-06 16:11:50.296 10938 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing ... success [0.014s]
2018-10-06 16:11:50.363 10938 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server ... success [0.067s]
2018-10-06 16:11:52.151 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action ... success [0.054s]
2018-10-06 16:11:54.222 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions ... success [2.070s]
2018-10-06 16:11:57.701 10938 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.012s]
2018-10-06 16:12:01.252 10938 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.079s]
2018-10-06 16:12:01.324 10938 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.072s]
2018-10-06 16:12:01.394 10938 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.070s]
2018-10-06 16:12:05.706 10938 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.222s]
2018-10-06 16:12:05.857 10938 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.150s]
2018-10-06 16:12:06.820 10938 INFO opnfv-tempest [-] {1} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image ... success [29.058s]
2018-10-06 16:12:06.829 10938 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name ... success [21.313s]
2018-10-06 16:12:06.940 10938 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [1.083s]
2018-10-06 16:12:06.947 10938 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.007s]
2018-10-06 16:12:07.127 10938 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.179s]
2018-10-06 16:12:08.411 10938 INFO opnfv-tempest [-] {1} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name ... success [1.599s]
2018-10-06 16:12:18.339 10938 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address ... success [11.513s]
2018-10-06 16:12:20.917 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [6.738s]
2018-10-06 16:12:22.124 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor ... success [0.626s]
2018-10-06 16:12:23.047 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image ... success [0.921s]
2018-10-06 16:12:23.731 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name ... success [0.684s]
2018-10-06 16:12:24.057 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status ... success [0.325s]
2018-10-06 16:12:24.708 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results ... success [0.651s]
2018-10-06 16:12:24.775 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_active_status ... success [0.067s]
2018-10-06 16:12:24.849 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor ... success [0.073s]
2018-10-06 16:12:24.915 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image ... success [0.066s]
2018-10-06 16:12:24.978 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit ... success [0.062s]
2018-10-06 16:12:25.051 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name ... success [0.072s]
2018-10-06 16:12:25.193 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard ... success [0.142s]
2018-10-06 16:12:25.379 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [4.461s]
2018-10-06 16:12:31.440 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [6.060s]
2018-10-06 16:12:35.771 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [4.330s]
2018-10-06 16:12:40.571 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [4.800s]
2018-10-06 16:12:43.995 10938 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON ... fail
2018-10-06 16:12:45.179 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [4.607s]
2018-10-06 16:12:49.197 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [4.018s]
2018-10-06 16:12:56.611 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [7.414s]
2018-10-06 16:13:00.368 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON ... fail
2018-10-06 16:13:01.001 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [4.388s]
2018-10-06 16:13:01.161 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.159s]
2018-10-06 16:13:01.430 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.269s]
2018-10-06 16:13:01.484 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.053s]
2018-10-06 16:13:01.568 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.084s]
2018-10-06 16:13:01.695 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.126s]
2018-10-06 16:13:01.798 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.102s]
2018-10-06 16:13:01.848 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.050s]
2018-10-06 16:13:01.910 10938 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestManualDisk ... fail
2018-10-06 16:13:02.115 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.266s]
2018-10-06 16:13:09.393 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [7.277s]
2018-10-06 16:13:11.111 10938 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.380s]
2018-10-06 16:13:11.367 10938 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.256s]
2018-10-06 16:13:11.607 10938 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [0.240s]
2018-10-06 16:13:12.015 10938 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [0.406s]
2018-10-06 16:13:12.433 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name ... success [1.082s]
2018-10-06 16:13:12.489 10938 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [0.474s]
2018-10-06 16:13:12.891 10938 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [0.401s]
2018-10-06 16:13:13.320 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit ... success [0.886s]
2018-10-06 16:13:14.200 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 ... success [0.880s]
2018-10-06 16:13:15.225 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor ... success [1.023s]
2018-10-06 16:13:16.096 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image ... success [0.871s]
2018-10-06 16:13:16.793 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.158s]
2018-10-06 16:13:17.128 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid ... success [1.031s]
2018-10-06 16:13:17.486 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit ... success [0.357s]
2018-10-06 16:13:18.161 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id ... success [0.674s]
2018-10-06 16:13:18.520 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [1.725s]
2018-10-06 16:13:18.525 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server ... success [0.362s]
2018-10-06 16:13:19.393 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [0.873s]
2018-10-06 16:13:19.541 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address ... success [1.015s]
2018-10-06 16:13:19.771 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server ... success [0.230s]
2018-10-06 16:13:19.821 10938 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.742s]
2018-10-06 16:13:20.311 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_deleted_server ... success [0.539s]
2018-10-06 16:13:20.635 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [1.242s]
2018-10-06 16:13:20.695 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server ... success [0.384s]
2018-10-06 16:13:21.587 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank ... success [0.890s]
2018-10-06 16:13:21.745 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [1.108s]
2018-10-06 16:13:21.749 10938 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [1.927s]
2018-10-06 16:13:21.982 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server ... success [0.394s]
2018-10-06 16:13:22.664 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server ... success [0.682s]
2018-10-06 16:13:23.033 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 ... success [0.368s]
2018-10-06 16:13:23.205 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [1.460s]
2018-10-06 16:13:23.406 10938 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name ... success [0.373s]
2018-10-06 16:13:24.198 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [0.992s]
2018-10-06 16:13:24.317 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.119s]
2018-10-06 16:13:24.339 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.022s]
2018-10-06 16:13:24.504 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.163s]
2018-10-06 16:13:24.681 10938 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.178s]
2018-10-06 16:13:24.975 10938 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name ... success [66.621s]
2018-10-06 16:13:29.073 10938 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.651s]
2018-10-06 16:13:29.356 10938 INFO opnfv-tempest [-] {2} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas ... success [0.323s]
2018-10-06 16:13:29.675 10938 INFO opnfv-tempest [-] {2} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas ... success [0.319s]
2018-10-06 16:13:31.128 10938 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [2.055s]
2018-10-06 16:13:31.205 10938 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [1.519s]
2018-10-06 16:13:31.360 10938 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image ... success [1.760s]
2018-10-06 16:13:31.960 10938 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [0.754s]
2018-10-06 16:13:35.208 10938 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [4.076s]
2018-10-06 16:13:36.528 10938 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [1.322s]
2018-10-06 16:13:38.680 10938 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [2.151s]
2018-10-06 16:13:39.863 10938 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [1.182s]
2018-10-06 16:13:41.654 10938 INFO opnfv-tempest [-] {2} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume ... fail [2.886s]
2018-10-06 16:13:41.692 10938 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port ... success [3.723s]
2018-10-06 16:13:41.857 10938 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.991s]
2018-10-06 16:13:42.043 10938 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.189s]
2018-10-06 16:13:43.941 10938 INFO opnfv-tempest [-] {2} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_list_get_volume_attachments ... fail [2.284s]
2018-10-06 16:13:44.926 10938 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete ... success [5.138s]
2018-10-06 16:13:45.339 10938 INFO opnfv-tempest [-] {1} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON.test_get_availability_zone_list ... success [0.158s]
2018-10-06 16:13:47.455 10938 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [5.762s]
2018-10-06 16:13:49.814 10938 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [2.357s]
2018-10-06 16:13:49.874 10938 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.061s]
2018-10-06 16:13:50.072 10938 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields ... success [0.197s]
2018-10-06 16:13:50.288 10938 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.216s]
2018-10-06 16:13:50.481 10938 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields ... success [0.193s]
2018-10-06 16:13:50.880 10938 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot ... success [5.953s]
2018-10-06 16:13:51.680 10938 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_bootable ... success [0.849s]
2018-10-06 16:13:52.234 10938 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_readonly_update ... success [0.553s]
2018-10-06 16:13:53.050 10938 INFO opnfv-tempest [-] {2} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.310s]
2018-10-06 16:13:56.500 10938 INFO opnfv-tempest [-] {3} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions ... success [0.156s]
2018-10-06 16:14:08.104 10938 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [7.900s]
2018-10-06 16:14:11.550 10938 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_image_schema ... success [0.011s]
2018-10-06 16:14:11.724 10938 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_images_schema ... success [0.173s]
2018-10-06 16:14:11.905 10938 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_container_format ... success [0.180s]
2018-10-06 16:14:12.081 10938 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_disk_format ... success [0.177s]
2018-10-06 16:14:12.115 10938 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_limit ... success [0.033s]
2018-10-06 16:14:12.476 10938 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_min_max_size ... success [0.359s]
2018-10-06 16:14:12.825 10938 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_size ... success [0.349s]
2018-10-06 16:14:12.868 10938 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_status ... success [0.043s]
2018-10-06 16:14:13.052 10938 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_visibility ... success [0.183s]
2018-10-06 16:14:13.097 10938 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_no_params ... success [0.045s]
2018-10-06 16:14:19.806 10938 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_as_clone ... success [11.698s]
2018-10-06 16:14:30.468 10938 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [0.980s]
2018-10-06 16:14:30.651 10938 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.183s]
2018-10-06 16:14:34.405 10938 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_upload ... success [42.163s]
2018-10-06 16:14:34.519 10938 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [14.712s]
2018-10-06 16:14:35.901 10938 INFO opnfv-tempest [-] {2} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.431s]
2018-10-06 16:14:45.641 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [1.395s]
2018-10-06 16:14:46.640 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [0.999s]
2018-10-06 16:14:46.934 10938 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_details_with_params ... success [0.230s]
2018-10-06 16:14:47.423 10938 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_with_params ... success [0.488s]
2018-10-06 16:14:57.771 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.189s]
2018-10-06 16:14:57.960 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name ... success [0.188s]
2018-10-06 16:14:58.009 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name ... success [0.049s]
2018-10-06 16:14:58.688 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination ... success [0.677s]
2018-10-06 16:14:58.786 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params ... success [0.097s]
2018-10-06 16:14:59.145 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination ... success [0.359s]
2018-10-06 16:14:59.195 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status ... success [0.050s]
2018-10-06 16:14:59.246 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status ... success [0.050s]
2018-10-06 16:14:59.435 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata ... success [0.188s]
2018-10-06 16:14:59.485 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details ... success [0.050s]
2018-10-06 16:14:59.670 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata ... success [0.184s]
2018-10-06 16:14:59.749 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone ... success [0.078s]
2018-10-06 16:14:59.899 10938 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_with_nonexistent_volume_id ... success [0.178s]
2018-10-06 16:14:59.973 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status ... success [0.222s]
2018-10-06 16:15:00.023 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone ... success [0.051s]
2018-10-06 16:15:00.079 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status ... success [0.055s]
2018-10-06 16:15:00.101 10938 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_without_passing_volume_id ... success [0.202s]
2018-10-06 16:15:07.488 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size ... success [0.173s]
2018-10-06 16:15:07.663 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id ... success [0.174s]
2018-10-06 16:15:07.845 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid ... success [0.181s]
2018-10-06 16:15:07.997 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type ... success [0.152s]
2018-10-06 16:15:08.158 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative ... success [0.160s]
2018-10-06 16:15:08.327 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero ... success [0.169s]
2018-10-06 16:15:08.371 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size ... success [0.043s]
2018-10-06 16:15:08.541 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id ... success [0.170s]
2018-10-06 16:15:08.699 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id ... success [0.157s]
2018-10-06 16:15:08.733 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id ... success [0.033s]
2018-10-06 16:15:08.742 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id ... success [0.009s]
2018-10-06 16:15:08.786 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status ... success [0.043s]
2018-10-06 16:15:08.832 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name ... success [0.045s]
2018-10-06 16:15:09.014 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status ... success [0.181s]
2018-10-06 16:15:09.199 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name ... success [0.185s]
2018-10-06 16:15:09.209 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id ... success [0.009s]
2018-10-06 16:15:09.399 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id ... success [0.189s]
2018-10-06 16:15:09.589 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id ... success [0.189s]
2018-10-06 16:15:09.622 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id ... success [0.032s]
2018-10-06 16:15:09.653 10938 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id ... success [0.031s]
2018-10-06 16:15:13.233 10938 INFO rally.task.context [-] Verification bc09daf4-15f7-4d9d-bf8d-024a56df078d | Context testr@default cleanup() started
2018-10-06 16:15:13.234 10938 INFO rally.task.context [-] Verification bc09daf4-15f7-4d9d-bf8d-024a56df078d | Context testr@default cleanup() finished in 0.65 msec
2018-10-06 16:15:13.234 10938 INFO rally.task.context [-] Verification bc09daf4-15f7-4d9d-bf8d-024a56df078d | Context tempest@default cleanup() started
2018-10-06 16:15:14.511 10938 INFO rally.task.context [-] Verification bc09daf4-15f7-4d9d-bf8d-024a56df078d | Context tempest@default cleanup() finished in 1.28 sec
2018-10-06 16:15:14.597 10938 INFO rally.api [-] Verification (UUID=368b1865-07f9-49a0-9678-eb8c779a119d) has been successfully finished for deployment 'opnfv-rally' (UUID=7a639e70-ac39-41ff-a43b-6f79b6219abe)!

======
Totals
======

Ran: 200 tests in 224.510 sec.
 - Success: 184
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 16

Using verification (UUID=368b1865-07f9-49a0-9678-eb8c779a119d) as the default verification for the future operations.