2018-11-18 16:51:58.422 10935 INFO rally.api [-] Starting verification (UUID=69ea0dee-a065-42b9-86f1-0a5e8371a3e3) for deployment 'opnfv-rally' (UUID=ee3b4e50-35eb-41b2-af7f-aed2bb642327) by verifier 'opnfv-tempest' (UUID=9e82dbb0-07a5-4014-957b-81162d0e6e01).
2018-11-18 16:51:58.946 10935 INFO rally.task.context [-] Verification 9e82dbb0-07a5-4014-957b-81162d0e6e01 | Context tempest@default setup()  started
2018-11-18 16:51:59.208 10935 WARNING oslo_config.cfg [-] Option "swift_operator_role" from group "tempest" is deprecated. Use option "swift_operator_role" from group "openstack".
2018-11-18 16:51:59.879 10935 INFO rally.task.context [-] Verification 9e82dbb0-07a5-4014-957b-81162d0e6e01 | Context tempest@default setup()  finished in 0.93 sec
2018-11-18 16:51:59.879 10935 INFO rally.task.context [-] Verification 9e82dbb0-07a5-4014-957b-81162d0e6e01 | Context testr@default setup()  started
2018-11-18 16:51:59.882 10935 INFO rally.task.context [-] Verification 9e82dbb0-07a5-4014-957b-81162d0e6e01 | Context testr@default setup()  finished in 2.94 msec
2018-11-18 16:52:04.971 10935 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.205s]
2018-11-18 16:52:05.028 10935 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.057s]
2018-11-18 16:52:06.899 10935 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password ... success [2.090s]
2018-11-18 16:52:09.670 10935 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.415s]
2018-11-18 16:52:17.916 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server ... success [13.220s]
2018-11-18 16:52:26.039 10935 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair ... success [19.135s]
2018-11-18 16:52:29.907 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action ... success [0.061s]
2018-11-18 16:52:31.275 10935 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date ... success [0.069s]
2018-11-18 16:52:31.286 10935 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date ... success [0.011s]
2018-11-18 16:52:31.423 10935 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count ... success [0.137s]
2018-11-18 16:52:31.438 10935 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value ... success [0.014s]
2018-11-18 16:52:31.449 10935 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string ... success [0.011s]
2018-11-18 16:52:31.480 10935 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor ... success [0.030s]
2018-11-18 16:52:31.544 10935 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image ... success [0.064s]
2018-11-18 16:52:31.603 10935 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name ... success [0.058s]
2018-11-18 16:52:31.747 10935 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted ... success [0.144s]
2018-11-18 16:52:31.763 10935 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing ... success [0.014s]
2018-11-18 16:52:31.832 10935 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server ... success [0.069s]
2018-11-18 16:52:32.264 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions ... success [2.356s]
2018-11-18 16:52:38.661 10935 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.012s]
2018-11-18 16:52:42.133 10935 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.081s]
2018-11-18 16:52:42.225 10935 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.091s]
2018-11-18 16:52:42.303 10935 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.078s]
2018-11-18 16:52:42.363 10935 INFO opnfv-tempest [-] {1} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image ... success [29.144s]
2018-11-18 16:52:43.305 10935 INFO opnfv-tempest [-] {1} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name ... success [0.948s]
2018-11-18 16:52:43.923 10935 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name ... success [17.880s]
2018-11-18 16:52:46.545 10935 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.148s]
2018-11-18 16:52:46.705 10935 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.159s]
2018-11-18 16:52:48.125 10935 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [1.418s]
2018-11-18 16:52:48.781 10935 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.656s]
2018-11-18 16:52:48.936 10935 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.155s]
2018-11-18 16:52:58.509 10935 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address ... success [14.585s]
2018-11-18 16:52:58.930 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor ... success [0.882s]
2018-11-18 16:52:59.788 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image ... success [0.857s]
2018-11-18 16:53:00.281 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name ... success [0.492s]
2018-11-18 16:53:00.515 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [4.357s]
2018-11-18 16:53:00.885 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status ... success [0.603s]
2018-11-18 16:53:01.120 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results ... success [0.234s]
2018-11-18 16:53:01.189 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_active_status ... success [0.068s]
2018-11-18 16:53:01.267 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor ... success [0.077s]
2018-11-18 16:53:01.359 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image ... success [0.091s]
2018-11-18 16:53:01.432 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit ... success [0.073s]
2018-11-18 16:53:01.507 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name ... success [0.074s]
2018-11-18 16:53:01.644 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard ... success [0.137s]
2018-11-18 16:53:08.542 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [8.026s]
2018-11-18 16:53:10.224 10935 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON ... fail
2018-11-18 16:53:12.641 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [4.098s]
2018-11-18 16:53:17.230 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [4.588s]
2018-11-18 16:53:20.975 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [3.744s]
2018-11-18 16:53:24.253 10935 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestManualDisk ... fail
2018-11-18 16:53:24.991 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [4.015s]
2018-11-18 16:53:28.428 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON ... fail
2018-11-18 16:53:28.884 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [3.893s]
2018-11-18 16:53:33.507 10935 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.942s]
2018-11-18 16:53:33.770 10935 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.263s]
2018-11-18 16:53:34.002 10935 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [0.231s]
2018-11-18 16:53:34.654 10935 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [0.651s]
2018-11-18 16:53:35.164 10935 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [0.509s]
2018-11-18 16:53:35.588 10935 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [0.424s]
2018-11-18 16:53:36.461 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [7.576s]
2018-11-18 16:53:39.920 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [3.458s]
2018-11-18 16:53:40.163 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.243s]
2018-11-18 16:53:40.307 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.144s]
2018-11-18 16:53:40.532 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.224s]
2018-11-18 16:53:40.722 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.189s]
2018-11-18 16:53:40.861 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name ... success [1.514s]
2018-11-18 16:53:40.968 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.246s]
2018-11-18 16:53:41.068 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.099s]
2018-11-18 16:53:41.140 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.071s]
2018-11-18 16:53:41.194 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.054s]
2018-11-18 16:53:41.467 10935 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.818s]
2018-11-18 16:53:42.070 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit ... success [1.208s]
2018-11-18 16:53:42.964 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 ... success [0.893s]
2018-11-18 16:53:43.986 10935 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [2.519s]
2018-11-18 16:53:44.457 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor ... success [1.492s]
2018-11-18 16:53:45.763 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [4.567s]
2018-11-18 16:53:46.175 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image ... success [1.716s]
2018-11-18 16:53:47.552 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid ... success [1.375s]
2018-11-18 16:53:47.928 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit ... success [0.375s]
2018-11-18 16:53:48.436 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id ... success [0.507s]
2018-11-18 16:53:48.999 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server ... success [0.562s]
2018-11-18 16:53:49.857 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address ... success [0.855s]
2018-11-18 16:53:50.855 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server ... success [0.998s]
2018-11-18 16:53:51.524 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_deleted_server ... success [0.667s]
2018-11-18 16:53:51.916 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server ... success [0.391s]
2018-11-18 16:53:52.323 10935 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [2.090s]
2018-11-18 16:53:52.664 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank ... success [0.746s]
2018-11-18 16:53:53.320 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server ... success [0.655s]
2018-11-18 16:53:53.750 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.164s]
2018-11-18 16:53:53.838 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server ... success [0.517s]
2018-11-18 16:53:54.307 10935 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [1.984s]
2018-11-18 16:53:54.443 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 ... success [0.605s]
2018-11-18 16:53:54.674 10935 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name ... success [0.231s]
2018-11-18 16:53:55.869 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [2.116s]
2018-11-18 16:53:57.255 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [1.386s]
2018-11-18 16:53:58.405 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [1.150s]
2018-11-18 16:53:58.768 10935 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [4.455s]
2018-11-18 16:53:59.620 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [1.214s]
2018-11-18 16:53:59.806 10935 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [1.042s]
2018-11-18 16:54:00.756 10935 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name ... success [62.232s]
2018-11-18 16:54:02.059 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [2.436s]
2018-11-18 16:54:02.385 10935 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [2.576s]
2018-11-18 16:54:03.263 10935 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image ... success [1.962s]
2018-11-18 16:54:03.315 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [1.257s]
2018-11-18 16:54:03.572 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.256s]
2018-11-18 16:54:03.598 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.026s]
2018-11-18 16:54:03.752 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.154s]
2018-11-18 16:54:03.770 10935 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.018s]
2018-11-18 16:54:04.186 10935 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [1.802s]
2018-11-18 16:54:05.273 10935 INFO opnfv-tempest [-] {2} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas ... success [0.338s]
2018-11-18 16:54:05.622 10935 INFO opnfv-tempest [-] {2} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas ... success [0.349s]
2018-11-18 16:54:06.508 10935 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [2.320s]
2018-11-18 16:54:06.625 10935 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.119s]
2018-11-18 16:54:10.514 10935 INFO opnfv-tempest [-] {1} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON.test_get_availability_zone_list ... success [0.158s]
2018-11-18 16:54:11.013 10935 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [2.074s]
2018-11-18 16:54:12.173 10935 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [1.159s]
2018-11-18 16:54:13.328 10935 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port ... success [3.654s]
2018-11-18 16:54:17.165 10935 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_bootable ... success [0.891s]
2018-11-18 16:54:17.394 10935 INFO opnfv-tempest [-] {2} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON ... fail
2018-11-18 16:54:18.159 10935 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_readonly_update ... success [0.993s]
2018-11-18 16:54:19.243 10935 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [5.914s]
2018-11-18 16:54:19.664 10935 INFO opnfv-tempest [-] {2} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.318s]
2018-11-18 16:54:21.901 10935 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [2.656s]
2018-11-18 16:54:22.097 10935 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.197s]
2018-11-18 16:54:22.290 10935 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields ... success [0.193s]
2018-11-18 16:54:22.491 10935 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.200s]
2018-11-18 16:54:22.534 10935 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields ... success [0.042s]
2018-11-18 16:54:26.421 10935 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete ... success [6.461s]
2018-11-18 16:54:30.387 10935 INFO opnfv-tempest [-] {3} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions ... success [0.155s]
2018-11-18 16:54:34.325 10935 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot ... success [7.901s]
2018-11-18 16:54:37.202 10935 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_image_schema ... success [0.008s]
2018-11-18 16:54:37.354 10935 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_images_schema ... success [0.152s]
2018-11-18 16:54:37.544 10935 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_container_format ... success [0.189s]
2018-11-18 16:54:37.722 10935 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_disk_format ... success [0.178s]
2018-11-18 16:54:37.754 10935 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_limit ... success [0.031s]
2018-11-18 16:54:37.951 10935 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_min_max_size ... success [0.196s]
2018-11-18 16:54:37.996 10935 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_size ... success [0.045s]
2018-11-18 16:54:38.041 10935 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_status ... success [0.044s]
2018-11-18 16:54:38.230 10935 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_visibility ... success [0.188s]
2018-11-18 16:54:38.422 10935 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_no_params ... success [0.191s]
2018-11-18 16:54:42.991 10935 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [8.081s]
2018-11-18 16:54:55.460 10935 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_as_clone ... success [12.464s]
2018-11-18 16:54:57.436 10935 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [0.653s]
2018-11-18 16:54:57.595 10935 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.159s]
2018-11-18 16:55:00.345 10935 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_upload ... success [42.176s]
2018-11-18 16:55:03.162 10935 INFO opnfv-tempest [-] {2} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.248s]
2018-11-18 16:55:07.974 10935 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [12.513s]
2018-11-18 16:55:11.305 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [1.266s]
2018-11-18 16:55:11.988 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [0.681s]
2018-11-18 16:55:14.299 10935 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_details_with_params ... success [0.363s]
2018-11-18 16:55:14.655 10935 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_with_params ... success [0.354s]
2018-11-18 16:55:24.162 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.279s]
2018-11-18 16:55:24.201 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name ... success [0.039s]
2018-11-18 16:55:24.251 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name ... success [0.049s]
2018-11-18 16:55:24.460 10935 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_with_nonexistent_volume_id ... success [0.178s]
2018-11-18 16:55:24.805 10935 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_without_passing_volume_id ... success [0.343s]
2018-11-18 16:55:24.936 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination ... success [0.684s]
2018-11-18 16:55:25.032 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params ... success [0.095s]
2018-11-18 16:55:25.381 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination ... success [0.348s]
2018-11-18 16:55:25.416 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status ... success [0.036s]
2018-11-18 16:55:25.471 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status ... success [0.055s]
2018-11-18 16:55:25.668 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata ... success [0.196s]
2018-11-18 16:55:25.718 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details ... success [0.049s]
2018-11-18 16:55:25.901 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata ... success [0.183s]
2018-11-18 16:55:26.127 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone ... success [0.225s]
2018-11-18 16:55:26.204 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status ... success [0.077s]
2018-11-18 16:55:26.252 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone ... success [0.047s]
2018-11-18 16:55:26.302 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status ... success [0.050s]
2018-11-18 16:55:33.771 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size ... success [0.174s]
2018-11-18 16:55:33.933 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id ... success [0.161s]
2018-11-18 16:55:34.194 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid ... success [0.261s]
2018-11-18 16:55:34.213 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type ... success [0.019s]
2018-11-18 16:55:34.369 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative ... success [0.156s]
2018-11-18 16:55:34.388 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero ... success [0.018s]
2018-11-18 16:55:34.430 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size ... success [0.041s]
2018-11-18 16:55:34.600 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id ... success [0.169s]
2018-11-18 16:55:34.610 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id ... success [0.009s]
2018-11-18 16:55:34.801 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id ... success [0.190s]
2018-11-18 16:55:34.957 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id ... success [0.155s]
2018-11-18 16:55:35.138 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status ... success [0.182s]
2018-11-18 16:55:35.183 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name ... success [0.044s]
2018-11-18 16:55:35.375 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status ... success [0.191s]
2018-11-18 16:55:35.567 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name ... success [0.191s]
2018-11-18 16:55:35.576 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id ... success [0.009s]
2018-11-18 16:55:35.607 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id ... success [0.031s]
2018-11-18 16:55:35.642 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id ... success [0.034s]
2018-11-18 16:55:35.675 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id ... success [0.032s]
2018-11-18 16:55:35.849 10935 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id ... success [0.174s]
2018-11-18 16:55:39.142 10935 INFO rally.task.context [-] Verification 9e82dbb0-07a5-4014-957b-81162d0e6e01 | Context testr@default cleanup() started
2018-11-18 16:55:39.143 10935 INFO rally.task.context [-] Verification 9e82dbb0-07a5-4014-957b-81162d0e6e01 | Context testr@default cleanup() finished in 0.60 msec
2018-11-18 16:55:39.143 10935 INFO rally.task.context [-] Verification 9e82dbb0-07a5-4014-957b-81162d0e6e01 | Context tempest@default cleanup() started
2018-11-18 16:55:40.049 10935 INFO rally.task.context [-] Verification 9e82dbb0-07a5-4014-957b-81162d0e6e01 | Context tempest@default cleanup() finished in 0.91 sec
2018-11-18 16:55:40.133 10935 INFO rally.api [-] Verification (UUID=69ea0dee-a065-42b9-86f1-0a5e8371a3e3) has been successfully finished for deployment 'opnfv-rally' (UUID=ee3b4e50-35eb-41b2-af7f-aed2bb642327)!

======
Totals
======

Ran: 200 tests in 212.915 sec.
 - Success: 184
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 16

Using verification (UUID=69ea0dee-a065-42b9-86f1-0a5e8371a3e3) as the default verification for the future operations.