2018-09-02 08:29:29.008 11183 INFO rally.api [-] Starting verification (UUID=33fcec28-0f29-4c5e-9818-5c96674ef74a) for deployment 'opnfv-rally' (UUID=579908da-ac1a-47d2-88e5-05893374e0f3) by verifier 'opnfv-tempest' (UUID=5fa87fbe-4582-435b-8264-0cfdf33664a8).
2018-09-02 08:29:29.849 11183 WARNING oslo_config.cfg [-] Option "swift_operator_role" from group "tempest" is deprecated. Use option "swift_operator_role" from group "openstack".
2018-09-02 08:29:29.964 11183 WARNING oslo_config.cfg [-] Option "img_name_regex" from group "tempest" is deprecated. Use option "img_name_regex" from group "openstack".
2018-09-02 08:29:32.347 11183 INFO rally.task.context [-] Verification 5fa87fbe-4582-435b-8264-0cfdf33664a8 | Context tempest@default setup()  finished in 2.83 sec
2018-09-02 08:29:32.351 11183 INFO rally.task.context [-] Verification 5fa87fbe-4582-435b-8264-0cfdf33664a8 | Context testr@default setup()  finished in 2.86 msec
2018-09-02 08:29:37.836 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.335s]
2018-09-02 08:29:38.280 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.750s]
2018-09-02 08:29:38.327 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.047s]
2018-09-02 08:30:07.645 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server ... success [25.423s]
2018-09-02 08:30:14.366 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor ... success [1.475s]
2018-09-02 08:30:15.357 11183 INFO opnfv-tempest [-] {0} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image ... success [18.864s]
2018-09-02 08:30:15.655 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image ... success [1.288s]
2018-09-02 08:30:16.705 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name ... success [1.050s]
2018-09-02 08:30:17.285 11183 INFO opnfv-tempest [-] {0} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name ... success [1.933s]
2018-09-02 08:30:17.442 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status ... success [0.737s]
2018-09-02 08:30:17.998 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results ... success [0.555s]
2018-09-02 08:30:18.076 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_active_status ... success [0.077s]
2018-09-02 08:30:18.153 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor ... success [0.077s]
2018-09-02 08:30:18.220 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image ... success [0.066s]
2018-09-02 08:30:18.289 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit ... success [0.068s]
2018-09-02 08:30:18.395 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name ... success [0.106s]
2018-09-02 08:30:18.531 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard ... success [0.136s]
2018-09-02 08:30:23.632 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name ... success [7.127s]
2018-09-02 08:30:23.697 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.065s]
2018-09-02 08:30:24.669 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail ... success [0.972s]
2018-09-02 08:30:24.766 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus ... success [0.096s]
2018-09-02 08:30:24.767 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s]
2018-09-02 08:30:38.368 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date ... success [0.070s]
2018-09-02 08:30:38.384 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date ... success [0.016s]
2018-09-02 08:30:38.546 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count ... success [0.161s]
2018-09-02 08:30:38.560 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value ... success [0.013s]
2018-09-02 08:30:38.573 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string ... success [0.013s]
2018-09-02 08:30:38.598 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor ... success [0.025s]
2018-09-02 08:30:38.661 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image ... success [0.061s]
2018-09-02 08:30:38.723 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name ... success [0.062s]
2018-09-02 08:30:39.753 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted ... success [1.029s]
2018-09-02 08:30:39.766 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing ... success [0.014s]
2018-09-02 08:30:39.838 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server ... success [0.071s]
2018-09-02 08:30:44.938 11183 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action ... success [0.058s]
2018-09-02 08:30:48.486 11183 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.690s]
2018-09-02 08:30:48.787 11183 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.300s]
2018-09-02 08:30:49.900 11183 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [1.112s]
2018-09-02 08:30:49.907 11183 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.008s]
2018-09-02 08:30:49.921 11183 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.014s]
2018-09-02 08:30:50.028 11183 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions ... success [5.089s]
2018-09-02 08:30:50.128 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.446s]
2018-09-02 08:30:50.390 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.261s]
2018-09-02 08:30:50.635 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [0.245s]
2018-09-02 08:30:51.036 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [0.400s]
2018-09-02 08:30:51.455 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [0.419s]
2018-09-02 08:30:51.928 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [0.473s]
2018-09-02 08:30:57.015 11183 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image ... success [2.586s]
2018-09-02 08:31:09.133 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [4.658s]
2018-09-02 08:31:12.696 11183 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON ... fail
2018-09-02 08:31:16.126 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [6.994s]
2018-09-02 08:31:16.478 11183 INFO opnfv-tempest [-] {0} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas ... success [0.616s]
2018-09-02 08:31:17.150 11183 INFO opnfv-tempest [-] {0} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas ... success [0.671s]
2018-09-02 08:31:20.368 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [4.241s]
2018-09-02 08:31:21.881 11183 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.228s]
2018-09-02 08:31:22.053 11183 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.172s]
2018-09-02 08:31:22.220 11183 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.166s]
2018-09-02 08:31:25.502 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [5.133s]
2018-09-02 08:31:25.958 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name ... success [3.111s]
2018-09-02 08:31:26.027 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.068s]
2018-09-02 08:31:26.942 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail ... success [0.915s]
2018-09-02 08:31:27.106 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus ... success [0.162s]
2018-09-02 08:31:27.107 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s]
2018-09-02 08:31:30.957 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [5.454s]
2018-09-02 08:31:34.731 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [3.774s]
2018-09-02 08:31:36.426 11183 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_image_schema ... success [0.010s]
2018-09-02 08:31:36.728 11183 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_images_schema ... success [0.302s]
2018-09-02 08:31:36.772 11183 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_container_format ... success [0.043s]
2018-09-02 08:31:37.561 11183 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_disk_format ... success [0.789s]
2018-09-02 08:31:37.595 11183 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_limit ... success [0.034s]
2018-09-02 08:31:37.647 11183 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_min_max_size ... success [0.051s]
2018-09-02 08:31:37.749 11183 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_size ... success [0.102s]
2018-09-02 08:31:38.137 11183 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_status ... success [0.387s]
2018-09-02 08:31:38.175 11183 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_visibility ... success [0.037s]
2018-09-02 08:31:38.215 11183 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_no_params ... success [0.040s]
2018-09-02 08:31:38.386 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [3.655s]
2018-09-02 08:31:44.778 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [6.390s]
2018-09-02 08:31:49.801 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [5.023s]
2018-09-02 08:31:50.143 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.342s]
2018-09-02 08:31:50.243 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.100s]
2018-09-02 08:31:50.336 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.092s]
2018-09-02 08:31:50.638 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.301s]
2018-09-02 08:31:50.713 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.075s]
2018-09-02 08:31:50.815 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.101s]
2018-09-02 08:31:50.925 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.110s]
2018-09-02 08:31:51.192 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.266s]
2018-09-02 08:31:51.234 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.042s]
2018-09-02 08:31:51.693 11183 INFO opnfv-tempest [-] {0} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions ... success [0.301s]
2018-09-02 08:31:57.814 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [6.579s]
2018-09-02 08:32:01.658 11183 INFO opnfv-tempest [-] {0} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [2.124s]
2018-09-02 08:32:03.057 11183 INFO opnfv-tempest [-] {0} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [1.398s]
2018-09-02 08:32:10.912 11183 INFO opnfv-tempest [-] {0} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.012s]
2018-09-02 08:32:20.887 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume ... success [68.459s]
2018-09-02 08:32:23.944 11183 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [8.341s]
2018-09-02 08:32:33.007 11183 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_as_clone ... success [9.061s]
2018-09-02 08:32:34.578 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [24.474s]
2018-09-02 08:32:36.070 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server ... success [11.859s]
2018-09-02 08:32:44.840 11183 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [11.832s]
2018-09-02 08:32:47.488 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [11.417s]
2018-09-02 08:32:50.727 11183 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_with_nonexistent_volume_id ... success [0.305s]
2018-09-02 08:32:50.935 11183 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_without_passing_volume_id ... success [0.207s]
2018-09-02 08:32:52.156 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [17.578s]
2018-09-02 08:33:04.310 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_list_get_volume_attachments ... success [43.412s]
2018-09-02 08:33:07.455 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [15.298s]
2018-09-02 08:33:15.822 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server ... success [28.328s]
2018-09-02 08:33:21.422 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [13.967s]
2018-09-02 08:33:25.553 11183 INFO opnfv-tempest [-] {3} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.323s]
2018-09-02 08:33:31.412 11183 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [1.093s]
2018-09-02 08:33:31.440 11183 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.027s]
2018-09-02 08:33:35.367 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server ... success [19.544s]
2018-09-02 08:33:43.877 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port ... success [5.630s]
2018-09-02 08:33:50.402 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [6.525s]
2018-09-02 08:33:52.872 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [2.469s]
2018-09-02 08:33:53.258 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.386s]
2018-09-02 08:33:53.312 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields ... success [0.054s]
2018-09-02 08:34:01.081 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password ... success [4.135s]
2018-09-02 08:34:03.948 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_update_delete_extra_route ... success [42.521s]
2018-09-02 08:34:15.116 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_port_list_filter_by_router_id ... success [21.802s]
2018-09-02 08:34:15.424 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.308s]
2018-09-02 08:34:15.743 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields ... success [0.319s]
2018-09-02 08:34:16.039 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_update_router_admin_state ... success [12.094s]
2018-09-02 08:34:21.508 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair ... success [20.422s]
2018-09-02 08:34:25.011 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.483s]
2018-09-02 08:34:30.454 11183 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size ... success [0.273s]
2018-09-02 08:34:30.745 11183 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id ... success [0.290s]
2018-09-02 08:34:31.055 11183 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid ... success [0.309s]
2018-09-02 08:34:31.341 11183 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type ... success [0.285s]
2018-09-02 08:34:31.604 11183 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative ... success [0.263s]
2018-09-02 08:34:31.894 11183 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero ... success [0.289s]
2018-09-02 08:34:32.171 11183 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size ... success [0.276s]
2018-09-02 08:34:32.458 11183 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id ... success [0.286s]
2018-09-02 08:34:32.727 11183 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id ... success [0.269s]
2018-09-02 08:34:33.006 11183 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id ... success [0.278s]
2018-09-02 08:34:33.279 11183 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id ... success [0.273s]
2018-09-02 08:34:33.315 11183 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status ... success [0.035s]
2018-09-02 08:34:33.351 11183 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name ... success [0.036s]
2018-09-02 08:34:33.386 11183 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status ... success [0.034s]
2018-09-02 08:34:33.760 11183 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name ... success [0.374s]
2018-09-02 08:34:34.013 11183 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id ... success [0.252s]
2018-09-02 08:34:34.045 11183 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id ... success [0.032s]
2018-09-02 08:34:34.421 11183 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id ... success [0.375s]
2018-09-02 08:34:34.814 11183 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id ... success [0.393s]
2018-09-02 08:34:34.865 11183 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id ... success [0.051s]
2018-09-02 08:34:47.557 11183 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete ... success [5.239s]
2018-09-02 08:34:53.194 11183 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot ... success [5.636s]
2018-09-02 08:34:53.326 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name ... success [31.812s]
2018-09-02 08:34:54.310 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [2.054s]
2018-09-02 08:34:56.350 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [2.040s]
2018-09-02 08:35:00.393 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [4.039s]
2018-09-02 08:35:01.490 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [1.100s]
2018-09-02 08:35:03.939 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [2.446s]
2018-09-02 08:35:05.371 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [1.433s]
2018-09-02 08:35:06.564 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.190s]
2018-09-02 08:35:06.629 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.067s]
2018-09-02 08:35:09.337 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address ... success [16.013s]
2018-09-02 08:35:11.186 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.262s]
2018-09-02 08:35:13.234 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [2.046s]
2018-09-02 08:35:14.221 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [0.987s]
2018-09-02 08:35:15.460 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [1.239s]
2018-09-02 08:35:17.422 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [1.961s]
2018-09-02 08:35:19.813 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [2.390s]
2018-09-02 08:35:20.728 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [0.914s]
2018-09-02 08:35:21.103 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.375s]
2018-09-02 08:35:21.121 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.018s]
2018-09-02 08:35:21.137 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.016s]
2018-09-02 08:35:21.154 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.016s]
2018-09-02 08:35:29.220 11183 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [2.320s]
2018-09-02 08:35:30.717 11183 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [1.497s]
2018-09-02 08:35:39.620 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name ... success [30.274s]
2018-09-02 08:35:40.934 11183 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.671s]
2018-09-02 08:35:40.972 11183 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name ... success [0.038s]
2018-09-02 08:35:41.323 11183 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name ... success [0.351s]
2018-09-02 08:35:41.955 11183 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination ... success [0.631s]
2018-09-02 08:35:42.517 11183 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params ... success [0.562s]
2018-09-02 08:35:43.381 11183 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination ... success [0.862s]
2018-09-02 08:35:43.601 11183 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status ... success [0.221s]
2018-09-02 08:35:43.886 11183 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status ... success [0.284s]
2018-09-02 08:35:44.215 11183 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata ... success [0.329s]
2018-09-02 08:35:44.276 11183 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details ... success [0.061s]
2018-09-02 08:35:44.465 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.012s]
2018-09-02 08:35:44.598 11183 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata ... success [0.321s]
2018-09-02 08:35:45.355 11183 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone ... success [0.756s]
2018-09-02 08:35:45.735 11183 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status ... success [0.380s]
2018-09-02 08:35:45.805 11183 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone ... success [0.070s]
2018-09-02 08:35:46.129 11183 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status ... success [0.324s]
2018-09-02 08:35:50.033 11183 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [1.552s]
2018-09-02 08:35:52.402 11183 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [2.368s]
2018-09-02 08:36:14.234 11183 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_add_router_interfaces_on_overlapping_subnets_returns_400 ... success [9.914s]
2018-09-02 08:36:14.567 11183 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_delete_non_existent_router_returns_404 ... success [0.335s]
2018-09-02 08:36:15.472 11183 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_add_gateway_invalid_network_returns_404 ... success [0.904s]
2018-09-02 08:36:17.779 11183 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_add_gateway_net_not_external_returns_400 ... success [2.307s]
2018-09-02 08:36:23.610 11183 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_remove_interface_in_use_returns_409 ... success [5.830s]
2018-09-02 08:36:23.663 11183 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_show_non_existent_router_returns_404 ... success [0.053s]
2018-09-02 08:36:24.037 11183 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_update_non_existent_router_returns_404 ... success [0.374s]
2018-09-02 08:36:47.072 11183 INFO opnfv-tempest [-] {2} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.007s]
2018-09-02 08:36:51.823 11183 INFO opnfv-tempest [-] {2} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON.test_get_availability_zone_list ... success [0.268s]
2018-09-02 08:36:58.199 11183 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_bootable ... success [1.348s]
2018-09-02 08:36:59.577 11183 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_readonly_update ... success [1.377s]
2018-09-02 08:37:20.243 11183 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_upload ... success [20.662s]
2018-09-02 08:37:35.215 11183 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_details_with_params ... success [1.572s]
2018-09-02 08:37:35.943 11183 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_with_params ... success [0.727s]
2018-09-02 08:37:46.729 11183 INFO rally.task.context [-] Verification 5fa87fbe-4582-435b-8264-0cfdf33664a8 | Context testr@default cleanup() started
2018-09-02 08:37:46.730 11183 INFO rally.task.context [-] Verification 5fa87fbe-4582-435b-8264-0cfdf33664a8 | Context testr@default cleanup() finished in 0.91 msec
2018-09-02 08:37:46.731 11183 INFO rally.task.context [-] Verification 5fa87fbe-4582-435b-8264-0cfdf33664a8 | Context tempest@default cleanup() started
2018-09-02 08:37:47.633 11183 INFO rally.task.context [-] Verification 5fa87fbe-4582-435b-8264-0cfdf33664a8 | Context tempest@default cleanup() finished in 0.90 sec
2018-09-02 08:37:47.702 11183 INFO rally.api [-] Verification (UUID=33fcec28-0f29-4c5e-9818-5c96674ef74a) has been successfully finished for deployment 'opnfv-rally' (UUID=579908da-ac1a-47d2-88e5-05893374e0f3)!

======
Totals
======

Ran: 217 tests in 481.015 sec.
 - Success: 199
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 18

Using verification (UUID=33fcec28-0f29-4c5e-9818-5c96674ef74a) as the default verification for the future operations.