2018-08-27 13:14:10.785 11183 INFO rally.api [-] Starting verification (UUID=1021dba6-99f4-4b3b-95f9-75c76c5192cc) for deployment 'opnfv-rally' (UUID=4fad201c-cab1-4d77-9db8-1bf17a79c3ec) by verifier 'opnfv-tempest' (UUID=9d3486a9-e4d7-4316-b857-b30e1f5aea8b).
2018-08-27 13:14:11.624 11183 WARNING oslo_config.cfg [-] Option "swift_operator_role" from group "tempest" is deprecated. Use option "swift_operator_role" from group "openstack".
2018-08-27 13:14:11.812 11183 WARNING oslo_config.cfg [-] Option "img_name_regex" from group "tempest" is deprecated. Use option "img_name_regex" from group "openstack".
2018-08-27 13:14:14.972 11183 INFO rally.task.context [-] Verification 9d3486a9-e4d7-4316-b857-b30e1f5aea8b | Context tempest@default setup()  finished in 3.68 sec
2018-08-27 13:14:14.975 11183 INFO rally.task.context [-] Verification 9d3486a9-e4d7-4316-b857-b30e1f5aea8b | Context testr@default setup()  finished in 2.42 msec
2018-08-27 13:14:21.738 11183 INFO opnfv-tempest [-] {14} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.011s]
2018-08-27 13:14:22.221 11183 INFO opnfv-tempest [-] {7} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.396s]
2018-08-27 13:14:22.274 11183 INFO opnfv-tempest [-] {7} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.054s]
2018-08-27 13:14:22.299 11183 INFO opnfv-tempest [-] {13} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.422s]
2018-08-27 13:14:22.300 11183 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.282s]
2018-08-27 13:14:22.620 11183 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.321s]
2018-08-27 13:14:23.168 11183 INFO opnfv-tempest [-] {4} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas ... success [1.220s]
2018-08-27 13:14:25.584 11183 INFO opnfv-tempest [-] {4} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas ... success [2.416s]
2018-08-27 13:14:26.459 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size ... success [2.068s]
2018-08-27 13:14:26.762 11183 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [4.141s]
2018-08-27 13:14:26.819 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id ... success [0.360s]
2018-08-27 13:14:27.103 11183 INFO opnfv-tempest [-] {5} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image ... success [5.151s]
2018-08-27 13:14:27.451 11183 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.689s]
2018-08-27 13:14:27.612 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid ... success [0.793s]
2018-08-27 13:14:27.808 11183 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.357s]
2018-08-27 13:14:28.005 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type ... success [0.392s]
2018-08-27 13:14:28.353 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative ... success [0.346s]
2018-08-27 13:14:28.697 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero ... success [0.343s]
2018-08-27 13:14:28.708 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size ... success [0.011s]
2018-08-27 13:14:29.556 11183 INFO opnfv-tempest [-] {13} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.340s]
2018-08-27 13:14:29.922 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id ... success [1.214s]
2018-08-27 13:14:29.931 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id ... success [0.009s]
2018-08-27 13:14:30.724 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id ... success [0.792s]
2018-08-27 13:14:30.783 11183 INFO opnfv-tempest [-] {0} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [3.937s]
2018-08-27 13:14:30.797 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password ... success [9.147s]
2018-08-27 13:14:31.057 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id ... success [0.333s]
2018-08-27 13:14:31.101 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status ... success [0.043s]
2018-08-27 13:14:31.542 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name ... success [0.440s]
2018-08-27 13:14:31.589 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status ... success [0.048s]
2018-08-27 13:14:32.024 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name ... success [0.435s]
2018-08-27 13:14:32.421 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id ... success [0.396s]
2018-08-27 13:14:32.752 11183 INFO opnfv-tempest [-] {13} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [3.194s]
2018-08-27 13:14:32.763 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id ... success [0.342s]
2018-08-27 13:14:33.192 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id ... success [0.428s]
2018-08-27 13:14:33.594 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id ... success [0.401s]
2018-08-27 13:14:33.949 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id ... success [0.354s]
2018-08-27 13:14:33.973 11183 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.184s]
2018-08-27 13:14:34.089 11183 INFO opnfv-tempest [-] {0} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [3.304s]
2018-08-27 13:14:34.186 11183 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.213s]
2018-08-27 13:14:34.466 11183 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.279s]
2018-08-27 13:14:35.177 11183 INFO opnfv-tempest [-] {13} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [2.424s]
2018-08-27 13:14:37.956 11183 INFO opnfv-tempest [-] {13} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [2.778s]
2018-08-27 13:14:39.055 11183 INFO opnfv-tempest [-] {14} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_details_with_params ... success [1.366s]
2018-08-27 13:14:40.679 11183 INFO opnfv-tempest [-] {14} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_with_params ... success [1.624s]
2018-08-27 13:14:42.516 11183 INFO opnfv-tempest [-] {13} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [4.559s]
2018-08-27 13:14:43.216 11183 INFO opnfv-tempest [-] {4} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_with_nonexistent_volume_id ... success [0.506s]
2018-08-27 13:14:43.675 11183 INFO opnfv-tempest [-] {4} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_without_passing_volume_id ... success [0.460s]
2018-08-27 13:14:43.873 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [6.521s]
2018-08-27 13:14:47.010 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [3.136s]
2018-08-27 13:14:47.387 11183 INFO opnfv-tempest [-] {0} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.012s]
2018-08-27 13:14:48.947 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [8.989s]
2018-08-27 13:14:50.557 11183 INFO opnfv-tempest [-] {13} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [8.039s]
2018-08-27 13:14:53.270 11183 INFO opnfv-tempest [-] {13} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [2.713s]
2018-08-27 13:14:53.439 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.871s]
2018-08-27 13:14:54.051 11183 INFO opnfv-tempest [-] {13} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.783s]
2018-08-27 13:14:54.070 11183 INFO opnfv-tempest [-] {13} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.019s]
2018-08-27 13:14:54.088 11183 INFO opnfv-tempest [-] {13} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.017s]
2018-08-27 13:14:54.160 11183 INFO opnfv-tempest [-] {13} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.072s]
2018-08-27 13:14:54.193 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.754s]
2018-08-27 13:14:54.939 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [0.745s]
2018-08-27 13:14:56.339 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [1.400s]
2018-08-27 13:14:58.431 11183 INFO opnfv-tempest [-] {12} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON ... fail
2018-08-27 13:14:58.461 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server ... success [36.871s]
2018-08-27 13:14:58.835 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [9.888s]
2018-08-27 13:14:59.049 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [2.710s]
2018-08-27 13:14:59.732 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete ... success [11.112s]
2018-08-27 13:15:01.641 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [2.591s]
2018-08-27 13:15:08.130 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [9.294s]
2018-08-27 13:15:08.821 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair ... success [38.015s]
2018-08-27 13:15:10.667 11183 INFO opnfv-tempest [-] {8} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image ... success [21.375s]
2018-08-27 13:15:11.995 11183 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [16.072s]
2018-08-27 13:15:12.265 11183 INFO opnfv-tempest [-] {8} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name ... success [1.601s]
2018-08-27 13:15:12.343 11183 INFO opnfv-tempest [-] {3} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.354s]
2018-08-27 13:15:12.346 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.418s]
2018-08-27 13:15:12.519 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot ... success [12.785s]
2018-08-27 13:15:12.649 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name ... success [0.302s]
2018-08-27 13:15:13.020 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name ... success [0.370s]
2018-08-27 13:15:13.447 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [5.317s]
2018-08-27 13:15:14.243 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination ... success [1.222s]
2018-08-27 13:15:14.878 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params ... success [0.633s]
2018-08-27 13:15:15.711 11183 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor ... success [0.718s]
2018-08-27 13:15:16.286 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination ... success [1.407s]
2018-08-27 13:15:16.477 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status ... success [0.191s]
2018-08-27 13:15:16.843 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status ... success [0.366s]
2018-08-27 13:15:16.911 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata ... success [0.067s]
2018-08-27 13:15:16.971 11183 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image ... success [1.259s]
2018-08-27 13:15:17.165 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details ... success [0.254s]
2018-08-27 13:15:17.527 11183 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name ... success [0.555s]
2018-08-27 13:15:17.573 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata ... success [0.408s]
2018-08-27 13:15:17.917 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone ... success [0.341s]
2018-08-27 13:15:18.003 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status ... success [0.086s]
2018-08-27 13:15:18.079 11183 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status ... success [0.552s]
2018-08-27 13:15:18.287 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone ... success [0.283s]
2018-08-27 13:15:18.651 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status ... success [0.361s]
2018-08-27 13:15:18.652 11183 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results ... success [0.571s]
2018-08-27 13:15:18.734 11183 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_active_status ... success [0.082s]
2018-08-27 13:15:18.816 11183 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor ... success [0.082s]
2018-08-27 13:15:18.901 11183 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image ... success [0.085s]
2018-08-27 13:15:18.975 11183 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit ... success [0.073s]
2018-08-27 13:15:19.075 11183 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name ... success [0.099s]
2018-08-27 13:15:19.257 11183 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard ... success [0.181s]
2018-08-27 13:15:20.371 11183 INFO opnfv-tempest [-] {12} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_image_schema ... success [0.434s]
2018-08-27 13:15:20.670 11183 INFO opnfv-tempest [-] {12} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_images_schema ... success [0.299s]
2018-08-27 13:15:20.716 11183 INFO opnfv-tempest [-] {12} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_container_format ... success [0.046s]
2018-08-27 13:15:21.011 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [7.563s]
2018-08-27 13:15:21.017 11183 INFO opnfv-tempest [-] {12} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_disk_format ... success [0.301s]
2018-08-27 13:15:21.319 11183 INFO opnfv-tempest [-] {12} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_limit ... success [0.301s]
2018-08-27 13:15:22.235 11183 INFO opnfv-tempest [-] {6} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name ... success [7.125s]
2018-08-27 13:15:22.310 11183 INFO opnfv-tempest [-] {6} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.074s]
2018-08-27 13:15:22.439 11183 INFO opnfv-tempest [-] {12} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_min_max_size ... success [1.119s]
2018-08-27 13:15:22.805 11183 INFO opnfv-tempest [-] {6} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail ... success [0.495s]
2018-08-27 13:15:22.939 11183 INFO opnfv-tempest [-] {6} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus ... success [0.132s]
2018-08-27 13:15:22.940 11183 INFO opnfv-tempest [-] {6} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s]
2018-08-27 13:15:23.168 11183 INFO opnfv-tempest [-] {12} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_size ... success [0.729s]
2018-08-27 13:15:23.212 11183 INFO opnfv-tempest [-] {12} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_status ... success [0.042s]
2018-08-27 13:15:23.252 11183 INFO opnfv-tempest [-] {12} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_visibility ... success [0.039s]
2018-08-27 13:15:23.307 11183 INFO opnfv-tempest [-] {12} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_no_params ... success [0.055s]
2018-08-27 13:15:23.753 11183 INFO opnfv-tempest [-] {10} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name ... success [1.962s]
2018-08-27 13:15:23.824 11183 INFO opnfv-tempest [-] {10} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.070s]
2018-08-27 13:15:25.670 11183 INFO opnfv-tempest [-] {10} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail ... success [1.845s]
2018-08-27 13:15:25.799 11183 INFO opnfv-tempest [-] {10} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus ... success [0.128s]
2018-08-27 13:15:25.800 11183 INFO opnfv-tempest [-] {10} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s]
2018-08-27 13:15:27.328 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [6.316s]
2018-08-27 13:15:28.517 11183 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_as_clone ... success [16.519s]
2018-08-27 13:15:31.233 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port ... success [6.969s]
2018-08-27 13:15:33.123 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [5.794s]
2018-08-27 13:15:37.161 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date ... success [0.228s]
2018-08-27 13:15:37.172 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date ... success [0.011s]
2018-08-27 13:15:37.321 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count ... success [0.149s]
2018-08-27 13:15:37.332 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value ... success [0.011s]
2018-08-27 13:15:37.355 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string ... success [0.023s]
2018-08-27 13:15:37.379 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor ... success [0.023s]
2018-08-27 13:15:37.450 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image ... success [0.070s]
2018-08-27 13:15:37.526 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name ... success [0.076s]
2018-08-27 13:15:38.742 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted ... success [1.214s]
2018-08-27 13:15:38.756 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing ... success [0.014s]
2018-08-27 13:15:38.855 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server ... success [0.099s]
2018-08-27 13:15:40.803 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [9.570s]
2018-08-27 13:15:42.002 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [8.877s]
2018-08-27 13:15:44.220 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [3.416s]
2018-08-27 13:15:44.399 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.179s]
2018-08-27 13:15:44.467 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields ... success [0.068s]
2018-08-27 13:15:45.945 11183 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [17.425s]
2018-08-27 13:15:47.492 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [5.491s]
2018-08-27 13:15:47.849 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.356s]
2018-08-27 13:15:48.205 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.356s]
2018-08-27 13:15:48.377 11183 INFO opnfv-tempest [-] {7} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [1.557s]
2018-08-27 13:15:48.427 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.222s]
2018-08-27 13:15:48.677 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.249s]
2018-08-27 13:15:48.681 11183 INFO opnfv-tempest [-] {8} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action ... success [0.058s]
2018-08-27 13:15:48.731 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.054s]
2018-08-27 13:15:48.886 11183 INFO opnfv-tempest [-] {7} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.508s]
2018-08-27 13:15:49.054 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.322s]
2018-08-27 13:15:49.367 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name ... success [40.541s]
2018-08-27 13:15:49.472 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.418s]
2018-08-27 13:15:49.584 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.111s]
2018-08-27 13:15:49.951 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.367s]
2018-08-27 13:15:51.831 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [2.613s]
2018-08-27 13:15:52.674 11183 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [2.032s]
2018-08-27 13:15:53.545 11183 INFO opnfv-tempest [-] {8} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions ... success [4.861s]
2018-08-27 13:15:53.866 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [2.034s]
2018-08-27 13:15:54.600 11183 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [1.925s]
2018-08-27 13:15:57.332 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [7.379s]
2018-08-27 13:16:00.948 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [7.080s]
2018-08-27 13:16:01.871 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [0.925s]
2018-08-27 13:16:03.132 11183 INFO opnfv-tempest [-] {8} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions ... success [0.398s]
2018-08-27 13:16:03.317 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [1.444s]
2018-08-27 13:16:04.058 11183 INFO opnfv-tempest [-] {6} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON.test_get_availability_zone_list ... success [0.416s]
2018-08-27 13:16:04.576 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [1.258s]
2018-08-27 13:16:06.932 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [2.352s]
2018-08-27 13:16:06.976 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.048s]
2018-08-27 13:16:08.273 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address ... success [18.905s]
2018-08-27 13:16:09.867 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_port_list_filter_by_router_id ... success [25.398s]
2018-08-27 13:16:10.159 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.293s]
2018-08-27 13:16:10.434 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields ... success [0.274s]
2018-08-27 13:16:12.782 11183 INFO opnfv-tempest [-] {15} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume ... success [94.988s]
2018-08-27 13:16:35.004 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [25.756s]
2018-08-27 13:16:39.642 11183 INFO opnfv-tempest [-] {10} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server ... success [12.506s]
2018-08-27 13:16:41.327 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name ... success [33.051s]
2018-08-27 13:16:46.466 11183 INFO opnfv-tempest [-] {2} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.007s]
2018-08-27 13:16:49.884 11183 INFO opnfv-tempest [-] {10} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [10.241s]
2018-08-27 13:16:51.844 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [16.839s]
2018-08-27 13:16:52.793 11183 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_bootable ... success [1.490s]
2018-08-27 13:16:54.090 11183 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_readonly_update ... success [1.295s]
2018-08-27 13:16:56.279 11183 INFO opnfv-tempest [-] {15} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_list_get_volume_attachments ... success [43.487s]
2018-08-27 13:17:08.896 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [17.051s]
2018-08-27 13:17:15.019 11183 INFO opnfv-tempest [-] {10} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server ... success [25.130s]
2018-08-27 13:17:18.805 11183 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_upload ... success [24.712s]
2018-08-27 13:17:19.958 11183 INFO opnfv-tempest [-] {15} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.651s]
2018-08-27 13:17:22.892 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [13.995s]
2018-08-27 13:17:35.821 11183 INFO opnfv-tempest [-] {10} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server ... success [20.801s]
2018-08-27 13:18:03.660 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_routers.RoutersTest.test_update_delete_extra_route ... success [40.764s]
2018-08-27 13:18:13.204 11183 INFO opnfv-tempest [-] {10} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_add_router_interfaces_on_overlapping_subnets_returns_400 ... success [9.714s]
2018-08-27 13:18:13.535 11183 INFO opnfv-tempest [-] {10} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_delete_non_existent_router_returns_404 ... success [0.332s]
2018-08-27 13:18:13.547 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_routers.RoutersTest.test_update_router_admin_state ... success [9.891s]
2018-08-27 13:18:14.212 11183 INFO opnfv-tempest [-] {10} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_add_gateway_invalid_network_returns_404 ... success [0.676s]
2018-08-27 13:18:16.098 11183 INFO opnfv-tempest [-] {10} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_add_gateway_net_not_external_returns_400 ... success [1.885s]
2018-08-27 13:18:21.828 11183 INFO opnfv-tempest [-] {10} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_remove_interface_in_use_returns_409 ... success [5.728s]
2018-08-27 13:18:21.873 11183 INFO opnfv-tempest [-] {10} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_show_non_existent_router_returns_404 ... success [0.046s]
2018-08-27 13:18:22.180 11183 INFO opnfv-tempest [-] {10} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_update_non_existent_router_returns_404 ... success [0.307s]
2018-08-27 13:18:48.133 11183 INFO rally.task.context [-] Verification 9d3486a9-e4d7-4316-b857-b30e1f5aea8b | Context testr@default cleanup() started
2018-08-27 13:18:48.134 11183 INFO rally.task.context [-] Verification 9d3486a9-e4d7-4316-b857-b30e1f5aea8b | Context testr@default cleanup() finished in 0.78 msec
2018-08-27 13:18:48.134 11183 INFO rally.task.context [-] Verification 9d3486a9-e4d7-4316-b857-b30e1f5aea8b | Context tempest@default cleanup() started
2018-08-27 13:18:49.043 11183 INFO rally.task.context [-] Verification 9d3486a9-e4d7-4316-b857-b30e1f5aea8b | Context tempest@default cleanup() finished in 0.91 sec
2018-08-27 13:18:49.130 11183 INFO rally.api [-] Verification (UUID=1021dba6-99f4-4b3b-95f9-75c76c5192cc) has been successfully finished for deployment 'opnfv-rally' (UUID=4fad201c-cab1-4d77-9db8-1bf17a79c3ec)!

======
Totals
======

Ran: 217 tests in 243.179 sec.
 - Success: 199
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 18

Using verification (UUID=1021dba6-99f4-4b3b-95f9-75c76c5192cc) as the default verification for the future operations.