2018-08-31 09:15:20.590 11183 INFO rally.api [-] Starting verification (UUID=9d4f4227-a48b-4daf-a71b-d89fe95ece85) for deployment 'opnfv-rally' (UUID=886aed6b-61b9-461a-a950-65b3b7775df7) by verifier 'opnfv-tempest' (UUID=b109c1d2-f8d2-4b16-b876-320786b38c0c).
2018-08-31 09:15:21.691 11183 WARNING oslo_config.cfg [-] Option "swift_operator_role" from group "tempest" is deprecated. Use option "swift_operator_role" from group "openstack".
2018-08-31 09:15:21.902 11183 WARNING oslo_config.cfg [-] Option "img_name_regex" from group "tempest" is deprecated. Use option "img_name_regex" from group "openstack".
2018-08-31 09:15:24.142 11183 INFO rally.task.context [-] Verification b109c1d2-f8d2-4b16-b876-320786b38c0c | Context tempest@default setup()  finished in 2.79 sec
2018-08-31 09:15:24.145 11183 INFO rally.task.context [-] Verification b109c1d2-f8d2-4b16-b876-320786b38c0c | Context testr@default setup()  finished in 2.90 msec
2018-08-31 09:15:30.952 11183 INFO opnfv-tempest [-] {14} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.012s]
2018-08-31 09:15:31.182 11183 INFO opnfv-tempest [-] {7} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.404s]
2018-08-31 09:15:31.238 11183 INFO opnfv-tempest [-] {7} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.056s]
2018-08-31 09:15:31.576 11183 INFO opnfv-tempest [-] {13} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.893s]
2018-08-31 09:15:31.639 11183 INFO opnfv-tempest [-] {4} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas ... success [0.696s]
2018-08-31 09:15:31.690 11183 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.778s]
2018-08-31 09:15:31.715 11183 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.024s]
2018-08-31 09:15:32.245 11183 INFO opnfv-tempest [-] {4} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas ... success [0.605s]
2018-08-31 09:15:34.520 11183 INFO opnfv-tempest [-] {5} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image ... success [3.803s]
2018-08-31 09:15:34.890 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size ... success [1.089s]
2018-08-31 09:15:34.925 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id ... success [0.035s]
2018-08-31 09:15:35.261 11183 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [3.545s]
2018-08-31 09:15:35.269 11183 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.008s]
2018-08-31 09:15:35.284 11183 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.015s]
2018-08-31 09:15:35.978 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid ... success [1.052s]
2018-08-31 09:15:36.474 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type ... success [0.496s]
2018-08-31 09:15:36.859 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative ... success [0.384s]
2018-08-31 09:15:37.187 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero ... success [0.327s]
2018-08-31 09:15:37.528 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size ... success [0.341s]
2018-08-31 09:15:37.562 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id ... success [0.034s]
2018-08-31 09:15:37.926 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id ... success [0.362s]
2018-08-31 09:15:37.960 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id ... success [0.034s]
2018-08-31 09:15:38.185 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password ... success [7.323s]
2018-08-31 09:15:38.300 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id ... success [0.340s]
2018-08-31 09:15:38.626 11183 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.219s]
2018-08-31 09:15:38.781 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status ... success [0.479s]
2018-08-31 09:15:38.933 11183 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.306s]
2018-08-31 09:15:39.068 11183 INFO opnfv-tempest [-] {13} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.216s]
2018-08-31 09:15:39.097 11183 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.165s]
2018-08-31 09:15:39.143 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name ... success [0.362s]
2018-08-31 09:15:39.470 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status ... success [0.326s]
2018-08-31 09:15:39.652 11183 INFO opnfv-tempest [-] {0} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [3.732s]
2018-08-31 09:15:39.770 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name ... success [0.300s]
2018-08-31 09:15:39.781 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id ... success [0.011s]
2018-08-31 09:15:40.160 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id ... success [0.378s]
2018-08-31 09:15:40.504 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id ... success [0.344s]
2018-08-31 09:15:40.919 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id ... success [0.415s]
2018-08-31 09:15:40.957 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id ... success [0.038s]
2018-08-31 09:15:41.267 11183 INFO opnfv-tempest [-] {0} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [1.615s]
2018-08-31 09:15:42.474 11183 INFO opnfv-tempest [-] {13} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [3.404s]
2018-08-31 09:15:44.863 11183 INFO opnfv-tempest [-] {13} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [2.389s]
2018-08-31 09:15:45.909 11183 INFO opnfv-tempest [-] {4} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_with_nonexistent_volume_id ... success [0.473s]
2018-08-31 09:15:46.365 11183 INFO opnfv-tempest [-] {4} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_without_passing_volume_id ... success [0.456s]
2018-08-31 09:15:47.009 11183 INFO opnfv-tempest [-] {13} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [2.146s]
2018-08-31 09:15:48.778 11183 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON ... fail
2018-08-31 09:15:50.050 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [4.176s]
2018-08-31 09:15:50.573 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [5.854s]
2018-08-31 09:15:50.897 11183 INFO opnfv-tempest [-] {13} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [3.886s]
2018-08-31 09:15:51.881 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair ... fail [13.690s]
2018-08-31 09:15:52.093 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [2.043s]
2018-08-31 09:15:52.795 11183 INFO opnfv-tempest [-] {14} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_details_with_params ... success [0.885s]
2018-08-31 09:15:53.081 11183 INFO opnfv-tempest [-] {14} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_with_params ... success [0.285s]
2018-08-31 09:15:53.110 11183 INFO opnfv-tempest [-] {0} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.012s]
2018-08-31 09:15:53.422 11183 INFO opnfv-tempest [-] {3} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.355s]
2018-08-31 09:15:54.975 11183 INFO opnfv-tempest [-] {13} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [4.077s]
2018-08-31 09:15:57.719 11183 INFO opnfv-tempest [-] {13} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [2.743s]
2018-08-31 09:15:58.168 11183 INFO opnfv-tempest [-] {13} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.449s]
2018-08-31 09:15:58.225 11183 INFO opnfv-tempest [-] {13} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.056s]
2018-08-31 09:15:58.251 11183 INFO opnfv-tempest [-] {13} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.026s]
2018-08-31 09:15:58.272 11183 INFO opnfv-tempest [-] {13} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.021s]
2018-08-31 09:16:00.304 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [9.730s]
2018-08-31 09:16:02.925 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete ... success [8.643s]
2018-08-31 09:16:03.414 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server ... success [32.400s]
2018-08-31 09:16:07.339 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [7.034s]
2018-08-31 09:16:09.816 11183 INFO opnfv-tempest [-] {12} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name ... success [2.467s]
2018-08-31 09:16:11.702 11183 INFO opnfv-tempest [-] {12} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit ... success [1.885s]
2018-08-31 09:16:13.610 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port ... success [8.802s]
2018-08-31 09:16:13.784 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.404s]
2018-08-31 09:16:14.005 11183 INFO opnfv-tempest [-] {12} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 ... success [2.302s]
2018-08-31 09:16:14.153 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name ... success [0.370s]
2018-08-31 09:16:14.592 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name ... success [0.438s]
2018-08-31 09:16:14.995 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [7.655s]
2018-08-31 09:16:15.142 11183 INFO opnfv-tempest [-] {11} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot ... success [12.216s]
2018-08-31 09:16:15.552 11183 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [14.398s]
2018-08-31 09:16:15.642 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination ... success [1.048s]
2018-08-31 09:16:16.364 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params ... success [0.722s]
2018-08-31 09:16:16.563 11183 INFO opnfv-tempest [-] {12} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor ... success [2.558s]
2018-08-31 09:16:16.921 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination ... success [0.556s]
2018-08-31 09:16:16.961 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status ... success [0.041s]
2018-08-31 09:16:17.331 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status ... success [0.368s]
2018-08-31 09:16:17.734 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata ... success [0.402s]
2018-08-31 09:16:17.814 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details ... success [0.080s]
2018-08-31 09:16:17.882 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata ... success [0.066s]
2018-08-31 09:16:17.981 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone ... success [0.098s]
2018-08-31 09:16:18.455 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status ... success [0.474s]
2018-08-31 09:16:18.536 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone ... success [0.080s]
2018-08-31 09:16:18.914 11183 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status ... success [0.378s]
2018-08-31 09:16:19.864 11183 INFO opnfv-tempest [-] {12} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image ... success [3.300s]
2018-08-31 09:16:20.284 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [5.289s]
2018-08-31 09:16:21.265 11183 INFO opnfv-tempest [-] {12} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid ... success [1.399s]
2018-08-31 09:16:22.348 11183 INFO opnfv-tempest [-] {8} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image ... success [21.562s]
2018-08-31 09:16:22.620 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [9.010s]
2018-08-31 09:16:22.764 11183 INFO opnfv-tempest [-] {12} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit ... success [1.500s]
2018-08-31 09:16:24.578 11183 INFO opnfv-tempest [-] {12} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id ... success [1.813s]
2018-08-31 09:16:25.664 11183 INFO opnfv-tempest [-] {10} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name ... success [1.861s]
2018-08-31 09:16:25.761 11183 INFO opnfv-tempest [-] {10} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.096s]
2018-08-31 09:16:25.870 11183 INFO opnfv-tempest [-] {8} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name ... success [3.526s]
2018-08-31 09:16:26.357 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [3.736s]
2018-08-31 09:16:26.366 11183 INFO opnfv-tempest [-] {10} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail ... success [0.605s]
2018-08-31 09:16:26.500 11183 INFO opnfv-tempest [-] {10} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus ... success [0.132s]
2018-08-31 09:16:26.501 11183 INFO opnfv-tempest [-] {10} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s]
2018-08-31 09:16:26.514 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [6.229s]
2018-08-31 09:16:26.829 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.472s]
2018-08-31 09:16:26.904 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields ... success [0.075s]
2018-08-31 09:16:27.354 11183 INFO opnfv-tempest [-] {12} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server ... success [2.775s]
2018-08-31 09:16:29.496 11183 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_as_clone ... success [13.942s]
2018-08-31 09:16:29.536 11183 INFO opnfv-tempest [-] {12} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address ... success [2.181s]
2018-08-31 09:16:30.999 11183 INFO opnfv-tempest [-] {12} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server ... success [1.463s]
2018-08-31 09:16:32.519 11183 INFO opnfv-tempest [-] {12} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_deleted_server ... success [1.519s]
2018-08-31 09:16:32.546 11183 INFO opnfv-tempest [-] {6} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name ... success [5.648s]
2018-08-31 09:16:32.638 11183 INFO opnfv-tempest [-] {6} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.092s]
2018-08-31 09:16:33.106 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [6.591s]
2018-08-31 09:16:33.158 11183 INFO opnfv-tempest [-] {6} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail ... success [0.519s]
2018-08-31 09:16:33.256 11183 INFO opnfv-tempest [-] {6} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus ... success [0.097s]
2018-08-31 09:16:33.258 11183 INFO opnfv-tempest [-] {6} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s]
2018-08-31 09:16:33.898 11183 INFO opnfv-tempest [-] {12} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server ... success [1.378s]
2018-08-31 09:16:36.149 11183 INFO opnfv-tempest [-] {12} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank ... success [2.248s]
2018-08-31 09:16:37.258 11183 INFO opnfv-tempest [-] {12} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server ... success [1.111s]
2018-08-31 09:16:38.827 11183 INFO opnfv-tempest [-] {12} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server ... success [1.568s]
2018-08-31 09:16:39.112 11183 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON ... fail
2018-08-31 09:16:40.071 11183 INFO opnfv-tempest [-] {12} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 ... success [1.243s]
2018-08-31 09:16:41.267 11183 INFO opnfv-tempest [-] {12} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name ... success [1.195s]
2018-08-31 09:16:43.327 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [10.220s]
2018-08-31 09:16:43.642 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date ... success [0.079s]
2018-08-31 09:16:43.657 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date ... success [0.016s]
2018-08-31 09:16:43.936 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count ... success [0.277s]
2018-08-31 09:16:43.950 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value ... success [0.014s]
2018-08-31 09:16:43.970 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string ... success [0.020s]
2018-08-31 09:16:44.004 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor ... success [0.033s]
2018-08-31 09:16:44.078 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image ... success [0.073s]
2018-08-31 09:16:44.194 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name ... success [0.116s]
2018-08-31 09:16:44.342 11183 INFO opnfv-tempest [-] {7} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [1.591s]
2018-08-31 09:16:44.465 11183 INFO opnfv-tempest [-] {7} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.122s]
2018-08-31 09:16:45.013 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted ... success [0.816s]
2018-08-31 09:16:45.026 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing ... success [0.014s]
2018-08-31 09:16:45.122 11183 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server ... success [0.096s]
2018-08-31 09:16:47.868 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name ... success [55.979s]
2018-08-31 09:16:48.364 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [5.037s]
2018-08-31 09:16:48.423 11183 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [18.926s]
2018-08-31 09:16:48.536 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.172s]
2018-08-31 09:16:48.646 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.110s]
2018-08-31 09:16:49.030 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.383s]
2018-08-31 09:16:49.083 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.053s]
2018-08-31 09:16:49.206 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.123s]
2018-08-31 09:16:49.319 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.112s]
2018-08-31 09:16:49.738 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.418s]
2018-08-31 09:16:50.004 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.266s]
2018-08-31 09:16:50.069 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.064s]
2018-08-31 09:16:55.566 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [2.841s]
2018-08-31 09:16:56.581 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [6.511s]
2018-08-31 09:16:57.496 11183 INFO opnfv-tempest [-] {12} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_image_schema ... success [0.357s]
2018-08-31 09:16:57.738 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [2.172s]
2018-08-31 09:16:57.804 11183 INFO opnfv-tempest [-] {12} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_images_schema ... success [0.308s]
2018-08-31 09:16:57.849 11183 INFO opnfv-tempest [-] {12} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_container_format ... success [0.044s]
2018-08-31 09:16:57.886 11183 INFO opnfv-tempest [-] {12} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_disk_format ... success [0.038s]
2018-08-31 09:16:58.126 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_port_list_filter_by_router_id ... success [31.220s]
2018-08-31 09:16:58.176 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.050s]
2018-08-31 09:16:58.296 11183 INFO opnfv-tempest [-] {12} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_limit ... success [0.409s]
2018-08-31 09:16:58.459 11183 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields ... success [0.283s]
2018-08-31 09:16:59.049 11183 INFO opnfv-tempest [-] {12} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_min_max_size ... success [0.751s]
2018-08-31 09:16:59.695 11183 INFO opnfv-tempest [-] {12} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_size ... success [0.646s]
2018-08-31 09:16:59.948 11183 INFO opnfv-tempest [-] {12} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_status ... success [0.252s]
2018-08-31 09:17:00.464 11183 INFO opnfv-tempest [-] {12} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_visibility ... success [0.515s]
2018-08-31 09:17:00.845 11183 INFO opnfv-tempest [-] {12} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_no_params ... success [0.381s]
2018-08-31 09:17:00.941 11183 INFO opnfv-tempest [-] {8} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action ... success [0.091s]
2018-08-31 09:17:01.217 11183 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [1.610s]
2018-08-31 09:17:02.995 11183 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [1.777s]
2018-08-31 09:17:04.367 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [6.624s]
2018-08-31 09:17:04.935 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [0.572s]
2018-08-31 09:17:06.035 11183 INFO opnfv-tempest [-] {8} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions ... success [5.092s]
2018-08-31 09:17:07.084 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address ... success [19.214s]
2018-08-31 09:17:07.841 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [2.903s]
2018-08-31 09:17:08.998 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [1.157s]
2018-08-31 09:17:10.415 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.414s]
2018-08-31 09:17:10.466 11183 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.055s]
2018-08-31 09:17:10.495 11183 INFO opnfv-tempest [-] {6} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON.test_get_availability_zone_list ... success [0.326s]
2018-08-31 09:17:13.348 11183 INFO opnfv-tempest [-] {8} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions ... success [0.394s]
2018-08-31 09:17:20.302 11183 INFO opnfv-tempest [-] {15} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume ... success [89.534s]
2018-08-31 09:17:33.587 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [25.460s]
2018-08-31 09:17:42.078 11183 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name ... success [34.989s]
2018-08-31 09:17:44.367 11183 INFO opnfv-tempest [-] {10} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server ... success [12.381s]
2018-08-31 09:17:47.327 11183 INFO opnfv-tempest [-] {2} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.007s]
2018-08-31 09:17:50.364 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [16.777s]
2018-08-31 09:17:53.089 11183 INFO opnfv-tempest [-] {10} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [8.723s]
2018-08-31 09:17:54.556 11183 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_bootable ... success [1.512s]
2018-08-31 09:17:55.532 11183 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_readonly_update ... success [0.976s]
2018-08-31 09:18:00.563 11183 INFO opnfv-tempest [-] {15} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_list_get_volume_attachments ... success [40.252s]
2018-08-31 09:18:07.072 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [16.707s]
2018-08-31 09:18:20.647 11183 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_upload ... success [25.108s]
2018-08-31 09:18:22.158 11183 INFO opnfv-tempest [-] {15} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [2.118s]
2018-08-31 09:18:22.808 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [15.735s]
2018-08-31 09:18:27.856 11183 INFO opnfv-tempest [-] {10} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server ... success [34.760s]
2018-08-31 09:18:47.351 11183 INFO opnfv-tempest [-] {10} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server ... success [19.494s]
2018-08-31 09:19:04.123 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_routers.RoutersTest.test_update_delete_extra_route ... success [41.310s]
2018-08-31 09:19:13.849 11183 INFO opnfv-tempest [-] {5} tempest.api.network.test_routers.RoutersTest.test_update_router_admin_state ... success [9.729s]
2018-08-31 09:19:23.380 11183 INFO opnfv-tempest [-] {10} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_add_router_interfaces_on_overlapping_subnets_returns_400 ... success [9.621s]
2018-08-31 09:19:23.426 11183 INFO opnfv-tempest [-] {10} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_delete_non_existent_router_returns_404 ... success [0.047s]
2018-08-31 09:19:23.848 11183 INFO opnfv-tempest [-] {10} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_add_gateway_invalid_network_returns_404 ... success [0.421s]
2018-08-31 09:19:25.919 11183 INFO opnfv-tempest [-] {10} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_add_gateway_net_not_external_returns_400 ... success [2.070s]
2018-08-31 09:19:31.797 11183 INFO opnfv-tempest [-] {10} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_remove_interface_in_use_returns_409 ... success [5.878s]
2018-08-31 09:19:32.119 11183 INFO opnfv-tempest [-] {10} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_show_non_existent_router_returns_404 ... success [0.321s]
2018-08-31 09:19:32.429 11183 INFO opnfv-tempest [-] {10} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_update_non_existent_router_returns_404 ... success [0.310s]
2018-08-31 09:19:54.739 11183 INFO rally.task.context [-] Verification b109c1d2-f8d2-4b16-b876-320786b38c0c | Context testr@default cleanup() started
2018-08-31 09:19:54.740 11183 INFO rally.task.context [-] Verification b109c1d2-f8d2-4b16-b876-320786b38c0c | Context testr@default cleanup() finished in 0.92 msec
2018-08-31 09:19:54.741 11183 INFO rally.task.context [-] Verification b109c1d2-f8d2-4b16-b876-320786b38c0c | Context tempest@default cleanup() started
2018-08-31 09:19:55.651 11183 INFO rally.task.context [-] Verification b109c1d2-f8d2-4b16-b876-320786b38c0c | Context tempest@default cleanup() finished in 0.91 sec
2018-08-31 09:19:55.730 11183 INFO rally.api [-] Verification (UUID=9d4f4227-a48b-4daf-a71b-d89fe95ece85) has been successfully finished for deployment 'opnfv-rally' (UUID=886aed6b-61b9-461a-a950-65b3b7775df7)!

======
Totals
======

Ran: 217 tests in 244.266 sec.
 - Success: 199
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 18

Using verification (UUID=9d4f4227-a48b-4daf-a71b-d89fe95ece85) as the default verification for the future operations.