2018-11-26 14:21:42.682 17428 INFO rally.api [-] Starting verification (UUID=9fa87534-eba4-4f26-8f38-89402ef960d9) for deployment 'opnfv-rally' (UUID=8c346497-ce8c-4b4f-b315-831f3eaa8c2e) by verifier 'opnfv-tempest' (UUID=9a24ad60-7a5c-4430-8e2d-dfc7b9e24a3e).
/usr/lib/python2.7/site-packages/urllib3/connection.py:344: SubjectAltNameWarning: Certificate for 192.16.1.222 has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/shazow/urllib3/issues/497 for details.)
  SubjectAltNameWarning
/usr/lib/python2.7/site-packages/urllib3/connection.py:344: SubjectAltNameWarning: Certificate for 192.16.1.222 has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/shazow/urllib3/issues/497 for details.)
  SubjectAltNameWarning
/usr/lib/python2.7/site-packages/urllib3/connection.py:344: SubjectAltNameWarning: Certificate for 192.16.1.222 has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/shazow/urllib3/issues/497 for details.)
  SubjectAltNameWarning
/usr/lib/python2.7/site-packages/urllib3/connection.py:344: SubjectAltNameWarning: Certificate for 192.16.1.222 has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/shazow/urllib3/issues/497 for details.)
  SubjectAltNameWarning
2018-11-26 14:21:44.151 17428 INFO rally.task.context [-] Verification 9a24ad60-7a5c-4430-8e2d-dfc7b9e24a3e | Context tempest@default setup()  finished in 0.95 sec
2018-11-26 14:21:44.153 17428 INFO rally.task.context [-] Verification 9a24ad60-7a5c-4430-8e2d-dfc7b9e24a3e | Context testr@default setup()  finished in 1.36 msec
2018-11-26 14:21:49.029 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.327s]
2018-11-26 14:21:49.162 17428 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.366s]
2018-11-26 14:21:49.278 17428 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.116s]
2018-11-26 14:22:04.103 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server ... success [11.282s]
2018-11-26 14:22:27.907 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date ... success [0.142s]
2018-11-26 14:22:27.926 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date ... success [0.019s]
2018-11-26 14:22:28.203 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count ... success [0.277s]
2018-11-26 14:22:28.234 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value ... success [0.030s]
2018-11-26 14:22:28.266 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string ... success [0.032s]
2018-11-26 14:22:28.303 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor ... success [0.036s]
2018-11-26 14:22:28.473 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image ... success [0.170s]
2018-11-26 14:22:28.581 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name ... success [0.108s]
2018-11-26 14:22:28.855 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted ... success [0.273s]
2018-11-26 14:22:28.887 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing ... success [0.031s]
2018-11-26 14:22:29.002 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server ... success [0.116s]
2018-11-26 14:22:38.625 17428 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.104s]
2018-11-26 14:22:38.670 17428 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.042s]
2018-11-26 14:22:39.106 17428 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [0.438s]
2018-11-26 14:22:39.140 17428 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.034s]
2018-11-26 14:22:39.187 17428 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.047s]
2018-11-26 14:22:43.754 17428 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image ... success [0.740s]
2018-11-26 14:22:55.708 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [5.621s]
2018-11-26 14:22:59.488 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [3.779s]
2018-11-26 14:23:02.470 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name ... success [29.720s]
2018-11-26 14:23:02.582 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.111s]
2018-11-26 14:23:03.269 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [3.780s]
2018-11-26 14:23:03.333 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail ... success [0.749s]
2018-11-26 14:23:03.620 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus ... success [0.288s]
2018-11-26 14:23:03.621 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.000s]
2018-11-26 14:23:07.666 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [4.394s]
2018-11-26 14:23:10.521 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [2.855s]
2018-11-26 14:23:14.824 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [4.304s]
2018-11-26 14:23:17.992 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [3.168s]
2018-11-26 14:23:25.166 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [7.171s]
2018-11-26 14:23:29.838 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [4.672s]
2018-11-26 14:23:30.129 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.290s]
2018-11-26 14:23:30.330 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.201s]
2018-11-26 14:23:30.536 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.206s]
2018-11-26 14:23:30.663 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.126s]
2018-11-26 14:23:30.768 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.105s]
2018-11-26 14:23:30.971 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.203s]
2018-11-26 14:23:31.357 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.385s]
2018-11-26 14:23:31.437 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.080s]
2018-11-26 14:23:31.515 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.077s]
2018-11-26 14:23:37.806 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [6.289s]
2018-11-26 14:23:46.618 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image ... success [109.091s]
2018-11-26 14:23:47.382 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name ... success [0.766s]
2018-11-26 14:23:59.026 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action ... success [0.177s]
2018-11-26 14:24:02.246 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions ... success [3.218s]
2018-11-26 14:24:17.998 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name ... success [0.902s]
2018-11-26 14:24:18.830 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit ... success [0.833s]
2018-11-26 14:24:19.748 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 ... success [0.917s]
2018-11-26 14:24:20.621 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor ... success [0.871s]
2018-11-26 14:24:21.403 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image ... success [0.782s]
2018-11-26 14:24:22.220 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid ... success [0.817s]
2018-11-26 14:24:22.618 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit ... success [0.396s]
2018-11-26 14:24:22.976 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id ... success [0.359s]
2018-11-26 14:24:23.119 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [33.581s]
2018-11-26 14:24:23.368 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server ... success [0.392s]
2018-11-26 14:24:24.143 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address ... success [0.775s]
2018-11-26 14:24:24.514 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server ... success [0.370s]
2018-11-26 14:24:24.945 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_deleted_server ... success [0.431s]
2018-11-26 14:24:25.375 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server ... success [0.429s]
2018-11-26 14:24:26.188 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank ... success [0.812s]
2018-11-26 14:24:26.585 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server ... success [0.396s]
2018-11-26 14:24:27.025 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server ... success [0.441s]
2018-11-26 14:24:27.450 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 ... success [0.425s]
2018-11-26 14:24:27.865 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name ... success [0.414s]
2018-11-26 14:24:33.778 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas ... success [0.254s]
2018-11-26 14:24:34.036 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas ... success [0.258s]
2018-11-26 14:24:36.134 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name ... success [22.634s]
2018-11-26 14:24:36.283 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.148s]
2018-11-26 14:24:36.657 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail ... success [0.375s]
2018-11-26 14:24:36.853 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus ... success [0.194s]
2018-11-26 14:24:36.854 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s]
2018-11-26 14:24:38.033 17428 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.135s]
2018-11-26 14:24:38.068 17428 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.035s]
2018-11-26 14:24:38.175 17428 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.107s]
2018-11-26 14:24:44.356 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [21.237s]
2018-11-26 14:24:49.294 17428 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_image_schema ... success [0.019s]
2018-11-26 14:24:49.321 17428 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_images_schema ... success [0.025s]
2018-11-26 14:24:49.425 17428 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_container_format ... success [0.105s]
2018-11-26 14:24:49.590 17428 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_disk_format ... success [0.164s]
2018-11-26 14:24:49.677 17428 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_limit ... success [0.087s]
2018-11-26 14:24:49.810 17428 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_min_max_size ... success [0.133s]
2018-11-26 14:24:49.952 17428 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_size ... success [0.141s]
2018-11-26 14:24:50.210 17428 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_status ... success [0.257s]
2018-11-26 14:24:50.307 17428 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_visibility ... success [0.097s]
2018-11-26 14:24:50.432 17428 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_no_params ... success [0.125s]
2018-11-26 14:25:01.519 17428 INFO opnfv-tempest [-] {0} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions ... success [0.296s]
2018-11-26 14:25:05.685 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [21.327s]
2018-11-26 14:25:12.207 17428 INFO opnfv-tempest [-] {0} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [1.158s]
2018-11-26 14:25:13.383 17428 INFO opnfv-tempest [-] {0} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [1.174s]
2018-11-26 14:25:21.322 17428 INFO opnfv-tempest [-] {0} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.024s]
2018-11-26 14:25:23.540 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [17.855s]
2018-11-26 14:25:33.622 17428 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [8.355s]
2018-11-26 14:25:45.049 17428 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_as_clone ... success [11.424s]
2018-11-26 14:25:57.614 17428 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [12.565s]
2018-11-26 14:26:04.774 17428 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_with_nonexistent_volume_id ... success [0.535s]
2018-11-26 14:26:04.866 17428 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_without_passing_volume_id ... success [0.091s]
2018-11-26 14:26:19.480 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server ... success [41.805s]
2018-11-26 14:26:25.071 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_update_delete_extra_route ... success [61.528s]
2018-11-26 14:26:37.020 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_update_router_admin_state ... success [11.950s]
2018-11-26 14:27:15.246 17428 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON ... fail
2018-11-26 14:27:24.718 17428 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.727s]
2018-11-26 14:27:25.216 17428 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.499s]
2018-11-26 14:27:25.580 17428 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [0.364s]
2018-11-26 14:27:26.193 17428 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [0.612s]
2018-11-26 14:27:26.784 17428 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [0.592s]
2018-11-26 14:27:27.718 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [68.238s]
2018-11-26 14:27:28.050 17428 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [1.265s]
2018-11-26 14:27:30.738 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.240s]
2018-11-26 14:27:31.981 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [1.243s]
2018-11-26 14:27:34.820 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [2.836s]
2018-11-26 14:27:35.599 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [0.780s]
2018-11-26 14:27:37.427 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [1.825s]
2018-11-26 14:27:38.610 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [1.184s]
2018-11-26 14:27:40.358 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.747s]
2018-11-26 14:27:40.459 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.101s]
2018-11-26 14:27:44.403 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.082s]
2018-11-26 14:27:45.733 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [1.330s]
2018-11-26 14:27:46.426 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [0.693s]
2018-11-26 14:27:47.386 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [0.959s]
2018-11-26 14:27:48.391 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [1.004s]
2018-11-26 14:27:50.322 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [1.929s]
2018-11-26 14:27:51.225 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [0.904s]
2018-11-26 14:27:51.385 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.160s]
2018-11-26 14:27:51.418 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.033s]
2018-11-26 14:27:51.449 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.030s]
2018-11-26 14:27:51.481 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.031s]
2018-11-26 14:27:57.893 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [0.826s]
2018-11-26 14:27:58.591 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [0.699s]
2018-11-26 14:28:11.415 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.081s]
2018-11-26 14:28:11.504 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name ... success [0.088s]
2018-11-26 14:28:11.606 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name ... success [0.102s]
2018-11-26 14:28:12.180 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination ... success [0.573s]
2018-11-26 14:28:12.396 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params ... success [0.216s]
2018-11-26 14:28:12.805 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination ... success [0.408s]
2018-11-26 14:28:12.878 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status ... success [0.074s]
2018-11-26 14:28:12.983 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status ... success [0.104s]
2018-11-26 14:28:13.145 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata ... success [0.161s]
2018-11-26 14:28:13.273 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details ... success [0.127s]
2018-11-26 14:28:13.344 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata ... success [0.071s]
2018-11-26 14:28:13.507 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone ... success [0.163s]
2018-11-26 14:28:13.692 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status ... success [0.184s]
2018-11-26 14:28:13.814 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone ... success [0.122s]
2018-11-26 14:28:13.924 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status ... success [0.109s]
2018-11-26 14:28:18.253 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server ... success [50.533s]
2018-11-26 14:28:59.251 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server ... success [40.994s]
2018-11-26 14:29:23.654 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password ... success [1.303s]
2018-11-26 14:30:09.436 17428 INFO opnfv-tempest [-] {3} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume ... success [139.734s]
2018-11-26 14:30:43.873 17428 INFO opnfv-tempest [-] {3} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_list_get_volume_attachments ... success [34.433s]
2018-11-26 14:31:06.068 17428 INFO opnfv-tempest [-] {3} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.431s]
2018-11-26 14:31:10.217 17428 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [0.319s]
2018-11-26 14:31:10.269 17428 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.053s]
2018-11-26 14:31:19.474 17428 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port ... success [3.782s]
2018-11-26 14:31:24.725 17428 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [5.251s]
2018-11-26 14:31:27.260 17428 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [2.533s]
2018-11-26 14:31:27.413 17428 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.153s]
2018-11-26 14:31:27.525 17428 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields ... success [0.112s]
2018-11-26 14:31:51.914 17428 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_port_list_filter_by_router_id ... success [24.388s]
2018-11-26 14:31:51.986 17428 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.073s]
2018-11-26 14:31:52.094 17428 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields ... success [0.107s]
2018-11-26 14:31:59.768 17428 INFO opnfv-tempest [-] {3} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [0.538s]
2018-11-26 14:32:00.552 17428 INFO opnfv-tempest [-] {3} tearDownClass (tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON) ... fail
2018-11-26 14:32:04.554 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size ... success [0.030s]
2018-11-26 14:32:04.615 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id ... success [0.061s]
2018-11-26 14:32:04.755 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid ... success [0.140s]
2018-11-26 14:32:04.791 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type ... success [0.035s]
2018-11-26 14:32:04.824 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative ... success [0.033s]
2018-11-26 14:32:04.858 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero ... success [0.034s]
2018-11-26 14:32:05.064 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size ... success [0.206s]
2018-11-26 14:32:05.137 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id ... success [0.072s]
2018-11-26 14:32:05.165 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id ... success [0.028s]
2018-11-26 14:32:05.239 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id ... success [0.074s]
2018-11-26 14:32:05.260 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id ... success [0.021s]
2018-11-26 14:32:05.356 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status ... success [0.095s]
2018-11-26 14:32:05.431 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name ... success [0.075s]
2018-11-26 14:32:05.508 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status ... success [0.076s]
2018-11-26 14:32:05.586 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name ... success [0.078s]
2018-11-26 14:32:05.603 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id ... success [0.017s]
2018-11-26 14:32:05.679 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id ... success [0.075s]
2018-11-26 14:32:05.751 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id ... success [0.072s]
2018-11-26 14:32:05.801 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id ... success [0.049s]
2018-11-26 14:32:05.880 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id ... success [0.079s]
2018-11-26 14:32:15.724 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete ... success [3.076s]
2018-11-26 14:32:22.730 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot ... success [7.006s]
2018-11-26 14:34:26.130 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair ... fail [302.422s]
2018-11-26 14:34:39.814 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name ... success [13.689s]
2018-11-26 14:34:46.341 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address ... success [6.525s]
2018-11-26 14:35:55.774 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name ... success [69.426s]
2018-11-26 14:36:00.295 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.015s]
2018-11-26 14:36:04.509 17428 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.392s]
2018-11-26 14:36:05.273 17428 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [0.764s]
2018-11-26 14:36:27.273 17428 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_add_router_interfaces_on_overlapping_subnets_returns_400 ... success [10.520s]
2018-11-26 14:36:27.387 17428 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_delete_non_existent_router_returns_404 ... success [0.114s]
2018-11-26 14:36:28.130 17428 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_add_gateway_invalid_network_returns_404 ... success [0.743s]
2018-11-26 14:36:31.038 17428 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_add_gateway_net_not_external_returns_400 ... success [2.907s]
2018-11-26 14:36:38.340 17428 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_remove_interface_in_use_returns_409 ... success [7.301s]
2018-11-26 14:36:38.427 17428 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_show_non_existent_router_returns_404 ... success [0.087s]
2018-11-26 14:36:38.552 17428 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_update_non_existent_router_returns_404 ... success [0.124s]
2018-11-26 14:37:08.398 17428 INFO opnfv-tempest [-] {2} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.011s]
2018-11-26 14:37:12.314 17428 INFO opnfv-tempest [-] {2} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON.test_get_availability_zone_list ... success [0.243s]
2018-11-26 14:37:18.065 17428 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_bootable ... success [0.366s]
2018-11-26 14:37:18.437 17428 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_readonly_update ... success [0.372s]
2018-11-26 14:38:21.688 17428 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_upload ... success [63.246s]
2018-11-26 14:38:33.347 17428 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_details_with_params ... success [0.158s]
2018-11-26 14:38:33.485 17428 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_with_params ... success [0.138s]
2018-11-26 14:38:41.535 17428 INFO rally.task.context [-] Verification 9a24ad60-7a5c-4430-8e2d-dfc7b9e24a3e | Context testr@default cleanup() started
2018-11-26 14:38:41.537 17428 INFO rally.task.context [-] Verification 9a24ad60-7a5c-4430-8e2d-dfc7b9e24a3e | Context testr@default cleanup() finished in 1.98 msec
2018-11-26 14:38:41.538 17428 INFO rally.task.context [-] Verification 9a24ad60-7a5c-4430-8e2d-dfc7b9e24a3e | Context tempest@default cleanup() started
/usr/lib/python2.7/site-packages/urllib3/connection.py:344: SubjectAltNameWarning: Certificate for 192.16.1.222 has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/shazow/urllib3/issues/497 for details.)
  SubjectAltNameWarning
/usr/lib/python2.7/site-packages/urllib3/connection.py:344: SubjectAltNameWarning: Certificate for 192.16.1.222 has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/shazow/urllib3/issues/497 for details.)
  SubjectAltNameWarning
/usr/lib/python2.7/site-packages/urllib3/connection.py:344: SubjectAltNameWarning: Certificate for 192.16.1.222 has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/shazow/urllib3/issues/497 for details.)
  SubjectAltNameWarning
2018-11-26 14:38:42.445 17428 INFO rally.task.context [-] Verification 9a24ad60-7a5c-4430-8e2d-dfc7b9e24a3e | Context tempest@default cleanup() finished in 0.91 sec
2018-11-26 14:38:42.465 17428 INFO rally.api [-] Verification (UUID=9fa87534-eba4-4f26-8f38-89402ef960d9) has been successfully finished for deployment 'opnfv-rally' (UUID=8c346497-ce8c-4b4f-b315-831f3eaa8c2e)!

======
Totals
======

Ran: 217 tests in 1007.042 sec.
 - Success: 205
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 12

Using verification (UUID=9fa87534-eba4-4f26-8f38-89402ef960d9) as the default verification for the future operations.