2018-12-03 15:41:57.611 17428 INFO rally.api [-] Starting verification (UUID=cd050d40-0c11-4e23-87a1-29e115504c43) for deployment 'opnfv-rally' (UUID=d7bf8f73-edf1-4eea-8bf6-7a857ed6b1b2) by verifier 'opnfv-tempest' (UUID=ac818573-1500-42b8-a236-5e490ac58c54).
/usr/lib/python2.7/site-packages/urllib3/connection.py:344: SubjectAltNameWarning: Certificate for 192.16.1.222 has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/shazow/urllib3/issues/497 for details.)
  SubjectAltNameWarning
/usr/lib/python2.7/site-packages/urllib3/connection.py:344: SubjectAltNameWarning: Certificate for 192.16.1.222 has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/shazow/urllib3/issues/497 for details.)
  SubjectAltNameWarning
/usr/lib/python2.7/site-packages/urllib3/connection.py:344: SubjectAltNameWarning: Certificate for 192.16.1.222 has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/shazow/urllib3/issues/497 for details.)
  SubjectAltNameWarning
/usr/lib/python2.7/site-packages/urllib3/connection.py:344: SubjectAltNameWarning: Certificate for 192.16.1.222 has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/shazow/urllib3/issues/497 for details.)
  SubjectAltNameWarning
2018-12-03 15:41:58.716 17428 INFO rally.task.context [-] Verification ac818573-1500-42b8-a236-5e490ac58c54 | Context tempest@default setup()  finished in 0.58 sec
2018-12-03 15:41:58.718 17428 INFO rally.task.context [-] Verification ac818573-1500-42b8-a236-5e490ac58c54 | Context testr@default setup()  finished in 1.30 msec
2018-12-03 15:42:03.461 17428 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.173s]
2018-12-03 15:42:03.479 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.251s]
2018-12-03 15:42:03.601 17428 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.141s]
2018-12-03 15:42:16.472 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server ... fail [8.597s]
2018-12-03 15:42:20.157 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image ... fail [9.557s]
2018-12-03 15:42:20.279 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name ... fail [0.120s]
2018-12-03 15:42:44.461 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action ... success [0.116s]
2018-12-03 15:42:45.966 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date ... success [0.109s]
2018-12-03 15:42:45.995 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date ... success [0.028s]
2018-12-03 15:42:46.221 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count ... success [0.227s]
2018-12-03 15:42:46.257 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value ... success [0.034s]
2018-12-03 15:42:46.274 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string ... success [0.017s]
2018-12-03 15:42:46.327 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor ... success [0.053s]
2018-12-03 15:42:46.431 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image ... success [0.104s]
2018-12-03 15:42:46.555 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name ... success [0.123s]
2018-12-03 15:42:46.822 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted ... success [0.267s]
2018-12-03 15:42:46.849 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing ... success [0.026s]
2018-12-03 15:42:46.949 17428 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server ... success [0.100s]
2018-12-03 15:42:50.859 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions ... success [6.396s]
2018-12-03 15:42:56.895 17428 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.162s]
2018-12-03 15:42:56.938 17428 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.043s]
2018-12-03 15:42:57.075 17428 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... fail [0.134s]
2018-12-03 15:42:57.095 17428 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.021s]
2018-12-03 15:42:57.149 17428 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.055s]
2018-12-03 15:43:00.837 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name ... success [31.277s]
2018-12-03 15:43:00.965 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.128s]
2018-12-03 15:43:01.379 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail ... success [0.414s]
2018-12-03 15:43:01.603 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus ... success [0.223s]
2018-12-03 15:43:01.603 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s]
2018-12-03 15:43:01.827 17428 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image ... fail [0.328s]
2018-12-03 15:43:13.905 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [5.753s]
2018-12-03 15:43:16.494 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name ... success [0.990s]
2018-12-03 15:43:17.081 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [3.176s]
2018-12-03 15:43:17.514 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit ... success [1.019s]
2018-12-03 15:43:18.997 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 ... success [1.481s]
2018-12-03 15:43:20.074 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor ... success [1.076s]
2018-12-03 15:43:21.018 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image ... success [0.944s]
2018-12-03 15:43:22.374 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid ... success [1.356s]
2018-12-03 15:43:22.807 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit ... success [0.433s]
2018-12-03 15:43:23.117 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [6.035s]
2018-12-03 15:43:23.209 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id ... success [0.401s]
2018-12-03 15:43:23.699 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server ... success [0.489s]
2018-12-03 15:43:24.706 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address ... success [1.006s]
2018-12-03 15:43:25.215 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server ... success [0.509s]
2018-12-03 15:43:25.662 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_deleted_server ... success [0.446s]
2018-12-03 15:43:26.274 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server ... success [0.612s]
2018-12-03 15:43:26.809 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [3.692s]
2018-12-03 15:43:27.250 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank ... success [0.974s]
2018-12-03 15:43:27.623 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server ... success [0.374s]
2018-12-03 15:43:28.046 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server ... success [0.422s]
2018-12-03 15:43:28.503 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 ... success [0.456s]
2018-12-03 15:43:28.916 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name ... success [0.413s]
2018-12-03 15:43:35.164 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [8.354s]
2018-12-03 15:43:36.859 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas ... success [0.267s]
2018-12-03 15:43:37.247 17428 INFO opnfv-tempest [-] {0} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas ... success [0.387s]
2018-12-03 15:43:37.837 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [2.673s]
2018-12-03 15:43:41.821 17428 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.091s]
2018-12-03 15:43:41.845 17428 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.023s]
2018-12-03 15:43:41.863 17428 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.018s]
2018-12-03 15:43:45.003 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [7.165s]
2018-12-03 15:43:54.413 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [9.408s]
2018-12-03 15:44:01.599 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [7.187s]
2018-12-03 15:44:02.176 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.576s]
2018-12-03 15:44:02.344 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.168s]
2018-12-03 15:44:02.531 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.187s]
2018-12-03 15:44:02.616 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.085s]
2018-12-03 15:44:02.688 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.071s]
2018-12-03 15:44:02.861 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.173s]
2018-12-03 15:44:03.033 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.171s]
2018-12-03 15:44:03.107 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.074s]
2018-12-03 15:44:03.208 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.100s]
2018-12-03 15:44:08.557 17428 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_image_schema ... success [0.022s]
2018-12-03 15:44:08.579 17428 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_images_schema ... success [0.022s]
2018-12-03 15:44:08.659 17428 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_container_format ... success [0.079s]
2018-12-03 15:44:08.721 17428 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_disk_format ... success [0.062s]
2018-12-03 15:44:08.808 17428 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_limit ... success [0.087s]
2018-12-03 15:44:08.927 17428 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_min_max_size ... success [0.119s]
2018-12-03 15:44:09.033 17428 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_size ... success [0.105s]
2018-12-03 15:44:09.119 17428 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_status ... success [0.085s]
2018-12-03 15:44:09.206 17428 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_visibility ... success [0.087s]
2018-12-03 15:44:09.292 17428 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_no_params ... success [0.085s]
2018-12-03 15:44:12.247 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [9.039s]
2018-12-03 15:44:20.882 17428 INFO opnfv-tempest [-] {0} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions ... success [0.291s]
2018-12-03 15:44:29.543 17428 INFO opnfv-tempest [-] {0} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [0.713s]
2018-12-03 15:44:30.469 17428 INFO opnfv-tempest [-] {0} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [0.924s]
2018-12-03 15:44:37.488 17428 INFO opnfv-tempest [-] {0} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.023s]
2018-12-03 15:44:41.526 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [16.273s]
2018-12-03 15:44:44.481 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name ... success [41.729s]
2018-12-03 15:44:44.617 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.137s]
2018-12-03 15:44:44.998 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail ... success [0.380s]
2018-12-03 15:44:45.184 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus ... success [0.186s]
2018-12-03 15:44:45.184 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s]
2018-12-03 15:44:50.138 17428 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [7.879s]
2018-12-03 15:44:51.173 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [9.647s]
2018-12-03 15:44:58.833 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [7.659s]
2018-12-03 15:44:58.963 17428 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_as_clone ... success [8.825s]
2018-12-03 15:45:05.976 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [7.142s]
2018-12-03 15:45:08.443 17428 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [9.479s]
2018-12-03 15:45:15.165 17428 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_with_nonexistent_volume_id ... success [0.271s]
2018-12-03 15:45:15.248 17428 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_without_passing_volume_id ... success [0.084s]
2018-12-03 15:45:43.725 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_update_delete_extra_route ... success [37.746s]
2018-12-03 15:45:45.382 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest.test_update_router_admin_state ... success [1.660s]
2018-12-03 15:46:04.717 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server ... success [30.376s]
2018-12-03 15:46:44.996 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.063s]
2018-12-03 15:46:46.323 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [1.327s]
2018-12-03 15:46:49.266 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [44.548s]
2018-12-03 15:46:49.577 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [3.251s]
2018-12-03 15:46:50.338 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [0.763s]
2018-12-03 15:46:51.987 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [1.647s]
2018-12-03 15:46:52.949 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [0.961s]
2018-12-03 15:46:54.400 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.451s]
2018-12-03 15:46:54.491 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.091s]
2018-12-03 15:46:58.275 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.145s]
2018-12-03 15:46:59.375 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [1.099s]
2018-12-03 15:46:59.913 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [0.538s]
2018-12-03 15:47:00.479 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [0.565s]
2018-12-03 15:47:01.124 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [0.645s]
2018-12-03 15:47:02.141 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [1.016s]
2018-12-03 15:47:03.126 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [0.984s]
2018-12-03 15:47:03.200 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.074s]
2018-12-03 15:47:03.242 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.042s]
2018-12-03 15:47:03.275 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.033s]
2018-12-03 15:47:03.301 17428 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.027s]
2018-12-03 15:47:09.366 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [0.626s]
2018-12-03 15:47:09.853 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [0.486s]
2018-12-03 15:47:20.691 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.077s]
2018-12-03 15:47:20.771 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name ... success [0.079s]
2018-12-03 15:47:20.860 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name ... success [0.089s]
2018-12-03 15:47:21.402 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination ... success [0.541s]
2018-12-03 15:47:21.635 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params ... success [0.232s]
2018-12-03 15:47:22.063 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination ... success [0.429s]
2018-12-03 15:47:22.158 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status ... success [0.094s]
2018-12-03 15:47:22.245 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status ... success [0.087s]
2018-12-03 15:47:22.379 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata ... success [0.133s]
2018-12-03 15:47:22.527 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details ... success [0.148s]
2018-12-03 15:47:22.598 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata ... success [0.071s]
2018-12-03 15:47:22.752 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone ... success [0.154s]
2018-12-03 15:47:22.891 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status ... success [0.138s]
2018-12-03 15:47:23.018 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone ... success [0.127s]
2018-12-03 15:47:23.139 17428 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status ... success [0.121s]
2018-12-03 15:47:31.169 17428 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON ... fail
2018-12-03 15:47:34.408 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server ... success [45.141s]
2018-12-03 15:47:39.047 17428 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.590s]
2018-12-03 15:47:39.386 17428 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.339s]
2018-12-03 15:47:39.683 17428 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [0.296s]
2018-12-03 15:47:40.297 17428 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [0.613s]
2018-12-03 15:47:41.002 17428 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [0.705s]
2018-12-03 15:47:41.601 17428 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [0.598s]
2018-12-03 15:48:04.064 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server ... success [29.653s]
2018-12-03 15:48:24.849 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password ... success [2.038s]
2018-12-03 15:48:32.018 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair ... success [7.167s]
2018-12-03 15:48:45.106 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name ... success [13.084s]
2018-12-03 15:48:53.017 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address ... success [7.910s]
2018-12-03 15:49:47.647 17428 INFO opnfv-tempest [-] {3} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume ... success [113.375s]
2018-12-03 15:50:02.411 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name ... success [69.386s]
2018-12-03 15:50:07.594 17428 INFO opnfv-tempest [-] {2} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.017s]
2018-12-03 15:50:12.523 17428 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.403s]
2018-12-03 15:50:13.054 17428 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [0.531s]
2018-12-03 15:50:19.884 17428 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest ... fail
2018-12-03 15:50:22.254 17428 INFO opnfv-tempest [-] {2} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.010s]
2018-12-03 15:50:24.135 17428 INFO opnfv-tempest [-] {3} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_list_get_volume_attachments ... success [36.483s]
2018-12-03 15:50:26.873 17428 INFO opnfv-tempest [-] {2} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON.test_get_availability_zone_list ... success [0.176s]
2018-12-03 15:50:33.377 17428 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_bootable ... success [0.401s]
2018-12-03 15:50:33.939 17428 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_readonly_update ... success [0.561s]
2018-12-03 15:50:44.617 17428 INFO opnfv-tempest [-] {3} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.426s]
2018-12-03 15:50:49.333 17428 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [0.334s]
2018-12-03 15:50:49.381 17428 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.047s]
2018-12-03 15:50:59.722 17428 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port ... success [4.352s]
2018-12-03 15:51:06.038 17428 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [6.315s]
2018-12-03 15:51:08.854 17428 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [2.817s]
2018-12-03 15:51:08.962 17428 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.108s]
2018-12-03 15:51:09.066 17428 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields ... success [0.102s]
2018-12-03 15:51:26.690 17428 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_port_list_filter_by_router_id ... success [17.623s]
2018-12-03 15:51:26.802 17428 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.111s]
2018-12-03 15:51:26.916 17428 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields ... success [0.114s]
2018-12-03 15:51:35.553 17428 INFO opnfv-tempest [-] {3} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [0.535s]
2018-12-03 15:51:38.965 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest ... fail
2018-12-03 15:51:46.945 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete ... success [2.960s]
2018-12-03 15:51:47.327 17428 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_upload ... success [73.382s]
2018-12-03 15:51:48.647 17428 INFO opnfv-tempest [-] {2} tearDownClass (tempest.api.volume.test_volumes_actions.VolumesActionsTest) ... fail
2018-12-03 15:51:58.213 17428 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_details_with_params ... success [0.144s]
2018-12-03 15:51:58.382 17428 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_with_params ... success [0.170s]
2018-12-03 15:56:48.139 17428 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot ... fail [301.147s]
2018-12-03 15:56:52.129 17428 INFO rally.task.context [-] Verification ac818573-1500-42b8-a236-5e490ac58c54 | Context testr@default cleanup() started
2018-12-03 15:56:52.130 17428 INFO rally.task.context [-] Verification ac818573-1500-42b8-a236-5e490ac58c54 | Context testr@default cleanup() finished in 0.82 msec
2018-12-03 15:56:52.130 17428 INFO rally.task.context [-] Verification ac818573-1500-42b8-a236-5e490ac58c54 | Context tempest@default cleanup() started
/usr/lib/python2.7/site-packages/urllib3/connection.py:344: SubjectAltNameWarning: Certificate for 192.16.1.222 has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/shazow/urllib3/issues/497 for details.)
  SubjectAltNameWarning
/usr/lib/python2.7/site-packages/urllib3/connection.py:344: SubjectAltNameWarning: Certificate for 192.16.1.222 has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/shazow/urllib3/issues/497 for details.)
  SubjectAltNameWarning
/usr/lib/python2.7/site-packages/urllib3/connection.py:344: SubjectAltNameWarning: Certificate for 192.16.1.222 has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/shazow/urllib3/issues/497 for details.)
  SubjectAltNameWarning
2018-12-03 15:56:52.974 17428 INFO rally.task.context [-] Verification ac818573-1500-42b8-a236-5e490ac58c54 | Context tempest@default cleanup() finished in 0.84 sec
2018-12-03 15:56:52.992 17428 INFO rally.api [-] Verification (UUID=cd050d40-0c11-4e23-87a1-29e115504c43) has been successfully finished for deployment 'opnfv-rally' (UUID=d7bf8f73-edf1-4eea-8bf6-7a857ed6b1b2)!

======
Totals
======

Ran: 217 tests in 887.125 sec.
 - Success: 173
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 44

Using verification (UUID=cd050d40-0c11-4e23-87a1-29e115504c43) as the default verification for the future operations.