2018-11-08 21:25:36.096 17746 INFO rally.api [-] Starting verification (UUID=300266f3-687c-4462-839f-78344a10a1b0) for deployment 'opnfv-rally' (UUID=8c2e73ba-a0f6-48f2-9601-1088e568319f) by verifier 'opnfv-tempest' (UUID=03e1d36b-59e1-431b-a23b-b3d604fb9b3f).
/usr/lib/python2.7/site-packages/urllib3/connection.py:344: SubjectAltNameWarning: Certificate for 192.16.1.222 has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/shazow/urllib3/issues/497 for details.)
  SubjectAltNameWarning
/usr/lib/python2.7/site-packages/urllib3/connection.py:344: SubjectAltNameWarning: Certificate for 192.16.1.222 has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/shazow/urllib3/issues/497 for details.)
  SubjectAltNameWarning
/usr/lib/python2.7/site-packages/urllib3/connection.py:344: SubjectAltNameWarning: Certificate for 192.16.1.222 has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/shazow/urllib3/issues/497 for details.)
  SubjectAltNameWarning
/usr/lib/python2.7/site-packages/urllib3/connection.py:344: SubjectAltNameWarning: Certificate for 192.16.1.222 has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/shazow/urllib3/issues/497 for details.)
  SubjectAltNameWarning
2018-11-08 21:25:37.447 17746 INFO rally.task.context [-] Verification 03e1d36b-59e1-431b-a23b-b3d604fb9b3f | Context tempest@default setup()  finished in 0.82 sec
2018-11-08 21:25:37.450 17746 INFO rally.task.context [-] Verification 03e1d36b-59e1-431b-a23b-b3d604fb9b3f | Context testr@default setup()  finished in 2.20 msec
2018-11-08 21:25:42.504 17746 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.315s]
2018-11-08 21:25:42.655 17746 INFO opnfv-tempest [-] {3} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.151s]
2018-11-08 21:25:42.678 17746 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.431s]
2018-11-08 21:25:59.556 17746 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server ... success [12.598s]
2018-11-08 21:26:17.948 17746 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor ... success [0.542s]
2018-11-08 21:26:18.503 17746 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image ... success [0.555s]
2018-11-08 21:26:19.005 17746 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name ... success [0.502s]
2018-11-08 21:26:19.490 17746 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status ... success [0.485s]
2018-11-08 21:26:19.927 17746 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results ... success [0.436s]
2018-11-08 21:26:20.318 17746 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_active_status ... success [0.390s]
2018-11-08 21:26:20.471 17746 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor ... success [0.153s]
2018-11-08 21:26:20.600 17746 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image ... success [0.129s]
2018-11-08 21:26:20.713 17746 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit ... success [0.112s]
2018-11-08 21:26:20.836 17746 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name ... success [0.123s]
2018-11-08 21:26:21.095 17746 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard ... success [0.258s]
2018-11-08 21:26:26.656 17746 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date ... success [0.108s]
2018-11-08 21:26:26.686 17746 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date ... success [0.030s]
2018-11-08 21:26:26.940 17746 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count ... success [0.253s]
2018-11-08 21:26:26.970 17746 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value ... success [0.029s]
2018-11-08 21:26:26.996 17746 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string ... success [0.025s]
2018-11-08 21:26:27.055 17746 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor ... success [0.059s]
2018-11-08 21:26:27.175 17746 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image ... success [0.120s]
2018-11-08 21:26:27.278 17746 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name ... success [0.102s]
2018-11-08 21:26:27.507 17746 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted ... success [0.228s]
2018-11-08 21:26:27.531 17746 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing ... success [0.024s]
2018-11-08 21:26:27.683 17746 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server ... success [0.151s]
2018-11-08 21:26:35.952 17746 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.191s]
2018-11-08 21:26:36.023 17746 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.073s]
2018-11-08 21:26:36.931 17746 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [0.907s]
2018-11-08 21:26:36.955 17746 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.023s]
2018-11-08 21:26:36.999 17746 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.045s]
2018-11-08 21:26:42.515 17746 INFO opnfv-tempest [-] {1} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image ... success [1.326s]
2018-11-08 21:26:51.561 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [2.619s]
2018-11-08 21:26:54.566 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [3.004s]
2018-11-08 21:26:57.679 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [3.113s]
2018-11-08 21:26:57.870 17746 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.807s]
2018-11-08 21:26:58.331 17746 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.459s]
2018-11-08 21:26:58.854 17746 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [0.524s]
2018-11-08 21:26:59.419 17746 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name ... success [31.097s]
2018-11-08 21:26:59.555 17746 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.136s]
2018-11-08 21:26:59.612 17746 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [0.758s]
2018-11-08 21:27:00.060 17746 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail ... success [0.504s]
2018-11-08 21:27:00.255 17746 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus ... success [0.195s]
2018-11-08 21:27:00.256 17746 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s]
2018-11-08 21:27:00.371 17746 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [0.759s]
2018-11-08 21:27:01.231 17746 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [0.859s]
2018-11-08 21:27:02.745 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [5.065s]
2018-11-08 21:27:07.516 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [4.769s]
2018-11-08 21:27:14.351 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [6.833s]
2018-11-08 21:27:20.303 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [5.951s]
2018-11-08 21:27:28.874 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [8.571s]
2018-11-08 21:27:33.409 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [4.535s]
2018-11-08 21:27:33.682 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.273s]
2018-11-08 21:27:34.222 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.539s]
2018-11-08 21:27:34.427 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.205s]
2018-11-08 21:27:34.527 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.099s]
2018-11-08 21:27:34.610 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.084s]
2018-11-08 21:27:34.849 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.239s]
2018-11-08 21:27:35.020 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.170s]
2018-11-08 21:27:35.115 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.095s]
2018-11-08 21:27:35.205 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.090s]
2018-11-08 21:27:40.551 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image ... success [108.815s]
2018-11-08 21:27:41.628 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name ... success [1.082s]
2018-11-08 21:27:45.081 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [9.874s]
2018-11-08 21:27:57.254 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action ... success [0.154s]
2018-11-08 21:28:01.542 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions ... success [4.286s]
2018-11-08 21:28:02.257 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_routers.RoutersTest ... fail
2018-11-08 21:28:06.339 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.455s]
2018-11-08 21:28:07.861 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [1.521s]
2018-11-08 21:28:10.995 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [3.132s]
2018-11-08 21:28:12.023 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [1.029s]
2018-11-08 21:28:13.949 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [1.926s]
2018-11-08 21:28:15.311 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [1.361s]
2018-11-08 21:28:15.871 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name ... success [0.914s]
2018-11-08 21:28:16.752 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit ... success [0.881s]
2018-11-08 21:28:17.099 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.786s]
2018-11-08 21:28:17.175 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.076s]
2018-11-08 21:28:18.518 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 ... success [1.765s]
2018-11-08 21:28:19.539 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor ... success [1.021s]
2018-11-08 21:28:20.449 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image ... success [0.910s]
2018-11-08 21:28:21.331 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.104s]
2018-11-08 21:28:21.410 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid ... success [0.960s]
2018-11-08 21:28:21.855 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit ... success [0.445s]
2018-11-08 21:28:22.273 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id ... success [0.417s]
2018-11-08 21:28:22.615 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [1.284s]
2018-11-08 21:28:22.764 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server ... success [0.491s]
2018-11-08 21:28:23.201 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [0.586s]
2018-11-08 21:28:23.674 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address ... success [0.908s]
2018-11-08 21:28:23.885 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [0.683s]
2018-11-08 21:28:24.168 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server ... success [0.494s]
2018-11-08 21:28:24.605 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [0.719s]
2018-11-08 21:28:24.636 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_deleted_server ... success [0.467s]
2018-11-08 21:28:25.032 17746 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name ... success [18.481s]
2018-11-08 21:28:25.069 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server ... success [0.433s]
2018-11-08 21:28:25.137 17746 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.104s]
2018-11-08 21:28:25.493 17746 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail ... success [0.356s]
2018-11-08 21:28:25.676 17746 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus ... success [0.182s]
2018-11-08 21:28:25.676 17746 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s]
2018-11-08 21:28:25.863 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [1.257s]
2018-11-08 21:28:25.927 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank ... success [0.858s]
2018-11-08 21:28:26.315 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server ... success [0.387s]
2018-11-08 21:28:26.699 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server ... success [0.384s]
2018-11-08 21:28:26.715 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [0.851s]
2018-11-08 21:28:26.848 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.133s]
2018-11-08 21:28:26.882 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.034s]
2018-11-08 21:28:26.923 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.040s]
2018-11-08 21:28:26.952 17746 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.029s]
2018-11-08 21:28:27.078 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 ... success [0.378s]
2018-11-08 21:28:27.403 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name ... success [0.324s]
2018-11-08 21:28:33.588 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas ... success [0.364s]
2018-11-08 21:28:33.894 17746 INFO opnfv-tempest [-] {0} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas ... success [0.308s]
2018-11-08 21:28:38.088 17746 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.102s]
2018-11-08 21:28:38.125 17746 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.036s]
2018-11-08 21:28:38.150 17746 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.025s]
2018-11-08 21:28:41.367 17746 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volume_metadata.VolumesMetadataTest ... fail
2018-11-08 21:28:47.713 17746 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.ListUserImagesTest ... fail
2018-11-08 21:28:49.556 17746 INFO opnfv-tempest [-] {1} tempest.api.volume.test_volumes_list.VolumesListTestJSON ... fail
2018-11-08 21:28:50.433 17746 INFO opnfv-tempest [-] {0} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions ... success [0.169s]
2018-11-08 21:28:59.806 17746 INFO opnfv-tempest [-] {0} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [1.171s]
2018-11-08 21:29:01.133 17746 INFO opnfv-tempest [-] {0} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [1.326s]
2018-11-08 21:29:08.702 17746 INFO opnfv-tempest [-] {0} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.024s]
2018-11-08 21:29:21.736 17746 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [8.505s]
2018-11-08 21:29:25.030 17746 INFO opnfv-tempest [-] {3} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume ... success [119.366s]
2018-11-08 21:29:30.889 17746 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_as_clone ... success [9.152s]
2018-11-08 21:29:42.701 17746 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [11.811s]
2018-11-08 21:29:48.373 17746 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_with_nonexistent_volume_id ... success [0.221s]
2018-11-08 21:29:48.449 17746 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_without_passing_volume_id ... success [0.076s]
2018-11-08 21:29:54.375 17746 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server ... success [31.966s]
2018-11-08 21:30:03.586 17746 INFO opnfv-tempest [-] {3} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_list_get_volume_attachments ... success [38.550s]
2018-11-08 21:30:25.621 17746 INFO opnfv-tempest [-] {3} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.433s]
2018-11-08 21:30:28.127 17746 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest ... fail
2018-11-08 21:30:29.624 17746 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON ... fail
2018-11-08 21:30:30.580 17746 INFO opnfv-tempest [-] {3} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON ... fail
2018-11-08 21:30:31.523 17746 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_negative.VolumesNegativeTest ... fail
2018-11-08 21:30:31.774 17746 INFO opnfv-tempest [-] {3} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON ... fail
2018-11-08 21:30:46.631 17746 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [52.256s]
2018-11-08 21:31:22.955 17746 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server ... success [36.322s]
2018-11-08 21:31:36.601 17746 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server ... fail [13.641s]
2018-11-08 21:32:09.727 17746 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password ... success [1.099s]
2018-11-08 21:32:16.726 17746 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair ... fail [6.995s]
2018-11-08 21:32:29.939 17746 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name ... success [13.213s]
2018-11-08 21:32:37.831 17746 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address ... success [7.891s]
2018-11-08 21:33:44.253 17746 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name ... success [66.414s]
2018-11-08 21:33:48.967 17746 INFO opnfv-tempest [-] {2} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.014s]
2018-11-08 21:33:52.796 17746 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.354s]
2018-11-08 21:33:53.540 17746 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [0.744s]
2018-11-08 21:34:15.623 17746 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_add_router_interfaces_on_overlapping_subnets_returns_400 ... success [11.365s]
2018-11-08 21:34:15.724 17746 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_delete_non_existent_router_returns_404 ... success [0.100s]
2018-11-08 21:34:16.706 17746 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_add_gateway_invalid_network_returns_404 ... success [0.982s]
2018-11-08 21:34:19.071 17746 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_add_gateway_net_not_external_returns_400 ... success [2.362s]
2018-11-08 21:34:26.870 17746 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_router_remove_interface_in_use_returns_409 ... success [7.800s]
2018-11-08 21:34:26.955 17746 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_show_non_existent_router_returns_404 ... success [0.084s]
2018-11-08 21:34:27.047 17746 INFO opnfv-tempest [-] {2} tempest.api.network.test_routers_negative.RoutersNegativeTest.test_update_non_existent_router_returns_404 ... success [0.092s]
2018-11-08 21:34:57.573 17746 INFO opnfv-tempest [-] {2} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.012s]
2018-11-08 21:35:01.400 17746 INFO opnfv-tempest [-] {2} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON.test_get_availability_zone_list ... success [0.184s]
2018-11-08 21:35:07.146 17746 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_bootable ... success [0.424s]
2018-11-08 21:35:07.548 17746 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_readonly_update ... success [0.401s]
2018-11-08 21:36:13.820 17746 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_upload ... success [66.267s]
2018-11-08 21:36:26.300 17746 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_details_with_params ... success [0.196s]
2018-11-08 21:36:26.505 17746 INFO opnfv-tempest [-] {2} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_with_params ... success [0.204s]
2018-11-08 21:36:35.492 17746 INFO rally.task.context [-] Verification 03e1d36b-59e1-431b-a23b-b3d604fb9b3f | Context testr@default cleanup() started
2018-11-08 21:36:35.493 17746 INFO rally.task.context [-] Verification 03e1d36b-59e1-431b-a23b-b3d604fb9b3f | Context testr@default cleanup() finished in 0.76 msec
2018-11-08 21:36:35.493 17746 INFO rally.task.context [-] Verification 03e1d36b-59e1-431b-a23b-b3d604fb9b3f | Context tempest@default cleanup() started
/usr/lib/python2.7/site-packages/urllib3/connection.py:344: SubjectAltNameWarning: Certificate for 192.16.1.222 has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/shazow/urllib3/issues/497 for details.)
  SubjectAltNameWarning
/usr/lib/python2.7/site-packages/urllib3/connection.py:344: SubjectAltNameWarning: Certificate for 192.16.1.222 has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/shazow/urllib3/issues/497 for details.)
  SubjectAltNameWarning
/usr/lib/python2.7/site-packages/urllib3/connection.py:344: SubjectAltNameWarning: Certificate for 192.16.1.222 has no `subjectAltName`, falling back to check for a `commonName` for now. This feature is being removed by major browsers and deprecated by RFC 2818. (See https://github.com/shazow/urllib3/issues/497 for details.)
  SubjectAltNameWarning
2018-11-08 21:36:36.333 17746 INFO rally.task.context [-] Verification 03e1d36b-59e1-431b-a23b-b3d604fb9b3f | Context tempest@default cleanup() finished in 0.84 sec
2018-11-08 21:36:36.354 17746 INFO rally.api [-] Verification (UUID=300266f3-687c-4462-839f-78344a10a1b0) has been successfully finished for deployment 'opnfv-rally' (UUID=8c2e73ba-a0f6-48f2-9601-1088e568319f)!

======
Totals
======

Ran: 217 tests in 646.764 sec.
 - Success: 149
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 68

Using verification (UUID=300266f3-687c-4462-839f-78344a10a1b0) as the default verification for the future operations.