2018-05-19 04:15:40.989 311 INFO rally.api [-] Starting verification (UUID=75412c49-82f3-46a0-9c66-cc25d4fcb5ad) for deployment 'opnfv-rally' (UUID=198c588c-940a-41e3-948f-876f269ed74e) by verifier 'opnfv-tempest' (UUID=ef34f932-4dac-47af-941f-54f136d84bb8).
2018-05-19 04:15:41.526 311 INFO rally.task.context [-] Verification ef34f932-4dac-47af-941f-54f136d84bb8 | Context tempest@default setup()  started
2018-05-19 04:15:43.600 311 INFO rally.task.context [-] Verification ef34f932-4dac-47af-941f-54f136d84bb8 | Context tempest@default setup()  finished in 2.07 sec
2018-05-19 04:15:43.600 311 INFO rally.task.context [-] Verification ef34f932-4dac-47af-941f-54f136d84bb8 | Context testr@default setup()  started
2018-05-19 04:15:43.603 311 INFO rally.task.context [-] Verification ef34f932-4dac-47af-941f-54f136d84bb8 | Context testr@default setup()  finished in 2.19 msec
2018-05-19 04:15:50.231 311 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.203s]
2018-05-19 04:15:50.298 311 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.066s]
2018-05-19 04:15:54.620 311 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.103s]
2018-05-19 04:15:54.713 311 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.092s]
2018-05-19 04:15:54.789 311 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.076s]
2018-05-19 04:15:59.517 311 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.165s]
2018-05-19 04:15:59.680 311 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.163s]
2018-05-19 04:16:00.473 311 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [0.792s]
2018-05-19 04:16:00.622 311 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.149s]
2018-05-19 04:16:00.777 311 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.154s]
2018-05-19 04:16:03.682 311 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action ... success [0.072s]
2018-05-19 04:16:07.126 311 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON ... fail
2018-05-19 04:16:07.367 311 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server ... success [17.367s]
2018-05-19 04:16:07.462 311 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions ... success [3.779s]
2018-05-19 04:16:08.763 311 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date ... success [0.075s]
2018-05-19 04:16:08.777 311 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date ... success [0.013s]
2018-05-19 04:16:08.921 311 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count ... success [0.144s]
2018-05-19 04:16:08.932 311 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value ... success [0.011s]
2018-05-19 04:16:08.944 311 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string ... success [0.012s]
2018-05-19 04:16:08.990 311 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor ... success [0.045s]
2018-05-19 04:16:09.054 311 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image ... success [0.063s]
2018-05-19 04:16:09.124 311 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name ... success [0.070s]
2018-05-19 04:16:09.434 311 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted ... success [0.309s]
2018-05-19 04:16:09.448 311 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing ... success [0.013s]
2018-05-19 04:16:09.520 311 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server ... success [0.072s]
2018-05-19 04:16:15.397 311 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image ... success [1.571s]
2018-05-19 04:16:16.733 311 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.398s]
2018-05-19 04:16:16.972 311 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.239s]
2018-05-19 04:16:17.258 311 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [0.285s]
2018-05-19 04:16:17.753 311 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [0.494s]
2018-05-19 04:16:18.192 311 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [0.439s]
2018-05-19 04:16:18.820 311 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [0.628s]
2018-05-19 04:16:23.038 311 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name ... success [1.779s]
2018-05-19 04:16:23.376 311 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [4.273s]
2018-05-19 04:16:24.518 311 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit ... success [1.479s]
2018-05-19 04:16:25.592 311 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port ... success [3.755s]
2018-05-19 04:16:26.129 311 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 ... success [1.609s]
2018-05-19 04:16:27.473 311 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor ... success [1.344s]
2018-05-19 04:16:28.048 311 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [2.664s]
2018-05-19 04:16:28.198 311 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [4.822s]
2018-05-19 04:16:28.973 311 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image ... success [1.500s]
2018-05-19 04:16:29.887 311 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [1.838s]
2018-05-19 04:16:30.147 311 INFO opnfv-tempest [-] {5} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image ... success [27.368s]
2018-05-19 04:16:30.886 311 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid ... success [1.911s]
2018-05-19 04:16:31.270 311 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [3.071s]
2018-05-19 04:16:31.554 311 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit ... success [0.669s]
2018-05-19 04:16:31.634 311 INFO opnfv-tempest [-] {5} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name ... success [1.490s]
2018-05-19 04:16:31.946 311 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id ... success [0.391s]
2018-05-19 04:16:32.100 311 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [6.507s]
2018-05-19 04:16:32.529 311 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server ... success [0.582s]
2018-05-19 04:16:34.272 311 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address ... success [1.741s]
2018-05-19 04:16:34.657 311 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [2.555s]
2018-05-19 04:16:34.746 311 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [4.855s]
2018-05-19 04:16:34.911 311 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.254s]
2018-05-19 04:16:34.949 311 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server ... success [0.678s]
2018-05-19 04:16:35.052 311 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields ... success [0.140s]
2018-05-19 04:16:35.208 311 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_deleted_server ... success [0.258s]
2018-05-19 04:16:35.243 311 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.190s]
2018-05-19 04:16:35.287 311 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields ... success [0.044s]
2018-05-19 04:16:35.750 311 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server ... success [0.542s]
2018-05-19 04:16:35.756 311 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [4.485s]
2018-05-19 04:16:35.895 311 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [1.151s]
2018-05-19 04:16:37.226 311 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank ... success [1.474s]
2018-05-19 04:16:38.060 311 INFO opnfv-tempest [-] {5} tearDownClass (tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON) ... fail
2018-05-19 04:16:38.102 311 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server ... success [0.875s]
2018-05-19 04:16:38.639 311 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server ... success [0.537s]
2018-05-19 04:16:39.139 311 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [3.241s]
2018-05-19 04:16:39.295 311 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 ... success [0.656s]
2018-05-19 04:16:39.532 311 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name ... success [0.236s]
2018-05-19 04:16:40.208 311 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [4.451s]
2018-05-19 04:16:40.615 311 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [1.476s]
2018-05-19 04:16:43.530 311 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [2.911s]
2018-05-19 04:16:43.570 311 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.043s]
2018-05-19 04:16:43.688 311 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [3.479s]
2018-05-19 04:16:48.417 311 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [4.727s]
2018-05-19 04:16:53.728 311 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [5.310s]
2018-05-19 04:16:56.740 311 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk ... fail
2018-05-19 04:16:58.292 311 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [4.563s]
2018-05-19 04:16:58.541 311 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.250s]
2018-05-19 04:16:58.786 311 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.243s]
2018-05-19 04:16:58.862 311 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.076s]
2018-05-19 04:16:58.922 311 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.059s]
2018-05-19 04:16:59.019 311 INFO opnfv-tempest [-] {5} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON.test_get_availability_zone_list ... success [0.158s]
2018-05-19 04:16:59.166 311 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.244s]
2018-05-19 04:16:59.411 311 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.244s]
2018-05-19 04:16:59.615 311 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.204s]
2018-05-19 04:16:59.667 311 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.052s]
2018-05-19 04:17:05.877 311 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [6.208s]
2018-05-19 04:17:20.161 311 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete ... success [5.291s]
2018-05-19 04:17:27.340 311 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot ... success [7.178s]
2018-05-19 04:17:33.447 311 INFO rally.task.context [-] Verification ef34f932-4dac-47af-941f-54f136d84bb8 | Context testr@default cleanup() started
2018-05-19 04:17:33.448 311 INFO rally.task.context [-] Verification ef34f932-4dac-47af-941f-54f136d84bb8 | Context testr@default cleanup() finished in 0.79 msec
2018-05-19 04:17:33.448 311 INFO rally.task.context [-] Verification ef34f932-4dac-47af-941f-54f136d84bb8 | Context tempest@default cleanup() started
2018-05-19 04:17:34.420 311 INFO rally.task.context [-] Verification ef34f932-4dac-47af-941f-54f136d84bb8 | Context tempest@default cleanup() finished in 0.97 sec
2018-05-19 04:17:34.533 311 INFO rally.api [-] Verification (UUID=75412c49-82f3-46a0-9c66-cc25d4fcb5ad) has been successfully finished for deployment 'opnfv-rally' (UUID=198c588c-940a-41e3-948f-876f269ed74e)!

======
Totals
======

Ran: 97 tests in 99.449 sec.
 - Success: 87
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 10

Using verification (UUID=75412c49-82f3-46a0-9c66-cc25d4fcb5ad) as the default verification for the future operations.