2018-04-05 14:18:07.741 9922 INFO rally.api [-] Starting verification (UUID=7fd7ff1a-7bfa-4d46-befc-504b165ae831) for deployment 'opnfv-rally' (UUID=dab362d8-ec8d-4ee9-b1f3-5941fd61cf88) by verifier 'opnfv-tempest' (UUID=93d61a9d-fb33-47b0-b0a1-bcae2573bf01).
2018-04-05 14:18:08.221 9922 INFO rally.task.context [-] Verification 93d61a9d-fb33-47b0-b0a1-bcae2573bf01 | Context tempest@default setup()  started
2018-04-05 14:18:10.353 9922 INFO rally.task.context [-] Verification 93d61a9d-fb33-47b0-b0a1-bcae2573bf01 | Context tempest@default setup()  finished in 2.13 sec
2018-04-05 14:18:10.353 9922 INFO rally.task.context [-] Verification 93d61a9d-fb33-47b0-b0a1-bcae2573bf01 | Context testr@default setup()  started
2018-04-05 14:18:10.356 9922 INFO rally.task.context [-] Verification 93d61a9d-fb33-47b0-b0a1-bcae2573bf01 | Context testr@default setup()  finished in 3.09 msec
2018-04-05 14:18:16.887 9922 INFO opnfv-tempest [-] {8} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.229s]
2018-04-05 14:18:19.749 9922 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_reserve_unreserve_volume ... success [1.160s]
2018-04-05 14:18:21.177 9922 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_bootable ... success [1.426s]
2018-04-05 14:18:22.317 9922 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_readonly_update ... success [1.139s]
2018-04-05 14:18:27.451 9922 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [3.628s]
2018-04-05 14:18:28.898 9922 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [1.448s]
2018-04-05 14:18:34.768 9922 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action ... success [0.063s]
2018-04-05 14:18:40.491 9922 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions ... success [5.720s]
2018-04-05 14:18:45.177 9922 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor ... success [0.532s]
2018-04-05 14:18:45.711 9922 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image ... success [0.533s]
2018-04-05 14:18:45.921 9922 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name ... success [0.209s]
2018-04-05 14:18:46.591 9922 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status ... success [0.669s]
2018-04-05 14:18:47.120 9922 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results ... success [0.528s]
2018-04-05 14:18:47.197 9922 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_active_status ... success [0.077s]
2018-04-05 14:18:47.269 9922 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor ... success [0.072s]
2018-04-05 14:18:47.340 9922 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image ... success [0.070s]
2018-04-05 14:18:47.410 9922 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit ... success [0.069s]
2018-04-05 14:18:47.482 9922 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name ... success [0.072s]
2018-04-05 14:18:47.622 9922 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard ... success [0.140s]
2018-04-05 14:18:51.757 9922 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image ... success [2.038s]
2018-04-05 14:18:57.258 9922 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date ... success [0.062s]
2018-04-05 14:18:57.272 9922 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date ... success [0.013s]
2018-04-05 14:18:57.407 9922 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count ... success [0.135s]
2018-04-05 14:18:57.419 9922 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value ... success [0.011s]
2018-04-05 14:18:57.432 9922 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string ... success [0.012s]
2018-04-05 14:18:57.463 9922 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor ... success [0.031s]
2018-04-05 14:18:57.532 9922 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image ... success [0.067s]
2018-04-05 14:18:57.595 9922 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name ... success [0.063s]
2018-04-05 14:18:57.741 9922 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted ... success [0.145s]
2018-04-05 14:18:57.756 9922 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing ... success [0.014s]
2018-04-05 14:18:57.824 9922 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server ... success [0.068s]
2018-04-05 14:19:02.848 9922 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port ... success [4.971s]
2018-04-05 14:19:04.502 9922 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name ... success [4.612s]
2018-04-05 14:19:04.585 9922 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.083s]
2018-04-05 14:19:05.274 9922 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail ... success [0.688s]
2018-04-05 14:19:05.404 9922 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus ... success [0.129s]
2018-04-05 14:19:05.405 9922 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s]
2018-04-05 14:19:10.254 9922 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [7.405s]
2018-04-05 14:19:13.175 9922 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [2.921s]
2018-04-05 14:19:13.380 9922 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.205s]
2018-04-05 14:19:13.574 9922 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields ... success [0.193s]
2018-04-05 14:19:13.729 9922 INFO opnfv-tempest [-] {7} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions ... success [0.162s]
2018-04-05 14:19:13.767 9922 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.192s]
2018-04-05 14:19:13.953 9922 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields ... success [0.185s]
2018-04-05 14:19:17.684 9922 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [5.261s]
2018-04-05 14:19:21.190 9922 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [3.505s]
2018-04-05 14:19:22.984 9922 INFO opnfv-tempest [-] {5} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image ... success [48.169s]
2018-04-05 14:19:25.269 9922 INFO opnfv-tempest [-] {5} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name ... success [2.291s]
2018-04-05 14:19:25.393 9922 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [4.203s]
2018-04-05 14:19:29.161 9922 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [3.767s]
2018-04-05 14:19:35.011 9922 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_upload ... success [72.685s]
2018-04-05 14:19:36.302 9922 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [7.140s]
2018-04-05 14:19:37.456 9922 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.436s]
2018-04-05 14:19:37.721 9922 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.265s]
2018-04-05 14:19:37.959 9922 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [0.237s]
2018-04-05 14:19:38.689 9922 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [0.728s]
2018-04-05 14:19:39.253 9922 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [0.563s]
2018-04-05 14:19:39.746 9922 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [0.493s]
2018-04-05 14:19:44.147 9922 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [7.844s]
2018-04-05 14:19:50.152 9922 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.993s]
2018-04-05 14:19:51.365 9922 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [7.218s]
2018-04-05 14:19:52.067 9922 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [1.915s]
2018-04-05 14:19:52.620 9922 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_details_with_params ... success [0.524s]
2018-04-05 14:19:52.832 9922 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_with_params ... success [0.211s]
2018-04-05 14:19:56.779 9922 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... fail [4.701s]
2018-04-05 14:19:57.996 9922 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [1.224s]
2018-04-05 14:19:58.657 9922 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [7.290s]
2018-04-05 14:20:00.061 9922 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... fail [2.054s]
2018-04-05 14:20:01.515 9922 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [1.460s]
2018-04-05 14:20:03.953 9922 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [2.435s]
2018-04-05 14:20:04.011 9922 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.060s]
2018-04-05 14:20:04.797 9922 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [6.139s]
2018-04-05 14:20:05.125 9922 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.328s]
2018-04-05 14:20:05.375 9922 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.248s]
2018-04-05 14:20:05.439 9922 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.065s]
2018-04-05 14:20:05.495 9922 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.055s]
2018-04-05 14:20:05.597 9922 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.102s]
2018-04-05 14:20:05.842 9922 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.244s]
2018-04-05 14:20:06.063 9922 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.220s]
2018-04-05 14:20:06.197 9922 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.134s]
2018-04-05 14:20:07.591 9922 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name ... success [5.757s]
2018-04-05 14:20:07.670 9922 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.079s]
2018-04-05 14:20:07.982 9922 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail ... success [0.311s]
2018-04-05 14:20:08.081 9922 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus ... success [0.098s]
2018-04-05 14:20:08.083 9922 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s]
2018-04-05 14:20:13.258 9922 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [7.059s]
2018-04-05 14:20:16.522 9922 INFO opnfv-tempest [-] {15} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server ... success [77.686s]
2018-04-05 14:20:22.467 9922 INFO opnfv-tempest [-] {5} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON.test_get_availability_zone_list ... success [0.166s]
2018-04-05 14:20:29.070 9922 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete ... success [5.466s]
2018-04-05 14:20:35.961 9922 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot ... success [6.889s]
2018-04-05 14:21:26.673 9922 INFO opnfv-tempest [-] {15} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [70.152s]
2018-04-05 14:22:55.327 9922 INFO opnfv-tempest [-] {15} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server ... success [88.649s]
2018-04-05 14:24:00.284 9922 INFO opnfv-tempest [-] {15} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server ... success [64.948s]
2018-04-05 14:24:21.308 9922 INFO opnfv-tempest [-] {15} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [6.960s]
2018-04-05 14:24:29.063 9922 INFO opnfv-tempest [-] {15} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_as_clone ... success [7.754s]
2018-04-05 14:24:43.402 9922 INFO opnfv-tempest [-] {15} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [14.337s]
2018-04-05 14:24:46.874 9922 INFO rally.task.context [-] Verification 93d61a9d-fb33-47b0-b0a1-bcae2573bf01 | Context testr@default cleanup() started
2018-04-05 14:24:46.875 9922 INFO rally.task.context [-] Verification 93d61a9d-fb33-47b0-b0a1-bcae2573bf01 | Context testr@default cleanup() finished in 0.73 msec
2018-04-05 14:24:46.875 9922 INFO rally.task.context [-] Verification 93d61a9d-fb33-47b0-b0a1-bcae2573bf01 | Context tempest@default cleanup() started
2018-04-05 14:24:47.814 9922 INFO rally.task.context [-] Verification 93d61a9d-fb33-47b0-b0a1-bcae2573bf01 | Context tempest@default cleanup() finished in 0.94 sec
2018-04-05 14:24:47.888 9922 INFO rally.api [-] Verification (UUID=7fd7ff1a-7bfa-4d46-befc-504b165ae831) has been successfully finished for deployment 'opnfv-rally' (UUID=dab362d8-ec8d-4ee9-b1f3-5941fd61cf88)!

======
Totals
======

Ran: 96 tests in 388.888 sec.
 - Success: 94
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 2

Using verification (UUID=7fd7ff1a-7bfa-4d46-befc-504b165ae831) as the default verification for the future operations.