2018-06-15 23:53:16.390 11238 INFO rally.api [-] Starting verification (UUID=806f9671-788c-4a72-b844-f6b963e9faf2) for deployment 'opnfv-rally' (UUID=0a9572a5-86c8-495e-a6f7-806a71106b34) by verifier 'opnfv-tempest' (UUID=7e5d3afd-d20a-4420-926f-f914d74e1a39).
2018-06-15 23:53:16.887 11238 INFO rally.task.context [-] Verification 7e5d3afd-d20a-4420-926f-f914d74e1a39 | Context tempest@default setup()  started
2018-06-15 23:53:20.180 11238 INFO rally.task.context [-] Verification 7e5d3afd-d20a-4420-926f-f914d74e1a39 | Context tempest@default setup()  finished in 3.29 sec
2018-06-15 23:53:20.180 11238 INFO rally.task.context [-] Verification 7e5d3afd-d20a-4420-926f-f914d74e1a39 | Context testr@default setup()  started
2018-06-15 23:53:20.184 11238 INFO rally.task.context [-] Verification 7e5d3afd-d20a-4420-926f-f914d74e1a39 | Context testr@default setup()  finished in 3.33 msec
2018-06-15 23:53:26.019 11238 INFO opnfv-tempest [-] {12} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.012s]
2018-06-15 23:53:26.130 11238 INFO opnfv-tempest [-] {14} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.322s]
2018-06-15 23:53:30.808 11238 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_reserve_unreserve_volume ... success [2.411s]
2018-06-15 23:53:31.116 11238 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.159s]
2018-06-15 23:53:32.817 11238 INFO opnfv-tempest [-] {14} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.889s]
2018-06-15 23:53:32.956 11238 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_bootable ... success [2.148s]
2018-06-15 23:53:33.878 11238 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [2.760s]
2018-06-15 23:53:36.710 11238 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_readonly_update ... success [3.752s]
2018-06-15 23:53:37.407 11238 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [3.527s]
2018-06-15 23:53:38.792 11238 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [1.385s]
2018-06-15 23:53:40.122 11238 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [1.329s]
2018-06-15 23:53:43.942 11238 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [3.818s]
2018-06-15 23:53:45.555 11238 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [1.612s]
2018-06-15 23:53:45.716 11238 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.162s]
2018-06-15 23:53:45.739 11238 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.022s]
2018-06-15 23:53:45.757 11238 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.018s]
2018-06-15 23:53:45.776 11238 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.019s]
2018-06-15 23:53:57.638 11238 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date ... success [0.063s]
2018-06-15 23:53:57.649 11238 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date ... success [0.011s]
2018-06-15 23:53:57.808 11238 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count ... success [0.158s]
2018-06-15 23:53:57.819 11238 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value ... success [0.011s]
2018-06-15 23:53:57.833 11238 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string ... success [0.013s]
2018-06-15 23:53:57.864 11238 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor ... success [0.031s]
2018-06-15 23:53:57.930 11238 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image ... success [0.064s]
2018-06-15 23:53:58.000 11238 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name ... success [0.069s]
2018-06-15 23:53:58.255 11238 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted ... success [0.254s]
2018-06-15 23:53:58.269 11238 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing ... success [0.015s]
2018-06-15 23:53:58.346 11238 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server ... success [0.076s]
2018-06-15 23:53:58.924 11238 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor ... success [0.590s]
2018-06-15 23:53:59.148 11238 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image ... success [0.223s]
2018-06-15 23:53:59.812 11238 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name ... success [0.664s]
2018-06-15 23:54:00.201 11238 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status ... success [0.387s]
2018-06-15 23:54:00.840 11238 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results ... success [0.639s]
2018-06-15 23:54:00.910 11238 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_active_status ... success [0.071s]
2018-06-15 23:54:00.984 11238 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor ... success [0.073s]
2018-06-15 23:54:01.053 11238 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image ... success [0.068s]
2018-06-15 23:54:01.119 11238 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit ... success [0.066s]
2018-06-15 23:54:01.184 11238 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name ... success [0.064s]
2018-06-15 23:54:01.328 11238 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard ... success [0.143s]
2018-06-15 23:54:16.936 11238 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [5.696s]
2018-06-15 23:54:23.103 11238 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [6.166s]
2018-06-15 23:54:27.479 11238 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [4.376s]
2018-06-15 23:54:31.118 11238 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [3.638s]
2018-06-15 23:54:35.573 11238 INFO opnfv-tempest [-] {7} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions ... success [0.152s]
2018-06-15 23:54:36.916 11238 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [5.797s]
2018-06-15 23:54:41.676 11238 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [4.760s]
2018-06-15 23:54:46.634 11238 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [4.957s]
2018-06-15 23:54:53.316 11238 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [6.680s]
2018-06-15 23:54:57.685 11238 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [4.368s]
2018-06-15 23:54:57.890 11238 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.205s]
2018-06-15 23:54:58.225 11238 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.334s]
2018-06-15 23:54:58.584 11238 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.358s]
2018-06-15 23:54:59.286 11238 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.701s]
2018-06-15 23:54:59.535 11238 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.249s]
2018-06-15 23:54:59.649 11238 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.113s]
2018-06-15 23:54:59.710 11238 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.060s]
2018-06-15 23:54:59.765 11238 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.054s]
2018-06-15 23:55:01.723 11238 INFO opnfv-tempest [-] {10} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume ... success [79.675s]
2018-06-15 23:55:02.067 11238 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_upload ... success [85.346s]
2018-06-15 23:55:07.512 11238 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [7.746s]
2018-06-15 23:55:23.016 11238 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_details_with_params ... success [0.478s]
2018-06-15 23:55:23.357 11238 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_with_params ... success [0.340s]
2018-06-15 23:55:27.433 11238 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete ... success [8.989s]
2018-06-15 23:55:39.387 11238 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot ... success [11.951s]
2018-06-15 23:55:49.065 11238 INFO opnfv-tempest [-] {10} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_list_get_volume_attachments ... success [47.332s]
2018-06-15 23:56:14.757 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size ... success [0.237s]
2018-06-15 23:56:14.930 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id ... success [0.173s]
2018-06-15 23:56:15.120 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid ... success [0.189s]
2018-06-15 23:56:15.139 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type ... success [0.019s]
2018-06-15 23:56:15.301 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative ... success [0.161s]
2018-06-15 23:56:15.314 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero ... success [0.012s]
2018-06-15 23:56:15.538 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size ... success [0.223s]
2018-06-15 23:56:15.721 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id ... success [0.183s]
2018-06-15 23:56:15.873 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id ... success [0.151s]
2018-06-15 23:56:15.906 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id ... success [0.033s]
2018-06-15 23:56:16.063 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id ... success [0.157s]
2018-06-15 23:56:16.249 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status ... success [0.185s]
2018-06-15 23:56:16.297 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name ... success [0.048s]
2018-06-15 23:56:16.478 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status ... success [0.179s]
2018-06-15 23:56:16.514 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name ... success [0.036s]
2018-06-15 23:56:16.914 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_negative_volume_status ... success [0.399s]
2018-06-15 23:56:17.114 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_nonexistent_volume_id ... success [0.200s]
2018-06-15 23:56:17.147 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_unreserve_volume_with_nonexistent_volume_id ... success [0.033s]
2018-06-15 23:56:17.157 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id ... success [0.009s]
2018-06-15 23:56:17.199 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id ... success [0.041s]
2018-06-15 23:56:17.422 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id ... success [0.222s]
2018-06-15 23:56:17.607 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id ... success [0.185s]
2018-06-15 23:56:17.787 11238 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id ... success [0.179s]
2018-06-15 23:56:22.141 11238 INFO rally.task.context [-] Verification 7e5d3afd-d20a-4420-926f-f914d74e1a39 | Context testr@default cleanup() started
2018-06-15 23:56:22.142 11238 INFO rally.task.context [-] Verification 7e5d3afd-d20a-4420-926f-f914d74e1a39 | Context testr@default cleanup() finished in 0.76 msec
2018-06-15 23:56:22.142 11238 INFO rally.task.context [-] Verification 7e5d3afd-d20a-4420-926f-f914d74e1a39 | Context tempest@default cleanup() started
2018-06-15 23:56:23.114 11238 INFO rally.task.context [-] Verification 7e5d3afd-d20a-4420-926f-f914d74e1a39 | Context tempest@default cleanup() finished in 0.97 sec
2018-06-15 23:56:23.192 11238 INFO rally.api [-] Verification (UUID=806f9671-788c-4a72-b844-f6b963e9faf2) has been successfully finished for deployment 'opnfv-rally' (UUID=0a9572a5-86c8-495e-a6f7-806a71106b34)!

======
Totals
======

Ran: 88 tests in 173.728 sec.
 - Success: 88
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 0

Using verification (UUID=806f9671-788c-4a72-b844-f6b963e9faf2) as the default verification for the future operations.