2018-06-10 07:23:35.821 11341 INFO rally.api [-] Starting verification (UUID=b77a3d96-a9b6-4629-90f4-0d65c29d0da2) for deployment 'opnfv-rally' (UUID=ef5e0079-0e6e-4cb2-ba4b-57b8c34aacf5) by verifier 'opnfv-tempest' (UUID=b2c9d64b-ac20-4732-a157-8e47e16f6640).
2018-06-10 07:23:36.336 11341 INFO rally.task.context [-] Verification b2c9d64b-ac20-4732-a157-8e47e16f6640 | Context tempest@default setup()  started
2018-06-10 07:23:37.700 11341 INFO rally.task.context [-] Verification b2c9d64b-ac20-4732-a157-8e47e16f6640 | Context tempest@default setup()  finished in 1.36 sec
2018-06-10 07:23:37.700 11341 INFO rally.task.context [-] Verification b2c9d64b-ac20-4732-a157-8e47e16f6640 | Context testr@default setup()  started
2018-06-10 07:23:37.704 11341 INFO rally.task.context [-] Verification b2c9d64b-ac20-4732-a157-8e47e16f6640 | Context testr@default setup()  finished in 3.17 msec
2018-06-10 07:23:43.829 11341 INFO opnfv-tempest [-] {12} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.013s]
2018-06-10 07:23:44.072 11341 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.239s]
2018-06-10 07:23:44.089 11341 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [0.339s]
2018-06-10 07:23:44.109 11341 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.020s]
2018-06-10 07:23:44.118 11341 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.047s]
2018-06-10 07:23:48.684 11341 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_reserve_unreserve_volume ... success [2.361s]
2018-06-10 07:23:49.161 11341 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_bootable ... success [0.476s]
2018-06-10 07:23:49.654 11341 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_readonly_update ... success [0.492s]
2018-06-10 07:23:49.742 11341 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.088s]
2018-06-10 07:23:49.818 11341 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.074s]
2018-06-10 07:23:49.895 11341 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.078s]
2018-06-10 07:23:50.179 11341 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.259s]
2018-06-10 07:23:52.457 11341 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [2.276s]
2018-06-10 07:23:53.290 11341 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [0.833s]
2018-06-10 07:23:54.032 11341 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [0.741s]
2018-06-10 07:23:54.447 11341 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.149s]
2018-06-10 07:23:54.462 11341 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.014s]
2018-06-10 07:23:54.633 11341 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [0.598s]
2018-06-10 07:23:54.653 11341 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [0.189s]
2018-06-10 07:23:54.660 11341 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.008s]
2018-06-10 07:23:54.809 11341 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.148s]
2018-06-10 07:23:56.335 11341 INFO opnfv-tempest [-] {6} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [1.255s]
2018-06-10 07:23:57.551 11341 INFO opnfv-tempest [-] {6} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [1.215s]
2018-06-10 07:23:57.649 11341 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [3.016s]
2018-06-10 07:23:58.507 11341 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [0.856s]
2018-06-10 07:23:58.613 11341 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.107s]
2018-06-10 07:23:58.634 11341 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.020s]
2018-06-10 07:23:58.658 11341 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.022s]
2018-06-10 07:23:58.676 11341 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.019s]
2018-06-10 07:23:59.445 11341 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date ... success [0.079s]
2018-06-10 07:23:59.460 11341 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date ... success [0.014s]
2018-06-10 07:23:59.598 11341 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count ... success [0.137s]
2018-06-10 07:23:59.610 11341 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value ... success [0.011s]
2018-06-10 07:23:59.620 11341 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string ... success [0.010s]
2018-06-10 07:23:59.655 11341 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor ... success [0.034s]
2018-06-10 07:23:59.734 11341 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image ... success [0.078s]
2018-06-10 07:23:59.804 11341 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name ... success [0.069s]
2018-06-10 07:23:59.973 11341 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted ... success [0.169s]
2018-06-10 07:23:59.989 11341 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing ... success [0.015s]
2018-06-10 07:24:00.054 11341 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server ... success [0.065s]
2018-06-10 07:24:10.757 11341 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.049s]
2018-06-10 07:24:10.940 11341 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name ... success [0.182s]
2018-06-10 07:24:10.991 11341 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name ... success [0.050s]
2018-06-10 07:24:11.599 11341 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination ... success [0.607s]
2018-06-10 07:24:11.710 11341 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params ... success [0.111s]
2018-06-10 07:24:11.931 11341 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination ... success [0.220s]
2018-06-10 07:24:11.982 11341 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status ... success [0.050s]
2018-06-10 07:24:12.028 11341 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status ... success [0.045s]
2018-06-10 07:24:12.086 11341 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata ... success [0.057s]
2018-06-10 07:24:12.151 11341 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details ... success [0.064s]
2018-06-10 07:24:12.194 11341 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata ... success [0.042s]
2018-06-10 07:24:12.278 11341 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone ... success [0.083s]
2018-06-10 07:24:12.299 11341 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [5.538s]
2018-06-10 07:24:12.356 11341 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status ... success [0.078s]
2018-06-10 07:24:12.404 11341 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone ... success [0.048s]
2018-06-10 07:24:12.453 11341 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status ... success [0.049s]
2018-06-10 07:24:16.676 11341 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [4.376s]
2018-06-10 07:24:21.884 11341 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [5.207s]
2018-06-10 07:24:26.139 11341 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [4.254s]
2018-06-10 07:24:30.796 11341 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [4.656s]
2018-06-10 07:24:33.248 11341 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_upload ... success [43.586s]
2018-06-10 07:24:34.656 11341 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [3.859s]
2018-06-10 07:24:38.539 11341 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [3.882s]
2018-06-10 07:24:41.984 11341 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [3.444s]
2018-06-10 07:24:44.384 11341 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_details_with_params ... success [0.210s]
2018-06-10 07:24:44.445 11341 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_with_params ... success [0.061s]
2018-06-10 07:24:46.138 11341 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [4.154s]
2018-06-10 07:24:46.275 11341 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.137s]
2018-06-10 07:24:46.387 11341 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.110s]
2018-06-10 07:24:46.571 11341 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.184s]
2018-06-10 07:24:46.621 11341 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.049s]
2018-06-10 07:24:46.721 11341 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.099s]
2018-06-10 07:24:46.807 11341 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.085s]
2018-06-10 07:24:46.868 11341 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.060s]
2018-06-10 07:24:46.920 11341 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.051s]
2018-06-10 07:24:49.749 11341 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [2.828s]
2018-06-10 07:25:01.432 11341 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete ... success [4.754s]
2018-06-10 07:25:06.714 11341 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot ... success [5.281s]
2018-06-10 07:25:11.990 11341 INFO rally.task.context [-] Verification b2c9d64b-ac20-4732-a157-8e47e16f6640 | Context testr@default cleanup() started
2018-06-10 07:25:11.991 11341 INFO rally.task.context [-] Verification b2c9d64b-ac20-4732-a157-8e47e16f6640 | Context testr@default cleanup() finished in 0.69 msec
2018-06-10 07:25:11.991 11341 INFO rally.task.context [-] Verification b2c9d64b-ac20-4732-a157-8e47e16f6640 | Context tempest@default cleanup() started
2018-06-10 07:25:12.814 11341 INFO rally.task.context [-] Verification b2c9d64b-ac20-4732-a157-8e47e16f6640 | Context tempest@default cleanup() finished in 0.82 sec
2018-06-10 07:25:12.892 11341 INFO rally.api [-] Verification (UUID=b77a3d96-a9b6-4629-90f4-0d65c29d0da2) has been successfully finished for deployment 'opnfv-rally' (UUID=ef5e0079-0e6e-4cb2-ba4b-57b8c34aacf5)!

======
Totals
======

Ran: 78 tests in 84.928 sec.
 - Success: 78
 - Skipped: 0
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 0

Using verification (UUID=b77a3d96-a9b6-4629-90f4-0d65c29d0da2) as the default verification for the future operations.