2018-04-22 12:49:03.003 1371 INFO rally.api [-] Starting verification (UUID=ce226127-b360-47e5-b064-e4bfb3b25c14) for deployment 'opnfv-rally' (UUID=9000885c-3b7a-40a6-b5f9-d3a83b2163f2) by verifier 'opnfv-tempest' (UUID=2159ac7c-45a7-4d8d-86e7-a97809f8dbd2). 2018-04-22 12:49:03.571 1371 INFO rally.task.context [-] Verification 2159ac7c-45a7-4d8d-86e7-a97809f8dbd2 | Context tempest@default setup() started 2018-04-22 12:49:04.663 1371 INFO rally.task.context [-] Verification 2159ac7c-45a7-4d8d-86e7-a97809f8dbd2 | Context tempest@default setup() finished in 1.09 sec 2018-04-22 12:49:04.663 1371 INFO rally.task.context [-] Verification 2159ac7c-45a7-4d8d-86e7-a97809f8dbd2 | Context testr@default setup() started 2018-04-22 12:49:04.665 1371 INFO rally.task.context [-] Verification 2159ac7c-45a7-4d8d-86e7-a97809f8dbd2 | Context testr@default setup() finished in 1.86 msec 2018-04-22 12:49:14.612 1371 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON ... skip: VolumesSnapshotTestJSON skipped as Cinder is not available 2018-04-22 12:49:14.818 1371 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest ... skip: VolumesMetadataTest skipped as Cinder is not available 2018-04-22 12:49:14.885 1371 INFO opnfv-tempest [-] {7} tempest.api.volume.test_extensions.ExtensionsTestJSON ... skip: ExtensionsTestJSON skipped as Cinder is not available 2018-04-22 12:49:15.771 1371 INFO opnfv-tempest [-] {5} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON ... skip: AvailabilityZoneTestJSON skipped as Cinder is not available 2018-04-22 12:49:16.432 1371 INFO opnfv-tempest [-] {13} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON ... skip: VolumesSnapshotListTestJSON skipped as Cinder is not available 2018-04-22 12:49:16.484 1371 INFO opnfv-tempest [-] {25} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON ... skip: VolumesSnapshotNegativeTestJSON skipped as Cinder is not available 2018-04-22 12:49:16.520 1371 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest ... skip: VolumesNegativeTest skipped as Cinder is not available 2018-04-22 12:49:17.034 1371 INFO opnfv-tempest [-] {29} tempest.api.volume.test_volumes_actions.VolumesActionsTest ... skip: VolumesActionsTest skipped as Cinder is not available 2018-04-22 12:49:17.238 1371 INFO opnfv-tempest [-] {38} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON ... skip: SnapshotMetadataTestJSON skipped as Cinder is not available 2018-04-22 12:49:17.262 1371 INFO opnfv-tempest [-] {15} tempest.api.volume.test_volumes_get.VolumesGetTest ... skip: VolumesGetTest skipped as Cinder is not available 2018-04-22 12:49:17.344 1371 INFO opnfv-tempest [-] {22} tempest.api.volume.test_volumes_list.VolumesListTestJSON ... skip: VolumesListTestJSON skipped as Cinder is not available 2018-04-22 12:49:17.384 1371 INFO opnfv-tempest [-] {26} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON ... skip: AttachVolumeTestJSON skipped as Cinder is not available 2018-04-22 12:49:18.437 1371 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [0.752s] 2018-04-22 12:49:18.460 1371 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.023s] 2018-04-22 12:49:18.765 1371 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.286s] 2018-04-22 12:49:19.939 1371 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.404s] 2018-04-22 12:49:20.248 1371 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [1.482s] 2018-04-22 12:49:20.258 1371 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.311s] 2018-04-22 12:49:20.962 1371 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [1.022s] 2018-04-22 12:49:21.587 1371 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [0.624s] 2018-04-22 12:49:21.916 1371 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [1.657s] 2018-04-22 12:49:22.708 1371 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [2.472s] 2018-04-22 12:49:23.139 1371 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [1.551s] 2018-04-22 12:49:23.162 1371 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [2.912s] 2018-04-22 12:49:23.937 1371 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [0.776s] 2018-04-22 12:49:23.991 1371 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [2.074s] 2018-04-22 12:49:23.999 1371 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [0.859s] 2018-04-22 12:49:24.114 1371 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [1.406s] 2018-04-22 12:49:24.345 1371 INFO opnfv-tempest [-] {18} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas ... success [0.212s] 2018-04-22 12:49:24.491 1371 INFO opnfv-tempest [-] {18} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas ... success [0.146s] 2018-04-22 12:49:25.064 1371 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password ... success [7.309s] 2018-04-22 12:49:25.103 1371 INFO opnfv-tempest [-] {24} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.148s] 2018-04-22 12:49:25.595 1371 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port ... success [5.710s] 2018-04-22 12:49:26.016 1371 INFO opnfv-tempest [-] {20} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.263s] 2018-04-22 12:49:26.101 1371 INFO opnfv-tempest [-] {20} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.085s] 2018-04-22 12:49:27.589 1371 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [3.588s] 2018-04-22 12:49:27.637 1371 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [3.699s] 2018-04-22 12:49:29.076 1371 INFO opnfv-tempest [-] {14} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.604s] 2018-04-22 12:49:30.022 1371 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [2.433s] 2018-04-22 12:49:30.483 1371 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [2.846s] 2018-04-22 12:49:30.757 1371 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.735s] 2018-04-22 12:49:30.782 1371 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.025s] 2018-04-22 12:49:30.803 1371 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.020s] 2018-04-22 12:49:30.822 1371 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.019s] 2018-04-22 12:49:32.064 1371 INFO opnfv-tempest [-] {19} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image ... success [8.294s] 2018-04-22 12:49:32.598 1371 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [7.002s] 2018-04-22 12:49:32.989 1371 INFO opnfv-tempest [-] {28} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.009s] 2018-04-22 12:49:35.096 1371 INFO opnfv-tempest [-] {30} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.829s] 2018-04-22 12:49:35.536 1371 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [5.050s] 2018-04-22 12:49:35.645 1371 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.111s] 2018-04-22 12:49:36.569 1371 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [3.971s] 2018-04-22 12:49:36.891 1371 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.321s] 2018-04-22 12:49:36.961 1371 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields ... success [0.070s] 2018-04-22 12:49:37.024 1371 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.063s] 2018-04-22 12:49:37.075 1371 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields ... success [0.051s] 2018-04-22 12:49:38.992 1371 INFO opnfv-tempest [-] {36} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [6.462s] 2018-04-22 12:49:39.009 1371 INFO opnfv-tempest [-] {36} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.018s] 2018-04-22 12:49:39.673 1371 INFO opnfv-tempest [-] {36} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [0.663s] 2018-04-22 12:49:39.680 1371 INFO opnfv-tempest [-] {36} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.007s] 2018-04-22 12:49:39.694 1371 INFO opnfv-tempest [-] {36} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.014s] 2018-04-22 12:49:43.040 1371 INFO opnfv-tempest [-] {32} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [9.089s] 2018-04-22 12:49:44.307 1371 INFO opnfv-tempest [-] {21} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON ... fail 2018-04-22 12:49:45.561 1371 INFO opnfv-tempest [-] {35} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON ... fail 2018-04-22 12:49:49.834 1371 INFO opnfv-tempest [-] {27} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server ... fail [26.019s] 2018-04-22 12:49:50.228 1371 INFO opnfv-tempest [-] {32} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [7.188s] 2018-04-22 12:49:50.861 1371 INFO opnfv-tempest [-] {34} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_image_schema ... success [0.010s] 2018-04-22 12:49:50.869 1371 INFO opnfv-tempest [-] {34} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_images_schema ... success [0.008s] 2018-04-22 12:49:50.919 1371 INFO opnfv-tempest [-] {34} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_container_format ... success [0.049s] 2018-04-22 12:49:51.006 1371 INFO opnfv-tempest [-] {34} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_disk_format ... success [0.087s] 2018-04-22 12:49:51.044 1371 INFO opnfv-tempest [-] {34} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_limit ... success [0.037s] 2018-04-22 12:49:51.101 1371 INFO opnfv-tempest [-] {34} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_min_max_size ... success [0.057s] 2018-04-22 12:49:51.156 1371 INFO opnfv-tempest [-] {34} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_size ... success [0.055s] 2018-04-22 12:49:51.206 1371 INFO opnfv-tempest [-] {34} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_status ... success [0.049s] 2018-04-22 12:49:51.250 1371 INFO opnfv-tempest [-] {34} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_visibility ... success [0.044s] 2018-04-22 12:49:51.298 1371 INFO opnfv-tempest [-] {34} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_no_params ... success [0.048s] 2018-04-22 12:49:52.187 1371 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON ... fail 2018-04-22 12:49:52.450 1371 INFO opnfv-tempest [-] {17} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON ... fail 2018-04-22 12:49:53.736 1371 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair ... fail [28.666s] 2018-04-22 12:49:54.833 1371 INFO opnfv-tempest [-] {16} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON ... fail 2018-04-22 12:49:55.880 1371 INFO opnfv-tempest [-] {32} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [5.651s] 2018-04-22 12:50:00.525 1371 INFO opnfv-tempest [-] {32} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [4.644s] 2018-04-22 12:50:01.848 1371 INFO opnfv-tempest [-] {23} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON ... fail 2018-04-22 12:50:03.166 1371 INFO opnfv-tempest [-] {32} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [2.640s] 2018-04-22 12:50:03.218 1371 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name ... fail [9.478s] 2018-04-22 12:50:05.544 1371 INFO opnfv-tempest [-] {32} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [2.378s] 2018-04-22 12:50:09.453 1371 INFO opnfv-tempest [-] {32} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [3.908s] 2018-04-22 12:50:10.858 1371 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address ... fail [7.639s] 2018-04-22 12:50:11.186 1371 INFO opnfv-tempest [-] {37} tempest.api.compute.servers.test_create_server.ServersTestManualDisk ... fail 2018-04-22 12:50:11.467 1371 INFO opnfv-tempest [-] {33} tempest.api.compute.servers.test_create_server.ServersTestJSON ... fail 2018-04-22 12:50:13.992 1371 INFO opnfv-tempest [-] {32} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [4.539s] 2018-04-22 12:50:14.885 1371 INFO opnfv-tempest [-] {31} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON ... fail 2018-04-22 12:50:17.507 1371 INFO opnfv-tempest [-] {32} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [3.513s] 2018-04-22 12:50:17.820 1371 INFO opnfv-tempest [-] {32} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.314s] 2018-04-22 12:50:17.942 1371 INFO opnfv-tempest [-] {32} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.122s] 2018-04-22 12:50:18.028 1371 INFO opnfv-tempest [-] {32} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.085s] 2018-04-22 12:50:18.109 1371 INFO opnfv-tempest [-] {32} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.081s] 2018-04-22 12:50:18.245 1371 INFO opnfv-tempest [-] {32} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.135s] 2018-04-22 12:50:18.380 1371 INFO opnfv-tempest [-] {32} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.135s] 2018-04-22 12:50:18.454 1371 INFO opnfv-tempest [-] {32} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.074s] 2018-04-22 12:50:18.553 1371 INFO opnfv-tempest [-] {32} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.098s] 2018-04-22 12:50:18.817 1371 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name ... fail [7.955s] 2018-04-22 12:50:23.982 1371 INFO opnfv-tempest [-] {32} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [5.428s] 2018-04-22 12:50:27.920 1371 INFO rally.task.context [-] Verification 2159ac7c-45a7-4d8d-86e7-a97809f8dbd2 | Context testr@default cleanup() started 2018-04-22 12:50:27.920 1371 INFO rally.task.context [-] Verification 2159ac7c-45a7-4d8d-86e7-a97809f8dbd2 | Context testr@default cleanup() finished in 0.42 msec 2018-04-22 12:50:27.920 1371 INFO rally.task.context [-] Verification 2159ac7c-45a7-4d8d-86e7-a97809f8dbd2 | Context tempest@default cleanup() started 2018-04-22 12:50:28.705 1371 INFO rally.task.context [-] Verification 2159ac7c-45a7-4d8d-86e7-a97809f8dbd2 | Context tempest@default cleanup() finished in 0.78 sec 2018-04-22 12:50:28.801 1371 INFO rally.api [-] Verification (UUID=ce226127-b360-47e5-b064-e4bfb3b25c14) has been successfully finished for deployment 'opnfv-rally' (UUID=9000885c-3b7a-40a6-b5f9-d3a83b2163f2)! ====== Totals ====== Ran: 204 tests in 69.380 sec. - Success: 76 - Skipped: 59 - Expected failures: 0 - Unexpected success: 0 - Failures: 69 Using verification (UUID=ce226127-b360-47e5-b064-e4bfb3b25c14) as the default verification for the future operations.