2018-03-22 20:33:54.688 51 INFO rally.api [-] Starting verification (UUID=d3b47e41-6bf2-4090-a3e0-7da9090ff5e1) for deployment 'opnfv-rally' (UUID=e0bcc563-c96a-489c-9bb4-5e8cb412b458) by verifier 'opnfv-tempest' (UUID=544838d2-adbb-4709-b3dd-1b1fddc6be0e). 2018-03-22 20:33:55.356 51 INFO rally.task.context [-] Verification 544838d2-adbb-4709-b3dd-1b1fddc6be0e | Context tempest@default setup() started 2018-03-22 20:33:57.542 51 INFO rally.task.context [-] Verification 544838d2-adbb-4709-b3dd-1b1fddc6be0e | Context tempest@default setup() finished in 2.19 sec 2018-03-22 20:33:57.543 51 INFO rally.task.context [-] Verification 544838d2-adbb-4709-b3dd-1b1fddc6be0e | Context testr@default setup() started 2018-03-22 20:33:57.545 51 INFO rally.task.context [-] Verification 544838d2-adbb-4709-b3dd-1b1fddc6be0e | Context testr@default setup() finished in 2.07 msec 2018-03-22 20:34:03.848 51 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor ... success [0.214s] 2018-03-22 20:34:03.970 51 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.122s] 2018-03-22 20:34:10.778 51 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create ... success [0.827s] 2018-03-22 20:34:12.239 51 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list ... success [1.458s] 2018-03-22 20:34:24.368 51 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete ... success [4.535s] 2018-03-22 20:34:39.866 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip ... success [8.368s] 2018-03-22 20:35:07.285 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers ... success [0.121s] 2018-03-22 20:35:07.287 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details ... success [0.001s] 2018-03-22 20:35:37.454 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.099s] 2018-03-22 20:35:37.455 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s] 2018-03-22 20:36:08.663 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.095s] 2018-03-22 20:36:08.666 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s] 2018-03-22 20:36:46.729 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [10.513s] 2018-03-22 20:37:09.225 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses ... success [0.071s] 2018-03-22 20:37:09.390 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network ... success [0.162s] 2018-03-22 20:37:17.863 51 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_get_version_details ... success [0.879s] 2018-03-22 20:37:17.877 51 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.014s] 2018-03-22 20:37:19.676 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_services.ServicesTestJSON ... skip: Identity api v2 is not enabled 2018-03-22 20:37:19.677 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_users.UsersTestJSON ... skip: Identity api v2 is not enabled 2018-03-22 20:37:24.831 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete ... success [0.491s] 2018-03-22 20:37:32.626 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists ... success [0.149s] 2018-03-22 20:37:41.431 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain ... success [0.942s] 2018-03-22 20:37:51.035 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint ... success [0.555s] 2018-03-22 20:38:03.634 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete ... success [4.461s] 2018-03-22 20:38:11.409 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy ... success [0.562s] 2018-03-22 20:38:18.775 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id ... success [0.273s] 2018-03-22 20:38:27.847 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list ... success [0.713s] 2018-03-22 20:38:37.202 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service ... success [0.650s] 2018-03-22 20:38:48.760 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all ... success [4.210s] 2018-03-22 20:38:51.564 51 INFO opnfv-tempest [-] {0} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery ... skip: Identity api v2 is not enabled 2018-03-22 20:38:54.071 51 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.096s] 2018-03-22 20:38:54.171 51 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.100s] 2018-03-22 20:38:54.279 51 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.107s] 2018-03-22 20:38:54.291 51 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions ... success [0.012s] 2018-03-22 20:38:59.300 51 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.544s] 2018-03-22 20:38:59.999 51 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file ... success [0.698s] 2018-03-22 20:39:00.960 51 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [0.961s] 2018-03-22 20:39:07.223 51 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_versions.VersionsTest.test_list_versions ... success [0.019s] 2018-03-22 20:39:12.611 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions ... success [1.064s] 2018-03-22 20:39:25.493 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address ... success [2.389s] 2018-03-22 20:39:28.442 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip ... success [2.947s] 2018-03-22 20:39:41.268 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network ... success [3.400s] 2018-03-22 20:39:44.487 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port ... success [3.218s] 2018-03-22 20:39:54.014 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet ... success [9.525s] 2018-03-22 20:40:06.848 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network ... success [3.642s] 2018-03-22 20:40:10.042 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port ... success [3.192s] 2018-03-22 20:40:14.443 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet ... success [4.402s] 2018-03-22 20:40:35.243 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet ... success [5.979s] 2018-03-22 20:40:35.412 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility ... success [0.169s] 2018-03-22 20:40:35.572 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks ... success [0.159s] 2018-03-22 20:40:35.642 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets ... success [0.069s] 2018-03-22 20:40:35.787 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network ... success [0.145s] 2018-03-22 20:40:35.877 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet ... success [0.090s] 2018-03-22 20:40:52.508 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [6.400s] 2018-03-22 20:40:52.824 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.316s] 2018-03-22 20:40:52.972 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.147s] 2018-03-22 20:40:53.040 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.067s] 2018-03-22 20:40:53.183 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.141s] 2018-03-22 20:40:53.256 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.074s] 2018-03-22 20:41:08.467 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools ... success [4.884s] 2018-03-22 20:41:14.980 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups ... success [6.512s] 2018-03-22 20:41:17.038 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port ... success [2.056s] 2018-03-22 20:41:17.122 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports ... success [0.085s] 2018-03-22 20:41:17.233 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port ... success [0.111s] 2018-03-22 20:41:30.905 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [5.447s] 2018-03-22 20:41:38.383 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups ... success [7.477s] 2018-03-22 20:41:40.003 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [1.620s] 2018-03-22 20:41:40.111 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.108s] 2018-03-22 20:41:40.186 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.074s] 2018-03-22 20:41:55.223 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces ... success [8.495s] 2018-03-22 20:42:00.710 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id ... success [5.487s] 2018-03-22 20:42:04.907 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id ... success [4.196s] 2018-03-22 20:42:11.368 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router ... success [6.460s] 2018-03-22 20:43:02.747 51 INFO opnfv-tempest [-] {0} tearDownClass (tempest.api.network.test_routers.RoutersIpV6Test) ... fail 2018-03-22 20:43:58.774 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... fail [53.134s] 2018-03-22 20:44:53.673 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... fail [54.897s] 2018-03-22 20:44:58.006 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [4.336s] 2018-03-22 20:45:00.926 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [2.919s] 2018-03-22 20:45:21.805 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group ... success [1.296s] 2018-03-22 20:45:23.240 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule ... success [1.433s] 2018-03-22 20:45:23.315 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups ... success [0.077s] 2018-03-22 20:45:28.677 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.258s] 2018-03-22 20:45:30.123 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.443s] 2018-03-22 20:45:30.200 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.078s] 2018-03-22 20:45:35.216 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [0.789s] 2018-03-22 20:45:40.103 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.013s] 2018-03-22 20:45:41.650 51 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest ... skip: AccountQuotasTest skipped as swift is not available 2018-03-22 20:45:41.651 51 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_services.AccountTest ... skip: AccountTest skipped as swift is not available 2018-03-22 20:45:41.653 51 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest ... skip: ContainerQuotasTest skipped as swift is not available 2018-03-22 20:45:41.654 51 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest ... skip: ContainerTest skipped as swift is not available 2018-03-22 20:45:41.654 51 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_object_services.ObjectTest ... skip: ObjectTest skipped as swift is not available 2018-03-22 20:45:44.208 51 INFO opnfv-tempest [-] {0} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.024s] 2018-03-22 20:46:01.925 51 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_attach_detach_volume_to_instance ... success [10.503s] 2018-03-22 20:46:13.863 51 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [6.382s] 2018-03-22 20:46:23.962 51 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [10.097s] 2018-03-22 20:46:33.568 51 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.069s] 2018-03-22 20:47:35.125 51 INFO opnfv-tempest [-] {0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops ... success [53.259s] 2018-03-22 20:48:05.851 51 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops ... success [21.125s] 2018-03-22 20:48:45.033 51 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_multinode.TestServerMultinode.test_schedule_to_all_nodes ... success [19.517s] 2018-03-22 20:49:01.486 51 INFO rally.task.context [-] Verification 544838d2-adbb-4709-b3dd-1b1fddc6be0e | Context testr@default cleanup() started 2018-03-22 20:49:01.487 51 INFO rally.task.context [-] Verification 544838d2-adbb-4709-b3dd-1b1fddc6be0e | Context testr@default cleanup() finished in 0.90 msec 2018-03-22 20:49:01.487 51 INFO rally.task.context [-] Verification 544838d2-adbb-4709-b3dd-1b1fddc6be0e | Context tempest@default cleanup() started 2018-03-22 20:49:02.696 51 INFO rally.task.context [-] Verification 544838d2-adbb-4709-b3dd-1b1fddc6be0e | Context tempest@default cleanup() finished in 1.21 sec 2018-03-22 20:49:02.753 51 INFO rally.api [-] Verification (UUID=d3b47e41-6bf2-4090-a3e0-7da9090ff5e1) has been successfully finished for deployment 'opnfv-rally' (UUID=e0bcc563-c96a-489c-9bb4-5e8cb412b458)! ====== Totals ====== Ran: 109 tests in 883.871 sec. - Success: 88 - Skipped: 19 - Expected failures: 0 - Unexpected success: 0 - Failures: 2 Using verification (UUID=d3b47e41-6bf2-4090-a3e0-7da9090ff5e1) as the default verification for the future operations.