2018-11-14 17:03:13.534 89 INFO rally.api [-] Starting verification (UUID=0ab0be4d-ffb4-4f74-a418-593b2afc711b) for deployment 'opnfv-rally' (UUID=80a0aaa6-3e31-41b2-8663-1564a484bb32) by verifier 'opnfv-tempest' (UUID=984a60c2-8838-4b4c-90cd-8c94fac023af).
2018-11-14 17:03:14.990 89 INFO rally.task.context [-] Verification 984a60c2-8838-4b4c-90cd-8c94fac023af | Context tempest@default setup()  finished in 0.91 sec
2018-11-14 17:03:14.994 89 INFO rally.task.context [-] Verification 984a60c2-8838-4b4c-90cd-8c94fac023af | Context testr@default setup()  finished in 3.46 msec
2018-11-14 17:03:20.795 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_agent_availability_zone.AgentAvailabilityZoneTestCase.test_agents_availability_zone ... skip [0.000s]: Need a single availability_zone assumption.
2018-11-14 17:03:21.044 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_list_agent ... success [0.218s]
2018-11-14 17:03:21.683 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_list_agents_non_admin ... success [0.638s]
2018-11-14 17:03:21.875 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_show_agent ... success [0.193s]
2018-11-14 17:03:22.406 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_update_agent_description ... success [0.529s]
2018-11-14 17:03:22.635 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_update_agent_status ... success [0.229s]
2018-11-14 17:03:26.987 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_l3_agent_scheduler.L3AgentSchedulerTestJSON ... skip: l3_agent_scheduler extension not enabled.
2018-11-14 17:03:26.988 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_logging.LoggingTestJSON ... skip: logging extension not enabled.
2018-11-14 17:03:28.701 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_add_remove_network_from_dhcp_agent ... success [4.721s]
2018-11-14 17:03:28.995 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_dhcp_port_status_active ... success [0.296s]
2018-11-14 17:03:29.212 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_list_dhcp_agent_hosting_network ... success [0.217s]
2018-11-14 17:03:29.781 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_list_networks_hosted_by_one_dhcp ... success [0.567s]
2018-11-14 17:03:32.635 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_networks.NetworksTestAdmin.test_create_network_with_project ... success [1.885s]
2018-11-14 17:03:32.823 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_networks.NetworksTestAdmin.test_create_network_with_project_and_other_tenant ... success [0.190s]
2018-11-14 17:03:34.013 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_networks.NetworksTestAdmin.test_create_network_with_project_and_tenant ... success [1.189s]
2018-11-14 17:03:34.015 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_networks.NetworksTestAdmin.test_create_tenant_network_vxlan ... skip [0.000s]: VXLAN type_driver is not enabled
2018-11-14 17:03:38.673 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_floating_ips_admin_actions.FloatingIPAdminTestJSON.test_associate_floating_ip_with_port_from_another_project ... success [6.765s]
2018-11-14 17:03:41.750 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_floating_ips_admin_actions.FloatingIPAdminTestJSON.test_create_floatingip_with_specified_ip_address ... success [3.078s]
2018-11-14 17:03:42.838 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_delete_policies_while_tenant_attached_to_net ... success [13.069s]
2018-11-14 17:03:45.524 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_extension_driver_port_security_admin.PortSecurityAdminTests.test_create_port_security_false_on_shared_network ... success [3.055s]
2018-11-14 17:03:45.978 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_floatingip_when_quotas_is_full ... success [3.453s]
2018-11-14 17:03:46.419 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_conversion_on_one_policy_delete ... success [3.582s]
2018-11-14 17:03:48.930 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_network_when_quotas_is_full ... success [2.952s]
2018-11-14 17:03:49.295 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_conversion_on_policy_create ... success [2.875s]
2018-11-14 17:03:52.332 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_conversion_on_policy_delete ... success [3.036s]
2018-11-14 17:03:53.548 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_logging_negative.LoggingNegativeTestJSON ... skip: logging extension not enabled.
2018-11-14 17:03:54.704 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_network_on_shared_policy_delete ... success [2.371s]
2018-11-14 17:03:54.968 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_port_when_quotas_is_full ... success [6.037s]
2018-11-14 17:03:56.637 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_router_when_quotas_is_full ... success [1.668s]
2018-11-14 17:03:58.910 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_security_group_rule_when_quotas_is_full ... success [2.271s]
2018-11-14 17:03:59.218 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_ports.PortTestCasesAdmin.test_regenerate_mac_address ... skip [0.001s]: Skipped because network extension: port-mac-address-regenerate is not enabled
2018-11-14 17:03:59.221 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_update_policy_from_wildcard_to_specific_tenant ... success [4.518s]
2018-11-14 17:04:00.641 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_security_group_when_quotas_is_full ... success [1.729s]
2018-11-14 17:04:02.214 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_ports.PortTestCasesAdmin.test_update_mac_address ... success [2.995s]
2018-11-14 17:04:05.955 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_subnet_when_quotas_is_full ... success [5.313s]
2018-11-14 17:04:07.079 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_quotas.QuotasTest.test_detail_quotas ... success [6.198s]
2018-11-14 17:04:08.217 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_policy_allows_tenant_to_allocate_floatingip ... success [8.994s]
2018-11-14 17:04:08.514 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_quotas.QuotasTest.test_quotas ... success [1.435s]
2018-11-14 17:04:12.761 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_routers_dvr.RouterTestCentralizedToDVR ... skip: l3-ha extension not enabled.
2018-11-14 17:04:15.752 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_policy_allows_tenant_to_attach_ext_gw ... success [7.535s]
2018-11-14 17:04:16.980 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_regular_client_blocked_from_creating_external_wild_policies ... success [1.227s]
2018-11-14 17:04:21.124 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_routers_dvr.RoutersTestDVR.test_centralized_router_creation ... success [1.971s]
2018-11-14 17:04:21.378 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_regular_client_shares_with_another ... success [4.398s]
2018-11-14 17:04:22.088 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_security_groups.SecGroupAdminTest.test_security_group_recreated_on_port_update ... success [5.644s]
2018-11-14 17:04:22.376 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_routers_dvr.RoutersTestDVR.test_distributed_router_creation ... success [1.252s]
2018-11-14 17:04:25.703 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_routers_flavors.RoutersFlavorTestCase ... skip: l3-flavors extension not enabled.
2018-11-14 17:04:26.757 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_wildcard_policy_created_from_external_network_api ... success [5.377s]
2018-11-14 17:04:27.456 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_wildcard_policy_delete_blocked_on_default_ext ... success [0.699s]
2018-11-14 17:04:29.294 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagFilterPortTestJSON.test_filter_port_tags ... success [1.293s]
2018-11-14 17:04:32.816 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_shared_network_extension.AllowedAddressPairSharedNetworkTest.test_create_with_address_pair_blocked_on_other_network ... success [0.808s]
2018-11-14 17:04:34.290 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_routers_ha.RoutersTestHA ... skip: l3-ha extension not enabled.
2018-11-14 17:04:34.581 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_shared_network_extension.AllowedAddressPairSharedNetworkTest.test_update_with_address_pair_blocked_on_other_network ... success [1.765s]
2018-11-14 17:04:44.959 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_create_rbac_policy_with_target_tenant_none ... success [5.119s]
2018-11-14 17:04:47.674 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_tag.TagFilterFloatingIpTestJSON.test_filter_floatingip_tags ... success [0.916s]
2018-11-14 17:04:49.932 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_create_rbac_policy_with_target_tenant_too_long_id ... success [4.972s]
2018-11-14 17:04:52.704 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagFilterQosPolicyTestJSON ... skip: Skipped because network extension: qos is not enabled
2018-11-14 17:04:54.074 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_delete_self_share_rule ... success [4.141s]
2018-11-14 17:04:56.191 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_tag.TagFilterRouterTestJSON.test_filter_router_tags ... success [2.289s]
2018-11-14 17:05:01.401 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_duplicate_policy_error ... success [7.327s]
2018-11-14 17:05:03.106 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagFilterSecGroupTestJSON.test_filter_security_group_tags ... success [1.877s]
2018-11-14 17:05:03.280 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_filter_fields ... success [1.879s]
2018-11-14 17:05:05.906 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_filter_policies ... success [2.625s]
2018-11-14 17:05:15.375 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_tag.TagFloatingIpTestJSON.test_floatingip_tags ... success [2.598s]
2018-11-14 17:05:15.422 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_filtering_works_with_rbac_records_present ... success [9.514s]
2018-11-14 17:05:16.462 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_tag.TagFilterTrunkTestJSON.test_filter_trunk_tags ... success [1.392s]
2018-11-14 17:05:19.227 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagNetworkTestJSON.test_network_tags ... success [4.176s]
2018-11-14 17:05:22.575 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_network_only_visible_to_policy_target ... success [7.152s]
2018-11-14 17:05:29.319 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_tag.TagPortTestJSON.test_port_tags ... success [3.825s]
2018-11-14 17:05:29.762 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_policy_show ... success [7.187s]
2018-11-14 17:05:32.607 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagRouterTestJSON.test_router_tags ... success [4.836s]
2018-11-14 17:05:36.869 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_tag.TagSecGroupTestJSON.test_security_group_tags ... success [3.290s]
2018-11-14 17:05:37.012 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_policy_target_update ... success [7.250s]
2018-11-14 17:05:42.902 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_tag.TagSubnetPoolTestJSON.test_subnetpool_tags ... success [3.479s]
2018-11-14 17:05:45.324 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_admin_create_shared_address_scope ... success [0.979s]
2018-11-14 17:05:46.034 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_admin_update_shared_address_scope ... success [0.711s]
2018-11-14 17:05:47.328 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_delete_address_scope ... success [1.292s]
2018-11-14 17:05:47.804 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_show_address_scope ... success [0.476s]
2018-11-14 17:05:48.027 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_port_presence_prevents_network_rbac_policy_deletion ... success [11.013s]
2018-11-14 17:05:48.217 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcp_stateful_fixedips_outrange ... success [7.083s]
2018-11-14 17:05:48.367 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_show_address_scope_project_id ... success [0.562s]
2018-11-14 17:05:48.967 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_tenant_create_list_address_scope ... success [0.600s]
2018-11-14 17:05:49.548 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_tenant_update_address_scope ... success [0.581s]
2018-11-14 17:05:53.540 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.227s]
2018-11-14 17:05:54.642 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination ... success [1.099s]
2018-11-14 17:05:55.101 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.459s]
2018-11-14 17:05:55.562 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.461s]
2018-11-14 17:05:55.769 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_rbac_bumps_network_revision ... success [7.741s]
2018-11-14 17:05:56.631 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [1.067s]
2018-11-14 17:05:58.172 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_allowed_address_pairs ... success [4.122s]
2018-11-14 17:05:59.459 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_with_href_links ... success [2.825s]
2018-11-14 17:06:01.148 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_with_marker ... success [1.689s]
2018-11-14 17:06:01.408 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_sorts_asc ... success [0.262s]
2018-11-14 17:06:01.500 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_sorts_desc ... success [0.090s]
2018-11-14 17:06:01.501 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_validation_filters ... skip [0.001s]: Skipped until Bug: 1749820 is resolved.
2018-11-14 17:06:03.711 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_create_list_port_with_address_pair ... success [4.226s]
2018-11-14 17:06:04.583 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_create_port_sec_with_security_group ... success [6.411s]
2018-11-14 17:06:07.055 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_rbac_policy_quota ... success [11.284s]
2018-11-14 17:06:07.329 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_address_pair ... success [3.617s]
2018-11-14 17:06:09.296 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_delete_with_port_sec ... success [4.711s]
2018-11-14 17:06:11.358 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_cidr_address_pair ... success [4.028s]
2018-11-14 17:06:13.053 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_default_value ... success [3.756s]
2018-11-14 17:06:15.661 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_regular_client_blocked_from_sharing_anothers_network ... success [8.607s]
2018-11-14 17:06:16.716 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_regular_client_blocked_from_sharing_with_wildcard ... success [1.054s]
2018-11-14 17:06:16.753 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_multiple_ip_mac_address_pair ... success [5.395s]
2018-11-14 17:06:17.002 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_specific_value_1 ... success [3.949s]
2018-11-14 17:06:17.932 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks_negative.NetworksNegativeTest.test_delete_network_in_use ... success [3.175s]
2018-11-14 17:06:19.325 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_regular_client_shares_to_another_regular_client ... success [2.609s]
2018-11-14 17:06:20.744 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_specific_value_2 ... success [3.741s]
2018-11-14 17:06:27.412 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_subnet_on_network_only_visible_to_policy_target ... success [8.085s]
2018-11-14 17:06:30.341 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_update_pass ... success [9.595s]
2018-11-14 17:06:30.776 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_tenant_can_delete_port_on_own_network ... success [3.364s]
2018-11-14 17:06:33.839 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_tenant_cant_delete_other_tenants_ports ... success [3.062s]
2018-11-14 17:06:35.005 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_auto_allocated_topology.TestAutoAllocatedTopology ... skip: No default subnetpool
2018-11-14 17:06:35.885 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_add_ips_to_port ... success [4.422s]
2018-11-14 17:06:36.975 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_update_port_failed ... success [6.634s]
2018-11-14 17:06:37.839 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_update_self_share_rule ... success [4.000s]
2018-11-14 17:06:43.080 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_change_dhcp_flag_then_create_port ... success [7.195s]
2018-11-14 17:06:45.807 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_create_update_port_description ... success [2.725s]
2018-11-14 17:06:45.811 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_create_update_port_with_dns_domain ... skip [0.001s]: Skipped because network extension: dns-domain-ports is not enabled
2018-11-14 17:06:45.812 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_create_update_port_with_dns_name ... skip [0.000s]: Skipped because network extension: dns-integration is not enabled
2018-11-14 17:06:45.813 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_create_update_port_with_no_dns_name ... skip [0.000s]: Skipped because network extension: dns-integration is not enabled
2018-11-14 17:06:46.595 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_extra_dhcp_options.ExtraDHCPOptionsIpV6TestJSON.test_create_list_port_with_extra_dhcp_options ... success [3.132s]
2018-11-14 17:06:47.555 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_extra_dhcp_options.ExtraDHCPOptionsIpV6TestJSON.test_update_show_port_with_extra_dhcp_options ... success [0.960s]
2018-11-14 17:06:57.546 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_qos.QosBandwidthLimitRuleTestJSON ... skip: qos extension not enabled.
2018-11-14 17:06:57.547 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_qos.QosBandwidthLimitRuleWithDirectionTestJSON ... skip: qos extension not enabled.
2018-11-14 17:06:57.548 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_qos.QosDscpMarkingRuleTestJSON ... skip: qos extension not enabled.
2018-11-14 17:06:59.044 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_create_bulk_shared_network ... success [2.557s]
2018-11-14 17:07:01.617 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_create_port_shared_network_as_non_admin_tenant ... success [2.572s]
2018-11-14 17:07:03.028 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_create_update_shared_network ... success [1.411s]
2018-11-14 17:07:04.090 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers.DvrRoutersTest.test_create_distributed_router ... success [2.916s]
2018-11-14 17:07:04.723 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_filtering_shared_networks ... success [1.694s]
2018-11-14 17:07:07.931 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers.DvrRoutersTestToCentralized ... skip: l3-ha extension not enabled.
2018-11-14 17:07:07.932 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers.HaRoutersTest ... skip: l3-ha extension not enabled.
2018-11-14 17:07:09.530 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_filtering_shared_subnets ... success [4.804s]
2018-11-14 17:07:10.155 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_list_shared_networks ... success [0.627s]
2018-11-14 17:07:10.567 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_show_shared_networks_attribute ... success [0.412s]
2018-11-14 17:07:22.812 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_create_update_delete_flavor ... success [0.951s]
2018-11-14 17:07:23.561 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_create_update_delete_service_profile ... success [0.748s]
2018-11-14 17:07:23.764 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_list_flavors ... success [0.203s]
2018-11-14 17:07:23.958 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_list_service_profiles ... success [0.194s]
2018-11-14 17:07:24.163 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_show_flavor ... success [0.205s]
2018-11-14 17:07:24.227 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_floating_ips_negative.FloatingIPNegativeTestJSON.test_associate_floatingip_with_port_with_floatingip ... success [18.931s]
2018-11-14 17:07:24.356 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_show_service_profile ... success [0.194s]
2018-11-14 17:07:29.033 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers_negative.RoutersNegativePolicyTest.test_add_interface_wrong_tenant ... success [10.388s]
2018-11-14 17:07:34.687 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_create_update_delete_flavor ... success [1.000s]
2018-11-14 17:07:35.375 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_create_update_delete_service_profile ... success [0.688s]
2018-11-14 17:07:35.606 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_list_flavors ... success [0.230s]
2018-11-14 17:07:35.617 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_list_service_profiles ... success [0.011s]
2018-11-14 17:07:35.632 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_show_flavor ... success [0.015s]
2018-11-14 17:07:35.646 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_show_service_profile ... success [0.013s]
2018-11-14 17:07:38.959 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagFilterNetworkTestJSON.test_filter_network_tags ... success [1.600s]
2018-11-14 17:07:41.264 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_metering_extensions.MeteringIpV6TestJSON ... skip: metering extension not enabled.
2018-11-14 17:07:48.318 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv6Test.test_admin_network_availability_before_subnet ... success [3.402s]
2018-11-14 17:07:50.566 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv4Test.test_admin_network_availability_before_subnet ... success [3.355s]
2018-11-14 17:07:52.070 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers_negative.RoutersNegativeTest.test_delete_router_in_use ... success [5.074s]
2018-11-14 17:07:54.758 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv6Test.test_net_ip_availability_after_port_delete ... success [6.439s]
2018-11-14 17:07:56.792 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv4Test.test_net_ip_availability_after_port_delete ... success [6.226s]
2018-11-14 17:08:02.983 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv6Test.test_net_ip_availability_after_subnet_and_ports ... success [8.226s]
2018-11-14 17:08:06.437 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv4Test.test_net_ip_availability_after_subnet_and_ports ... success [9.644s]
2018-11-14 17:08:10.546 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagFilterSubnetTestJSON.test_filter_subnet_tags ... success [1.923s]
2018-11-14 17:08:11.066 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_with_boolean_type_name ... success [0.177s]
2018-11-14 17:08:11.270 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_with_too_long_name ... success [0.204s]
2018-11-14 17:08:14.868 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_delete_in_use_sec_group ... success [3.596s]
2018-11-14 17:08:15.355 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_update_default_security_group_name ... success [0.487s]
2018-11-14 17:08:15.636 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_network_ip_availability_negative.NetworksIpAvailabilityNegativeTest.test_network_availability_nonexistent_network_id ... success [0.577s]
2018-11-14 17:08:15.799 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_update_security_group_with_boolean_type_name ... success [0.444s]
2018-11-14 17:08:16.267 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_update_security_group_with_too_long_name ... success [0.466s]
2018-11-14 17:08:17.530 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_create_network_with_project ... success [2.263s]
2018-11-14 17:08:17.533 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_create_update_network_dns_domain ... skip [0.001s]: Skipped because network extension: dns-integration is not enabled
2018-11-14 17:08:18.396 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_list_networks_fields_keystone_v3 ... success [0.864s]
2018-11-14 17:08:18.652 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_show_network ... success [0.257s]
2018-11-14 17:08:19.716 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_show_network_fields_keystone_v3 ... success [1.064s]
2018-11-14 17:08:22.699 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_qos_negative.QosNegativeTestJSON ... skip: qos extension not enabled.
2018-11-14 17:08:25.041 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_admin_create_shared_subnetpool ... success [1.295s]
2018-11-14 17:08:28.690 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.114s]
2018-11-14 17:08:29.428 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_dual_stack_subnets_from_subnetpools ... success [4.388s]
2018-11-14 17:08:29.595 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination ... success [0.903s]
2018-11-14 17:08:29.978 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.384s]
2018-11-14 17:08:30.007 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_list_subnetpool ... success [0.580s]
2018-11-14 17:08:30.337 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.359s]
2018-11-14 17:08:30.883 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.544s]
2018-11-14 17:08:32.135 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnet_from_pool_with_default_prefixlen ... success [2.126s]
2018-11-14 17:08:33.376 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_portbinding_bumps_revision ... success [7.189s]
2018-11-14 17:08:33.542 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_with_href_links ... success [2.659s]
2018-11-14 17:08:34.559 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_with_marker ... success [1.017s]
2018-11-14 17:08:34.611 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_sorts_asc ... success [0.053s]
2018-11-14 17:08:34.665 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_sorts_desc ... success [0.054s]
2018-11-14 17:08:34.817 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnet_from_pool_with_prefixlen ... success [2.682s]
2018-11-14 17:08:37.303 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnet_from_pool_with_quota ... success [2.484s]
2018-11-14 17:08:38.756 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_allowed_address_pairs_bumps_revision ... success [5.380s]
2018-11-14 17:08:38.758 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_dns_domain_bumps_revision ... skip [0.001s]: Skipped because network extension: dns-integration is not enabled
2018-11-14 17:08:40.950 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_qos.QosMinimumBandwidthRuleTestJSON ... skip: qos extension not enabled.
2018-11-14 17:08:40.951 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_qos.QosTestJSON ... skip: qos extension not enabled.
2018-11-14 17:08:41.189 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnet_from_pool_with_subnet_cidr ... success [3.885s]
2018-11-14 17:08:42.493 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_external_network_bumps_revision ... success [3.736s]
2018-11-14 17:08:42.661 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnetpool_associate_address_scope ... success [1.471s]
2018-11-14 17:08:43.334 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_update_subnetpool_description ... success [0.670s]
2018-11-14 17:08:43.937 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_get_subnetpool ... success [0.605s]
2018-11-14 17:08:44.917 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_show_subnetpool_has_project_id ... success [0.979s]
2018-11-14 17:08:45.637 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_tenant_create_non_default_subnetpool ... success [0.720s]
2018-11-14 17:08:46.323 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_tenant_update_subnetpool ... success [0.685s]
2018-11-14 17:08:47.908 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_associate_address_scope ... success [1.584s]
2018-11-14 17:08:49.586 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_extra_dhcp_opt_bumps_revision ... success [7.092s]
2018-11-14 17:08:49.818 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_associate_another_address_scope ... success [1.909s]
2018-11-14 17:08:50.196 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagFilterSubnetpoolTestJSON.test_filter_subnetpool_tags ... success [0.921s]
2018-11-14 17:08:51.015 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_disassociate_address_scope ... success [1.195s]
2018-11-14 17:08:51.385 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_prefixes_append ... success [0.371s]
2018-11-14 17:08:51.735 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_prefixes_extend ... success [0.350s]
2018-11-14 17:08:52.530 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_security_group_rule_with_ipv6_protocol_integers ... success [9.008s]
2018-11-14 17:08:55.147 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_security_group_rule_with_ipv6_protocol_legacy_names ... success [2.618s]
2018-11-14 17:09:02.317 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_security_group_rule_with_ipv6_protocol_names ... success [7.158s]
2018-11-14 17:09:05.000 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagQosPolicyTestJSON ... skip: Skipped because network extension: qos is not enabled
2018-11-14 17:09:11.382 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_floatingip_bumps_revision ... success [21.794s]
2018-11-14 17:09:14.154 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_network_bumps_revision ... success [2.774s]
2018-11-14 17:09:15.755 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_network_constrained_by_revision ... fail [1.595s]
2018-11-14 17:09:16.178 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagSubnetTestJSON.test_subnet_tags ... success [4.091s]
2018-11-14 17:09:17.124 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_show_delete_security_group_rule_integers ... success [14.782s]
2018-11-14 17:09:20.088 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_port_bumps_revision ... success [4.335s]
2018-11-14 17:09:27.861 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_port_security_bumps_revisions ... success [7.772s]
2018-11-14 17:09:28.281 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_sp_associate_address_scope_multiple_prefix_intersect ... success [1.491s]
2018-11-14 17:09:28.578 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_show_delete_security_group_rule_names ... success [11.430s]
2018-11-14 17:09:32.239 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_port_sg_binding_bumps_revision ... success [4.375s]
2018-11-14 17:09:32.243 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_qos_network_policy_binding_bumps_revision ... skip [0.001s]: Skipped because network extension: qos is not enabled
2018-11-14 17:09:32.244 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_qos_port_policy_binding_bumps_revision ... skip [0.001s]: Skipped because network extension: qos is not enabled
2018-11-14 17:09:33.230 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnet_different_pools_same_network ... success [4.949s]
2018-11-14 17:09:34.057 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnetpool_associate_address_scope_of_other_owner ... success [0.827s]
2018-11-14 17:09:35.872 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnetpool_associate_address_scope_prefix_intersect ... success [1.814s]
2018-11-14 17:09:35.941 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagTrunkTestJSON.test_trunk_tags ... success [3.399s]
2018-11-14 17:09:36.066 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnetpool_associate_invalid_address_scope ... success [0.194s]
2018-11-14 17:09:37.111 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnetpool_associate_non_exist_address_scope ... success [1.043s]
2018-11-14 17:09:37.326 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_delete_non_existent_subnetpool ... success [0.214s]
2018-11-14 17:09:37.350 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_get_non_existent_subnetpool ... success [0.025s]
2018-11-14 17:09:37.637 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_create_default_subnetpool ... success [0.286s]
2018-11-14 17:09:37.811 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupProtocolTest.test_create_security_group_rule_with_ipv6_protocol_integers ... success [5.677s]
2018-11-14 17:09:37.997 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_create_shared_subnetpool ... success [0.359s]
2018-11-14 17:09:38.829 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_create_subnetpool_associate_shared_address_scope ... success [0.832s]
2018-11-14 17:09:39.911 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_get_not_shared_admin_subnetpool ... success [1.081s]
2018-11-14 17:09:40.779 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupProtocolTest.test_create_security_group_rule_with_ipv6_protocol_names ... success [2.968s]
2018-11-14 17:09:41.262 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_update_sp_prefix_associated_with_shared_addr_scope ... success [1.350s]
2018-11-14 17:09:41.305 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_non_existent_subnetpool ... success [0.043s]
2018-11-14 17:09:42.229 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_associate_address_scope_of_other_owner ... success [0.923s]
2018-11-14 17:09:42.708 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_associate_address_scope_wrong_ip_version ... success [0.479s]
2018-11-14 17:09:43.271 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_multiple_prefix_intersect ... success [0.562s]
2018-11-14 17:09:43.580 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_not_modifiable_shared ... success [0.309s]
2018-11-14 17:09:44.476 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_prefix_intersect ... success [0.895s]
2018-11-14 17:09:44.826 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_prefixes_shrink ... success [0.348s]
2018-11-14 17:09:44.904 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_service_type_management.ServiceTypeManagementTest.test_service_provider_list ... success [0.584s]
2018-11-14 17:09:45.184 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_tenant_id ... success [0.358s]
2018-11-14 17:09:46.685 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_router_bumps_revision ... success [14.443s]
2018-11-14 17:09:46.686 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_router_extra_attributes_bumps_revision ... skip [0.001s]: Skipped because network extension: l3-ha is not enabled
2018-11-14 17:09:49.531 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.UpdateTagsTest.test_update_tags_affects_only_updated_resource ... success [3.659s]
2018-11-14 17:09:52.309 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_create_network_with_timestamp ... success [1.165s]
2018-11-14 17:09:54.100 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_create_port_with_timestamp ... success [1.790s]
2018-11-14 17:09:55.739 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_create_subnet_with_timestamp ... success [1.639s]
2018-11-14 17:09:55.955 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_create_subnetpool_with_timestamp ... success [0.215s]
2018-11-14 17:09:55.956 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_segment_with_timestamp ... skip [0.001s]: Skipped because network extension: standard-attr-segment is not enabled
2018-11-14 17:09:56.969 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_show_networks_attribute_with_timestamp ... success [1.013s]
2018-11-14 17:09:59.603 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_show_port_attribute_with_timestamp ... success [2.632s]
2018-11-14 17:10:00.584 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_router_extra_routes_bumps_revision ... success [13.897s]
2018-11-14 17:10:00.688 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_delete_address_scope_associated_with_subnetpool ... success [1.359s]
2018-11-14 17:10:00.898 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_delete_non_existent_address_scope ... success [0.210s]
2018-11-14 17:10:01.131 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_get_non_existent_address_scope ... success [0.233s]
2018-11-14 17:10:01.333 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_tenant_create_shared_address_scope ... success [0.201s]
2018-11-14 17:10:01.900 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_sg_group_bumps_revision ... success [1.316s]
2018-11-14 17:10:01.967 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_show_subnet_attribute_with_timestamp ... success [2.364s]
2018-11-14 17:10:02.396 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_tenant_get_not_shared_admin_address_scope ... success [1.061s]
2018-11-14 17:10:02.799 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_show_subnetpool_attribute_with_timestamp ... success [0.832s]
2018-11-14 17:10:02.828 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_tenant_update_address_scope_shared_false ... success [0.433s]
2018-11-14 17:10:03.165 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_tenant_update_address_scope_shared_true ... success [0.336s]
2018-11-14 17:10:03.181 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_update_non_existent_address_scope ... success [0.016s]
2018-11-14 17:10:03.662 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_update_shared_address_scope_to_unshare ... success [0.480s]
2018-11-14 17:10:05.002 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.240s]
2018-11-14 17:10:05.175 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_sg_rule_bumps_sg_revision ... success [3.273s]
2018-11-14 17:10:05.434 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_update_network_with_timestamp ... success [2.633s]
2018-11-14 17:10:06.103 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination ... success [1.099s]
2018-11-14 17:10:06.443 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.340s]
2018-11-14 17:10:06.607 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.164s]
2018-11-14 17:10:07.461 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.852s]
2018-11-14 17:10:09.255 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_update_port_with_timestamp ... success [3.820s]
2018-11-14 17:10:10.641 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_with_href_links ... success [3.177s]
2018-11-14 17:10:11.588 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_with_marker ... success [0.947s]
2018-11-14 17:10:11.645 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_sorts_asc ... success [0.058s]
2018-11-14 17:10:11.834 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_update_subnet_with_timestamp ... success [2.579s]
2018-11-14 17:10:11.920 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_sorts_desc ... success [0.274s]
2018-11-14 17:10:11.921 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_validation_filters ... skip [0.001s]: Skipped until Bug: 1749820 is resolved.
2018-11-14 17:10:13.041 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_update_subnetpool_with_timestamp ... success [1.207s]
2018-11-14 17:10:14.411 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_subnet_bumps_network_revision ... success [9.236s]
2018-11-14 17:10:20.512 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairTestJSON.test_create_list_port_with_address_pair ... success [2.305s]
2018-11-14 17:10:21.765 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_subnet_bumps_revision ... success [7.353s]
2018-11-14 17:10:23.819 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_address_pair ... success [3.308s]
2018-11-14 17:10:27.641 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_cidr_address_pair ... success [3.821s]
2018-11-14 17:10:31.105 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_subnet_service_types_bumps_revisions ... success [9.339s]
2018-11-14 17:10:31.812 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_subnetpool_bumps_revision ... success [0.708s]
2018-11-14 17:10:33.850 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_multiple_ip_mac_address_pair ... success [6.208s]
2018-11-14 17:10:36.328 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_create_sg_with_timestamp ... success [1.752s]
2018-11-14 17:10:37.455 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_create_sgrule_with_timestamp ... success [1.127s]
2018-11-14 17:10:40.526 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_show_sg_attribute_with_timestamp ... success [3.070s]
2018-11-14 17:10:42.831 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_show_sgrule_attribute_with_timestamp ... success [2.304s]
2018-11-14 17:10:44.550 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_update_sg_with_timestamp ... success [1.718s]
2018-11-14 17:10:46.051 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extensions.ExtensionsTest.test_list_extensions_includes_all ... success [0.619s]
2018-11-14 17:10:46.230 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extensions.ExtensionsTest.test_list_extensions_pagination ... success [0.179s]
2018-11-14 17:10:46.435 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extensions.ExtensionsTest.test_list_extensions_project_id ... success [0.204s]
2018-11-14 17:10:46.632 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extensions.ExtensionsTest.test_list_extensions_sorting ... success [0.197s]
2018-11-14 17:10:48.770 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_create_router_with_default_snat_value ... success [5.529s]
2018-11-14 17:10:49.960 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.189s]
2018-11-14 17:10:50.633 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination ... success [0.672s]
2018-11-14 17:10:50.867 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.234s]
2018-11-14 17:10:51.128 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.260s]
2018-11-14 17:10:51.249 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.120s]
2018-11-14 17:10:52.638 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_with_href_links ... success [1.387s]
2018-11-14 17:10:52.808 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_with_marker ... success [0.171s]
2018-11-14 17:10:52.829 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_sorts_asc ... success [0.022s]
2018-11-14 17:10:52.850 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_sorts_desc ... success [0.021s]
2018-11-14 17:10:55.214 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_create_router_with_snat_explicit ... success [6.445s]
2018-11-14 17:10:55.616 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extra_dhcp_options.ExtraDHCPOptionsTestJSON.test_create_list_port_with_extra_dhcp_options ... success [2.217s]
2018-11-14 17:10:56.573 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extra_dhcp_options.ExtraDHCPOptionsTestJSON.test_update_show_port_with_extra_dhcp_options ... success [0.958s]
2018-11-14 17:10:57.629 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_create_update_router_description ... success [2.415s]
2018-11-14 17:11:11.148 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_empty_trunk_details ... success [5.983s]
2018-11-14 17:11:13.789 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_network_attached_with_two_routers ... success [16.157s]
2018-11-14 17:11:16.476 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_floating_ips.FloatingIPTestJSON.test_blank_update_clears_association ... success [2.742s]
2018-11-14 17:11:16.512 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_trunk_details_no_subports ... success [5.364s]
2018-11-14 17:11:20.972 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_floating_ips.FloatingIPTestJSON.test_create_update_floatingip_description ... success [4.494s]
2018-11-14 17:11:20.974 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_floating_ips.FloatingIPTestJSON.test_create_update_floatingip_port_details ... skip [0.001s]: Skipped because network extension: fip-port-details is not enabled
2018-11-14 17:11:24.005 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_trunk_details_with_subport ... success [7.490s]
2018-11-14 17:11:24.401 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_floating_ips.FloatingIPTestJSON.test_floatingip_update_extra_attributes_port_id_not_changed ... success [3.429s]
2018-11-14 17:11:28.140 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestMtusJSON ... skip: Either vxlan or gre type driver not enabled.
2018-11-14 17:11:35.823 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_metering_extensions.MeteringTestJSON ... skip: metering extension not enabled.
2018-11-14 17:11:35.824 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_metering_negative.MeteringNegativeTestJSON ... skip: metering extension not enabled.
2018-11-14 17:11:39.860 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_networks.NetworksMtuTestJSON.test_create_network_custom_mtu ... success [1.576s]
2018-11-14 17:11:41.369 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_networks.NetworksMtuTestJSON.test_update_network_custom_mtu ... success [1.509s]
2018-11-14 17:11:44.516 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_qos.QosSearchCriteriaTest ... skip: qos extension not enabled.
2018-11-14 17:11:44.517 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_qos.RbacSharedQosPoliciesTest ... skip: qos extension not enabled.
2018-11-14 17:11:49.053 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.275s]
2018-11-14 17:11:50.414 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination ... success [1.359s]
2018-11-14 17:11:50.796 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.382s]
2018-11-14 17:11:51.334 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.538s]
2018-11-14 17:11:52.068 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.733s]
2018-11-14 17:11:54.141 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_with_href_links ... success [2.070s]
2018-11-14 17:11:54.864 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_with_marker ... success [0.723s]
2018-11-14 17:11:54.955 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_sorts_asc ... success [0.092s]
2018-11-14 17:11:55.335 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_sorts_desc ... success [0.380s]
2018-11-14 17:12:08.434 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_create_router_with_default_snat_value ... success [4.376s]
2018-11-14 17:12:14.912 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_create_router_with_snat_explicit ... success [6.477s]
2018-11-14 17:12:17.122 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_create_update_router_description ... success [2.209s]
2018-11-14 17:12:19.634 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_router_interface_status ... fail [65.825s]
2018-11-14 17:12:26.972 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_update_extra_route ... success [7.343s]
2018-11-14 17:12:30.794 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_network_attached_with_two_routers ... success [13.669s]
2018-11-14 17:12:31.545 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_update_router_reset_gateway_without_snat ... success [4.573s]
2018-11-14 17:12:35.635 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_update_router_set_gateway_with_snat_explicit ... success [4.089s]
2018-11-14 17:12:40.003 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_update_router_set_gateway_without_snat ... success [4.367s]
2018-11-14 17:13:00.145 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers_negative.DvrRoutersNegativeTest.test_router_create_tenant_distributed_returns_forbidden ... success [0.204s]
2018-11-14 17:13:09.496 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers_negative.HaRoutersNegativeTest ... skip: l3-ha extension not enabled.
2018-11-14 17:13:13.351 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups.SecGroupTest.test_create_bulk_sec_groups ... success [1.758s]
2018-11-14 17:13:15.006 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.653s]
2018-11-14 17:13:19.940 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_with_boolean_type_name ... success [0.190s]
2018-11-14 17:13:20.132 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_with_too_long_name ... success [0.192s]
2018-11-14 17:13:21.307 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_delete_in_use_sec_group ... success [1.173s]
2018-11-14 17:13:21.786 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_update_default_security_group_name ... success [0.479s]
2018-11-14 17:13:22.221 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_update_security_group_with_boolean_type_name ... success [0.434s]
2018-11-14 17:13:22.477 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_update_security_group_with_too_long_name ... success [0.256s]
2018-11-14 17:13:31.428 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.292s]
2018-11-14 17:13:32.311 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination ... success [0.880s]
2018-11-14 17:13:32.573 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.263s]
2018-11-14 17:13:32.805 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.231s]
2018-11-14 17:13:33.343 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.537s]
2018-11-14 17:13:34.640 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_with_href_links ... success [1.294s]
2018-11-14 17:13:35.004 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_with_marker ... success [0.365s]
2018-11-14 17:13:35.027 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_sorts_asc ... success [0.024s]
2018-11-14 17:13:35.240 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_sorts_desc ... success [0.211s]
2018-11-14 17:13:35.241 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_validation_filters ... skip [0.001s]: Skipped until Bug: 1749820 is resolved.
2018-11-14 17:13:36.728 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_router_interface_status ... fail [65.915s]
2018-11-14 17:13:43.655 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_update_extra_route ... success [6.931s]
2018-11-14 17:13:44.444 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_admin_create_shared_subnetpool ... success [1.332s]
2018-11-14 17:13:45.067 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_list_subnetpool ... success [0.624s]
2018-11-14 17:13:46.860 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnet_from_pool_with_default_prefixlen ... success [1.791s]
2018-11-14 17:13:48.286 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_update_router_reset_gateway_without_snat ... success [4.630s]
2018-11-14 17:13:48.988 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnet_from_pool_with_prefixlen ... success [2.127s]
2018-11-14 17:13:51.411 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnet_from_pool_with_quota ... success [2.423s]
2018-11-14 17:13:52.936 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_update_router_set_gateway_with_snat_explicit ... success [4.650s]
2018-11-14 17:13:53.189 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnet_from_pool_with_subnet_cidr ... success [1.777s]
2018-11-14 17:13:53.708 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnetpool_associate_address_scope ... success [0.519s]
2018-11-14 17:13:54.497 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_update_subnetpool_description ... success [0.786s]
2018-11-14 17:13:54.855 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_get_subnetpool ... success [0.358s]
2018-11-14 17:13:55.088 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_show_subnetpool_has_project_id ... success [0.233s]
2018-11-14 17:13:55.544 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_tenant_create_non_default_subnetpool ... success [0.456s]
2018-11-14 17:13:56.231 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_tenant_update_subnetpool ... success [0.687s]
2018-11-14 17:13:57.114 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_associate_address_scope ... success [0.881s]
2018-11-14 17:13:57.172 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_update_router_set_gateway_without_snat ... success [4.236s]
2018-11-14 17:13:57.837 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_associate_another_address_scope ... success [0.723s]
2018-11-14 17:13:58.366 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_disassociate_address_scope ... success [0.530s]
2018-11-14 17:13:59.149 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_prefixes_append ... success [0.781s]
2018-11-14 17:13:59.568 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_prefixes_extend ... success [0.419s]
2018-11-14 17:14:23.125 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_create_floatingip_with_timestamp ... success [1.958s]
2018-11-14 17:14:23.484 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_create_router_with_timestamp ... success [0.359s]
2018-11-14 17:14:25.276 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_show_floatingip_attribute_with_timestamp ... success [1.790s]
2018-11-14 17:14:25.776 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_show_router_attribute_with_timestamp ... success [0.500s]
2018-11-14 17:14:27.042 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolTest.test_create_show_delete_security_group_rule_integers ... success [11.748s]
2018-11-14 17:14:27.877 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_update_floatingip_with_timestamp ... success [2.100s]
2018-11-14 17:14:28.953 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_update_router_with_timestamp ... success [1.076s]
2018-11-14 17:14:37.985 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolTest.test_create_show_delete_security_group_rule_names ... success [10.918s]
2018-11-14 17:14:39.389 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_trunk.TrunkTestInheritJSONBase ... skip: VLAN type_driver is not enabled
2018-11-14 17:14:49.504 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_add_subport ... success [8.412s]
2018-11-14 17:14:54.654 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_show_delete_trunk ... success [5.150s]
2018-11-14 17:14:58.704 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_trunk_empty_subports_list ... success [4.048s]
2018-11-14 17:15:02.639 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_trunk_subports_not_specified ... success [3.934s]
2018-11-14 17:15:06.663 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_update_trunk ... success [4.023s]
2018-11-14 17:15:10.427 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_update_trunk_with_description ... success [3.764s]
2018-11-14 17:15:16.372 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_delete_trunk_with_subport_is_allowed ... success [5.944s]
2018-11-14 17:15:23.687 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_get_subports ... success [7.315s]
2018-11-14 17:15:30.562 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_list_trunks ... success [6.873s]
2018-11-14 17:15:40.022 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_remove_subport ... success [9.459s]
2018-11-14 17:15:44.737 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_show_trunk_has_project_id ... success [4.715s]
2018-11-14 17:15:49.325 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestMtusJSON ... skip: Either vxlan or gre type driver not enabled.
2018-11-14 17:16:02.457 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_add_subport_duplicate_segmentation_details ... success [9.772s]
2018-11-14 17:16:06.669 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_add_subport_passing_dict ... success [4.212s]
2018-11-14 17:16:12.311 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_add_subport_port_id_disabled_trunk ... success [5.641s]
2018-11-14 17:16:16.890 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_add_subport_port_id_uses_trunk_port_id ... success [4.578s]
2018-11-14 17:16:17.611 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_subport_invalid_inherit_network_segmentation_type ... skip [0.720s]: Vxlan type driver must be enabled for this test.
2018-11-14 17:16:23.226 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_subport_missing_segmentation_id ... success [5.615s]
2018-11-14 17:16:27.065 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_subport_nonexistent_port_id ... success [3.838s]
2018-11-14 17:16:30.072 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_subport_nonexistent_trunk ... success [3.007s]
2018-11-14 17:16:38.625 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_duplicate_subport_segmentation_ids ... success [8.551s]
2018-11-14 17:16:40.105 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_nonexistent_port_id ... success [1.480s]
2018-11-14 17:16:43.552 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_nonexistent_subport_port_id ... success [3.447s]
2018-11-14 17:16:46.778 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_port_id ... success [3.225s]
2018-11-14 17:16:50.217 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_segmentation_id ... success [3.438s]
2018-11-14 17:16:53.946 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_segmentation_type ... success [3.728s]
2018-11-14 17:17:01.047 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_delete_port_in_use_by_subport ... success [7.100s]
2018-11-14 17:17:06.345 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_delete_port_in_use_by_trunk ... success [5.296s]
2018-11-14 17:17:10.687 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_delete_trunk_disabled_trunk ... success [4.343s]
2018-11-14 17:17:17.145 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_not_found ... success [6.456s]
2018-11-14 17:17:24.704 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_passing_dict ... success [7.559s]
2018-11-14 17:17:29.606 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_port_id_disabled_trunk ... success [4.901s]
2018-11-14 17:17:35.042 89 INFO rally.task.context [-] Verification 984a60c2-8838-4b4c-90cd-8c94fac023af | Context testr@default cleanup() started
2018-11-14 17:17:35.043 89 INFO rally.task.context [-] Verification 984a60c2-8838-4b4c-90cd-8c94fac023af | Context testr@default cleanup() finished in 0.94 msec
2018-11-14 17:17:35.044 89 INFO rally.task.context [-] Verification 984a60c2-8838-4b4c-90cd-8c94fac023af | Context tempest@default cleanup() started
2018-11-14 17:17:36.001 89 INFO rally.task.context [-] Verification 984a60c2-8838-4b4c-90cd-8c94fac023af | Context tempest@default cleanup() finished in 0.96 sec
2018-11-14 17:17:36.118 89 INFO rally.api [-] Verification (UUID=0ab0be4d-ffb4-4f74-a418-593b2afc711b) has been successfully finished for deployment 'opnfv-rally' (UUID=80a0aaa6-3e31-41b2-8663-1564a484bb32)!

======
Totals
======

Ran: 547 tests in 852.636 sec.
 - Success: 387
 - Skipped: 157
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 3

Using verification (UUID=0ab0be4d-ffb4-4f74-a418-593b2afc711b) as the default verification for the future operations.