2019-01-10 11:13:59.933 89 INFO rally.api [-] Starting verification (UUID=c5ffc553-0d7d-4c5c-bf1f-ecd509f39c52) for deployment 'opnfv-rally' (UUID=7b25d0db-2f35-4e96-8754-a30097326eed) by verifier 'opnfv-tempest' (UUID=ac822f38-cc8f-46e0-9c3a-a08ec6e8f2a5).
2019-01-10 11:14:01.383 89 INFO rally.task.context [-] Verification ac822f38-cc8f-46e0-9c3a-a08ec6e8f2a5 | Context tempest@default setup()  finished in 0.89 sec
2019-01-10 11:14:01.387 89 INFO rally.task.context [-] Verification ac822f38-cc8f-46e0-9c3a-a08ec6e8f2a5 | Context testr@default setup()  finished in 2.71 msec
2019-01-10 11:14:07.141 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_agent_availability_zone.AgentAvailabilityZoneTestCase.test_agents_availability_zone ... skip [0.000s]: Need a single availability_zone assumption.
2019-01-10 11:14:07.162 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_list_agent ... success [0.012s]
2019-01-10 11:14:07.804 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_list_agents_non_admin ... success [0.640s]
2019-01-10 11:14:07.996 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_show_agent ... success [0.192s]
2019-01-10 11:14:08.104 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_update_agent_description ... success [0.108s]
2019-01-10 11:14:08.129 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_update_agent_status ... success [0.026s]
2019-01-10 11:14:11.679 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_l3_agent_scheduler.L3AgentSchedulerTestJSON ... skip: l3_agent_scheduler extension not enabled.
2019-01-10 11:14:11.680 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_logging.LoggingTestJSON ... skip: logging extension not enabled.
2019-01-10 11:14:12.641 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_add_remove_network_from_dhcp_agent ... success [2.719s]
2019-01-10 11:14:12.840 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_dhcp_port_status_active ... success [0.201s]
2019-01-10 11:14:12.860 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_list_dhcp_agent_hosting_network ... success [0.020s]
2019-01-10 11:14:13.005 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_list_networks_hosted_by_one_dhcp ... success [0.144s]
2019-01-10 11:14:16.896 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_networks.NetworksTestAdmin.test_create_network_with_project ... success [1.752s]
2019-01-10 11:14:17.081 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_networks.NetworksTestAdmin.test_create_network_with_project_and_other_tenant ... success [0.186s]
2019-01-10 11:14:17.459 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_networks.NetworksTestAdmin.test_create_network_with_project_and_tenant ... success [0.377s]
2019-01-10 11:14:17.461 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_networks.NetworksTestAdmin.test_create_tenant_network_vxlan ... skip [0.000s]: VXLAN type_driver is not enabled
2019-01-10 11:14:22.816 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_floating_ips_admin_actions.FloatingIPAdminTestJSON.test_associate_floating_ip_with_port_from_another_project ... success [6.330s]
2019-01-10 11:14:25.292 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_floating_ips_admin_actions.FloatingIPAdminTestJSON.test_create_floatingip_with_specified_ip_address ... success [2.477s]
2019-01-10 11:14:25.933 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_delete_policies_while_tenant_attached_to_net ... success [11.286s]
2019-01-10 11:14:27.051 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_extension_driver_port_security_admin.PortSecurityAdminTests.test_create_port_security_false_on_shared_network ... success [3.336s]
2019-01-10 11:14:28.191 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_conversion_on_one_policy_delete ... success [2.259s]
2019-01-10 11:14:29.827 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_conversion_on_policy_create ... success [1.636s]
2019-01-10 11:14:29.987 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_floatingip_when_quotas_is_full ... success [4.384s]
2019-01-10 11:14:32.264 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_network_when_quotas_is_full ... success [2.276s]
2019-01-10 11:14:32.501 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_conversion_on_policy_delete ... success [2.674s]
2019-01-10 11:14:33.013 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_logging_negative.LoggingNegativeTestJSON ... skip: logging extension not enabled.
2019-01-10 11:14:34.872 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_network_on_shared_policy_delete ... success [2.370s]
2019-01-10 11:14:36.876 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_port_when_quotas_is_full ... success [4.610s]
2019-01-10 11:14:38.177 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_router_when_quotas_is_full ... success [1.303s]
2019-01-10 11:14:38.720 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_update_policy_from_wildcard_to_specific_tenant ... success [3.848s]
2019-01-10 11:14:39.002 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_ports.PortTestCasesAdmin.test_regenerate_mac_address ... skip [0.001s]: Skipped because network extension: port-mac-address-regenerate is not enabled
2019-01-10 11:14:40.053 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_security_group_rule_when_quotas_is_full ... success [1.872s]
2019-01-10 11:14:41.093 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_security_group_when_quotas_is_full ... success [1.040s]
2019-01-10 11:14:41.883 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_ports.PortTestCasesAdmin.test_update_mac_address ... success [2.879s]
2019-01-10 11:14:44.301 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_policy_allows_tenant_to_allocate_floatingip ... success [5.579s]
2019-01-10 11:14:44.715 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_subnet_when_quotas_is_full ... success [3.622s]
2019-01-10 11:14:45.826 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_quotas.QuotasTest.test_detail_quotas ... success [3.838s]
2019-01-10 11:14:46.699 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_quotas.QuotasTest.test_quotas ... success [0.873s]
2019-01-10 11:14:49.875 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_routers_dvr.RouterTestCentralizedToDVR ... skip: l3-ha extension not enabled.
2019-01-10 11:14:49.915 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_policy_allows_tenant_to_attach_ext_gw ... success [5.613s]
2019-01-10 11:14:50.875 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_regular_client_blocked_from_creating_external_wild_policies ... success [0.959s]
2019-01-10 11:14:53.614 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_routers_dvr.RoutersTestDVR.test_centralized_router_creation ... success [0.739s]
2019-01-10 11:14:54.494 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_regular_client_shares_with_another ... success [3.619s]
2019-01-10 11:14:54.638 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_routers_dvr.RoutersTestDVR.test_distributed_router_creation ... success [1.024s]
2019-01-10 11:14:56.997 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_routers_flavors.RoutersFlavorTestCase ... skip: l3-flavors extension not enabled.
2019-01-10 11:14:58.378 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_security_groups.SecGroupAdminTest.test_security_group_recreated_on_port_update ... success [5.091s]
2019-01-10 11:14:58.782 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_wildcard_policy_created_from_external_network_api ... success [4.286s]
2019-01-10 11:14:59.700 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_wildcard_policy_delete_blocked_on_default_ext ... success [0.919s]
2019-01-10 11:15:04.427 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_shared_network_extension.AllowedAddressPairSharedNetworkTest.test_create_with_address_pair_blocked_on_other_network ... success [1.175s]
2019-01-10 11:15:04.664 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagFilterPortTestJSON.test_filter_port_tags ... success [0.511s]
2019-01-10 11:15:05.669 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_routers_ha.RoutersTestHA ... skip: l3-ha extension not enabled.
2019-01-10 11:15:05.793 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_shared_network_extension.AllowedAddressPairSharedNetworkTest.test_update_with_address_pair_blocked_on_other_network ... success [1.366s]
2019-01-10 11:15:16.215 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_create_rbac_policy_with_target_tenant_none ... success [6.117s]
2019-01-10 11:15:19.034 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_create_rbac_policy_with_target_tenant_too_long_id ... success [2.820s]
2019-01-10 11:15:20.177 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_tag.TagFilterFloatingIpTestJSON.test_filter_floatingip_tags ... success [0.204s]
2019-01-10 11:15:20.237 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_tag.TagFilterRouterTestJSON.test_filter_router_tags ... success [1.611s]
2019-01-10 11:15:22.364 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagFilterQosPolicyTestJSON ... skip: Skipped because network extension: qos is not enabled
2019-01-10 11:15:23.255 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_delete_self_share_rule ... success [4.220s]
2019-01-10 11:15:27.262 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_duplicate_policy_error ... success [4.006s]
2019-01-10 11:15:28.607 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_filter_fields ... success [1.344s]
2019-01-10 11:15:30.516 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_filter_policies ... success [1.908s]
2019-01-10 11:15:31.176 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagFilterSecGroupTestJSON.test_filter_security_group_tags ... success [0.978s]
2019-01-10 11:15:35.292 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_tag.TagFloatingIpTestJSON.test_floatingip_tags ... success [1.392s]
2019-01-10 11:15:36.217 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_filtering_works_with_rbac_records_present ... success [5.700s]
2019-01-10 11:15:41.163 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_network_only_visible_to_policy_target ... success [4.946s]
2019-01-10 11:15:44.535 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_tag.TagFilterTrunkTestJSON.test_filter_trunk_tags ... success [0.430s]
2019-01-10 11:15:44.604 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagNetworkTestJSON.test_network_tags ... success [2.989s]
2019-01-10 11:15:46.166 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_policy_show ... success [5.003s]
2019-01-10 11:15:47.623 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_tag.TagPortTestJSON.test_port_tags ... success [2.675s]
2019-01-10 11:15:51.216 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_policy_target_update ... success [5.050s]
2019-01-10 11:15:55.997 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagRouterTestJSON.test_router_tags ... success [3.492s]
2019-01-10 11:15:57.216 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_port_presence_prevents_network_rbac_policy_deletion ... success [5.999s]
2019-01-10 11:15:58.057 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_tag.TagSubnetPoolTestJSON.test_subnetpool_tags ... success [2.213s]
2019-01-10 11:16:02.059 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_rbac_bumps_network_revision ... success [4.843s]
2019-01-10 11:16:03.093 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_tag.TagSecGroupTestJSON.test_security_group_tags ... success [1.237s]
2019-01-10 11:16:06.991 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.299s]
2019-01-10 11:16:07.371 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcp_stateful_fixedips_outrange ... success [4.053s]
2019-01-10 11:16:07.702 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination ... success [0.709s]
2019-01-10 11:16:07.950 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.248s]
2019-01-10 11:16:08.179 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.228s]
2019-01-10 11:16:08.405 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_rbac_policy_quota ... success [6.344s]
2019-01-10 11:16:09.001 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.822s]
2019-01-10 11:16:10.684 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_admin_create_shared_address_scope ... success [0.756s]
2019-01-10 11:16:11.116 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_with_href_links ... success [2.112s]
2019-01-10 11:16:11.243 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_admin_update_shared_address_scope ... success [0.559s]
2019-01-10 11:16:12.410 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_delete_address_scope ... success [1.166s]
2019-01-10 11:16:12.438 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_with_marker ... success [1.322s]
2019-01-10 11:16:12.729 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_sorts_asc ... success [0.292s]
2019-01-10 11:16:12.847 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_sorts_desc ... success [0.117s]
2019-01-10 11:16:12.849 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_validation_filters ... skip [0.001s]: Skipped until Bug: 1749820 is resolved.
2019-01-10 11:16:12.922 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_show_address_scope ... success [0.512s]
2019-01-10 11:16:12.978 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_show_address_scope_project_id ... success [0.056s]
2019-01-10 11:16:13.042 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_tenant_create_list_address_scope ... success [0.064s]
2019-01-10 11:16:13.159 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_tenant_update_address_scope ... success [0.117s]
2019-01-10 11:16:13.356 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_regular_client_blocked_from_sharing_anothers_network ... success [4.952s]
2019-01-10 11:16:14.738 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_regular_client_blocked_from_sharing_with_wildcard ... success [1.381s]
2019-01-10 11:16:15.899 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_allowed_address_pairs ... success [2.875s]
2019-01-10 11:16:16.476 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_regular_client_shares_to_another_regular_client ... success [1.737s]
2019-01-10 11:16:20.635 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_create_port_sec_with_security_group ... success [4.736s]
2019-01-10 11:16:20.724 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_subnet_on_network_only_visible_to_policy_target ... success [4.249s]
2019-01-10 11:16:23.645 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_tenant_can_delete_port_on_own_network ... success [2.919s]
2019-01-10 11:16:24.159 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_delete_with_port_sec ... success [3.523s]
2019-01-10 11:16:24.499 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_create_list_port_with_address_pair ... success [2.309s]
2019-01-10 11:16:25.883 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_tenant_cant_delete_other_tenants_ports ... success [2.238s]
2019-01-10 11:16:27.556 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_default_value ... success [3.397s]
2019-01-10 11:16:28.036 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks_negative.NetworksNegativeTest.test_delete_network_in_use ... success [3.656s]
2019-01-10 11:16:28.252 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_address_pair ... success [3.753s]
2019-01-10 11:16:28.483 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_update_self_share_rule ... success [2.600s]
2019-01-10 11:16:31.211 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_cidr_address_pair ... success [2.958s]
2019-01-10 11:16:31.368 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_specific_value_1 ... success [3.811s]
2019-01-10 11:16:34.262 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_specific_value_2 ... success [2.893s]
2019-01-10 11:16:36.259 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_multiple_ip_mac_address_pair ... success [5.047s]
2019-01-10 11:16:39.448 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_add_ips_to_port ... success [4.696s]
2019-01-10 11:16:40.855 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_update_pass ... success [6.591s]
2019-01-10 11:16:43.127 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_change_dhcp_flag_then_create_port ... success [3.679s]
2019-01-10 11:16:45.584 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_create_update_port_description ... success [2.456s]
2019-01-10 11:16:45.587 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_create_update_port_with_dns_domain ... skip [0.001s]: Skipped because network extension: dns-domain-ports is not enabled
2019-01-10 11:16:45.592 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_create_update_port_with_dns_name ... skip [0.001s]: Skipped because network extension: dns-integration is not enabled
2019-01-10 11:16:45.595 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_create_update_port_with_no_dns_name ... skip [0.001s]: Skipped because network extension: dns-integration is not enabled
2019-01-10 11:16:45.595 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_update_port_failed ... success [4.737s]
2019-01-10 11:16:45.919 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_create_bulk_shared_network ... success [2.332s]
2019-01-10 11:16:48.495 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_create_port_shared_network_as_non_admin_tenant ... success [2.575s]
2019-01-10 11:16:50.358 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_create_update_shared_network ... success [1.863s]
2019-01-10 11:16:50.922 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_auto_allocated_topology.TestAutoAllocatedTopology ... skip: No default subnetpool
2019-01-10 11:16:51.453 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_filtering_shared_networks ... success [1.093s]
2019-01-10 11:16:54.026 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_filtering_shared_subnets ... success [2.572s]
2019-01-10 11:16:54.266 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_list_shared_networks ... success [0.241s]
2019-01-10 11:16:54.787 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_qos.QosBandwidthLimitRuleTestJSON ... skip: qos extension not enabled.
2019-01-10 11:16:54.789 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_qos.QosBandwidthLimitRuleWithDirectionTestJSON ... skip: qos extension not enabled.
2019-01-10 11:16:54.790 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_qos.QosDscpMarkingRuleTestJSON ... skip: qos extension not enabled.
2019-01-10 11:16:55.065 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_show_shared_networks_attribute ... success [0.799s]
2019-01-10 11:16:59.481 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_extra_dhcp_options.ExtraDHCPOptionsIpV6TestJSON.test_create_list_port_with_extra_dhcp_options ... success [2.081s]
2019-01-10 11:17:00.334 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers.DvrRoutersTest.test_create_distributed_router ... success [2.236s]
2019-01-10 11:17:00.350 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_extra_dhcp_options.ExtraDHCPOptionsIpV6TestJSON.test_update_show_port_with_extra_dhcp_options ... success [0.870s]
2019-01-10 11:17:03.676 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers.DvrRoutersTestToCentralized ... skip: l3-ha extension not enabled.
2019-01-10 11:17:03.677 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers.HaRoutersTest ... skip: l3-ha extension not enabled.
2019-01-10 11:17:15.229 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagFilterNetworkTestJSON.test_filter_network_tags ... success [1.294s]
2019-01-10 11:17:15.445 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_create_update_delete_flavor ... success [0.465s]
2019-01-10 11:17:15.827 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_create_update_delete_service_profile ... success [0.382s]
2019-01-10 11:17:15.841 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_list_flavors ... success [0.014s]
2019-01-10 11:17:16.031 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_list_service_profiles ... success [0.190s]
2019-01-10 11:17:16.044 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_show_flavor ... success [0.013s]
2019-01-10 11:17:16.054 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_show_service_profile ... success [0.010s]
2019-01-10 11:17:18.110 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers_negative.RoutersNegativePolicyTest.test_add_interface_wrong_tenant ... success [7.263s]
2019-01-10 11:17:25.334 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_create_update_delete_flavor ... success [0.204s]
2019-01-10 11:17:25.658 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_create_update_delete_service_profile ... success [0.323s]
2019-01-10 11:17:25.673 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_list_flavors ... success [0.015s]
2019-01-10 11:17:25.684 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_list_service_profiles ... success [0.011s]
2019-01-10 11:17:25.698 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_show_flavor ... success [0.013s]
2019-01-10 11:17:25.719 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_show_service_profile ... success [0.021s]
2019-01-10 11:17:28.497 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_metering_extensions.MeteringIpV6TestJSON ... skip: metering extension not enabled.
2019-01-10 11:17:31.023 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_floating_ips_negative.FloatingIPNegativeTestJSON.test_associate_floatingip_with_port_with_floatingip ... success [15.695s]
2019-01-10 11:17:35.106 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv6Test.test_admin_network_availability_before_subnet ... success [3.458s]
2019-01-10 11:17:36.875 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers_negative.RoutersNegativeTest.test_delete_router_in_use ... success [4.133s]
2019-01-10 11:17:37.718 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagFilterSubnetTestJSON.test_filter_subnet_tags ... success [0.731s]
2019-01-10 11:17:39.878 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv6Test.test_net_ip_availability_after_port_delete ... success [4.771s]
2019-01-10 11:17:46.616 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv6Test.test_net_ip_availability_after_subnet_and_ports ... success [6.737s]
2019-01-10 11:17:48.706 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_with_boolean_type_name ... success [0.010s]
2019-01-10 11:17:48.717 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_with_too_long_name ... success [0.012s]
2019-01-10 11:17:50.988 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_delete_in_use_sec_group ... success [2.269s]
2019-01-10 11:17:51.308 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_update_default_security_group_name ... success [0.320s]
2019-01-10 11:17:51.364 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_update_security_group_with_boolean_type_name ... success [0.055s]
2019-01-10 11:17:51.416 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_update_security_group_with_too_long_name ... success [0.052s]
2019-01-10 11:17:53.893 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_network_ip_availability_negative.NetworksIpAvailabilityNegativeTest.test_network_availability_nonexistent_network_id ... success [0.569s]
2019-01-10 11:17:54.549 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv4Test.test_admin_network_availability_before_subnet ... success [2.846s]
2019-01-10 11:17:59.104 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_admin_create_shared_subnetpool ... success [1.297s]
2019-01-10 11:17:59.345 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv4Test.test_net_ip_availability_after_port_delete ... success [4.796s]
2019-01-10 11:18:01.881 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagFilterSubnetpoolTestJSON.test_filter_subnetpool_tags ... success [0.820s]
2019-01-10 11:18:01.915 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_dual_stack_subnets_from_subnetpools ... success [2.812s]
2019-01-10 11:18:02.685 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_list_subnetpool ... success [0.768s]
2019-01-10 11:18:04.284 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnet_from_pool_with_default_prefixlen ... success [1.598s]
2019-01-10 11:18:05.191 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.265s]
2019-01-10 11:18:05.914 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnet_from_pool_with_prefixlen ... success [1.628s]
2019-01-10 11:18:06.068 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination ... success [0.875s]
2019-01-10 11:18:06.824 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.756s]
2019-01-10 11:18:06.982 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv4Test.test_net_ip_availability_after_subnet_and_ports ... success [7.637s]
2019-01-10 11:18:07.314 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.488s]
2019-01-10 11:18:07.398 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnet_from_pool_with_quota ... success [1.485s]
2019-01-10 11:18:07.705 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.390s]
2019-01-10 11:18:08.946 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnet_from_pool_with_subnet_cidr ... success [1.547s]
2019-01-10 11:18:09.477 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnetpool_associate_address_scope ... success [0.530s]
2019-01-10 11:18:09.750 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_with_href_links ... success [2.043s]
2019-01-10 11:18:10.230 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_update_subnetpool_description ... success [0.752s]
2019-01-10 11:18:10.286 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_with_marker ... success [0.536s]
2019-01-10 11:18:10.344 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_sorts_asc ... success [0.060s]
2019-01-10 11:18:10.402 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_sorts_desc ... success [0.058s]
2019-01-10 11:18:10.460 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_get_subnetpool ... success [0.230s]
2019-01-10 11:18:10.754 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_show_subnetpool_has_project_id ... success [0.293s]
2019-01-10 11:18:10.885 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_tenant_create_non_default_subnetpool ... success [0.131s]
2019-01-10 11:18:11.148 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_tenant_update_subnetpool ... success [0.262s]
2019-01-10 11:18:11.485 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_associate_address_scope ... success [0.336s]
2019-01-10 11:18:11.935 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_associate_another_address_scope ... success [0.450s]
2019-01-10 11:18:12.316 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_disassociate_address_scope ... success [0.380s]
2019-01-10 11:18:12.752 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_prefixes_append ... success [0.436s]
2019-01-10 11:18:13.049 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_prefixes_extend ... success [0.297s]
2019-01-10 11:18:13.950 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagQosPolicyTestJSON ... skip: Skipped because network extension: qos is not enabled
2019-01-10 11:18:14.638 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_qos.QosMinimumBandwidthRuleTestJSON ... skip: qos extension not enabled.
2019-01-10 11:18:14.639 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_qos.QosTestJSON ... skip: qos extension not enabled.
2019-01-10 11:18:15.478 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_create_network_with_project ... success [1.307s]
2019-01-10 11:18:15.479 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_create_update_network_dns_domain ... skip [0.001s]: Skipped because network extension: dns-integration is not enabled
2019-01-10 11:18:16.451 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_list_networks_fields_keystone_v3 ... success [0.971s]
2019-01-10 11:18:16.536 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_show_network ... success [0.086s]
2019-01-10 11:18:16.836 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_show_network_fields_keystone_v3 ... success [0.299s]
2019-01-10 11:18:20.285 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_qos_negative.QosNegativeTestJSON ... skip: qos extension not enabled.
2019-01-10 11:18:22.854 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagSubnetTestJSON.test_subnet_tags ... success [2.786s]
2019-01-10 11:18:23.704 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_security_group_rule_with_ipv6_protocol_integers ... success [7.062s]
2019-01-10 11:18:25.023 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_security_group_rule_with_ipv6_protocol_legacy_names ... success [1.322s]
2019-01-10 11:18:28.828 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_security_group_rule_with_ipv6_protocol_names ... success [3.794s]
2019-01-10 11:18:30.480 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_portbinding_bumps_revision ... success [6.845s]
2019-01-10 11:18:34.662 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_sp_associate_address_scope_multiple_prefix_intersect ... success [1.305s]
2019-01-10 11:18:34.824 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_allowed_address_pairs_bumps_revision ... success [4.343s]
2019-01-10 11:18:34.825 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_dns_domain_bumps_revision ... skip [0.001s]: Skipped because network extension: dns-integration is not enabled
2019-01-10 11:18:36.063 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_show_delete_security_group_rule_integers ... success [7.210s]
2019-01-10 11:18:36.348 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagTrunkTestJSON.test_trunk_tags ... success [2.075s]
2019-01-10 11:18:36.477 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_external_network_bumps_revision ... success [1.653s]
2019-01-10 11:18:37.443 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnet_different_pools_same_network ... success [2.781s]
2019-01-10 11:18:37.944 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnetpool_associate_address_scope_of_other_owner ... success [0.501s]
2019-01-10 11:18:38.815 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnetpool_associate_address_scope_prefix_intersect ... success [0.870s]
2019-01-10 11:18:38.824 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnetpool_associate_invalid_address_scope ... success [0.009s]
2019-01-10 11:18:39.083 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnetpool_associate_non_exist_address_scope ... success [0.258s]
2019-01-10 11:18:39.104 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_delete_non_existent_subnetpool ... success [0.021s]
2019-01-10 11:18:39.120 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_get_non_existent_subnetpool ... success [0.016s]
2019-01-10 11:18:39.178 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_create_default_subnetpool ... success [0.057s]
2019-01-10 11:18:39.295 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_create_shared_subnetpool ... success [0.117s]
2019-01-10 11:18:39.912 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_create_subnetpool_associate_shared_address_scope ... success [0.617s]
2019-01-10 11:18:40.338 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_get_not_shared_admin_subnetpool ... success [0.426s]
2019-01-10 11:18:40.492 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_extra_dhcp_opt_bumps_revision ... success [4.014s]
2019-01-10 11:18:41.230 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_update_sp_prefix_associated_with_shared_addr_scope ... success [0.890s]
2019-01-10 11:18:41.249 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_non_existent_subnetpool ... success [0.019s]
2019-01-10 11:18:41.479 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_associate_address_scope_of_other_owner ... success [0.230s]
2019-01-10 11:18:41.895 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_associate_address_scope_wrong_ip_version ... success [0.415s]
2019-01-10 11:18:42.510 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_multiple_prefix_intersect ... success [0.614s]
2019-01-10 11:18:42.800 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_not_modifiable_shared ... success [0.290s]
2019-01-10 11:18:43.191 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_prefix_intersect ... success [0.389s]
2019-01-10 11:18:43.562 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_prefixes_shrink ... success [0.372s]
2019-01-10 11:18:43.710 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_tenant_id ... success [0.148s]
2019-01-10 11:18:44.547 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_show_delete_security_group_rule_names ... success [8.462s]
2019-01-10 11:18:47.747 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.UpdateTagsTest.test_update_tags_affects_only_updated_resource ... success [3.318s]
2019-01-10 11:18:51.240 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupProtocolTest.test_create_security_group_rule_with_ipv6_protocol_integers ... success [2.939s]
2019-01-10 11:18:53.212 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupProtocolTest.test_create_security_group_rule_with_ipv6_protocol_names ... success [1.973s]
2019-01-10 11:18:56.484 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_delete_address_scope_associated_with_subnetpool ... success [1.199s]
2019-01-10 11:18:56.495 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_delete_non_existent_address_scope ... success [0.012s]
2019-01-10 11:18:56.508 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_get_non_existent_address_scope ... success [0.012s]
2019-01-10 11:18:56.518 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_tenant_create_shared_address_scope ... success [0.009s]
2019-01-10 11:18:57.330 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_tenant_get_not_shared_admin_address_scope ... success [0.811s]
2019-01-10 11:18:57.409 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_service_type_management.ServiceTypeManagementTest.test_service_provider_list ... success [0.663s]
2019-01-10 11:18:57.422 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_floatingip_bumps_revision ... success [16.928s]
2019-01-10 11:18:57.650 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_tenant_update_address_scope_shared_false ... success [0.320s]
2019-01-10 11:18:57.705 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_tenant_update_address_scope_shared_true ... success [0.054s]
2019-01-10 11:18:57.897 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_update_non_existent_address_scope ... success [0.191s]
2019-01-10 11:18:58.128 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_update_shared_address_scope_to_unshare ... success [0.231s]
2019-01-10 11:18:59.215 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.242s]
2019-01-10 11:18:59.637 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_network_bumps_revision ... success [2.216s]
2019-01-10 11:18:59.806 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination ... success [0.589s]
2019-01-10 11:18:59.983 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.178s]
2019-01-10 11:19:00.296 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.312s]
2019-01-10 11:19:00.780 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.483s]
2019-01-10 11:19:00.901 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_network_constrained_by_revision ... fail [1.258s]
2019-01-10 11:19:02.039 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_with_href_links ... success [1.257s]
2019-01-10 11:19:02.576 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_with_marker ... success [0.537s]
2019-01-10 11:19:02.627 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_sorts_asc ... success [0.052s]
2019-01-10 11:19:02.682 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_sorts_desc ... success [0.054s]
2019-01-10 11:19:02.683 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_validation_filters ... skip [0.001s]: Skipped until Bug: 1749820 is resolved.
2019-01-10 11:19:04.057 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_port_bumps_revision ... success [3.158s]
2019-01-10 11:19:04.766 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_create_network_with_timestamp ... success [1.051s]
2019-01-10 11:19:05.977 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_create_port_with_timestamp ... success [1.211s]
2019-01-10 11:19:07.445 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_create_subnet_with_timestamp ... success [1.468s]
2019-01-10 11:19:07.924 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_create_subnetpool_with_timestamp ... success [0.478s]
2019-01-10 11:19:07.926 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_segment_with_timestamp ... skip [0.001s]: Skipped because network extension: standard-attr-segment is not enabled
2019-01-10 11:19:08.569 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_show_networks_attribute_with_timestamp ... success [0.644s]
2019-01-10 11:19:09.336 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_port_security_bumps_revisions ... success [5.278s]
2019-01-10 11:19:10.344 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_show_port_attribute_with_timestamp ... success [1.774s]
2019-01-10 11:19:10.470 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairTestJSON.test_create_list_port_with_address_pair ... success [2.684s]
2019-01-10 11:19:11.659 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_show_subnet_attribute_with_timestamp ... success [1.314s]
2019-01-10 11:19:12.087 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_show_subnetpool_attribute_with_timestamp ... success [0.428s]
2019-01-10 11:19:13.693 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_update_network_with_timestamp ... success [1.605s]
2019-01-10 11:19:13.705 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_address_pair ... success [3.236s]
2019-01-10 11:19:14.633 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_port_sg_binding_bumps_revision ... success [5.294s]
2019-01-10 11:19:14.637 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_qos_network_policy_binding_bumps_revision ... skip [0.001s]: Skipped because network extension: qos is not enabled
2019-01-10 11:19:14.638 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_qos_port_policy_binding_bumps_revision ... skip [0.000s]: Skipped because network extension: qos is not enabled
2019-01-10 11:19:15.460 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_update_port_with_timestamp ... success [1.767s]
2019-01-10 11:19:16.481 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_cidr_address_pair ... success [2.775s]
2019-01-10 11:19:17.338 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_update_subnet_with_timestamp ... success [1.877s]
2019-01-10 11:19:17.562 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_update_subnetpool_with_timestamp ... success [0.225s]
2019-01-10 11:19:18.869 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_create_sg_with_timestamp ... success [2.768s]
2019-01-10 11:19:21.020 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_create_sgrule_with_timestamp ... success [2.151s]
2019-01-10 11:19:21.819 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_multiple_ip_mac_address_pair ... success [5.337s]
2019-01-10 11:19:22.360 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_show_sg_attribute_with_timestamp ... success [1.339s]
2019-01-10 11:19:23.279 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_show_sgrule_attribute_with_timestamp ... success [0.919s]
2019-01-10 11:19:24.748 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_update_sg_with_timestamp ... success [1.468s]
2019-01-10 11:19:26.143 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_router_bumps_revision ... success [11.508s]
2019-01-10 11:19:26.144 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_router_extra_attributes_bumps_revision ... skip [0.001s]: Skipped because network extension: l3-ha is not enabled
2019-01-10 11:19:29.364 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extensions.ExtensionsTest.test_list_extensions_includes_all ... success [0.651s]
2019-01-10 11:19:29.371 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extensions.ExtensionsTest.test_list_extensions_pagination ... success [0.007s]
2019-01-10 11:19:29.667 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extensions.ExtensionsTest.test_list_extensions_project_id ... success [0.296s]
2019-01-10 11:19:29.851 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extensions.ExtensionsTest.test_list_extensions_sorting ... success [0.183s]
2019-01-10 11:19:36.920 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_router_extra_routes_bumps_revision ... success [10.776s]
2019-01-10 11:19:38.013 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_sg_group_bumps_revision ... success [1.094s]
2019-01-10 11:19:39.058 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_sg_rule_bumps_sg_revision ... success [1.043s]
2019-01-10 11:19:39.326 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extra_dhcp_options.ExtraDHCPOptionsTestJSON.test_create_list_port_with_extra_dhcp_options ... success [1.989s]
2019-01-10 11:19:40.440 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extra_dhcp_options.ExtraDHCPOptionsTestJSON.test_update_show_port_with_extra_dhcp_options ... success [1.115s]
2019-01-10 11:19:44.450 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.023s]
2019-01-10 11:19:44.514 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_subnet_bumps_network_revision ... success [5.456s]
2019-01-10 11:19:44.914 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination ... success [0.463s]
2019-01-10 11:19:44.966 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.052s]
2019-01-10 11:19:45.016 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.049s]
2019-01-10 11:19:45.529 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.511s]
2019-01-10 11:19:46.444 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_with_href_links ... success [0.914s]
2019-01-10 11:19:46.606 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_with_marker ... success [0.163s]
2019-01-10 11:19:46.631 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_sorts_asc ... success [0.025s]
2019-01-10 11:19:46.651 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_sorts_desc ... success [0.021s]
2019-01-10 11:19:50.339 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_subnet_bumps_revision ... success [5.824s]
2019-01-10 11:19:57.151 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_subnet_service_types_bumps_revisions ... success [6.812s]
2019-01-10 11:19:57.719 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_subnetpool_bumps_revision ... success [0.568s]
2019-01-10 11:19:59.986 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_empty_trunk_details ... success [3.334s]
2019-01-10 11:20:00.511 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_floating_ips.FloatingIPTestJSON.test_blank_update_clears_association ... success [2.758s]
2019-01-10 11:20:03.855 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_floating_ips.FloatingIPTestJSON.test_create_update_floatingip_description ... success [3.342s]
2019-01-10 11:20:03.858 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_floating_ips.FloatingIPTestJSON.test_create_update_floatingip_port_details ... skip [0.001s]: Skipped because network extension: fip-port-details is not enabled
2019-01-10 11:20:04.232 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_trunk_details_no_subports ... success [4.246s]
2019-01-10 11:20:06.894 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_floating_ips.FloatingIPTestJSON.test_floatingip_update_extra_attributes_port_id_not_changed ... success [3.038s]
2019-01-10 11:20:10.182 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_create_router_with_default_snat_value ... success [4.155s]
2019-01-10 11:20:10.665 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_trunk_details_with_subport ... success [6.432s]
2019-01-10 11:20:14.695 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestMtusJSON ... skip: Either vxlan or gre type driver not enabled.
2019-01-10 11:20:16.693 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_create_router_with_snat_explicit ... success [6.511s]
2019-01-10 11:20:17.885 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_create_update_router_description ... success [1.191s]
2019-01-10 11:20:19.086 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_metering_extensions.MeteringTestJSON ... skip: metering extension not enabled.
2019-01-10 11:20:19.087 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_metering_negative.MeteringNegativeTestJSON ... skip: metering extension not enabled.
2019-01-10 11:20:22.281 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_networks.NetworksMtuTestJSON.test_create_network_custom_mtu ... success [1.266s]
2019-01-10 11:20:24.326 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_networks.NetworksMtuTestJSON.test_update_network_custom_mtu ... success [2.045s]
2019-01-10 11:20:27.984 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_qos.QosSearchCriteriaTest ... skip: qos extension not enabled.
2019-01-10 11:20:27.985 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_qos.RbacSharedQosPoliciesTest ... skip: qos extension not enabled.
2019-01-10 11:20:30.779 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_network_attached_with_two_routers ... success [12.892s]
2019-01-10 11:20:31.628 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.271s]
2019-01-10 11:20:32.494 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination ... success [0.864s]
2019-01-10 11:20:32.920 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.426s]
2019-01-10 11:20:33.454 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.533s]
2019-01-10 11:20:34.044 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.590s]
2019-01-10 11:20:35.827 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_with_href_links ... success [1.781s]
2019-01-10 11:20:36.610 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_with_marker ... success [0.783s]
2019-01-10 11:20:36.744 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_sorts_asc ... success [0.134s]
2019-01-10 11:20:36.831 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_sorts_desc ... success [0.087s]
2019-01-10 11:20:48.796 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_create_router_with_default_snat_value ... success [3.781s]
2019-01-10 11:20:54.773 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_create_router_with_snat_explicit ... success [5.978s]
2019-01-10 11:20:56.252 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_create_update_router_description ... success [1.478s]
2019-01-10 11:21:08.543 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_network_attached_with_two_routers ... success [12.289s]
2019-01-10 11:21:36.229 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_router_interface_status ... fail [65.434s]
2019-01-10 11:21:42.253 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_update_extra_route ... success [6.028s]
2019-01-10 11:21:46.302 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_update_router_reset_gateway_without_snat ... success [4.048s]
2019-01-10 11:21:49.752 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_update_router_set_gateway_with_snat_explicit ... success [3.449s]
2019-01-10 11:21:53.185 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_update_router_set_gateway_without_snat ... success [3.432s]
2019-01-10 11:22:06.944 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers_negative.DvrRoutersNegativeTest.test_router_create_tenant_distributed_returns_forbidden ... success [0.013s]
2019-01-10 11:22:12.792 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers_negative.HaRoutersNegativeTest ... skip: l3-ha extension not enabled.
2019-01-10 11:22:13.754 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_router_interface_status ... fail [65.192s]
2019-01-10 11:22:16.075 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups.SecGroupTest.test_create_bulk_sec_groups ... success [1.394s]
2019-01-10 11:22:17.032 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [0.956s]
2019-01-10 11:22:20.154 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_update_extra_route ... success [6.404s]
2019-01-10 11:22:22.105 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_with_boolean_type_name ... success [0.198s]
2019-01-10 11:22:22.114 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_with_too_long_name ... success [0.009s]
2019-01-10 11:22:23.115 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_delete_in_use_sec_group ... success [0.999s]
2019-01-10 11:22:23.244 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_update_default_security_group_name ... success [0.129s]
2019-01-10 11:22:23.298 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_update_security_group_with_boolean_type_name ... success [0.053s]
2019-01-10 11:22:23.525 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_update_security_group_with_too_long_name ... success [0.226s]
2019-01-10 11:22:24.238 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_update_router_reset_gateway_without_snat ... success [4.084s]
2019-01-10 11:22:27.855 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_update_router_set_gateway_with_snat_explicit ... success [3.616s]
2019-01-10 11:22:31.306 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_update_router_set_gateway_without_snat ... success [3.450s]
2019-01-10 11:22:32.580 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.194s]
2019-01-10 11:22:32.855 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination ... success [0.272s]
2019-01-10 11:22:33.135 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.281s]
2019-01-10 11:22:33.543 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.407s]
2019-01-10 11:22:33.675 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.131s]
2019-01-10 11:22:34.883 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_with_href_links ... success [1.205s]
2019-01-10 11:22:35.065 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_with_marker ... success [0.183s]
2019-01-10 11:22:35.088 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_sorts_asc ... success [0.024s]
2019-01-10 11:22:35.115 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_sorts_desc ... success [0.025s]
2019-01-10 11:22:35.116 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_validation_filters ... skip [0.000s]: Skipped until Bug: 1749820 is resolved.
2019-01-10 11:22:42.908 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_admin_create_shared_subnetpool ... success [1.210s]
2019-01-10 11:22:43.520 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_list_subnetpool ... success [0.613s]
2019-01-10 11:22:44.895 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnet_from_pool_with_default_prefixlen ... success [1.374s]
2019-01-10 11:22:46.609 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnet_from_pool_with_prefixlen ... success [1.713s]
2019-01-10 11:22:48.009 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnet_from_pool_with_quota ... success [1.400s]
2019-01-10 11:22:49.468 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnet_from_pool_with_subnet_cidr ... success [1.458s]
2019-01-10 11:22:50.471 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnetpool_associate_address_scope ... success [1.004s]
2019-01-10 11:22:51.071 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_update_subnetpool_description ... success [0.598s]
2019-01-10 11:22:51.472 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_get_subnetpool ... success [0.402s]
2019-01-10 11:22:51.658 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_show_subnetpool_has_project_id ... success [0.186s]
2019-01-10 11:22:51.789 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_tenant_create_non_default_subnetpool ... success [0.131s]
2019-01-10 11:22:52.065 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_tenant_update_subnetpool ... success [0.275s]
2019-01-10 11:22:52.759 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_associate_address_scope ... success [0.693s]
2019-01-10 11:22:53.178 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_associate_another_address_scope ... success [0.419s]
2019-01-10 11:22:53.299 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolTest.test_create_show_delete_security_group_rule_integers ... success [10.902s]
2019-01-10 11:22:53.626 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_disassociate_address_scope ... success [0.448s]
2019-01-10 11:22:53.848 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_prefixes_append ... success [0.221s]
2019-01-10 11:22:54.054 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_prefixes_extend ... success [0.206s]
2019-01-10 11:23:00.865 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolTest.test_create_show_delete_security_group_rule_names ... success [7.541s]
2019-01-10 11:23:02.206 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_trunk.TrunkTestInheritJSONBase ... skip: VLAN type_driver is not enabled
2019-01-10 11:23:10.342 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_create_floatingip_with_timestamp ... success [1.919s]
2019-01-10 11:23:10.460 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_create_router_with_timestamp ... success [0.119s]
2019-01-10 11:23:12.131 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_show_floatingip_attribute_with_timestamp ... success [1.670s]
2019-01-10 11:23:12.757 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_show_router_attribute_with_timestamp ... success [0.625s]
2019-01-10 11:23:14.246 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_update_floatingip_with_timestamp ... success [1.489s]
2019-01-10 11:23:15.109 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_update_router_with_timestamp ... success [0.862s]
2019-01-10 11:23:31.413 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_add_subport ... success [6.818s]
2019-01-10 11:23:34.969 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_show_delete_trunk ... success [3.556s]
2019-01-10 11:23:37.994 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_trunk_empty_subports_list ... success [3.024s]
2019-01-10 11:23:41.461 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_trunk_subports_not_specified ... success [3.467s]
2019-01-10 11:23:45.505 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_update_trunk ... success [4.043s]
2019-01-10 11:23:48.746 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_update_trunk_with_description ... success [3.240s]
2019-01-10 11:23:54.083 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_delete_trunk_with_subport_is_allowed ... success [5.336s]
2019-01-10 11:24:00.349 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_get_subports ... success [6.266s]
2019-01-10 11:24:07.028 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_list_trunks ... success [6.678s]
2019-01-10 11:24:15.818 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_remove_subport ... success [8.788s]
2019-01-10 11:24:19.850 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_show_trunk_has_project_id ... success [4.032s]
2019-01-10 11:24:23.326 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestMtusJSON ... skip: Either vxlan or gre type driver not enabled.
2019-01-10 11:24:34.631 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_add_subport_duplicate_segmentation_details ... success [8.253s]
2019-01-10 11:24:37.850 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_add_subport_passing_dict ... success [3.218s]
2019-01-10 11:24:41.554 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_add_subport_port_id_disabled_trunk ... success [3.703s]
2019-01-10 11:24:45.162 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_add_subport_port_id_uses_trunk_port_id ... success [3.607s]
2019-01-10 11:24:45.652 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_subport_invalid_inherit_network_segmentation_type ... skip [0.490s]: Vxlan type driver must be enabled for this test.
2019-01-10 11:24:50.693 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_subport_missing_segmentation_id ... success [5.040s]
2019-01-10 11:24:54.447 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_subport_nonexistent_port_id ... success [3.753s]
2019-01-10 11:24:57.099 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_subport_nonexistent_trunk ... success [2.652s]
2019-01-10 11:25:04.883 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_duplicate_subport_segmentation_ids ... success [7.783s]
2019-01-10 11:25:06.209 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_nonexistent_port_id ... success [1.327s]
2019-01-10 11:25:09.549 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_nonexistent_subport_port_id ... success [3.339s]
2019-01-10 11:25:12.924 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_port_id ... success [3.374s]
2019-01-10 11:25:16.281 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_segmentation_id ... success [3.357s]
2019-01-10 11:25:19.338 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_segmentation_type ... success [3.056s]
2019-01-10 11:25:26.765 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_delete_port_in_use_by_subport ... success [7.426s]
2019-01-10 11:25:31.087 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_delete_port_in_use_by_trunk ... success [4.321s]
2019-01-10 11:25:35.249 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_delete_trunk_disabled_trunk ... success [4.161s]
2019-01-10 11:25:41.622 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_not_found ... success [6.373s]
2019-01-10 11:25:48.722 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_passing_dict ... success [7.099s]
2019-01-10 11:25:53.912 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_port_id_disabled_trunk ... success [5.190s]
2019-01-10 11:25:58.826 89 INFO rally.task.context [-] Verification ac822f38-cc8f-46e0-9c3a-a08ec6e8f2a5 | Context testr@default cleanup() started
2019-01-10 11:25:58.826 89 INFO rally.task.context [-] Verification ac822f38-cc8f-46e0-9c3a-a08ec6e8f2a5 | Context testr@default cleanup() finished in 0.88 msec
2019-01-10 11:25:58.827 89 INFO rally.task.context [-] Verification ac822f38-cc8f-46e0-9c3a-a08ec6e8f2a5 | Context tempest@default cleanup() started
2019-01-10 11:25:59.704 89 INFO rally.task.context [-] Verification ac822f38-cc8f-46e0-9c3a-a08ec6e8f2a5 | Context tempest@default cleanup() finished in 0.88 sec
2019-01-10 11:25:59.839 89 INFO rally.api [-] Verification (UUID=c5ffc553-0d7d-4c5c-bf1f-ecd509f39c52) has been successfully finished for deployment 'opnfv-rally' (UUID=7b25d0db-2f35-4e96-8754-a30097326eed)!

======
Totals
======

Ran: 547 tests in 710.527 sec.
 - Success: 387
 - Skipped: 157
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 3

Using verification (UUID=c5ffc553-0d7d-4c5c-bf1f-ecd509f39c52) as the default verification for the future operations.