2018-08-11 21:29:47.122 119 INFO rally.api [-] Starting verification (UUID=1c12e638-7644-421b-b1a5-8b2bb0b5dd92) for deployment 'opnfv-rally' (UUID=30ffdee8-96a5-4ecb-adef-6085d53971c4) by verifier 'opnfv-tempest' (UUID=c7060e5f-4080-40a2-8c51-0443e37f8ec7).
2018-08-11 21:29:48.120 119 WARNING oslo_config.cfg [-] Option "img_name_regex" from group "tempest" is deprecated. Use option "img_name_regex" from group "openstack".
2018-08-11 21:29:49.018 119 INFO rally.task.context [-] Verification c7060e5f-4080-40a2-8c51-0443e37f8ec7 | Context tempest@default setup()  finished in 1.34 sec
2018-08-11 21:29:49.021 119 INFO rally.task.context [-] Verification c7060e5f-4080-40a2-8c51-0443e37f8ec7 | Context testr@default setup()  finished in 2.58 msec
2018-08-11 21:29:55.277 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_list_agent ... success [0.180s]
2018-08-11 21:29:55.755 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_agent_availability_zone.AgentAvailabilityZoneTestCase.test_agents_availability_zone ... skip [0.000s]: Need a single availability_zone assumption.
2018-08-11 21:29:55.859 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_list_agents_non_admin ... success [0.582s]
2018-08-11 21:29:55.874 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_show_agent ... success [0.015s]
2018-08-11 21:29:56.498 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_update_agent_description ... success [0.623s]
2018-08-11 21:29:56.562 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_update_agent_status ... success [0.065s]
2018-08-11 21:30:00.064 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_l3_agent_scheduler.L3AgentSchedulerTestJSON ... skip: l3_agent_scheduler extension not enabled.
2018-08-11 21:30:00.065 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_logging.LoggingTestJSON ... skip: logging extension not enabled.
2018-08-11 21:30:00.618 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_add_remove_network_from_dhcp_agent ... success [2.728s]
2018-08-11 21:30:00.848 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_dhcp_port_status_active ... success [0.232s]
2018-08-11 21:30:00.875 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_list_dhcp_agent_hosting_network ... success [0.026s]
2018-08-11 21:30:01.001 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_list_networks_hosted_by_one_dhcp ... success [0.125s]
2018-08-11 21:30:05.312 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_networks.NetworksTestAdmin.test_create_network_with_project ... success [1.967s]
2018-08-11 21:30:05.547 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_networks.NetworksTestAdmin.test_create_network_with_project_and_other_tenant ... success [0.237s]
2018-08-11 21:30:06.352 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_networks.NetworksTestAdmin.test_create_network_with_project_and_tenant ... success [0.803s]
2018-08-11 21:30:06.353 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_networks.NetworksTestAdmin.test_create_tenant_network_vxlan ... skip [0.000s]: VXLAN type_driver is not enabled
2018-08-11 21:30:09.910 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_floating_ips_admin_actions.FloatingIPAdminTestJSON.test_associate_floating_ip_with_port_from_another_project ... success [4.994s]
2018-08-11 21:30:12.412 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_floating_ips_admin_actions.FloatingIPAdminTestJSON.test_create_floatingip_with_specified_ip_address ... success [2.503s]
2018-08-11 21:30:13.554 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_extension_driver_port_security_admin.PortSecurityAdminTests.test_create_port_security_false_on_shared_network ... success [2.577s]
2018-08-11 21:30:14.419 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_delete_policies_while_tenant_attached_to_net ... success [11.005s]
2018-08-11 21:30:16.348 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_floatingip_when_quotas_is_full ... success [2.732s]
2018-08-11 21:30:17.361 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_conversion_on_one_policy_delete ... success [2.942s]
2018-08-11 21:30:18.214 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_network_when_quotas_is_full ... success [1.866s]
2018-08-11 21:30:19.540 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_logging_negative.LoggingNegativeTestJSON ... skip: logging extension not enabled.
2018-08-11 21:30:20.348 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_conversion_on_policy_create ... success [2.986s]
2018-08-11 21:30:22.511 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_conversion_on_policy_delete ... success [2.162s]
2018-08-11 21:30:24.014 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_port_when_quotas_is_full ... success [5.798s]
2018-08-11 21:30:24.787 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_ports.PortTestCasesAdmin.test_regenerate_mac_address ... skip [0.001s]: Skipped because network extension: port-mac-address-regenerate is not enabled
2018-08-11 21:30:24.971 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_network_on_shared_policy_delete ... success [2.460s]
2018-08-11 21:30:25.434 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_router_when_quotas_is_full ... success [1.420s]
2018-08-11 21:30:27.678 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_security_group_rule_when_quotas_is_full ... success [2.242s]
2018-08-11 21:30:28.019 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_ports.PortTestCasesAdmin.test_update_mac_address ... success [3.230s]
2018-08-11 21:30:28.643 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_security_group_when_quotas_is_full ... success [0.965s]
2018-08-11 21:30:28.898 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_update_policy_from_wildcard_to_specific_tenant ... success [3.926s]
2018-08-11 21:30:32.535 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_subnet_when_quotas_is_full ... success [3.891s]
2018-08-11 21:30:32.650 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_quotas.QuotasTest.test_detail_quotas ... success [5.002s]
2018-08-11 21:30:33.240 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_quotas.QuotasTest.test_quotas ... success [0.590s]
2018-08-11 21:30:35.114 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_policy_allows_tenant_to_allocate_floatingip ... success [6.214s]
2018-08-11 21:30:36.370 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_routers_dvr.RouterTestCentralizedToDVR ... skip: l3-ha extension not enabled.
2018-08-11 21:30:40.253 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_policy_allows_tenant_to_attach_ext_gw ... success [5.139s]
2018-08-11 21:30:41.104 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_routers_dvr.RoutersTestDVR.test_centralized_router_creation ... success [1.135s]
2018-08-11 21:30:41.917 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_routers_dvr.RoutersTestDVR.test_distributed_router_creation ... success [0.813s]
2018-08-11 21:30:42.013 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_regular_client_blocked_from_creating_external_wild_policies ... success [1.759s]
2018-08-11 21:30:45.273 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_routers_flavors.RoutersFlavorTestCase ... skip: l3-flavors extension not enabled.
2018-08-11 21:30:45.625 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_security_groups.SecGroupAdminTest.test_security_group_recreated_on_port_update ... success [5.714s]
2018-08-11 21:30:46.044 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_regular_client_shares_with_another ... success [4.031s]
2018-08-11 21:30:50.293 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_wildcard_policy_created_from_external_network_api ... success [4.247s]
2018-08-11 21:30:51.180 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_wildcard_policy_delete_blocked_on_default_ext ... success [0.888s]
2018-08-11 21:30:51.674 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_shared_network_extension.AllowedAddressPairSharedNetworkTest.test_create_with_address_pair_blocked_on_other_network ... success [0.873s]
2018-08-11 21:30:52.141 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagFilterPortTestJSON.test_filter_port_tags ... success [1.162s]
2018-08-11 21:30:53.278 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_shared_network_extension.AllowedAddressPairSharedNetworkTest.test_update_with_address_pair_blocked_on_other_network ... success [1.604s]
2018-08-11 21:30:56.554 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_routers_ha.RoutersTestHA ... skip: l3-ha extension not enabled.
2018-08-11 21:31:06.088 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_create_rbac_policy_with_target_tenant_none ... success [5.223s]
2018-08-11 21:31:06.837 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_tag.TagFilterFloatingIpTestJSON.test_filter_floatingip_tags ... success [0.595s]
2018-08-11 21:31:08.204 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_tag.TagFilterRouterTestJSON.test_filter_router_tags ... success [1.623s]
2018-08-11 21:31:10.075 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_create_rbac_policy_with_target_tenant_too_long_id ... success [3.987s]
2018-08-11 21:31:12.958 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagFilterQosPolicyTestJSON ... skip: Skipped because network extension: qos is not enabled
2018-08-11 21:31:14.212 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_delete_self_share_rule ... success [4.136s]
2018-08-11 21:31:18.841 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_duplicate_policy_error ... success [4.628s]
2018-08-11 21:31:20.449 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_filter_fields ... success [1.607s]
2018-08-11 21:31:21.848 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagFilterSecGroupTestJSON.test_filter_security_group_tags ... success [1.088s]
2018-08-11 21:31:22.345 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_filter_policies ... success [1.895s]
2018-08-11 21:31:23.434 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_tag.TagFloatingIpTestJSON.test_floatingip_tags ... success [1.200s]
2018-08-11 21:31:28.225 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_filtering_works_with_rbac_records_present ... success [5.879s]
2018-08-11 21:31:29.385 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_tag.TagFilterTrunkTestJSON.test_filter_trunk_tags ... success [0.283s]
2018-08-11 21:31:32.999 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_network_only_visible_to_policy_target ... success [4.773s]
2018-08-11 21:31:33.893 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagNetworkTestJSON.test_network_tags ... success [2.899s]
2018-08-11 21:31:34.310 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_tag.TagPortTestJSON.test_port_tags ... success [1.612s]
2018-08-11 21:31:37.721 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_policy_show ... success [4.721s]
2018-08-11 21:31:41.934 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_policy_target_update ... success [4.212s]
2018-08-11 21:31:44.322 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_tag.TagSubnetPoolTestJSON.test_subnetpool_tags ... success [1.872s]
2018-08-11 21:31:46.454 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagRouterTestJSON.test_router_tags ... success [3.878s]
2018-08-11 21:31:47.296 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_tag.TagSecGroupTestJSON.test_security_group_tags ... success [2.000s]
2018-08-11 21:31:47.696 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_port_presence_prevents_network_rbac_policy_deletion ... success [5.761s]
2018-08-11 21:31:52.415 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_rbac_bumps_network_revision ... success [4.719s]
2018-08-11 21:31:52.737 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.303s]
2018-08-11 21:31:53.506 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination ... success [0.767s]
2018-08-11 21:31:53.776 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.270s]
2018-08-11 21:31:54.340 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.564s]
2018-08-11 21:31:54.627 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_admin_create_shared_address_scope ... success [0.607s]
2018-08-11 21:31:55.199 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_admin_update_shared_address_scope ... success [0.571s]
2018-08-11 21:31:55.550 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [1.209s]
2018-08-11 21:31:56.259 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_delete_address_scope ... success [1.059s]
2018-08-11 21:31:56.328 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_show_address_scope ... success [0.069s]
2018-08-11 21:31:56.804 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_show_address_scope_project_id ... success [0.475s]
2018-08-11 21:31:57.262 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_tenant_create_list_address_scope ... success [0.457s]
2018-08-11 21:31:57.490 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_tenant_update_address_scope ... success [0.229s]
2018-08-11 21:31:57.802 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_with_href_links ... success [2.249s]
2018-08-11 21:31:58.147 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcp_stateful_fixedips_outrange ... success [4.339s]
2018-08-11 21:31:58.465 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_rbac_policy_quota ... success [6.048s]
2018-08-11 21:31:58.673 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_with_marker ... success [0.872s]
2018-08-11 21:31:58.805 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_sorts_asc ... success [0.133s]
2018-08-11 21:31:58.935 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_sorts_desc ... success [0.129s]
2018-08-11 21:31:58.937 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_validation_filters ... skip [0.001s]: Skipped until Bug: 1749820 is resolved.
2018-08-11 21:32:03.270 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_regular_client_blocked_from_sharing_anothers_network ... success [4.805s]
2018-08-11 21:32:03.975 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_regular_client_blocked_from_sharing_with_wildcard ... success [0.704s]
2018-08-11 21:32:05.392 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_regular_client_shares_to_another_regular_client ... success [1.417s]
2018-08-11 21:32:06.221 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_allowed_address_pairs ... success [3.500s]
2018-08-11 21:32:07.702 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_create_list_port_with_address_pair ... success [1.744s]
2018-08-11 21:32:10.033 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_subnet_on_network_only_visible_to_policy_target ... success [4.640s]
2018-08-11 21:32:11.088 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_address_pair ... success [3.386s]
2018-08-11 21:32:11.518 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_create_port_sec_with_security_group ... success [5.297s]
2018-08-11 21:32:12.492 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks_negative.NetworksNegativeTest.test_delete_network_in_use ... success [3.529s]
2018-08-11 21:32:12.683 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_tenant_can_delete_port_on_own_network ... success [2.650s]
2018-08-11 21:32:13.827 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_cidr_address_pair ... success [2.739s]
2018-08-11 21:32:14.316 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_delete_with_port_sec ... success [2.798s]
2018-08-11 21:32:14.505 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_tenant_cant_delete_other_tenants_ports ... success [1.821s]
2018-08-11 21:32:16.702 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_default_value ... success [2.386s]
2018-08-11 21:32:17.068 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_update_self_share_rule ... success [2.563s]
2018-08-11 21:32:17.878 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_multiple_ip_mac_address_pair ... success [4.049s]
2018-08-11 21:32:19.578 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_specific_value_1 ... success [2.875s]
2018-08-11 21:32:22.228 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_specific_value_2 ... success [2.649s]
2018-08-11 21:32:24.481 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_add_ips_to_port ... success [3.761s]
2018-08-11 21:32:27.356 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_update_pass ... success [5.127s]
2018-08-11 21:32:27.763 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_change_dhcp_flag_then_create_port ... success [3.281s]
2018-08-11 21:32:29.962 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_auto_allocated_topology.TestAutoAllocatedTopology ... skip: No default subnetpool
2018-08-11 21:32:30.048 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_create_update_port_description ... success [2.283s]
2018-08-11 21:32:30.052 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_create_update_port_with_dns_domain ... skip [0.001s]: Skipped because network extension: dns-domain-ports is not enabled
2018-08-11 21:32:30.053 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_create_update_port_with_dns_name ... skip [0.000s]: Skipped because network extension: dns-integration is not enabled
2018-08-11 21:32:30.054 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_create_update_port_with_no_dns_name ... skip [0.001s]: Skipped because network extension: dns-integration is not enabled
2018-08-11 21:32:32.766 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_update_port_failed ... success [5.408s]
2018-08-11 21:32:35.772 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_create_bulk_shared_network ... success [2.412s]
2018-08-11 21:32:37.806 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_extra_dhcp_options.ExtraDHCPOptionsIpV6TestJSON.test_create_list_port_with_extra_dhcp_options ... success [2.108s]
2018-08-11 21:32:38.409 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_create_port_shared_network_as_non_admin_tenant ... success [2.636s]
2018-08-11 21:32:38.434 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_qos.QosBandwidthLimitRuleTestJSON ... skip: qos extension not enabled.
2018-08-11 21:32:38.435 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_qos.QosBandwidthLimitRuleWithDirectionTestJSON ... skip: qos extension not enabled.
2018-08-11 21:32:38.437 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_qos.QosDscpMarkingRuleTestJSON ... skip: qos extension not enabled.
2018-08-11 21:32:38.459 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_extra_dhcp_options.ExtraDHCPOptionsIpV6TestJSON.test_update_show_port_with_extra_dhcp_options ... success [0.654s]
2018-08-11 21:32:40.977 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_create_update_shared_network ... success [2.567s]
2018-08-11 21:32:42.746 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_filtering_shared_networks ... success [1.768s]
2018-08-11 21:32:44.545 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers.DvrRoutersTest.test_create_distributed_router ... success [1.887s]
2018-08-11 21:32:46.052 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_filtering_shared_subnets ... success [3.304s]
2018-08-11 21:32:46.265 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_list_shared_networks ... success [0.214s]
2018-08-11 21:32:46.464 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_show_shared_networks_attribute ... success [0.200s]
2018-08-11 21:32:47.170 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers.DvrRoutersTestToCentralized ... skip: l3-ha extension not enabled.
2018-08-11 21:32:47.171 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers.HaRoutersTest ... skip: l3-ha extension not enabled.
2018-08-11 21:32:59.918 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_create_update_delete_flavor ... success [0.831s]
2018-08-11 21:33:00.359 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_create_update_delete_service_profile ... success [0.441s]
2018-08-11 21:33:00.376 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_list_flavors ... success [0.018s]
2018-08-11 21:33:00.396 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_list_service_profiles ... success [0.019s]
2018-08-11 21:33:00.417 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_show_flavor ... success [0.021s]
2018-08-11 21:33:00.430 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_show_service_profile ... success [0.013s]
2018-08-11 21:33:01.220 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers_negative.RoutersNegativePolicyTest.test_add_interface_wrong_tenant ... success [6.047s]
2018-08-11 21:33:07.551 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_floating_ips_negative.FloatingIPNegativeTestJSON.test_associate_floatingip_with_port_with_floatingip ... success [15.077s]
2018-08-11 21:33:08.010 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagFilterNetworkTestJSON.test_filter_network_tags ... success [1.370s]
2018-08-11 21:33:10.561 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_create_update_delete_flavor ... success [1.530s]
2018-08-11 21:33:11.023 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_create_update_delete_service_profile ... success [0.461s]
2018-08-11 21:33:11.037 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_list_flavors ... success [0.014s]
2018-08-11 21:33:11.050 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_list_service_profiles ... success [0.013s]
2018-08-11 21:33:11.066 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_show_flavor ... success [0.015s]
2018-08-11 21:33:11.080 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_show_service_profile ... success [0.013s]
2018-08-11 21:33:13.689 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_metering_extensions.MeteringIpV6TestJSON ... skip: metering extension not enabled.
2018-08-11 21:33:19.956 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv6Test.test_admin_network_availability_before_subnet ... success [2.477s]
2018-08-11 21:33:20.342 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers_negative.RoutersNegativeTest.test_delete_router_in_use ... success [4.181s]
2018-08-11 21:33:26.111 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv6Test.test_net_ip_availability_after_port_delete ... success [6.153s]
2018-08-11 21:33:28.241 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv4Test.test_admin_network_availability_before_subnet ... success [2.932s]
2018-08-11 21:33:31.046 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagFilterSubnetTestJSON.test_filter_subnet_tags ... success [0.681s]
2018-08-11 21:33:32.102 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv6Test.test_net_ip_availability_after_subnet_and_ports ... success [5.990s]
2018-08-11 21:33:32.666 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_with_boolean_type_name ... success [0.015s]
2018-08-11 21:33:32.857 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_with_too_long_name ... success [0.191s]
2018-08-11 21:33:33.712 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv4Test.test_net_ip_availability_after_port_delete ... success [5.470s]
2018-08-11 21:33:34.724 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_delete_in_use_sec_group ... success [1.866s]
2018-08-11 21:33:35.019 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_update_default_security_group_name ... success [0.294s]
2018-08-11 21:33:35.082 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_update_security_group_with_boolean_type_name ... success [0.063s]
2018-08-11 21:33:35.141 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_update_security_group_with_too_long_name ... success [0.059s]
2018-08-11 21:33:38.821 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_network_ip_availability_negative.NetworksIpAvailabilityNegativeTest.test_network_availability_nonexistent_network_id ... success [0.550s]
2018-08-11 21:33:42.813 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv4Test.test_net_ip_availability_after_subnet_and_ports ... success [9.101s]
2018-08-11 21:33:43.497 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_admin_create_shared_subnetpool ... success [1.851s]
2018-08-11 21:33:47.227 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_dual_stack_subnets_from_subnetpools ... success [3.729s]
2018-08-11 21:33:47.664 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_list_subnetpool ... success [0.438s]
2018-08-11 21:33:48.759 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnet_from_pool_with_default_prefixlen ... success [1.093s]
2018-08-11 21:33:50.190 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnet_from_pool_with_prefixlen ... success [1.430s]
2018-08-11 21:33:50.550 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_create_network_with_project ... success [1.383s]
2018-08-11 21:33:50.552 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_create_update_network_dns_domain ... skip [0.001s]: Skipped because network extension: dns-integration is not enabled
2018-08-11 21:33:51.484 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_list_networks_fields_keystone_v3 ... success [0.933s]
2018-08-11 21:33:51.575 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_show_network ... success [0.092s]
2018-08-11 21:33:51.884 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.293s]
2018-08-11 21:33:52.032 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnet_from_pool_with_quota ... success [1.843s]
2018-08-11 21:33:52.284 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_show_network_fields_keystone_v3 ... success [0.708s]
2018-08-11 21:33:52.620 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination ... success [0.733s]
2018-08-11 21:33:53.359 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.739s]
2018-08-11 21:33:53.489 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnet_from_pool_with_subnet_cidr ... success [1.455s]
2018-08-11 21:33:53.753 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagFilterSubnetpoolTestJSON.test_filter_subnetpool_tags ... success [0.391s]
2018-08-11 21:33:53.806 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.448s]
2018-08-11 21:33:53.933 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnetpool_associate_address_scope ... success [0.444s]
2018-08-11 21:33:54.597 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.788s]
2018-08-11 21:33:54.624 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_update_subnetpool_description ... success [0.689s]
2018-08-11 21:33:54.803 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_get_subnetpool ... success [0.180s]
2018-08-11 21:33:55.011 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_show_subnetpool_has_project_id ... success [0.208s]
2018-08-11 21:33:55.122 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_tenant_create_non_default_subnetpool ... success [0.111s]
2018-08-11 21:33:55.460 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_tenant_update_subnetpool ... success [0.336s]
2018-08-11 21:33:55.907 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_qos_negative.QosNegativeTestJSON ... skip: qos extension not enabled.
2018-08-11 21:33:56.031 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_associate_address_scope ... success [0.570s]
2018-08-11 21:33:56.167 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_with_href_links ... success [1.568s]
2018-08-11 21:33:56.712 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_associate_another_address_scope ... success [0.680s]
2018-08-11 21:33:56.971 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_with_marker ... success [0.804s]
2018-08-11 21:33:57.093 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_sorts_asc ... success [0.124s]
2018-08-11 21:33:57.201 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_sorts_desc ... success [0.108s]
2018-08-11 21:33:57.432 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_disassociate_address_scope ... success [0.721s]
2018-08-11 21:33:58.112 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_prefixes_append ... success [0.679s]
2018-08-11 21:33:58.427 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_prefixes_extend ... success [0.316s]
2018-08-11 21:34:01.602 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_qos.QosMinimumBandwidthRuleTestJSON ... skip: qos extension not enabled.
2018-08-11 21:34:01.603 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_qos.QosTestJSON ... skip: qos extension not enabled.
2018-08-11 21:34:05.450 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagQosPolicyTestJSON ... skip: Skipped because network extension: qos is not enabled
2018-08-11 21:34:05.933 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_portbinding_bumps_revision ... success [6.969s]
2018-08-11 21:34:09.157 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_security_group_rule_with_ipv6_protocol_integers ... success [5.525s]
2018-08-11 21:34:09.221 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_allowed_address_pairs_bumps_revision ... success [3.288s]
2018-08-11 21:34:09.222 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_dns_domain_bumps_revision ... skip [0.001s]: Skipped because network extension: dns-integration is not enabled
2018-08-11 21:34:11.701 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_security_group_rule_with_ipv6_protocol_legacy_names ... success [2.546s]
2018-08-11 21:34:11.707 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_external_network_bumps_revision ... success [2.486s]
2018-08-11 21:34:14.265 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagSubnetTestJSON.test_subnet_tags ... success [2.418s]
2018-08-11 21:34:16.286 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_extra_dhcp_opt_bumps_revision ... success [4.577s]
2018-08-11 21:34:17.130 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_security_group_rule_with_ipv6_protocol_names ... success [5.418s]
2018-08-11 21:34:21.257 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_sp_associate_address_scope_multiple_prefix_intersect ... success [1.104s]
2018-08-11 21:34:24.031 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnet_different_pools_same_network ... success [2.773s]
2018-08-11 21:34:24.369 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnetpool_associate_address_scope_of_other_owner ... success [0.338s]
2018-08-11 21:34:25.028 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnetpool_associate_address_scope_prefix_intersect ... success [0.659s]
2018-08-11 21:34:25.234 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnetpool_associate_invalid_address_scope ... success [0.207s]
2018-08-11 21:34:25.550 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnetpool_associate_non_exist_address_scope ... success [0.315s]
2018-08-11 21:34:25.571 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_delete_non_existent_subnetpool ... success [0.021s]
2018-08-11 21:34:25.672 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_get_non_existent_subnetpool ... success [0.101s]
2018-08-11 21:34:25.825 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_create_default_subnetpool ... success [0.152s]
2018-08-11 21:34:25.934 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_create_shared_subnetpool ... success [0.109s]
2018-08-11 21:34:26.457 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_create_subnetpool_associate_shared_address_scope ... success [0.521s]
2018-08-11 21:34:26.962 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_get_not_shared_admin_subnetpool ... success [0.504s]
2018-08-11 21:34:27.486 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagTrunkTestJSON.test_trunk_tags ... success [1.153s]
2018-08-11 21:34:27.503 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_show_delete_security_group_rule_integers ... success [10.346s]
2018-08-11 21:34:27.998 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_update_sp_prefix_associated_with_shared_addr_scope ... success [1.034s]
2018-08-11 21:34:28.187 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_non_existent_subnetpool ... success [0.189s]
2018-08-11 21:34:28.529 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_associate_address_scope_of_other_owner ... success [0.342s]
2018-08-11 21:34:29.208 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_associate_address_scope_wrong_ip_version ... success [0.678s]
2018-08-11 21:34:29.638 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_multiple_prefix_intersect ... success [0.430s]
2018-08-11 21:34:30.025 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_not_modifiable_shared ... success [0.388s]
2018-08-11 21:34:30.623 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_prefix_intersect ... success [0.596s]
2018-08-11 21:34:30.898 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_prefixes_shrink ... success [0.276s]
2018-08-11 21:34:31.236 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_tenant_id ... success [0.338s]
2018-08-11 21:34:31.884 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_floatingip_bumps_revision ... success [15.596s]
2018-08-11 21:34:33.718 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_network_bumps_revision ... success [1.834s]
2018-08-11 21:34:34.853 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_network_constrained_by_revision ... fail [1.128s]
2018-08-11 21:34:37.074 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_show_delete_security_group_rule_names ... success [9.539s]
2018-08-11 21:34:38.047 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_port_bumps_revision ... success [3.197s]
2018-08-11 21:34:38.719 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.UpdateTagsTest.test_update_tags_affects_only_updated_resource ... success [3.818s]
2018-08-11 21:34:43.124 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupProtocolTest.test_create_security_group_rule_with_ipv6_protocol_integers ... success [2.842s]
2018-08-11 21:34:43.272 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_port_security_bumps_revisions ... success [5.224s]
2018-08-11 21:34:44.856 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupProtocolTest.test_create_security_group_rule_with_ipv6_protocol_names ... success [1.732s]
2018-08-11 21:34:45.663 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.198s]
2018-08-11 21:34:46.355 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination ... success [0.690s]
2018-08-11 21:34:46.731 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.376s]
2018-08-11 21:34:46.916 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.184s]
2018-08-11 21:34:47.001 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_delete_address_scope_associated_with_subnetpool ... success [1.274s]
2018-08-11 21:34:47.176 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_delete_non_existent_address_scope ... success [0.175s]
2018-08-11 21:34:47.195 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_get_non_existent_address_scope ... success [0.019s]
2018-08-11 21:34:47.211 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_tenant_create_shared_address_scope ... success [0.016s]
2018-08-11 21:34:47.503 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.587s]
2018-08-11 21:34:47.536 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_port_sg_binding_bumps_revision ... success [4.261s]
2018-08-11 21:34:47.538 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_qos_network_policy_binding_bumps_revision ... skip [0.001s]: Skipped because network extension: qos is not enabled
2018-08-11 21:34:47.540 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_qos_port_policy_binding_bumps_revision ... skip [0.001s]: Skipped because network extension: qos is not enabled
2018-08-11 21:34:48.064 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_tenant_get_not_shared_admin_address_scope ... success [0.851s]
2018-08-11 21:34:48.117 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_tenant_update_address_scope_shared_false ... success [0.054s]
2018-08-11 21:34:48.385 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_tenant_update_address_scope_shared_true ... success [0.268s]
2018-08-11 21:34:48.400 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_update_non_existent_address_scope ... success [0.014s]
2018-08-11 21:34:48.843 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_update_shared_address_scope_to_unshare ... success [0.443s]
2018-08-11 21:34:48.911 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_service_type_management.ServiceTypeManagementTest.test_service_provider_list ... success [0.640s]
2018-08-11 21:34:49.603 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_with_href_links ... success [2.096s]
2018-08-11 21:34:50.322 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_with_marker ... success [0.720s]
2018-08-11 21:34:50.394 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_sorts_asc ... success [0.073s]
2018-08-11 21:34:50.476 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_sorts_desc ... success [0.080s]
2018-08-11 21:34:50.477 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_validation_filters ... skip [0.001s]: Skipped until Bug: 1749820 is resolved.
2018-08-11 21:34:54.956 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_create_network_with_timestamp ... success [1.070s]
2018-08-11 21:34:56.672 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_router_bumps_revision ... success [9.132s]
2018-08-11 21:34:56.673 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_router_extra_attributes_bumps_revision ... skip [0.001s]: Skipped because network extension: l3-ha is not enabled
2018-08-11 21:34:57.353 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_create_port_with_timestamp ... success [2.397s]
2018-08-11 21:34:58.306 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_create_subnet_with_timestamp ... success [0.952s]
2018-08-11 21:34:58.420 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_create_subnetpool_with_timestamp ... success [0.113s]
2018-08-11 21:34:58.422 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_segment_with_timestamp ... skip [0.001s]: Skipped because network extension: standard-attr-segment is not enabled
2018-08-11 21:34:58.805 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_show_networks_attribute_with_timestamp ... success [0.385s]
2018-08-11 21:35:00.248 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_show_port_attribute_with_timestamp ... success [1.441s]
2018-08-11 21:35:00.911 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairTestJSON.test_create_list_port_with_address_pair ... success [2.193s]
2018-08-11 21:35:01.688 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_show_subnet_attribute_with_timestamp ... success [1.439s]
2018-08-11 21:35:02.059 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_show_subnetpool_attribute_with_timestamp ... success [0.371s]
2018-08-11 21:35:03.706 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_create_sg_with_timestamp ... success [1.557s]
2018-08-11 21:35:03.735 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_address_pair ... success [2.825s]
2018-08-11 21:35:04.043 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_update_network_with_timestamp ... success [1.983s]
2018-08-11 21:35:05.958 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_create_sgrule_with_timestamp ... success [2.251s]
2018-08-11 21:35:06.106 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_update_port_with_timestamp ... success [2.062s]
2018-08-11 21:35:06.738 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_show_sg_attribute_with_timestamp ... success [0.778s]
2018-08-11 21:35:06.764 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_router_extra_routes_bumps_revision ... success [10.092s]
2018-08-11 21:35:07.333 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_cidr_address_pair ... success [3.597s]
2018-08-11 21:35:07.509 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_sg_group_bumps_revision ... success [0.745s]
2018-08-11 21:35:07.786 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_show_sgrule_attribute_with_timestamp ... success [1.049s]
2018-08-11 21:35:08.363 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_update_subnet_with_timestamp ... success [2.256s]
2018-08-11 21:35:08.625 119 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_update_sg_with_timestamp ... success [0.834s]
2018-08-11 21:35:08.625 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_sg_rule_bumps_sg_revision ... success [1.110s]
2018-08-11 21:35:08.935 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_update_subnetpool_with_timestamp ... success [0.573s]
2018-08-11 21:35:12.598 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_multiple_ip_mac_address_pair ... success [5.264s]
2018-08-11 21:35:14.137 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_subnet_bumps_network_revision ... success [5.515s]
2018-08-11 21:35:19.933 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_subnet_bumps_revision ... success [5.795s]
2018-08-11 21:35:19.995 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extensions.ExtensionsTest.test_list_extensions_pagination ... success [0.543s]
2018-08-11 21:35:20.158 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extensions.ExtensionsTest.test_list_extensions_project_id ... success [0.164s]
2018-08-11 21:35:20.170 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extensions.ExtensionsTest.test_list_extensions_sorting ... success [0.012s]
2018-08-11 21:35:24.589 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_subnet_service_types_bumps_revisions ... success [4.656s]
2018-08-11 21:35:25.132 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_subnetpool_bumps_revision ... success [0.544s]
2018-08-11 21:35:28.817 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extra_dhcp_options.ExtraDHCPOptionsTestJSON.test_create_list_port_with_extra_dhcp_options ... success [1.559s]
2018-08-11 21:35:29.722 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extra_dhcp_options.ExtraDHCPOptionsTestJSON.test_update_show_port_with_extra_dhcp_options ... success [0.906s]
2018-08-11 21:35:35.010 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.033s]
2018-08-11 21:35:35.148 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination ... success [0.136s]
2018-08-11 21:35:35.208 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.060s]
2018-08-11 21:35:35.270 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.062s]
2018-08-11 21:35:35.891 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.619s]
2018-08-11 21:35:36.250 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_with_href_links ... success [0.357s]
2018-08-11 21:35:36.451 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_with_marker ... success [0.202s]
2018-08-11 21:35:36.482 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_sorts_asc ... success [0.032s]
2018-08-11 21:35:36.513 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_sorts_desc ... success [0.031s]
2018-08-11 21:35:36.926 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_create_router_with_default_snat_value ... success [3.683s]
2018-08-11 21:35:44.080 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_create_router_with_snat_explicit ... success [7.154s]
2018-08-11 21:35:45.479 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_create_update_router_description ... success [1.398s]
2018-08-11 21:35:45.931 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_floating_ips.FloatingIPTestJSON.test_blank_update_clears_association ... success [2.169s]
2018-08-11 21:35:49.255 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_floating_ips.FloatingIPTestJSON.test_create_update_floatingip_description ... success [3.322s]
2018-08-11 21:35:49.257 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_floating_ips.FloatingIPTestJSON.test_create_update_floatingip_port_details ... skip [0.001s]: Skipped because network extension: fip-port-details is not enabled
2018-08-11 21:35:50.206 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_empty_trunk_details ... success [4.247s]
2018-08-11 21:35:52.497 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_floating_ips.FloatingIPTestJSON.test_floatingip_update_extra_attributes_port_id_not_changed ... success [3.241s]
2018-08-11 21:35:54.058 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_trunk_details_no_subports ... success [3.852s]
2018-08-11 21:35:56.766 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_network_attached_with_two_routers ... success [11.284s]
2018-08-11 21:36:00.241 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_trunk_details_with_subport ... success [6.182s]
2018-08-11 21:36:01.895 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_metering_extensions.MeteringTestJSON ... skip: metering extension not enabled.
2018-08-11 21:36:01.896 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_metering_negative.MeteringNegativeTestJSON ... skip: metering extension not enabled.
2018-08-11 21:36:02.764 119 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestMtusJSON ... skip: Either vxlan or gre type driver not enabled.
2018-08-11 21:36:04.834 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_networks.NetworksMtuTestJSON.test_create_network_custom_mtu ... success [1.024s]
2018-08-11 21:36:06.370 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_networks.NetworksMtuTestJSON.test_update_network_custom_mtu ... success [1.537s]
2018-08-11 21:36:09.051 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_qos.QosSearchCriteriaTest ... skip: qos extension not enabled.
2018-08-11 21:36:09.053 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_qos.RbacSharedQosPoliciesTest ... skip: qos extension not enabled.
2018-08-11 21:36:13.007 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.100s]
2018-08-11 21:36:13.615 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination ... success [0.606s]
2018-08-11 21:36:13.938 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.323s]
2018-08-11 21:36:14.272 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.334s]
2018-08-11 21:36:14.856 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.584s]
2018-08-11 21:36:16.746 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_with_href_links ... success [1.888s]
2018-08-11 21:36:17.613 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_with_marker ... success [0.867s]
2018-08-11 21:36:17.704 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_sorts_asc ... success [0.092s]
2018-08-11 21:36:17.797 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_sorts_desc ... success [0.093s]
2018-08-11 21:36:28.674 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_create_router_with_default_snat_value ... success [4.016s]
2018-08-11 21:36:33.480 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_create_router_with_snat_explicit ... success [4.806s]
2018-08-11 21:36:34.581 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_create_update_router_description ... success [1.100s]
2018-08-11 21:36:46.073 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_network_attached_with_two_routers ... success [11.490s]
2018-08-11 21:37:02.895 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_router_interface_status ... fail [66.113s]
2018-08-11 21:37:08.601 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_update_extra_route ... success [5.710s]
2018-08-11 21:37:12.018 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_update_router_reset_gateway_without_snat ... success [3.415s]
2018-08-11 21:37:15.005 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_update_router_set_gateway_with_snat_explicit ... success [2.986s]
2018-08-11 21:37:18.172 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_update_router_set_gateway_without_snat ... success [3.167s]
2018-08-11 21:37:31.989 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers_negative.DvrRoutersNegativeTest.test_router_create_tenant_distributed_returns_forbidden ... success [0.188s]
2018-08-11 21:37:37.828 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers_negative.HaRoutersNegativeTest ... skip: l3-ha extension not enabled.
2018-08-11 21:37:41.479 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups.SecGroupTest.test_create_bulk_sec_groups ... success [1.772s]
2018-08-11 21:37:42.618 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.139s]
2018-08-11 21:37:46.715 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_with_boolean_type_name ... success [0.163s]
2018-08-11 21:37:46.727 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_with_too_long_name ... success [0.012s]
2018-08-11 21:37:47.717 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_delete_in_use_sec_group ... success [0.988s]
2018-08-11 21:37:47.839 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_update_default_security_group_name ... success [0.122s]
2018-08-11 21:37:47.898 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_update_security_group_with_boolean_type_name ... success [0.059s]
2018-08-11 21:37:48.112 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_update_security_group_with_too_long_name ... success [0.213s]
2018-08-11 21:37:50.998 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_router_interface_status ... fail [64.908s]
2018-08-11 21:37:55.471 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.054s]
2018-08-11 21:37:55.780 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination ... success [0.306s]
2018-08-11 21:37:55.843 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.065s]
2018-08-11 21:37:55.907 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.063s]
2018-08-11 21:37:56.040 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.131s]
2018-08-11 21:37:56.740 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_with_href_links ... success [0.698s]
2018-08-11 21:37:56.961 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_update_extra_route ... success [5.967s]
2018-08-11 21:37:57.281 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_with_marker ... success [0.541s]
2018-08-11 21:37:57.315 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_sorts_asc ... success [0.034s]
2018-08-11 21:37:57.349 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_sorts_desc ... success [0.033s]
2018-08-11 21:37:57.351 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_validation_filters ... skip [0.001s]: Skipped until Bug: 1749820 is resolved.
2018-08-11 21:38:00.491 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_update_router_reset_gateway_without_snat ... success [3.528s]
2018-08-11 21:38:03.902 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_update_router_set_gateway_with_snat_explicit ... success [3.411s]
2018-08-11 21:38:04.155 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_admin_create_shared_subnetpool ... success [1.273s]
2018-08-11 21:38:04.866 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_list_subnetpool ... success [0.712s]
2018-08-11 21:38:06.308 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnet_from_pool_with_default_prefixlen ... success [1.441s]
2018-08-11 21:38:07.451 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_update_router_set_gateway_without_snat ... success [3.548s]
2018-08-11 21:38:07.745 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnet_from_pool_with_prefixlen ... success [1.437s]
2018-08-11 21:38:09.223 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnet_from_pool_with_quota ... success [1.476s]
2018-08-11 21:38:10.871 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnet_from_pool_with_subnet_cidr ... success [1.647s]
2018-08-11 21:38:11.169 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnetpool_associate_address_scope ... success [0.299s]
2018-08-11 21:38:11.514 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_update_subnetpool_description ... success [0.343s]
2018-08-11 21:38:11.848 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_get_subnetpool ... success [0.335s]
2018-08-11 21:38:12.122 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_show_subnetpool_has_project_id ... success [0.273s]
2018-08-11 21:38:12.245 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_tenant_create_non_default_subnetpool ... success [0.123s]
2018-08-11 21:38:12.516 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_tenant_update_subnetpool ... success [0.270s]
2018-08-11 21:38:12.929 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_associate_address_scope ... success [0.413s]
2018-08-11 21:38:13.361 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_associate_another_address_scope ... success [0.431s]
2018-08-11 21:38:13.877 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_disassociate_address_scope ... success [0.516s]
2018-08-11 21:38:14.157 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_prefixes_append ... success [0.280s]
2018-08-11 21:38:14.457 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_prefixes_extend ... success [0.300s]
2018-08-11 21:38:29.353 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolTest.test_create_show_delete_security_group_rule_integers ... success [10.659s]
2018-08-11 21:38:31.205 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_create_floatingip_with_timestamp ... success [1.844s]
2018-08-11 21:38:31.321 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_create_router_with_timestamp ... success [0.117s]
2018-08-11 21:38:32.734 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_show_floatingip_attribute_with_timestamp ... success [1.412s]
2018-08-11 21:38:33.295 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_show_router_attribute_with_timestamp ... success [0.561s]
2018-08-11 21:38:34.962 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_update_floatingip_with_timestamp ... success [1.666s]
2018-08-11 21:38:35.771 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_update_router_with_timestamp ... success [0.809s]
2018-08-11 21:38:37.018 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolTest.test_create_show_delete_security_group_rule_names ... success [7.645s]
2018-08-11 21:38:38.183 119 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_trunk.TrunkTestInheritJSONBase ... skip: VLAN type_driver is not enabled
2018-08-11 21:38:52.344 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_add_subport ... success [7.423s]
2018-08-11 21:38:54.986 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_show_delete_trunk ... success [2.641s]
2018-08-11 21:38:57.634 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_trunk_empty_subports_list ... success [2.648s]
2018-08-11 21:39:00.934 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_trunk_subports_not_specified ... success [3.298s]
2018-08-11 21:39:04.908 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_update_trunk ... success [3.974s]
2018-08-11 21:39:08.375 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_update_trunk_with_description ... success [3.466s]
2018-08-11 21:39:13.809 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_delete_trunk_with_subport_is_allowed ... success [5.434s]
2018-08-11 21:39:19.195 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_get_subports ... success [5.385s]
2018-08-11 21:39:25.588 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_list_trunks ... success [6.392s]
2018-08-11 21:39:33.644 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_remove_subport ... success [8.055s]
2018-08-11 21:39:37.642 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_show_trunk_has_project_id ... success [3.998s]
2018-08-11 21:39:41.324 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestMtusJSON ... skip: Either vxlan or gre type driver not enabled.
2018-08-11 21:39:52.748 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_add_subport_duplicate_segmentation_details ... success [8.376s]
2018-08-11 21:39:55.908 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_add_subport_passing_dict ... success [3.160s]
2018-08-11 21:39:59.329 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_add_subport_port_id_disabled_trunk ... success [3.421s]
2018-08-11 21:40:02.919 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_add_subport_port_id_uses_trunk_port_id ... success [3.589s]
2018-08-11 21:40:03.413 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_subport_invalid_inherit_network_segmentation_type ... skip [0.493s]: Vxlan type driver must be enabled for this test.
2018-08-11 21:40:08.563 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_subport_missing_segmentation_id ... success [5.149s]
2018-08-11 21:40:12.024 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_subport_nonexistent_port_id ... success [3.459s]
2018-08-11 21:40:14.678 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_subport_nonexistent_trunk ... success [2.654s]
2018-08-11 21:40:21.930 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_duplicate_subport_segmentation_ids ... success [7.249s]
2018-08-11 21:40:23.050 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_nonexistent_port_id ... success [1.120s]
2018-08-11 21:40:26.055 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_nonexistent_subport_port_id ... success [3.005s]
2018-08-11 21:40:29.778 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_port_id ... success [3.722s]
2018-08-11 21:40:32.830 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_segmentation_id ... success [3.051s]
2018-08-11 21:40:35.898 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_segmentation_type ... success [3.067s]
2018-08-11 21:40:42.331 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_delete_port_in_use_by_subport ... success [6.432s]
2018-08-11 21:40:46.108 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_delete_port_in_use_by_trunk ... success [3.776s]
2018-08-11 21:40:50.662 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_delete_trunk_disabled_trunk ... success [4.554s]
2018-08-11 21:40:56.717 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_not_found ... success [6.053s]
2018-08-11 21:41:03.665 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_passing_dict ... success [6.947s]
2018-08-11 21:41:08.390 119 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_port_id_disabled_trunk ... success [4.725s]
2018-08-11 21:41:13.600 119 INFO rally.task.context [-] Verification c7060e5f-4080-40a2-8c51-0443e37f8ec7 | Context testr@default cleanup() started
2018-08-11 21:41:13.601 119 INFO rally.task.context [-] Verification c7060e5f-4080-40a2-8c51-0443e37f8ec7 | Context testr@default cleanup() finished in 0.91 msec
2018-08-11 21:41:13.601 119 INFO rally.task.context [-] Verification c7060e5f-4080-40a2-8c51-0443e37f8ec7 | Context tempest@default cleanup() started
2018-08-11 21:41:14.535 119 INFO rally.task.context [-] Verification c7060e5f-4080-40a2-8c51-0443e37f8ec7 | Context tempest@default cleanup() finished in 0.93 sec
2018-08-11 21:41:14.653 119 INFO rally.api [-] Verification (UUID=1c12e638-7644-421b-b1a5-8b2bb0b5dd92) has been successfully finished for deployment 'opnfv-rally' (UUID=30ffdee8-96a5-4ecb-adef-6085d53971c4)!

======
Totals
======

Ran: 546 tests in 676.758 sec.
 - Success: 386
 - Skipped: 157
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 3

Using verification (UUID=1c12e638-7644-421b-b1a5-8b2bb0b5dd92) as the default verification for the future operations.