2018-12-04 20:02:58.644 89 INFO rally.api [-] Starting verification (UUID=5bf9336b-0ac9-42cb-9c51-41efc9cf897f) for deployment 'opnfv-rally' (UUID=be95848e-88af-4892-8866-902424e32dbb) by verifier 'opnfv-tempest' (UUID=1656ef9b-101f-4043-8a31-84306e70a94a).
2018-12-04 20:03:00.149 89 INFO rally.task.context [-] Verification 1656ef9b-101f-4043-8a31-84306e70a94a | Context tempest@default setup()  finished in 0.94 sec
2018-12-04 20:03:00.152 89 INFO rally.task.context [-] Verification 1656ef9b-101f-4043-8a31-84306e70a94a | Context testr@default setup()  finished in 2.54 msec
2018-12-04 20:03:06.118 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_list_agent ... success [0.016s]
2018-12-04 20:03:06.221 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_agent_availability_zone.AgentAvailabilityZoneTestCase.test_agents_availability_zone ... skip [0.000s]: Need a single availability_zone assumption.
2018-12-04 20:03:06.733 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_list_agents_non_admin ... success [0.614s]
2018-12-04 20:03:06.929 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_show_agent ... success [0.196s]
2018-12-04 20:03:07.322 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_update_agent_description ... success [0.392s]
2018-12-04 20:03:07.353 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_update_agent_status ... success [0.031s]
2018-12-04 20:03:10.498 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_l3_agent_scheduler.L3AgentSchedulerTestJSON ... skip: l3_agent_scheduler extension not enabled.
2018-12-04 20:03:10.499 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_logging.LoggingTestJSON ... skip: logging extension not enabled.
2018-12-04 20:03:12.008 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_add_remove_network_from_dhcp_agent ... success [2.792s]
2018-12-04 20:03:12.099 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_dhcp_port_status_active ... success [0.093s]
2018-12-04 20:03:12.117 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_list_dhcp_agent_hosting_network ... success [0.018s]
2018-12-04 20:03:12.280 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_list_networks_hosted_by_one_dhcp ... success [0.162s]
2018-12-04 20:03:15.931 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_networks.NetworksTestAdmin.test_create_network_with_project ... success [1.862s]
2018-12-04 20:03:16.146 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_networks.NetworksTestAdmin.test_create_network_with_project_and_other_tenant ... success [0.216s]
2018-12-04 20:03:16.630 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_networks.NetworksTestAdmin.test_create_network_with_project_and_tenant ... success [0.483s]
2018-12-04 20:03:16.631 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_networks.NetworksTestAdmin.test_create_tenant_network_vxlan ... skip [0.000s]: VXLAN type_driver is not enabled
2018-12-04 20:03:22.294 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_floating_ips_admin_actions.FloatingIPAdminTestJSON.test_associate_floating_ip_with_port_from_another_project ... success [6.238s]
2018-12-04 20:03:25.032 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_extension_driver_port_security_admin.PortSecurityAdminTests.test_create_port_security_false_on_shared_network ... success [2.939s]
2018-12-04 20:03:25.237 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_floating_ips_admin_actions.FloatingIPAdminTestJSON.test_create_floatingip_with_specified_ip_address ... success [2.943s]
2018-12-04 20:03:25.798 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_delete_policies_while_tenant_attached_to_net ... success [10.697s]
2018-12-04 20:03:27.853 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_floatingip_when_quotas_is_full ... success [3.534s]
2018-12-04 20:03:28.230 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_conversion_on_one_policy_delete ... success [2.433s]
2018-12-04 20:03:29.949 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_conversion_on_policy_create ... success [1.719s]
2018-12-04 20:03:30.069 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_network_when_quotas_is_full ... success [2.217s]
2018-12-04 20:03:31.197 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_logging_negative.LoggingNegativeTestJSON ... skip: logging extension not enabled.
2018-12-04 20:03:32.758 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_conversion_on_policy_delete ... success [2.808s]
2018-12-04 20:03:34.123 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_port_when_quotas_is_full ... success [4.052s]
2018-12-04 20:03:34.920 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_network_on_shared_policy_delete ... success [2.161s]
2018-12-04 20:03:35.485 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_router_when_quotas_is_full ... success [1.362s]
2018-12-04 20:03:36.821 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_ports.PortTestCasesAdmin.test_regenerate_mac_address ... skip [0.001s]: Skipped because network extension: port-mac-address-regenerate is not enabled
2018-12-04 20:03:37.065 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_security_group_rule_when_quotas_is_full ... success [1.578s]
2018-12-04 20:03:38.946 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_update_policy_from_wildcard_to_specific_tenant ... success [4.026s]
2018-12-04 20:03:39.134 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_security_group_when_quotas_is_full ... success [2.069s]
2018-12-04 20:03:39.931 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_ports.PortTestCasesAdmin.test_update_mac_address ... success [3.109s]
2018-12-04 20:03:43.141 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_subnet_when_quotas_is_full ... success [4.005s]
2018-12-04 20:03:44.855 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_policy_allows_tenant_to_allocate_floatingip ... success [5.907s]
2018-12-04 20:03:44.965 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_quotas.QuotasTest.test_detail_quotas ... success [3.922s]
2018-12-04 20:03:45.864 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_quotas.QuotasTest.test_quotas ... success [0.899s]
2018-12-04 20:03:49.367 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_routers_dvr.RouterTestCentralizedToDVR ... skip: l3-ha extension not enabled.
2018-12-04 20:03:50.746 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_policy_allows_tenant_to_attach_ext_gw ... success [5.892s]
2018-12-04 20:03:52.603 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_regular_client_blocked_from_creating_external_wild_policies ... success [1.856s]
2018-12-04 20:03:52.944 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_routers_dvr.RoutersTestDVR.test_centralized_router_creation ... success [0.932s]
2018-12-04 20:03:53.794 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_routers_dvr.RoutersTestDVR.test_distributed_router_creation ... success [0.850s]
2018-12-04 20:03:56.794 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_routers_flavors.RoutersFlavorTestCase ... skip: l3-flavors extension not enabled.
2018-12-04 20:03:57.278 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_regular_client_shares_with_another ... success [4.674s]
2018-12-04 20:03:58.743 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_security_groups.SecGroupAdminTest.test_security_group_recreated_on_port_update ... success [5.697s]
2018-12-04 20:04:00.917 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_wildcard_policy_created_from_external_network_api ... success [3.638s]
2018-12-04 20:04:01.960 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_wildcard_policy_delete_blocked_on_default_ext ... success [1.043s]
2018-12-04 20:04:02.455 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagFilterPortTestJSON.test_filter_port_tags ... success [1.089s]
2018-12-04 20:04:03.026 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_shared_network_extension.AllowedAddressPairSharedNetworkTest.test_create_with_address_pair_blocked_on_other_network ... success [0.853s]
2018-12-04 20:04:05.410 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_shared_network_extension.AllowedAddressPairSharedNetworkTest.test_update_with_address_pair_blocked_on_other_network ... success [2.384s]
2018-12-04 20:04:07.889 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_routers_ha.RoutersTestHA ... skip: l3-ha extension not enabled.
2018-12-04 20:04:16.925 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_create_rbac_policy_with_target_tenant_none ... success [4.400s]
2018-12-04 20:04:20.312 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_create_rbac_policy_with_target_tenant_too_long_id ... success [3.387s]
2018-12-04 20:04:20.618 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_tag.TagFilterRouterTestJSON.test_filter_router_tags ... success [1.595s]
2018-12-04 20:04:20.804 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_tag.TagFilterFloatingIpTestJSON.test_filter_floatingip_tags ... success [0.633s]
2018-12-04 20:04:21.884 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagFilterQosPolicyTestJSON ... skip: Skipped because network extension: qos is not enabled
2018-12-04 20:04:23.992 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_delete_self_share_rule ... success [3.679s]
2018-12-04 20:04:28.025 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_duplicate_policy_error ... success [4.032s]
2018-12-04 20:04:30.156 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_filter_fields ... success [2.127s]
2018-12-04 20:04:30.157 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagFilterSecGroupTestJSON.test_filter_security_group_tags ... success [0.623s]
2018-12-04 20:04:31.506 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_filter_policies ... success [1.351s]
2018-12-04 20:04:34.873 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_tag.TagFloatingIpTestJSON.test_floatingip_tags ... success [1.083s]
2018-12-04 20:04:36.486 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_filtering_works_with_rbac_records_present ... success [4.979s]
2018-12-04 20:04:41.322 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_network_only_visible_to_policy_target ... success [4.835s]
2018-12-04 20:04:43.886 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagNetworkTestJSON.test_network_tags ... success [3.325s]
2018-12-04 20:04:44.522 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_tag.TagFilterTrunkTestJSON.test_filter_trunk_tags ... success [0.196s]
2018-12-04 20:04:45.711 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_policy_show ... success [4.388s]
2018-12-04 20:04:47.642 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_tag.TagPortTestJSON.test_port_tags ... success [1.888s]
2018-12-04 20:04:50.964 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_policy_target_update ... success [5.252s]
2018-12-04 20:04:55.198 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagRouterTestJSON.test_router_tags ... success [3.464s]
2018-12-04 20:04:56.572 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_tag.TagSubnetPoolTestJSON.test_subnetpool_tags ... success [0.718s]
2018-12-04 20:04:58.492 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_port_presence_prevents_network_rbac_policy_deletion ... success [7.527s]
2018-12-04 20:05:02.964 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_tag.TagSecGroupTestJSON.test_security_group_tags ... success [2.469s]
2018-12-04 20:05:04.569 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_rbac_bumps_network_revision ... success [6.077s]
2018-12-04 20:05:05.175 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.292s]
2018-12-04 20:05:06.257 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination ... success [1.079s]
2018-12-04 20:05:06.768 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.512s]
2018-12-04 20:05:07.188 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcp_stateful_fixedips_outrange ... success [5.504s]
2018-12-04 20:05:07.233 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.464s]
2018-12-04 20:05:08.090 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.856s]
2018-12-04 20:05:10.434 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_with_href_links ... success [2.341s]
2018-12-04 20:05:11.122 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_rbac_policy_quota ... success [6.551s]
2018-12-04 20:05:11.196 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_with_marker ... success [0.763s]
2018-12-04 20:05:11.295 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_sorts_asc ... success [0.100s]
2018-12-04 20:05:11.390 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_sorts_desc ... success [0.094s]
2018-12-04 20:05:11.391 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_validation_filters ... skip [0.001s]: Skipped until Bug: 1749820 is resolved.
2018-12-04 20:05:11.407 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_admin_create_shared_address_scope ... success [0.835s]
2018-12-04 20:05:11.923 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_admin_update_shared_address_scope ... success [0.516s]
2018-12-04 20:05:13.094 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_delete_address_scope ... success [1.170s]
2018-12-04 20:05:13.336 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_show_address_scope ... success [0.242s]
2018-12-04 20:05:13.366 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_show_address_scope_project_id ... success [0.030s]
2018-12-04 20:05:13.711 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_tenant_create_list_address_scope ... success [0.343s]
2018-12-04 20:05:14.014 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_tenant_update_address_scope ... success [0.304s]
2018-12-04 20:05:16.163 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_regular_client_blocked_from_sharing_anothers_network ... success [5.041s]
2018-12-04 20:05:17.381 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_regular_client_blocked_from_sharing_with_wildcard ... success [1.217s]
2018-12-04 20:05:17.752 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_allowed_address_pairs ... success [4.816s]
2018-12-04 20:05:19.096 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_regular_client_shares_to_another_regular_client ... success [1.714s]
2018-12-04 20:05:22.469 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_create_port_sec_with_security_group ... success [4.717s]
2018-12-04 20:05:23.110 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_subnet_on_network_only_visible_to_policy_target ... success [4.013s]
2018-12-04 20:05:24.711 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks_negative.NetworksNegativeTest.test_delete_network_in_use ... success [2.970s]
2018-12-04 20:05:25.454 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_delete_with_port_sec ... success [2.985s]
2018-12-04 20:05:25.641 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_tenant_can_delete_port_on_own_network ... success [2.530s]
2018-12-04 20:05:26.334 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_create_list_port_with_address_pair ... success [2.053s]
2018-12-04 20:05:28.387 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_default_value ... success [2.933s]
2018-12-04 20:05:28.394 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_tenant_cant_delete_other_tenants_ports ... success [2.753s]
2018-12-04 20:05:29.206 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_address_pair ... success [2.873s]
2018-12-04 20:05:30.275 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_specific_value_1 ... success [1.887s]
2018-12-04 20:05:31.566 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_update_self_share_rule ... success [3.171s]
2018-12-04 20:05:32.609 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_cidr_address_pair ... success [3.402s]
2018-12-04 20:05:33.000 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_specific_value_2 ... success [2.725s]
2018-12-04 20:05:35.662 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_add_ips_to_port ... success [3.153s]
2018-12-04 20:05:38.714 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_multiple_ip_mac_address_pair ... success [6.105s]
2018-12-04 20:05:39.243 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_update_pass ... success [6.241s]
2018-12-04 20:05:41.224 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_change_dhcp_flag_then_create_port ... success [5.561s]
2018-12-04 20:05:43.687 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_create_update_port_description ... success [2.461s]
2018-12-04 20:05:43.690 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_create_update_port_with_dns_domain ... skip [0.001s]: Skipped because network extension: dns-domain-ports is not enabled
2018-12-04 20:05:43.693 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_create_update_port_with_dns_name ... skip [0.001s]: Skipped because network extension: dns-integration is not enabled
2018-12-04 20:05:43.694 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_create_update_port_with_no_dns_name ... skip [0.001s]: Skipped because network extension: dns-integration is not enabled
2018-12-04 20:05:46.631 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_update_port_failed ... success [7.387s]
2018-12-04 20:05:51.302 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_auto_allocated_topology.TestAutoAllocatedTopology ... skip: No default subnetpool
2018-12-04 20:05:51.511 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_create_bulk_shared_network ... success [2.742s]
2018-12-04 20:05:51.588 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_qos.QosBandwidthLimitRuleTestJSON ... skip: qos extension not enabled.
2018-12-04 20:05:51.590 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_qos.QosBandwidthLimitRuleWithDirectionTestJSON ... skip: qos extension not enabled.
2018-12-04 20:05:51.591 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_qos.QosDscpMarkingRuleTestJSON ... skip: qos extension not enabled.
2018-12-04 20:05:53.378 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_create_port_shared_network_as_non_admin_tenant ... success [1.865s]
2018-12-04 20:05:54.317 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_create_update_shared_network ... success [0.939s]
2018-12-04 20:05:56.019 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_filtering_shared_networks ... success [1.700s]
2018-12-04 20:05:57.752 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers.DvrRoutersTest.test_create_distributed_router ... success [2.768s]
2018-12-04 20:05:59.004 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_extra_dhcp_options.ExtraDHCPOptionsIpV6TestJSON.test_create_list_port_with_extra_dhcp_options ... success [2.364s]
2018-12-04 20:05:59.240 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_filtering_shared_subnets ... success [3.220s]
2018-12-04 20:05:59.468 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_list_shared_networks ... success [0.230s]
2018-12-04 20:05:59.729 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_extra_dhcp_options.ExtraDHCPOptionsIpV6TestJSON.test_update_show_port_with_extra_dhcp_options ... success [0.725s]
2018-12-04 20:05:59.898 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_show_shared_networks_attribute ... success [0.430s]
2018-12-04 20:06:01.529 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers.DvrRoutersTestToCentralized ... skip: l3-ha extension not enabled.
2018-12-04 20:06:01.530 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers.HaRoutersTest ... skip: l3-ha extension not enabled.
2018-12-04 20:06:16.654 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_create_update_delete_flavor ... success [0.575s]
2018-12-04 20:06:17.044 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_create_update_delete_service_profile ... success [0.390s]
2018-12-04 20:06:17.057 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_list_flavors ... success [0.013s]
2018-12-04 20:06:17.067 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_list_service_profiles ... success [0.010s]
2018-12-04 20:06:17.084 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_show_flavor ... success [0.016s]
2018-12-04 20:06:17.098 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_show_service_profile ... success [0.015s]
2018-12-04 20:06:17.476 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers_negative.RoutersNegativePolicyTest.test_add_interface_wrong_tenant ... success [6.277s]
2018-12-04 20:06:22.349 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagFilterNetworkTestJSON.test_filter_network_tags ... success [0.941s]
2018-12-04 20:06:25.716 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_create_update_delete_flavor ... success [0.374s]
2018-12-04 20:06:26.251 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_create_update_delete_service_profile ... success [0.534s]
2018-12-04 20:06:26.262 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_list_flavors ... success [0.012s]
2018-12-04 20:06:26.274 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_list_service_profiles ... success [0.011s]
2018-12-04 20:06:26.286 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_show_flavor ... success [0.012s]
2018-12-04 20:06:26.298 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_show_service_profile ... success [0.012s]
2018-12-04 20:06:29.265 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_metering_extensions.MeteringIpV6TestJSON ... skip: metering extension not enabled.
2018-12-04 20:06:30.719 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_floating_ips_negative.FloatingIPNegativeTestJSON.test_associate_floatingip_with_port_with_floatingip ... success [14.496s]
2018-12-04 20:06:35.625 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv6Test.test_admin_network_availability_before_subnet ... success [3.153s]
2018-12-04 20:06:37.683 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers_negative.RoutersNegativeTest.test_delete_router_in_use ... success [5.376s]
2018-12-04 20:06:41.062 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv6Test.test_net_ip_availability_after_port_delete ... success [5.437s]
2018-12-04 20:06:46.908 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagFilterSubnetTestJSON.test_filter_subnet_tags ... success [1.345s]
2018-12-04 20:06:48.974 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv6Test.test_net_ip_availability_after_subnet_and_ports ... success [7.911s]
2018-12-04 20:06:50.958 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_with_boolean_type_name ... success [0.226s]
2018-12-04 20:06:51.178 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_with_too_long_name ... success [0.220s]
2018-12-04 20:06:52.741 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_delete_in_use_sec_group ... success [1.561s]
2018-12-04 20:06:52.871 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_update_default_security_group_name ... success [0.131s]
2018-12-04 20:06:52.976 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_update_security_group_with_boolean_type_name ... success [0.104s]
2018-12-04 20:06:53.031 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_update_security_group_with_too_long_name ... success [0.055s]
2018-12-04 20:06:53.521 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv4Test.test_admin_network_availability_before_subnet ... success [2.611s]
2018-12-04 20:06:55.975 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_network_ip_availability_negative.NetworksIpAvailabilityNegativeTest.test_network_availability_nonexistent_network_id ... success [0.670s]
2018-12-04 20:06:59.610 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv4Test.test_net_ip_availability_after_port_delete ... success [6.089s]
2018-12-04 20:07:01.310 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_admin_create_shared_subnetpool ... success [1.316s]
2018-12-04 20:07:04.741 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_dual_stack_subnets_from_subnetpools ... success [3.432s]
2018-12-04 20:07:05.074 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_list_subnetpool ... success [0.333s]
2018-12-04 20:07:06.136 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.104s]
2018-12-04 20:07:06.520 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv4Test.test_net_ip_availability_after_subnet_and_ports ... success [6.909s]
2018-12-04 20:07:06.614 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnet_from_pool_with_default_prefixlen ... success [1.539s]
2018-12-04 20:07:06.898 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination ... success [0.760s]
2018-12-04 20:07:07.330 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.433s]
2018-12-04 20:07:07.480 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.150s]
2018-12-04 20:07:07.962 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.480s]
2018-12-04 20:07:08.541 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnet_from_pool_with_prefixlen ... success [1.926s]
2018-12-04 20:07:09.058 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_with_href_links ... success [1.094s]
2018-12-04 20:07:09.670 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_with_marker ... success [0.613s]
2018-12-04 20:07:09.719 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_sorts_asc ... success [0.050s]
2018-12-04 20:07:09.769 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_sorts_desc ... success [0.050s]
2018-12-04 20:07:10.646 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagFilterSubnetpoolTestJSON.test_filter_subnetpool_tags ... success [0.673s]
2018-12-04 20:07:11.082 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnet_from_pool_with_quota ... success [2.540s]
2018-12-04 20:07:12.242 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnet_from_pool_with_subnet_cidr ... success [1.159s]
2018-12-04 20:07:12.513 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnetpool_associate_address_scope ... success [0.272s]
2018-12-04 20:07:13.118 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_update_subnetpool_description ... success [0.602s]
2018-12-04 20:07:13.322 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_get_subnetpool ... success [0.206s]
2018-12-04 20:07:13.711 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_show_subnetpool_has_project_id ... success [0.389s]
2018-12-04 20:07:13.943 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_tenant_create_non_default_subnetpool ... success [0.231s]
2018-12-04 20:07:14.496 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_tenant_update_subnetpool ... success [0.553s]
2018-12-04 20:07:14.907 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_associate_address_scope ... success [0.410s]
2018-12-04 20:07:15.264 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_qos.QosMinimumBandwidthRuleTestJSON ... skip: qos extension not enabled.
2018-12-04 20:07:15.265 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_qos.QosTestJSON ... skip: qos extension not enabled.
2018-12-04 20:07:15.467 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_create_network_with_project ... success [1.542s]
2018-12-04 20:07:15.469 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_create_update_network_dns_domain ... skip [0.001s]: Skipped because network extension: dns-integration is not enabled
2018-12-04 20:07:15.927 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_associate_another_address_scope ... success [1.018s]
2018-12-04 20:07:16.262 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_disassociate_address_scope ... success [0.335s]
2018-12-04 20:07:16.512 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_list_networks_fields_keystone_v3 ... success [1.043s]
2018-12-04 20:07:16.585 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_show_network ... success [0.074s]
2018-12-04 20:07:16.613 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_prefixes_append ... success [0.351s]
2018-12-04 20:07:16.922 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_prefixes_extend ... success [0.310s]
2018-12-04 20:07:17.467 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_show_network_fields_keystone_v3 ... success [0.882s]
2018-12-04 20:07:20.407 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_qos_negative.QosNegativeTestJSON ... skip: qos extension not enabled.
2018-12-04 20:07:21.168 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagQosPolicyTestJSON ... skip: Skipped because network extension: qos is not enabled
2018-12-04 20:07:23.579 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_security_group_rule_with_ipv6_protocol_integers ... success [6.388s]
2018-12-04 20:07:25.492 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_security_group_rule_with_ipv6_protocol_legacy_names ... success [1.916s]
2018-12-04 20:07:29.520 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagSubnetTestJSON.test_subnet_tags ... success [2.865s]
2018-12-04 20:07:30.015 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_security_group_rule_with_ipv6_protocol_names ... success [4.514s]
2018-12-04 20:07:31.095 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_portbinding_bumps_revision ... success [7.329s]
2018-12-04 20:07:35.421 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_allowed_address_pairs_bumps_revision ... success [4.326s]
2018-12-04 20:07:35.423 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_dns_domain_bumps_revision ... skip [0.001s]: Skipped because network extension: dns-integration is not enabled
2018-12-04 20:07:37.848 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_show_delete_security_group_rule_integers ... success [7.812s]
2018-12-04 20:07:37.985 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_external_network_bumps_revision ... success [2.564s]
2018-12-04 20:07:39.459 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_sp_associate_address_scope_multiple_prefix_intersect ... success [1.744s]
2018-12-04 20:07:41.963 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_extra_dhcp_opt_bumps_revision ... success [3.977s]
2018-12-04 20:07:42.924 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnet_different_pools_same_network ... success [3.464s]
2018-12-04 20:07:43.535 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnetpool_associate_address_scope_of_other_owner ... success [0.612s]
2018-12-04 20:07:44.049 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnetpool_associate_address_scope_prefix_intersect ... success [0.514s]
2018-12-04 20:07:44.298 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnetpool_associate_invalid_address_scope ... success [0.249s]
2018-12-04 20:07:44.632 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnetpool_associate_non_exist_address_scope ... success [0.333s]
2018-12-04 20:07:44.650 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_delete_non_existent_subnetpool ... success [0.018s]
2018-12-04 20:07:44.666 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_get_non_existent_subnetpool ... success [0.016s]
2018-12-04 20:07:44.692 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagTrunkTestJSON.test_trunk_tags ... success [2.264s]
2018-12-04 20:07:44.784 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_create_default_subnetpool ... success [0.117s]
2018-12-04 20:07:44.943 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_create_shared_subnetpool ... success [0.159s]
2018-12-04 20:07:45.274 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_create_subnetpool_associate_shared_address_scope ... success [0.330s]
2018-12-04 20:07:45.773 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_get_not_shared_admin_subnetpool ... success [0.498s]
2018-12-04 20:07:46.436 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_show_delete_security_group_rule_names ... success [8.568s]
2018-12-04 20:07:47.222 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_update_sp_prefix_associated_with_shared_addr_scope ... success [1.447s]
2018-12-04 20:07:47.239 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_non_existent_subnetpool ... success [0.018s]
2018-12-04 20:07:47.610 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_associate_address_scope_of_other_owner ... success [0.370s]
2018-12-04 20:07:47.909 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_associate_address_scope_wrong_ip_version ... success [0.299s]
2018-12-04 20:07:48.356 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_multiple_prefix_intersect ... success [0.446s]
2018-12-04 20:07:48.565 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_not_modifiable_shared ... success [0.209s]
2018-12-04 20:07:49.639 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_prefix_intersect ... success [1.073s]
2018-12-04 20:07:49.926 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_prefixes_shrink ... success [0.287s]
2018-12-04 20:07:50.341 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_tenant_id ... success [0.415s]
2018-12-04 20:07:53.237 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupProtocolTest.test_create_security_group_rule_with_ipv6_protocol_integers ... success [3.354s]
2018-12-04 20:07:54.553 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupProtocolTest.test_create_security_group_rule_with_ipv6_protocol_names ... success [1.315s]
2018-12-04 20:07:56.249 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.UpdateTagsTest.test_update_tags_affects_only_updated_resource ... success [3.013s]
2018-12-04 20:07:58.270 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_floatingip_bumps_revision ... success [16.305s]
2018-12-04 20:07:58.917 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_service_type_management.ServiceTypeManagementTest.test_service_provider_list ... success [0.585s]
2018-12-04 20:07:59.717 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_network_bumps_revision ... success [1.448s]
2018-12-04 20:08:01.003 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_network_constrained_by_revision ... fail [1.280s]
2018-12-04 20:08:04.332 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_port_bumps_revision ... success [3.332s]
2018-12-04 20:08:04.631 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_delete_address_scope_associated_with_subnetpool ... success [1.105s]
2018-12-04 20:08:04.827 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_delete_non_existent_address_scope ... success [0.196s]
2018-12-04 20:08:05.106 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_get_non_existent_address_scope ... success [0.277s]
2018-12-04 20:08:05.107 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.089s]
2018-12-04 20:08:05.244 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_create_network_with_timestamp ... success [1.109s]
2018-12-04 20:08:05.313 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_tenant_create_shared_address_scope ... success [0.207s]
2018-12-04 20:08:05.660 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination ... success [0.552s]
2018-12-04 20:08:06.091 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_tenant_get_not_shared_admin_address_scope ... success [0.777s]
2018-12-04 20:08:06.166 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_tenant_update_address_scope_shared_false ... success [0.075s]
2018-12-04 20:08:06.214 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_tenant_update_address_scope_shared_true ... success [0.048s]
2018-12-04 20:08:06.226 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_update_non_existent_address_scope ... success [0.012s]
2018-12-04 20:08:06.316 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.650s]
2018-12-04 20:08:06.456 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_update_shared_address_scope_to_unshare ... success [0.229s]
2018-12-04 20:08:06.662 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.352s]
2018-12-04 20:08:07.375 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.712s]
2018-12-04 20:08:07.503 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_create_port_with_timestamp ... success [2.259s]
2018-12-04 20:08:08.665 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_create_subnet_with_timestamp ... success [1.162s]
2018-12-04 20:08:09.459 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_with_href_links ... success [2.080s]
2018-12-04 20:08:09.594 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_create_subnetpool_with_timestamp ... success [0.927s]
2018-12-04 20:08:09.595 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_segment_with_timestamp ... skip [0.001s]: Skipped because network extension: standard-attr-segment is not enabled
2018-12-04 20:08:09.963 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_with_marker ... success [0.505s]
2018-12-04 20:08:10.029 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_sorts_asc ... success [0.067s]
2018-12-04 20:08:10.083 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_sorts_desc ... success [0.052s]
2018-12-04 20:08:10.084 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_validation_filters ... skip [0.001s]: Skipped until Bug: 1749820 is resolved.
2018-12-04 20:08:10.851 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_show_networks_attribute_with_timestamp ... success [1.257s]
2018-12-04 20:08:10.968 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_port_security_bumps_revisions ... success [6.635s]
2018-12-04 20:08:12.588 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_show_port_attribute_with_timestamp ... success [1.736s]
2018-12-04 20:08:13.618 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_show_subnet_attribute_with_timestamp ... success [1.029s]
2018-12-04 20:08:13.820 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_show_subnetpool_attribute_with_timestamp ... success [0.203s]
2018-12-04 20:08:15.479 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_update_network_with_timestamp ... success [1.658s]
2018-12-04 20:08:15.524 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_port_sg_binding_bumps_revision ... success [4.554s]
2018-12-04 20:08:15.527 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_qos_network_policy_binding_bumps_revision ... skip [0.001s]: Skipped because network extension: qos is not enabled
2018-12-04 20:08:15.528 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_qos_port_policy_binding_bumps_revision ... skip [0.001s]: Skipped because network extension: qos is not enabled
2018-12-04 20:08:17.760 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_update_port_with_timestamp ... success [2.280s]
2018-12-04 20:08:19.857 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairTestJSON.test_create_list_port_with_address_pair ... success [2.878s]
2018-12-04 20:08:21.222 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_update_subnet_with_timestamp ... success [3.462s]
2018-12-04 20:08:21.739 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_update_subnetpool_with_timestamp ... success [0.517s]
2018-12-04 20:08:22.795 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_address_pair ... success [2.938s]
2018-12-04 20:08:25.313 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_cidr_address_pair ... success [2.517s]
2018-12-04 20:08:26.235 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_create_sg_with_timestamp ... success [1.827s]
2018-12-04 20:08:27.252 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_create_sgrule_with_timestamp ... success [1.017s]
2018-12-04 20:08:27.407 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_router_bumps_revision ... success [11.879s]
2018-12-04 20:08:27.408 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_router_extra_attributes_bumps_revision ... skip [0.001s]: Skipped because network extension: l3-ha is not enabled
2018-12-04 20:08:29.103 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_show_sg_attribute_with_timestamp ... success [1.849s]
2018-12-04 20:08:29.783 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_multiple_ip_mac_address_pair ... success [4.469s]
2018-12-04 20:08:30.622 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_show_sgrule_attribute_with_timestamp ... success [1.519s]
2018-12-04 20:08:31.753 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_update_sg_with_timestamp ... success [1.131s]
2018-12-04 20:08:37.720 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extensions.ExtensionsTest.test_list_extensions_includes_all ... success [0.613s]
2018-12-04 20:08:37.728 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extensions.ExtensionsTest.test_list_extensions_pagination ... success [0.008s]
2018-12-04 20:08:37.924 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extensions.ExtensionsTest.test_list_extensions_project_id ... success [0.195s]
2018-12-04 20:08:37.932 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extensions.ExtensionsTest.test_list_extensions_sorting ... success [0.008s]
2018-12-04 20:08:38.389 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_router_extra_routes_bumps_revision ... success [10.981s]
2018-12-04 20:08:40.460 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_sg_group_bumps_revision ... success [2.070s]
2018-12-04 20:08:41.282 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_sg_rule_bumps_sg_revision ... success [0.821s]
2018-12-04 20:08:44.591 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_subnet_bumps_network_revision ... success [3.309s]
2018-12-04 20:08:48.201 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extra_dhcp_options.ExtraDHCPOptionsTestJSON.test_create_list_port_with_extra_dhcp_options ... success [2.107s]
2018-12-04 20:08:49.354 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extra_dhcp_options.ExtraDHCPOptionsTestJSON.test_update_show_port_with_extra_dhcp_options ... success [1.154s]
2018-12-04 20:08:50.434 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_subnet_bumps_revision ... success [5.843s]
2018-12-04 20:08:50.999 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.028s]
2018-12-04 20:08:51.339 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination ... success [0.339s]
2018-12-04 20:08:51.396 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.057s]
2018-12-04 20:08:51.459 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.062s]
2018-12-04 20:08:51.590 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.130s]
2018-12-04 20:08:51.919 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_with_href_links ... success [0.327s]
2018-12-04 20:08:52.081 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_with_marker ... success [0.162s]
2018-12-04 20:08:52.110 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_sorts_asc ... success [0.029s]
2018-12-04 20:08:52.141 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_sorts_desc ... success [0.031s]
2018-12-04 20:08:55.681 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_subnet_service_types_bumps_revisions ... success [5.246s]
2018-12-04 20:08:56.003 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_subnetpool_bumps_revision ... success [0.322s]
2018-12-04 20:09:05.927 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_empty_trunk_details ... success [3.616s]
2018-12-04 20:09:06.233 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_floating_ips.FloatingIPTestJSON.test_blank_update_clears_association ... success [2.066s]
2018-12-04 20:09:09.481 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_floating_ips.FloatingIPTestJSON.test_create_update_floatingip_description ... success [3.246s]
2018-12-04 20:09:09.482 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_floating_ips.FloatingIPTestJSON.test_create_update_floatingip_port_details ... skip [0.001s]: Skipped because network extension: fip-port-details is not enabled
2018-12-04 20:09:09.566 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_create_router_with_default_snat_value ... success [4.583s]
2018-12-04 20:09:11.002 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_trunk_details_no_subports ... success [5.075s]
2018-12-04 20:09:12.734 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_floating_ips.FloatingIPTestJSON.test_floatingip_update_extra_attributes_port_id_not_changed ... success [3.252s]
2018-12-04 20:09:16.057 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_create_router_with_snat_explicit ... success [6.492s]
2018-12-04 20:09:17.529 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_trunk_details_with_subport ... success [6.526s]
2018-12-04 20:09:18.055 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_create_update_router_description ... success [1.998s]
2018-12-04 20:09:20.383 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestMtusJSON ... skip: Either vxlan or gre type driver not enabled.
2018-12-04 20:09:24.269 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_metering_extensions.MeteringTestJSON ... skip: metering extension not enabled.
2018-12-04 20:09:24.270 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_metering_negative.MeteringNegativeTestJSON ... skip: metering extension not enabled.
2018-12-04 20:09:27.559 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_networks.NetworksMtuTestJSON.test_create_network_custom_mtu ... success [1.359s]
2018-12-04 20:09:28.869 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_networks.NetworksMtuTestJSON.test_update_network_custom_mtu ... success [1.309s]
2018-12-04 20:09:29.761 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_network_attached_with_two_routers ... success [11.702s]
2018-12-04 20:09:31.411 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_qos.QosSearchCriteriaTest ... skip: qos extension not enabled.
2018-12-04 20:09:31.412 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_qos.RbacSharedQosPoliciesTest ... skip: qos extension not enabled.
2018-12-04 20:09:34.794 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.088s]
2018-12-04 20:09:35.792 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination ... success [0.997s]
2018-12-04 20:09:35.958 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.166s]
2018-12-04 20:09:36.125 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.166s]
2018-12-04 20:09:36.634 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.509s]
2018-12-04 20:09:38.391 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_with_href_links ... success [1.755s]
2018-12-04 20:09:39.076 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_with_marker ... success [0.685s]
2018-12-04 20:09:39.159 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_sorts_asc ... success [0.083s]
2018-12-04 20:09:39.243 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_sorts_desc ... success [0.084s]
2018-12-04 20:09:50.995 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_create_router_with_default_snat_value ... success [4.106s]
2018-12-04 20:09:56.084 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_create_router_with_snat_explicit ... success [5.089s]
2018-12-04 20:09:57.244 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_create_update_router_description ... success [1.159s]
2018-12-04 20:10:08.852 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_network_attached_with_two_routers ... success [11.606s]
2018-12-04 20:10:35.409 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_router_interface_status ... fail [65.631s]
2018-12-04 20:10:41.923 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_update_extra_route ... success [6.519s]
2018-12-04 20:10:45.688 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_update_router_reset_gateway_without_snat ... success [3.764s]
2018-12-04 20:10:48.994 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_update_router_set_gateway_with_snat_explicit ... success [3.305s]
2018-12-04 20:10:52.420 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_update_router_set_gateway_without_snat ... success [3.426s]
2018-12-04 20:11:05.943 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers_negative.DvrRoutersNegativeTest.test_router_create_tenant_distributed_returns_forbidden ... success [0.184s]
2018-12-04 20:11:11.975 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers_negative.HaRoutersNegativeTest ... skip: l3-ha extension not enabled.
2018-12-04 20:11:14.133 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_router_interface_status ... fail [65.263s]
2018-12-04 20:11:15.685 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups.SecGroupTest.test_create_bulk_sec_groups ... success [1.553s]
2018-12-04 20:11:16.846 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.159s]
2018-12-04 20:11:20.329 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_update_extra_route ... success [6.199s]
2018-12-04 20:11:21.320 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_with_boolean_type_name ... success [0.177s]
2018-12-04 20:11:21.331 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_with_too_long_name ... success [0.011s]
2018-12-04 20:11:22.785 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_delete_in_use_sec_group ... success [1.452s]
2018-12-04 20:11:23.053 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_update_default_security_group_name ... success [0.268s]
2018-12-04 20:11:23.109 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_update_security_group_with_boolean_type_name ... success [0.055s]
2018-12-04 20:11:23.164 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_update_security_group_with_too_long_name ... success [0.055s]
2018-12-04 20:11:24.101 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_update_router_reset_gateway_without_snat ... success [3.771s]
2018-12-04 20:11:27.402 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_update_router_set_gateway_with_snat_explicit ... success [3.300s]
2018-12-04 20:11:30.625 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_update_router_set_gateway_without_snat ... success [3.222s]
2018-12-04 20:11:31.261 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.048s]
2018-12-04 20:11:31.735 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination ... success [0.473s]
2018-12-04 20:11:31.959 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.225s]
2018-12-04 20:11:32.206 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.246s]
2018-12-04 20:11:32.595 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.388s]
2018-12-04 20:11:33.307 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_with_href_links ... success [0.709s]
2018-12-04 20:11:33.462 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_with_marker ... success [0.157s]
2018-12-04 20:11:33.486 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_sorts_asc ... success [0.025s]
2018-12-04 20:11:33.516 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_sorts_desc ... success [0.028s]
2018-12-04 20:11:33.517 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_validation_filters ... skip [0.001s]: Skipped until Bug: 1749820 is resolved.
2018-12-04 20:11:41.326 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_admin_create_shared_subnetpool ... success [1.235s]
2018-12-04 20:11:41.599 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_list_subnetpool ... success [0.275s]
2018-12-04 20:11:43.402 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnet_from_pool_with_default_prefixlen ... success [1.802s]
2018-12-04 20:11:44.924 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnet_from_pool_with_prefixlen ... success [1.521s]
2018-12-04 20:11:46.255 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnet_from_pool_with_quota ... success [1.330s]
2018-12-04 20:11:47.848 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnet_from_pool_with_subnet_cidr ... success [1.593s]
2018-12-04 20:11:48.068 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnetpool_associate_address_scope ... success [0.220s]
2018-12-04 20:11:48.344 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_update_subnetpool_description ... success [0.275s]
2018-12-04 20:11:48.746 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_get_subnetpool ... success [0.403s]
2018-12-04 20:11:49.410 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_show_subnetpool_has_project_id ... success [0.663s]
2018-12-04 20:11:49.627 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_tenant_create_non_default_subnetpool ... success [0.217s]
2018-12-04 20:11:49.937 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_tenant_update_subnetpool ... success [0.309s]
2018-12-04 20:11:50.298 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_associate_address_scope ... success [0.360s]
2018-12-04 20:11:50.731 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_associate_another_address_scope ... success [0.432s]
2018-12-04 20:11:51.100 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_disassociate_address_scope ... success [0.369s]
2018-12-04 20:11:51.373 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_prefixes_append ... success [0.273s]
2018-12-04 20:11:51.704 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_prefixes_extend ... success [0.331s]
2018-12-04 20:11:53.474 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolTest.test_create_show_delete_security_group_rule_integers ... success [11.850s]
2018-12-04 20:12:01.730 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolTest.test_create_show_delete_security_group_rule_names ... success [8.233s]
2018-12-04 20:12:02.882 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_trunk.TrunkTestInheritJSONBase ... skip: VLAN type_driver is not enabled
2018-12-04 20:12:08.962 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_create_floatingip_with_timestamp ... success [1.658s]
2018-12-04 20:12:09.224 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_create_router_with_timestamp ... success [0.262s]
2018-12-04 20:12:10.713 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_show_floatingip_attribute_with_timestamp ... success [1.489s]
2018-12-04 20:12:11.158 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_show_router_attribute_with_timestamp ... success [0.444s]
2018-12-04 20:12:12.363 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_update_floatingip_with_timestamp ... success [1.205s]
2018-12-04 20:12:13.190 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_update_router_with_timestamp ... success [0.826s]
2018-12-04 20:12:29.331 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_add_subport ... success [7.267s]
2018-12-04 20:12:32.035 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_show_delete_trunk ... success [2.704s]
2018-12-04 20:12:35.528 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_trunk_empty_subports_list ... success [3.493s]
2018-12-04 20:12:38.313 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_trunk_subports_not_specified ... success [2.784s]
2018-12-04 20:12:42.374 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_update_trunk ... success [4.061s]
2018-12-04 20:12:46.382 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_update_trunk_with_description ... success [4.008s]
2018-12-04 20:12:52.016 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_delete_trunk_with_subport_is_allowed ... success [5.634s]
2018-12-04 20:12:57.805 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_get_subports ... success [5.788s]
2018-12-04 20:13:04.190 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_list_trunks ... success [6.383s]
2018-12-04 20:13:12.853 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_remove_subport ... success [8.662s]
2018-12-04 20:13:16.655 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_show_trunk_has_project_id ... success [3.803s]
2018-12-04 20:13:20.517 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestMtusJSON ... skip: Either vxlan or gre type driver not enabled.
2018-12-04 20:13:32.055 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_add_subport_duplicate_segmentation_details ... success [8.417s]
2018-12-04 20:13:35.814 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_add_subport_passing_dict ... success [3.760s]
2018-12-04 20:13:39.097 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_add_subport_port_id_disabled_trunk ... success [3.282s]
2018-12-04 20:13:42.238 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_add_subport_port_id_uses_trunk_port_id ... success [3.140s]
2018-12-04 20:13:42.697 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_subport_invalid_inherit_network_segmentation_type ... skip [0.458s]: Vxlan type driver must be enabled for this test.
2018-12-04 20:13:47.830 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_subport_missing_segmentation_id ... success [5.133s]
2018-12-04 20:13:51.353 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_subport_nonexistent_port_id ... success [3.522s]
2018-12-04 20:13:54.143 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_subport_nonexistent_trunk ... success [2.790s]
2018-12-04 20:14:01.567 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_duplicate_subport_segmentation_ids ... success [7.422s]
2018-12-04 20:14:02.844 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_nonexistent_port_id ... success [1.278s]
2018-12-04 20:14:06.020 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_nonexistent_subport_port_id ... success [3.175s]
2018-12-04 20:14:09.286 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_port_id ... success [3.265s]
2018-12-04 20:14:13.196 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_segmentation_id ... success [3.910s]
2018-12-04 20:14:16.473 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_segmentation_type ... success [3.276s]
2018-12-04 20:14:22.746 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_delete_port_in_use_by_subport ... success [6.272s]
2018-12-04 20:14:26.998 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_delete_port_in_use_by_trunk ... success [4.252s]
2018-12-04 20:14:30.910 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_delete_trunk_disabled_trunk ... success [3.911s]
2018-12-04 20:14:37.391 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_not_found ... success [6.480s]
2018-12-04 20:14:44.083 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_passing_dict ... success [6.692s]
2018-12-04 20:14:48.814 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_port_id_disabled_trunk ... success [4.730s]
2018-12-04 20:14:53.894 89 INFO rally.task.context [-] Verification 1656ef9b-101f-4043-8a31-84306e70a94a | Context testr@default cleanup() started
2018-12-04 20:14:53.895 89 INFO rally.task.context [-] Verification 1656ef9b-101f-4043-8a31-84306e70a94a | Context testr@default cleanup() finished in 0.88 msec
2018-12-04 20:14:53.896 89 INFO rally.task.context [-] Verification 1656ef9b-101f-4043-8a31-84306e70a94a | Context tempest@default cleanup() started
2018-12-04 20:14:54.792 89 INFO rally.task.context [-] Verification 1656ef9b-101f-4043-8a31-84306e70a94a | Context tempest@default cleanup() finished in 0.90 sec
2018-12-04 20:14:54.924 89 INFO rally.api [-] Verification (UUID=5bf9336b-0ac9-42cb-9c51-41efc9cf897f) has been successfully finished for deployment 'opnfv-rally' (UUID=be95848e-88af-4892-8866-902424e32dbb)!

======
Totals
======

Ran: 547 tests in 706.602 sec.
 - Success: 387
 - Skipped: 157
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 3

Using verification (UUID=5bf9336b-0ac9-42cb-9c51-41efc9cf897f) as the default verification for the future operations.