2018-12-13 22:50:51.472 89 INFO rally.api [-] Starting verification (UUID=9591b417-6697-4812-885a-37f7e38d8ffe) for deployment 'opnfv-rally' (UUID=023c7fd9-b314-4058-b125-c5e9c0d0bcb3) by verifier 'opnfv-tempest' (UUID=8cb94da2-2556-4938-a096-04f7dbc67fef).
2018-12-13 22:50:53.065 89 INFO rally.task.context [-] Verification 8cb94da2-2556-4938-a096-04f7dbc67fef | Context tempest@default setup()  finished in 1.03 sec
2018-12-13 22:50:53.068 89 INFO rally.task.context [-] Verification 8cb94da2-2556-4938-a096-04f7dbc67fef | Context testr@default setup()  finished in 2.62 msec
2018-12-13 22:50:58.938 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_agent_availability_zone.AgentAvailabilityZoneTestCase.test_agents_availability_zone ... skip [0.000s]: Need a single availability_zone assumption.
2018-12-13 22:50:59.161 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_list_agent ... success [0.193s]
2018-12-13 22:50:59.737 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_list_agents_non_admin ... success [0.575s]
2018-12-13 22:50:59.936 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_show_agent ... success [0.200s]
2018-12-13 22:51:00.932 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_update_agent_description ... success [0.994s]
2018-12-13 22:51:01.149 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_agent_management.AgentManagementTestJSON.test_update_agent_status ... success [0.218s]
2018-12-13 22:51:05.272 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_l3_agent_scheduler.L3AgentSchedulerTestJSON ... skip: l3_agent_scheduler extension not enabled.
2018-12-13 22:51:05.273 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_logging.LoggingTestJSON ... skip: logging extension not enabled.
2018-12-13 22:51:06.330 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_add_remove_network_from_dhcp_agent ... success [3.742s]
2018-12-13 22:51:06.597 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_dhcp_port_status_active ... success [0.269s]
2018-12-13 22:51:06.795 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_list_dhcp_agent_hosting_network ... success [0.197s]
2018-12-13 22:51:07.116 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_list_networks_hosted_by_one_dhcp ... success [0.321s]
2018-12-13 22:51:11.059 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_networks.NetworksTestAdmin.test_create_network_with_project ... success [2.138s]
2018-12-13 22:51:11.244 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_networks.NetworksTestAdmin.test_create_network_with_project_and_other_tenant ... success [0.188s]
2018-12-13 22:51:12.307 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_networks.NetworksTestAdmin.test_create_network_with_project_and_tenant ... success [1.061s]
2018-12-13 22:51:12.308 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_networks.NetworksTestAdmin.test_create_tenant_network_vxlan ... skip [0.000s]: VXLAN type_driver is not enabled
2018-12-13 22:51:16.669 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_floating_ips_admin_actions.FloatingIPAdminTestJSON.test_associate_floating_ip_with_port_from_another_project ... success [5.609s]
2018-12-13 22:51:19.494 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_floating_ips_admin_actions.FloatingIPAdminTestJSON.test_create_floatingip_with_specified_ip_address ... success [2.825s]
2018-12-13 22:51:22.169 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_delete_policies_while_tenant_attached_to_net ... success [13.829s]
2018-12-13 22:51:23.671 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_extension_driver_port_security_admin.PortSecurityAdminTests.test_create_port_security_false_on_shared_network ... success [3.162s]
2018-12-13 22:51:25.322 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_floatingip_when_quotas_is_full ... success [4.095s]
2018-12-13 22:51:25.670 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_conversion_on_one_policy_delete ... success [3.503s]
2018-12-13 22:51:28.759 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_network_when_quotas_is_full ... success [3.437s]
2018-12-13 22:51:28.851 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_conversion_on_policy_create ... success [3.181s]
2018-12-13 22:51:31.065 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_conversion_on_policy_delete ... success [2.213s]
2018-12-13 22:51:32.331 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_logging_negative.LoggingNegativeTestJSON ... skip: logging extension not enabled.
2018-12-13 22:51:33.720 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_network_on_shared_policy_delete ... success [2.655s]
2018-12-13 22:51:34.527 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_port_when_quotas_is_full ... success [5.767s]
2018-12-13 22:51:36.330 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_router_when_quotas_is_full ... success [1.802s]
2018-12-13 22:51:38.597 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_security_group_rule_when_quotas_is_full ... success [2.266s]
2018-12-13 22:51:38.719 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_ports.PortTestCasesAdmin.test_regenerate_mac_address ... skip [0.001s]: Skipped because network extension: port-mac-address-regenerate is not enabled
2018-12-13 22:51:38.875 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_external_update_policy_from_wildcard_to_specific_tenant ... success [5.154s]
2018-12-13 22:51:40.360 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_security_group_when_quotas_is_full ... success [1.763s]
2018-12-13 22:51:43.101 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_ports.PortTestCasesAdmin.test_update_mac_address ... success [4.381s]
2018-12-13 22:51:44.357 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_quotas.QuotasTest.test_detail_quotas ... success [5.668s]
2018-12-13 22:51:44.778 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_quotas_negative.QuotasAdminNegativeTestJSON.test_create_subnet_when_quotas_is_full ... success [4.418s]
2018-12-13 22:51:45.228 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_quotas.QuotasTest.test_quotas ... success [0.872s]
2018-12-13 22:51:47.498 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_policy_allows_tenant_to_allocate_floatingip ... success [8.622s]
2018-12-13 22:51:48.869 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_routers_dvr.RouterTestCentralizedToDVR ... skip: l3-ha extension not enabled.
2018-12-13 22:51:53.900 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_policy_allows_tenant_to_attach_ext_gw ... success [6.401s]
2018-12-13 22:51:55.089 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_regular_client_blocked_from_creating_external_wild_policies ... success [1.189s]
2018-12-13 22:51:58.314 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_security_groups.SecGroupAdminTest.test_security_group_recreated_on_port_update ... success [5.763s]
2018-12-13 22:51:58.457 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_routers_dvr.RoutersTestDVR.test_centralized_router_creation ... success [1.460s]
2018-12-13 22:52:00.093 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_routers_dvr.RoutersTestDVR.test_distributed_router_creation ... success [1.635s]
2018-12-13 22:52:01.099 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_regular_client_shares_with_another ... success [6.009s]
2018-12-13 22:52:04.623 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_routers_flavors.RoutersFlavorTestCase ... skip: l3-flavors extension not enabled.
2018-12-13 22:52:05.779 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_wildcard_policy_created_from_external_network_api ... success [4.678s]
2018-12-13 22:52:06.777 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_external_network_extension.ExternalNetworksRBACTestJSON.test_wildcard_policy_delete_blocked_on_default_ext ... success [0.999s]
2018-12-13 22:52:08.949 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagFilterPortTestJSON.test_filter_port_tags ... success [1.461s]
2018-12-13 22:52:11.095 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_shared_network_extension.AllowedAddressPairSharedNetworkTest.test_create_with_address_pair_blocked_on_other_network ... success [1.014s]
2018-12-13 22:52:12.754 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_shared_network_extension.AllowedAddressPairSharedNetworkTest.test_update_with_address_pair_blocked_on_other_network ... success [1.659s]
2018-12-13 22:52:13.373 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_routers_ha.RoutersTestHA ... skip: l3-ha extension not enabled.
2018-12-13 22:52:22.022 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_create_rbac_policy_with_target_tenant_none ... success [3.550s]
2018-12-13 22:52:26.355 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_tag.TagFilterFloatingIpTestJSON.test_filter_floatingip_tags ... success [1.355s]
2018-12-13 22:52:29.226 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_create_rbac_policy_with_target_tenant_too_long_id ... success [7.204s]
2018-12-13 22:52:31.784 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagFilterQosPolicyTestJSON ... skip: Skipped because network extension: qos is not enabled
2018-12-13 22:52:32.363 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_tag.TagFilterRouterTestJSON.test_filter_router_tags ... success [2.139s]
2018-12-13 22:52:33.485 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_delete_self_share_rule ... success [4.257s]
2018-12-13 22:52:42.535 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_duplicate_policy_error ... success [9.049s]
2018-12-13 22:52:42.789 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagFilterSecGroupTestJSON.test_filter_security_group_tags ... success [1.199s]
2018-12-13 22:52:44.596 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_filter_fields ... success [2.061s]
2018-12-13 22:52:46.937 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_filter_policies ... success [2.340s]
2018-12-13 22:52:51.955 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_tag.TagFloatingIpTestJSON.test_floatingip_tags ... success [3.367s]
2018-12-13 22:52:54.855 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_filtering_works_with_rbac_records_present ... success [7.916s]
2018-12-13 22:52:57.538 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_tag.TagFilterTrunkTestJSON.test_filter_trunk_tags ... success [0.757s]
2018-12-13 22:52:59.672 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagNetworkTestJSON.test_network_tags ... success [5.055s]
2018-12-13 22:53:03.542 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_network_only_visible_to_policy_target ... success [8.686s]
2018-12-13 22:53:07.856 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_tag.TagPortTestJSON.test_port_tags ... success [3.394s]
2018-12-13 22:53:12.264 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_policy_show ... success [8.722s]
2018-12-13 22:53:14.056 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.admin.test_tag.TagRouterTestJSON.test_router_tags ... success [5.345s]
2018-12-13 22:53:18.477 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.admin.test_tag.TagSecGroupTestJSON.test_security_group_tags ... success [3.003s]
2018-12-13 22:53:18.643 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_policy_target_update ... success [6.379s]
2018-12-13 22:53:20.244 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.admin.test_tag.TagSubnetPoolTestJSON.test_subnetpool_tags ... success [3.356s]
2018-12-13 22:53:27.452 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_admin_create_shared_address_scope ... success [0.859s]
2018-12-13 22:53:28.021 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_admin_update_shared_address_scope ... success [0.569s]
2018-12-13 22:53:28.753 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_dhcp_ipv6.NetworksTestDHCPv6.test_dhcp_stateful_fixedips_outrange ... success [6.597s]
2018-12-13 22:53:29.325 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_delete_address_scope ... success [1.303s]
2018-12-13 22:53:29.859 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_show_address_scope ... success [0.535s]
2018-12-13 22:53:29.880 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_port_presence_prevents_network_rbac_policy_deletion ... success [11.236s]
2018-12-13 22:53:30.405 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_show_address_scope_project_id ... success [0.545s]
2018-12-13 22:53:30.648 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_tenant_create_list_address_scope ... success [0.242s]
2018-12-13 22:53:31.046 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_address_scopes.AddressScopeTest.test_tenant_update_address_scope ... success [0.398s]
2018-12-13 22:53:32.384 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.283s]
2018-12-13 22:53:34.176 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination ... success [1.789s]
2018-12-13 22:53:34.771 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.596s]
2018-12-13 22:53:35.615 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.843s]
2018-12-13 22:53:36.685 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [1.069s]
2018-12-13 22:53:37.280 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_rbac_bumps_network_revision ... success [7.399s]
2018-12-13 22:53:38.658 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_allowed_address_pairs ... success [3.747s]
2018-12-13 22:53:39.423 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_with_href_links ... success [2.735s]
2018-12-13 22:53:40.673 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_pagination_with_marker ... success [1.250s]
2018-12-13 22:53:41.006 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_sorts_asc ... success [0.335s]
2018-12-13 22:53:41.110 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_sorts_desc ... success [0.103s]
2018-12-13 22:53:41.112 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks.NetworksSearchCriteriaTest.test_list_validation_filters ... skip [0.001s]: Skipped until Bug: 1749820 is resolved.
2018-12-13 22:53:44.842 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_create_list_port_with_address_pair ... success [3.505s]
2018-12-13 22:53:45.138 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_create_port_sec_with_security_group ... success [6.480s]
2018-12-13 22:53:46.092 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_rbac_policy_quota ... success [8.810s]
2018-12-13 22:53:48.979 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_address_pair ... success [4.136s]
2018-12-13 22:53:48.984 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_delete_with_port_sec ... success [3.845s]
2018-12-13 22:53:51.200 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_cidr_address_pair ... success [2.220s]
2018-12-13 22:53:53.115 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_default_value ... success [4.130s]
2018-12-13 22:53:53.222 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_regular_client_blocked_from_sharing_anothers_network ... success [7.130s]
2018-12-13 22:53:55.818 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_regular_client_blocked_from_sharing_with_wildcard ... success [2.596s]
2018-12-13 22:53:57.136 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairIpV6TestJSON.test_update_port_with_multiple_ip_mac_address_pair ... success [5.936s]
2018-12-13 22:53:57.892 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_specific_value_1 ... success [4.776s]
2018-12-13 22:53:59.052 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_regular_client_shares_to_another_regular_client ... success [3.232s]
2018-12-13 22:53:59.054 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_networks_negative.NetworksNegativeTest.test_delete_network_in_use ... success [3.545s]
2018-12-13 22:54:01.386 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_specific_value_2 ... success [3.495s]
2018-12-13 22:54:09.896 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_subnet_on_network_only_visible_to_policy_target ... success [10.843s]
2018-12-13 22:54:12.904 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_update_pass ... success [11.516s]
2018-12-13 22:54:13.378 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_tenant_can_delete_port_on_own_network ... success [3.483s]
2018-12-13 22:54:15.573 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_add_ips_to_port ... success [3.459s]
2018-12-13 22:54:15.653 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_tenant_cant_delete_other_tenants_ports ... success [2.274s]
2018-12-13 22:54:16.844 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_auto_allocated_topology.TestAutoAllocatedTopology ... skip: No default subnetpool
2018-12-13 22:54:20.618 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.RBACSharedNetworksTest.test_update_self_share_rule ... success [4.965s]
2018-12-13 22:54:20.689 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_extension_driver_port_security.PortSecTest.test_port_sec_update_port_failed ... success [7.784s]
2018-12-13 22:54:21.699 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_change_dhcp_flag_then_create_port ... success [6.125s]
2018-12-13 22:54:24.642 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_create_update_port_description ... success [2.940s]
2018-12-13 22:54:24.646 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_create_update_port_with_dns_domain ... skip [0.001s]: Skipped because network extension: dns-domain-ports is not enabled
2018-12-13 22:54:24.648 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_create_update_port_with_dns_name ... skip [0.001s]: Skipped because network extension: dns-integration is not enabled
2018-12-13 22:54:24.649 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_ports.PortsTestJSON.test_create_update_port_with_no_dns_name ... skip [0.001s]: Skipped because network extension: dns-integration is not enabled
2018-12-13 22:54:26.573 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_extra_dhcp_options.ExtraDHCPOptionsIpV6TestJSON.test_create_list_port_with_extra_dhcp_options ... success [2.411s]
2018-12-13 22:54:27.583 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_extra_dhcp_options.ExtraDHCPOptionsIpV6TestJSON.test_update_show_port_with_extra_dhcp_options ... success [1.009s]
2018-12-13 22:54:37.228 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_qos.QosBandwidthLimitRuleTestJSON ... skip: qos extension not enabled.
2018-12-13 22:54:37.230 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_qos.QosBandwidthLimitRuleWithDirectionTestJSON ... skip: qos extension not enabled.
2018-12-13 22:54:37.231 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_qos.QosDscpMarkingRuleTestJSON ... skip: qos extension not enabled.
2018-12-13 22:54:40.827 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_create_bulk_shared_network ... success [2.654s]
2018-12-13 22:54:43.625 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers.DvrRoutersTest.test_create_distributed_router ... success [2.648s]
2018-12-13 22:54:43.998 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_create_port_shared_network_as_non_admin_tenant ... success [3.169s]
2018-12-13 22:54:45.355 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_create_update_shared_network ... success [1.358s]
2018-12-13 22:54:47.469 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_filtering_shared_networks ... success [2.112s]
2018-12-13 22:54:49.567 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers.DvrRoutersTestToCentralized ... skip: l3-ha extension not enabled.
2018-12-13 22:54:49.568 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers.HaRoutersTest ... skip: l3-ha extension not enabled.
2018-12-13 22:54:53.667 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_filtering_shared_subnets ... success [6.195s]
2018-12-13 22:54:53.858 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_list_shared_networks ... success [0.193s]
2018-12-13 22:54:54.353 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_shared_network_extension.SharedNetworksTest.test_show_shared_networks_attribute ... success [0.495s]
2018-12-13 22:55:02.932 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_create_update_delete_flavor ... success [1.061s]
2018-12-13 22:55:03.072 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_floating_ips_negative.FloatingIPNegativeTestJSON.test_associate_floatingip_with_port_with_floatingip ... success [19.792s]
2018-12-13 22:55:03.970 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_create_update_delete_service_profile ... success [1.037s]
2018-12-13 22:55:04.173 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_list_flavors ... success [0.203s]
2018-12-13 22:55:04.184 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_list_service_profiles ... success [0.012s]
2018-12-13 22:55:04.377 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_show_flavor ... success [0.192s]
2018-12-13 22:55:04.394 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsIpV6TestJSON.test_show_service_profile ... success [0.017s]
2018-12-13 22:55:11.032 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers_negative.RoutersNegativePolicyTest.test_add_interface_wrong_tenant ... success [10.818s]
2018-12-13 22:55:15.482 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_create_update_delete_flavor ... success [1.401s]
2018-12-13 22:55:16.128 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_create_update_delete_service_profile ... success [0.645s]
2018-12-13 22:55:16.139 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_list_flavors ... success [0.012s]
2018-12-13 22:55:16.150 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_list_service_profiles ... success [0.010s]
2018-12-13 22:55:16.335 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_show_flavor ... success [0.185s]
2018-12-13 22:55:16.347 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_flavors_extensions.TestFlavorsJson.test_show_service_profile ... success [0.012s]
2018-12-13 22:55:20.091 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_metering_extensions.MeteringIpV6TestJSON ... skip: metering extension not enabled.
2018-12-13 22:55:24.869 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagFilterNetworkTestJSON.test_filter_network_tags ... success [1.533s]
2018-12-13 22:55:26.588 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv6Test.test_admin_network_availability_before_subnet ... success [2.664s]
2018-12-13 22:55:27.320 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv4Test.test_admin_network_availability_before_subnet ... success [2.782s]
2018-12-13 22:55:32.544 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_routers_negative.RoutersNegativeTest.test_delete_router_in_use ... success [4.465s]
2018-12-13 22:55:33.019 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv6Test.test_net_ip_availability_after_port_delete ... success [6.431s]
2018-12-13 22:55:33.748 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv4Test.test_net_ip_availability_after_port_delete ... success [6.427s]
2018-12-13 22:55:40.119 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv6Test.test_net_ip_availability_after_subnet_and_ports ... success [7.099s]
2018-12-13 22:55:42.672 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_network_ip_availability.NetworksIpAvailabilityIPv4Test.test_net_ip_availability_after_subnet_and_ports ... success [8.923s]
2018-12-13 22:55:46.820 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_with_boolean_type_name ... success [0.218s]
2018-12-13 22:55:47.023 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_create_security_group_with_too_long_name ... success [0.203s]
2018-12-13 22:55:49.284 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_network_ip_availability_negative.NetworksIpAvailabilityNegativeTest.test_network_availability_nonexistent_network_id ... success [0.585s]
2018-12-13 22:55:49.986 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_delete_in_use_sec_group ... success [2.962s]
2018-12-13 22:55:50.274 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_update_default_security_group_name ... success [0.288s]
2018-12-13 22:55:50.741 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_update_security_group_with_boolean_type_name ... success [0.467s]
2018-12-13 22:55:51.163 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupIPv6Test.test_update_security_group_with_too_long_name ... success [0.422s]
2018-12-13 22:55:53.655 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_create_network_with_project ... success [2.120s]
2018-12-13 22:55:53.656 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_create_update_network_dns_domain ... skip [0.001s]: Skipped because network extension: dns-integration is not enabled
2018-12-13 22:55:54.642 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_list_networks_fields_keystone_v3 ... success [0.987s]
2018-12-13 22:55:54.917 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_show_network ... success [0.274s]
2018-12-13 22:55:54.947 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagFilterSubnetTestJSON.test_filter_subnet_tags ... success [0.961s]
2018-12-13 22:55:55.455 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_networks.NetworksTestJSON.test_show_network_fields_keystone_v3 ... success [0.538s]
2018-12-13 22:55:59.850 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_qos_negative.QosNegativeTestJSON ... skip: qos extension not enabled.
2018-12-13 22:56:01.708 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_admin_create_shared_subnetpool ... success [1.590s]
2018-12-13 22:56:05.128 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.252s]
2018-12-13 22:56:06.183 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination ... success [1.053s]
2018-12-13 22:56:06.621 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.438s]
2018-12-13 22:56:07.240 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.618s]
2018-12-13 22:56:07.267 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_dual_stack_subnets_from_subnetpools ... success [5.559s]
2018-12-13 22:56:07.971 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.730s]
2018-12-13 22:56:08.009 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_list_subnetpool ... success [0.743s]
2018-12-13 22:56:09.938 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_with_href_links ... success [1.964s]
2018-12-13 22:56:10.126 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnet_from_pool_with_default_prefixlen ... success [2.116s]
2018-12-13 22:56:11.316 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_pagination_with_marker ... success [1.378s]
2018-12-13 22:56:11.566 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_sorts_asc ... success [0.251s]
2018-12-13 22:56:11.620 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_ports.PortsSearchCriteriaTest.test_list_sorts_desc ... success [0.055s]
2018-12-13 22:56:12.799 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_portbinding_bumps_revision ... success [8.950s]
2018-12-13 22:56:13.170 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnet_from_pool_with_prefixlen ... success [3.044s]
2018-12-13 22:56:16.265 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnet_from_pool_with_quota ... success [3.093s]
2018-12-13 22:56:18.988 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_qos.QosMinimumBandwidthRuleTestJSON ... skip: qos extension not enabled.
2018-12-13 22:56:18.989 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_qos.QosTestJSON ... skip: qos extension not enabled.
2018-12-13 22:56:19.026 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_allowed_address_pairs_bumps_revision ... success [6.226s]
2018-12-13 22:56:19.027 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_dns_domain_bumps_revision ... skip [0.001s]: Skipped because network extension: dns-integration is not enabled
2018-12-13 22:56:19.282 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnet_from_pool_with_subnet_cidr ... success [3.017s]
2018-12-13 22:56:20.383 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_subnetpool_associate_address_scope ... success [1.101s]
2018-12-13 22:56:21.568 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_create_update_subnetpool_description ... success [1.183s]
2018-12-13 22:56:21.982 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_external_network_bumps_revision ... success [2.955s]
2018-12-13 22:56:22.180 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_get_subnetpool ... success [0.613s]
2018-12-13 22:56:22.829 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_show_subnetpool_has_project_id ... success [0.648s]
2018-12-13 22:56:23.258 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_tenant_create_non_default_subnetpool ... success [0.429s]
2018-12-13 22:56:24.427 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_tenant_update_subnetpool ... success [1.169s]
2018-12-13 22:56:25.205 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_associate_address_scope ... success [0.777s]
2018-12-13 22:56:26.842 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_associate_another_address_scope ... success [1.636s]
2018-12-13 22:56:28.455 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_extra_dhcp_opt_bumps_revision ... success [6.473s]
2018-12-13 22:56:28.924 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_disassociate_address_scope ... success [2.081s]
2018-12-13 22:56:29.713 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_prefixes_append ... success [0.790s]
2018-12-13 22:56:30.399 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTestV6.test_update_subnetpool_prefixes_extend ... success [0.686s]
2018-12-13 22:56:32.429 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_security_group_rule_with_ipv6_protocol_integers ... success [10.920s]
2018-12-13 22:56:34.476 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagFilterSubnetpoolTestJSON.test_filter_subnetpool_tags ... success [1.549s]
2018-12-13 22:56:34.663 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_security_group_rule_with_ipv6_protocol_legacy_names ... success [2.237s]
2018-12-13 22:56:42.630 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_security_group_rule_with_ipv6_protocol_names ... success [7.956s]
2018-12-13 22:56:49.850 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagQosPolicyTestJSON ... skip: Skipped because network extension: qos is not enabled
2018-12-13 22:56:52.137 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_floatingip_bumps_revision ... success [23.680s]
2018-12-13 22:56:53.931 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_network_bumps_revision ... success [1.795s]
2018-12-13 22:56:55.249 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_network_constrained_by_revision ... fail [1.313s]
2018-12-13 22:56:57.743 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_show_delete_security_group_rule_integers ... success [15.089s]
2018-12-13 22:56:59.317 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_port_bumps_revision ... success [4.070s]
2018-12-13 22:57:02.175 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagSubnetTestJSON.test_subnet_tags ... success [4.724s]
2018-12-13 22:57:04.475 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_sp_associate_address_scope_multiple_prefix_intersect ... success [1.409s]
2018-12-13 22:57:06.700 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_port_security_bumps_revisions ... success [7.382s]
2018-12-13 22:57:09.587 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnet_different_pools_same_network ... success [5.112s]
2018-12-13 22:57:10.193 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnetpool_associate_address_scope_of_other_owner ... success [0.606s]
2018-12-13 22:57:10.801 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolIPv6Test.test_create_show_delete_security_group_rule_names ... success [13.040s]
2018-12-13 22:57:10.899 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnetpool_associate_address_scope_prefix_intersect ... success [0.706s]
2018-12-13 22:57:11.093 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnetpool_associate_invalid_address_scope ... success [0.194s]
2018-12-13 22:57:11.252 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_create_subnetpool_associate_non_exist_address_scope ... success [0.158s]
2018-12-13 22:57:11.450 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_delete_non_existent_subnetpool ... success [0.198s]
2018-12-13 22:57:11.466 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_get_non_existent_subnetpool ... success [0.015s]
2018-12-13 22:57:11.731 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_create_default_subnetpool ... success [0.265s]
2018-12-13 22:57:11.893 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_create_shared_subnetpool ... success [0.161s]
2018-12-13 22:57:12.379 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_create_subnetpool_associate_shared_address_scope ... success [0.486s]
2018-12-13 22:57:12.530 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_port_sg_binding_bumps_revision ... success [5.828s]
2018-12-13 22:57:12.533 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_qos_network_policy_binding_bumps_revision ... skip [0.001s]: Skipped because network extension: qos is not enabled
2018-12-13 22:57:12.534 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_qos_port_policy_binding_bumps_revision ... skip [0.001s]: Skipped because network extension: qos is not enabled
2018-12-13 22:57:12.968 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_get_not_shared_admin_subnetpool ... success [0.589s]
2018-12-13 22:57:14.590 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_tenant_update_sp_prefix_associated_with_shared_addr_scope ... success [1.619s]
2018-12-13 22:57:14.829 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_non_existent_subnetpool ... success [0.240s]
2018-12-13 22:57:15.391 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_associate_address_scope_of_other_owner ... success [0.561s]
2018-12-13 22:57:16.129 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_associate_address_scope_wrong_ip_version ... success [0.738s]
2018-12-13 22:57:17.665 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupProtocolTest.test_create_security_group_rule_with_ipv6_protocol_integers ... success [3.410s]
2018-12-13 22:57:17.811 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_multiple_prefix_intersect ... success [1.680s]
2018-12-13 22:57:18.588 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_not_modifiable_shared ... success [0.777s]
2018-12-13 22:57:19.772 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_prefix_intersect ... success [1.183s]
2018-12-13 22:57:20.543 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_prefixes_shrink ... success [0.771s]
2018-12-13 22:57:20.947 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnetpools_negative.SubnetPoolsNegativeTestJSON.test_update_subnetpool_tenant_id ... success [0.405s]
2018-12-13 22:57:21.340 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupProtocolTest.test_create_security_group_rule_with_ipv6_protocol_names ... success [3.676s]
2018-12-13 22:57:22.399 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.TagTrunkTestJSON.test_trunk_tags ... success [2.994s]
2018-12-13 22:57:25.240 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_router_bumps_revision ... success [12.706s]
2018-12-13 22:57:25.241 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_router_extra_attributes_bumps_revision ... skip [0.001s]: Skipped because network extension: l3-ha is not enabled
2018-12-13 22:57:25.740 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_service_type_management.ServiceTypeManagementTest.test_service_provider_list ... success [0.579s]
2018-12-13 22:57:32.738 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_create_network_with_timestamp ... success [1.040s]
2018-12-13 22:57:34.631 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_create_port_with_timestamp ... success [1.892s]
2018-12-13 22:57:36.164 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_create_subnet_with_timestamp ... success [1.533s]
2018-12-13 22:57:36.482 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_create_subnetpool_with_timestamp ... success [0.317s]
2018-12-13 22:57:36.488 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_segment_with_timestamp ... skip [0.001s]: Skipped because network extension: standard-attr-segment is not enabled
2018-12-13 22:57:36.711 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.admin.test_tag.UpdateTagsTest.test_update_tags_affects_only_updated_resource ... success [3.997s]
2018-12-13 22:57:37.520 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_show_networks_attribute_with_timestamp ... success [1.036s]
2018-12-13 22:57:38.633 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_router_extra_routes_bumps_revision ... success [13.392s]
2018-12-13 22:57:39.901 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_show_port_attribute_with_timestamp ... success [2.381s]
2018-12-13 22:57:40.017 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_sg_group_bumps_revision ... success [1.385s]
2018-12-13 22:57:41.373 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.425s]
2018-12-13 22:57:42.377 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination ... success [1.002s]
2018-12-13 22:57:42.522 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_sg_rule_bumps_sg_revision ... success [2.502s]
2018-12-13 22:57:42.948 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.572s]
2018-12-13 22:57:43.112 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_show_subnet_attribute_with_timestamp ... success [3.209s]
2018-12-13 22:57:43.334 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.385s]
2018-12-13 22:57:43.619 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_show_subnetpool_attribute_with_timestamp ... success [0.508s]
2018-12-13 22:57:44.022 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.687s]
2018-12-13 22:57:45.860 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_update_network_with_timestamp ... success [2.239s]
2018-12-13 22:57:46.158 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_subnet_bumps_network_revision ... success [3.637s]
2018-12-13 22:57:46.397 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_with_href_links ... success [2.373s]
2018-12-13 22:57:47.277 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_pagination_with_marker ... success [0.881s]
2018-12-13 22:57:47.329 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_sorts_asc ... success [0.052s]
2018-12-13 22:57:47.384 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_sorts_desc ... success [0.053s]
2018-12-13 22:57:47.386 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_subnets.SubnetsSearchCriteriaTest.test_list_validation_filters ... skip [0.001s]: Skipped until Bug: 1749820 is resolved.
2018-12-13 22:57:48.306 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_delete_address_scope_associated_with_subnetpool ... success [1.045s]
2018-12-13 22:57:48.509 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_delete_non_existent_address_scope ... success [0.204s]
2018-12-13 22:57:48.710 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_get_non_existent_address_scope ... success [0.201s]
2018-12-13 22:57:48.820 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_update_port_with_timestamp ... success [2.960s]
2018-12-13 22:57:48.907 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_tenant_create_shared_address_scope ... success [0.197s]
2018-12-13 22:57:49.731 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_tenant_get_not_shared_admin_address_scope ... success [0.822s]
2018-12-13 22:57:49.978 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_tenant_update_address_scope_shared_false ... success [0.248s]
2018-12-13 22:57:50.292 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_tenant_update_address_scope_shared_true ... success [0.313s]
2018-12-13 22:57:50.307 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_update_non_existent_address_scope ... success [0.015s]
2018-12-13 22:57:50.864 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_update_subnet_with_timestamp ... success [2.044s]
2018-12-13 22:57:50.889 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_address_scopes_negative.AddressScopeTestNegative.test_update_shared_address_scope_to_unshare ... success [0.582s]
2018-12-13 22:57:52.280 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_timestamp.TestTimeStamp.test_update_subnetpool_with_timestamp ... success [1.416s]
2018-12-13 22:57:54.745 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_subnet_bumps_revision ... success [8.585s]
2018-12-13 22:58:06.285 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_subnet_service_types_bumps_revisions ... success [11.539s]
2018-12-13 22:58:07.344 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_revisions.TestRevisions.test_update_subnetpool_bumps_revision ... success [1.059s]
2018-12-13 22:58:09.481 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairTestJSON.test_create_list_port_with_address_pair ... success [3.085s]
2018-12-13 22:58:11.976 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_address_pair ... success [2.494s]
2018-12-13 22:58:14.539 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_cidr_address_pair ... success [2.562s]
2018-12-13 22:58:14.785 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_create_sg_with_timestamp ... success [1.365s]
2018-12-13 22:58:16.363 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_create_sgrule_with_timestamp ... success [1.577s]
2018-12-13 22:58:17.521 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_show_sg_attribute_with_timestamp ... success [1.157s]
2018-12-13 22:58:19.716 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_allowed_address_pair.AllowedAddressPairTestJSON.test_update_port_with_multiple_ip_mac_address_pair ... success [5.176s]
2018-12-13 22:58:19.794 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_show_sgrule_attribute_with_timestamp ... success [2.272s]
2018-12-13 22:58:20.649 89 INFO opnfv-tempest [-] {1} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithSecurityGroup.test_update_sg_with_timestamp ... success [0.855s]
2018-12-13 22:58:22.374 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_create_router_with_default_snat_value ... success [5.006s]
2018-12-13 22:58:29.354 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extensions.ExtensionsTest.test_list_extensions_includes_all ... success [0.588s]
2018-12-13 22:58:29.447 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.025s]
2018-12-13 22:58:29.562 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extensions.ExtensionsTest.test_list_extensions_pagination ... success [0.209s]
2018-12-13 22:58:29.572 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extensions.ExtensionsTest.test_list_extensions_project_id ... success [0.009s]
2018-12-13 22:58:29.766 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extensions.ExtensionsTest.test_list_extensions_sorting ... success [0.194s]
2018-12-13 22:58:29.928 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination ... success [0.479s]
2018-12-13 22:58:30.143 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_create_router_with_snat_explicit ... success [7.770s]
2018-12-13 22:58:30.339 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.410s]
2018-12-13 22:58:30.580 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.241s]
2018-12-13 22:58:31.451 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.870s]
2018-12-13 22:58:32.476 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_create_update_router_description ... success [2.332s]
2018-12-13 22:58:32.679 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_with_href_links ... success [1.226s]
2018-12-13 22:58:33.227 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_pagination_with_marker ... success [0.548s]
2018-12-13 22:58:33.251 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_sorts_asc ... success [0.025s]
2018-12-13 22:58:33.467 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk.TrunksSearchCriteriaTest.test_list_sorts_desc ... success [0.216s]
2018-12-13 22:58:40.140 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extra_dhcp_options.ExtraDHCPOptionsTestJSON.test_create_list_port_with_extra_dhcp_options ... success [2.216s]
2018-12-13 22:58:41.082 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_extra_dhcp_options.ExtraDHCPOptionsTestJSON.test_update_show_port_with_extra_dhcp_options ... success [0.943s]
2018-12-13 22:58:46.260 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_network_attached_with_two_routers ... success [13.781s]
2018-12-13 22:58:48.721 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_empty_trunk_details ... success [4.954s]
2018-12-13 22:58:53.361 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_trunk_details_no_subports ... success [4.640s]
2018-12-13 22:59:00.875 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_floating_ips.FloatingIPTestJSON.test_blank_update_clears_association ... success [2.898s]
2018-12-13 22:59:01.617 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk_details.TestTrunkDetailsJSON.test_port_resource_trunk_details_with_subport ... success [8.255s]
2018-12-13 22:59:04.553 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_floating_ips.FloatingIPTestJSON.test_create_update_floatingip_description ... success [3.674s]
2018-12-13 22:59:04.554 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_floating_ips.FloatingIPTestJSON.test_create_update_floatingip_port_details ... skip [0.001s]: Skipped because network extension: fip-port-details is not enabled
2018-12-13 22:59:05.011 89 INFO opnfv-tempest [-] {0} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestMtusJSON ... skip: Either vxlan or gre type driver not enabled.
2018-12-13 22:59:08.197 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_floating_ips.FloatingIPTestJSON.test_floatingip_update_extra_attributes_port_id_not_changed ... success [3.644s]
2018-12-13 22:59:20.765 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_metering_extensions.MeteringTestJSON ... skip: metering extension not enabled.
2018-12-13 22:59:20.766 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_metering_negative.MeteringNegativeTestJSON ... skip: metering extension not enabled.
2018-12-13 22:59:24.022 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_networks.NetworksMtuTestJSON.test_create_network_custom_mtu ... success [1.255s]
2018-12-13 22:59:25.353 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_networks.NetworksMtuTestJSON.test_update_network_custom_mtu ... success [1.331s]
2018-12-13 22:59:28.932 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_qos.QosSearchCriteriaTest ... skip: qos extension not enabled.
2018-12-13 22:59:28.933 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_qos.RbacSharedQosPoliciesTest ... skip: qos extension not enabled.
2018-12-13 22:59:33.704 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.282s]
2018-12-13 22:59:34.893 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination ... success [1.187s]
2018-12-13 22:59:35.652 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.759s]
2018-12-13 22:59:36.006 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.354s]
2018-12-13 22:59:36.928 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.921s]
2018-12-13 22:59:39.147 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_with_href_links ... success [2.217s]
2018-12-13 22:59:40.251 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_pagination_with_marker ... success [1.104s]
2018-12-13 22:59:40.344 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_sorts_asc ... success [0.093s]
2018-12-13 22:59:40.432 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersSearchCriteriaTest.test_list_sorts_desc ... success [0.089s]
2018-12-13 22:59:53.023 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_router_interface_status ... fail [66.747s]
2018-12-13 22:59:54.313 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_create_router_with_default_snat_value ... success [4.563s]
2018-12-13 23:00:00.858 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_update_extra_route ... success [7.837s]
2018-12-13 23:00:01.018 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_create_router_with_snat_explicit ... success [6.706s]
2018-12-13 23:00:02.392 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_create_update_router_description ... success [1.373s]
2018-12-13 23:00:06.118 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_update_router_reset_gateway_without_snat ... success [5.260s]
2018-12-13 23:00:11.162 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_update_router_set_gateway_with_snat_explicit ... success [5.044s]
2018-12-13 23:00:15.461 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers.RoutersIpV6Test.test_update_router_set_gateway_without_snat ... success [4.298s]
2018-12-13 23:00:17.417 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_network_attached_with_two_routers ... success [15.022s]
2018-12-13 23:00:36.836 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers_negative.DvrRoutersNegativeTest.test_router_create_tenant_distributed_returns_forbidden ... success [0.235s]
2018-12-13 23:00:44.076 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_routers_negative.HaRoutersNegativeTest ... skip: l3-ha extension not enabled.
2018-12-13 23:00:47.909 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups.SecGroupTest.test_create_bulk_sec_groups ... success [1.708s]
2018-12-13 23:00:49.155 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.246s]
2018-12-13 23:00:53.885 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_with_boolean_type_name ... success [0.189s]
2018-12-13 23:00:54.080 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_with_too_long_name ... success [0.194s]
2018-12-13 23:00:55.750 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_delete_in_use_sec_group ... success [1.669s]
2018-12-13 23:00:56.432 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_update_default_security_group_name ... success [0.682s]
2018-12-13 23:00:56.879 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_update_security_group_with_boolean_type_name ... success [0.446s]
2018-12-13 23:00:57.440 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_security_groups_negative.NegativeSecGroupTest.test_update_security_group_with_too_long_name ... success [0.561s]
2018-12-13 23:01:06.704 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_no_pagination_limit_0 ... success [0.218s]
2018-12-13 23:01:07.582 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination ... success [0.877s]
2018-12-13 23:01:07.861 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_page_reverse_asc ... success [0.280s]
2018-12-13 23:01:08.295 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_page_reverse_desc ... success [0.433s]
2018-12-13 23:01:08.590 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_page_reverse_with_href_links ... success [0.294s]
2018-12-13 23:01:09.923 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_with_href_links ... success [1.331s]
2018-12-13 23:01:10.316 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_pagination_with_marker ... success [0.394s]
2018-12-13 23:01:10.343 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_sorts_asc ... success [0.028s]
2018-12-13 23:01:10.371 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_sorts_desc ... success [0.026s]
2018-12-13 23:01:10.372 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_validation_filters ... skip [0.001s]: Skipped until Bug: 1749820 is resolved.
2018-12-13 23:01:19.485 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_admin_create_shared_subnetpool ... success [1.315s]
2018-12-13 23:01:20.153 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_list_subnetpool ... success [0.669s]
2018-12-13 23:01:22.074 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnet_from_pool_with_default_prefixlen ... success [1.920s]
2018-12-13 23:01:23.474 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_router_interface_status ... fail [66.042s]
2018-12-13 23:01:24.284 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnet_from_pool_with_prefixlen ... success [2.210s]
2018-12-13 23:01:26.266 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnet_from_pool_with_quota ... success [1.981s]
2018-12-13 23:01:29.055 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnet_from_pool_with_subnet_cidr ... success [2.789s]
2018-12-13 23:01:30.016 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_subnetpool_associate_address_scope ... success [0.960s]
2018-12-13 23:01:31.129 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_create_update_subnetpool_description ... success [1.111s]
2018-12-13 23:01:31.800 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_get_subnetpool ... success [0.672s]
2018-12-13 23:01:32.159 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_show_subnetpool_has_project_id ... success [0.359s]
2018-12-13 23:01:32.336 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_tenant_create_non_default_subnetpool ... success [0.177s]
2018-12-13 23:01:32.340 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_update_extra_route ... success [8.869s]
2018-12-13 23:01:32.857 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_tenant_update_subnetpool ... success [0.520s]
2018-12-13 23:01:34.141 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_associate_address_scope ... success [1.282s]
2018-12-13 23:01:34.530 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_associate_another_address_scope ... success [0.388s]
2018-12-13 23:01:35.194 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_disassociate_address_scope ... success [0.664s]
2018-12-13 23:01:35.427 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_prefixes_append ... success [0.233s]
2018-12-13 23:01:35.731 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_subnetpools.SubnetPoolsTest.test_update_subnetpool_prefixes_extend ... success [0.304s]
2018-12-13 23:01:37.116 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_update_router_reset_gateway_without_snat ... success [4.776s]
2018-12-13 23:01:41.863 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_update_router_set_gateway_with_snat_explicit ... success [4.746s]
2018-12-13 23:01:46.808 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_routers.RoutersTest.test_update_router_set_gateway_without_snat ... success [4.944s]
2018-12-13 23:01:58.874 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_create_floatingip_with_timestamp ... success [2.234s]
2018-12-13 23:01:59.175 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_create_router_with_timestamp ... success [0.302s]
2018-12-13 23:02:00.957 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_show_floatingip_attribute_with_timestamp ... success [1.780s]
2018-12-13 23:02:01.596 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_show_router_attribute_with_timestamp ... success [0.638s]
2018-12-13 23:02:03.497 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_update_floatingip_with_timestamp ... success [1.901s]
2018-12-13 23:02:04.664 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_timestamp.TestTimeStampWithL3.test_update_router_with_timestamp ... success [1.167s]
2018-12-13 23:02:16.101 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolTest.test_create_show_delete_security_group_rule_integers ... success [12.987s]
2018-12-13 23:02:24.896 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_security_groups.SecGroupProtocolTest.test_create_show_delete_security_group_rule_names ... success [8.775s]
2018-12-13 23:02:25.131 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_add_subport ... success [9.331s]
2018-12-13 23:02:26.341 89 INFO opnfv-tempest [-] {3} neutron_tempest_plugin.api.test_trunk.TrunkTestInheritJSONBase ... skip: VLAN type_driver is not enabled
2018-12-13 23:02:29.223 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_show_delete_trunk ... success [4.092s]
2018-12-13 23:02:33.047 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_trunk_empty_subports_list ... success [3.823s]
2018-12-13 23:02:37.830 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_trunk_subports_not_specified ... success [4.783s]
2018-12-13 23:02:42.396 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_update_trunk ... success [4.565s]
2018-12-13 23:02:46.134 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_create_update_trunk_with_description ... success [3.737s]
2018-12-13 23:02:52.767 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_delete_trunk_with_subport_is_allowed ... success [6.632s]
2018-12-13 23:02:59.553 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_get_subports ... success [6.785s]
2018-12-13 23:03:06.785 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_list_trunks ... success [7.231s]
2018-12-13 23:03:15.732 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_remove_subport ... success [8.946s]
2018-12-13 23:03:20.250 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestJSON.test_show_trunk_has_project_id ... success [4.518s]
2018-12-13 23:03:24.766 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk.TrunkTestMtusJSON ... skip: Either vxlan or gre type driver not enabled.
2018-12-13 23:03:38.009 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_add_subport_duplicate_segmentation_details ... success [9.899s]
2018-12-13 23:03:43.029 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_add_subport_passing_dict ... success [5.021s]
2018-12-13 23:03:47.488 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_add_subport_port_id_disabled_trunk ... success [4.459s]
2018-12-13 23:03:52.120 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_add_subport_port_id_uses_trunk_port_id ... success [4.631s]
2018-12-13 23:03:53.201 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_subport_invalid_inherit_network_segmentation_type ... skip [1.081s]: Vxlan type driver must be enabled for this test.
2018-12-13 23:03:58.880 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_subport_missing_segmentation_id ... success [5.678s]
2018-12-13 23:04:03.387 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_subport_nonexistent_port_id ... success [4.507s]
2018-12-13 23:04:06.680 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_subport_nonexistent_trunk ... success [3.293s]
2018-12-13 23:04:15.354 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_duplicate_subport_segmentation_ids ... success [8.672s]
2018-12-13 23:04:16.590 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_nonexistent_port_id ... success [1.237s]
2018-12-13 23:04:20.285 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_nonexistent_subport_port_id ... success [3.694s]
2018-12-13 23:04:23.616 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_port_id ... success [3.331s]
2018-12-13 23:04:27.020 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_segmentation_id ... success [3.402s]
2018-12-13 23:04:30.400 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_create_trunk_with_subport_missing_segmentation_type ... success [3.379s]
2018-12-13 23:04:37.259 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_delete_port_in_use_by_subport ... success [6.858s]
2018-12-13 23:04:41.743 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_delete_port_in_use_by_trunk ... success [4.483s]
2018-12-13 23:04:46.538 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_delete_trunk_disabled_trunk ... success [4.795s]
2018-12-13 23:04:52.945 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_not_found ... success [6.406s]
2018-12-13 23:05:00.737 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_passing_dict ... success [7.792s]
2018-12-13 23:05:05.840 89 INFO opnfv-tempest [-] {2} neutron_tempest_plugin.api.test_trunk_negative.TrunkTestJSON.test_remove_subport_port_id_disabled_trunk ... success [5.102s]
2018-12-13 23:05:11.166 89 INFO rally.task.context [-] Verification 8cb94da2-2556-4938-a096-04f7dbc67fef | Context testr@default cleanup() started
2018-12-13 23:05:11.167 89 INFO rally.task.context [-] Verification 8cb94da2-2556-4938-a096-04f7dbc67fef | Context testr@default cleanup() finished in 0.92 msec
2018-12-13 23:05:11.168 89 INFO rally.task.context [-] Verification 8cb94da2-2556-4938-a096-04f7dbc67fef | Context tempest@default cleanup() started
2018-12-13 23:05:12.096 89 INFO rally.task.context [-] Verification 8cb94da2-2556-4938-a096-04f7dbc67fef | Context tempest@default cleanup() finished in 0.93 sec
2018-12-13 23:05:12.237 89 INFO rally.api [-] Verification (UUID=9591b417-6697-4812-885a-37f7e38d8ffe) has been successfully finished for deployment 'opnfv-rally' (UUID=023c7fd9-b314-4058-b125-c5e9c0d0bcb3)!

======
Totals
======

Ran: 547 tests in 850.767 sec.
 - Success: 387
 - Skipped: 157
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 3

Using verification (UUID=9591b417-6697-4812-885a-37f7e38d8ffe) as the default verification for the future operations.