2020-04-17 21:21:28,588 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+-----------------------------------------------------------------------------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+-----------------------------------------------------------------------------------------------------------------------------------+ | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_DST_URL | s3://artifacts.opnfv.org/cntt/X0F8EUUP7G2Q/cntt-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-cntt-run-15 | | S3_ENDPOINT_URL | https://storage.googleapis.com | | DEPLOY_SCENARIO | os-nosdn-nofeature-ha | | BUILD_TAG | X0F8EUUP7G2Q | | DEBUG | false | | INSTALLER_TYPE | cntt | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | HTTP_DST_URL | http://artifacts.opnfv.org/cntt/X0F8EUUP7G2Q/cntt-opnfv-functest-smoke-cntt-latest-neutron-tempest-plugin-api-cntt-run-15 | | NODE_NAME | intel-pod15 | +-------------------------+-----------------------------------------------------------------------------------------------------------------------------------+ 2020-04-17 21:21:28,592 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file export OS_AUTH_URL=http://identity-airship.intel-pod15.opnfv.org/v3 export OS_USER_DOMAIN_NAME=default export OS_PROJECT_DOMAIN_NAME=default export OS_USERNAME=admin export OS_PROJECT_NAME=admin export OS_PASSWORD=password123 export OS_IDENTITY_API_VERSION=3 export OS_INTERFACE=public export OS_REGION_NAME=intel-pod15 2020-04-17 21:21:28,592 - xtesting.ci.run_tests - DEBUG - Test args: neutron-tempest-plugin-api-cntt 2020-04-17 21:21:28,622 - xtesting.ci.run_tests - INFO - Loading test case 'neutron-tempest-plugin-api-cntt'... 2020-04-17 21:21:29,366 - functest.core.tenantnetwork - DEBUG - password: Z9,TeLLXmttV^mDkr29Aq0n1finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: d01a6403-9134-41ce-b5b6-bb991dbfccae ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-04-17 21:21:53,578 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-04-17 21:21:54,606 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Create verifier from existing repo... 2020-04-17 21:22:00,306 - functest.opnfv_tests.openstack.tempest.tempest - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide Using verifier 'opnfv-tempest' (UUID=7ec90713-e238-4f31-9d48-786099eb1a2d) as the default verifier for the future CLI operations. 2020-04-17 21:22:03,718 - functest.core.singlevm - DEBUG - image: Munch({'container_format': u'bare', 'min_ram': 0, 'locations': [], 'file': u'/v2/images/62dab1b4-a5a6-48e7-8aaa-d687d06a0131/file', 'owner': u'c190aa927fdc422eb97986695db0102e', 'id': u'62dab1b4-a5a6-48e7-8aaa-d687d06a0131', 'size': 12716032, u'self': u'/v2/images/62dab1b4-a5a6-48e7-8aaa-d687d06a0131', 'disk_format': u'qcow2', 'protected': False, 'location': Munch({'project': Munch({'domain_id': None, 'id': u'c190aa927fdc422eb97986695db0102e', 'name': 'neutron-tempest-pl-project_a85e4fec-18a3-4244-b7b1-fdca32b7d5ac', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), 'minRam': 0, 'direct_url': None, u'schema': u'/v2/schemas/image', 'status': u'active', 'updated': u'2020-04-17T21:22:03Z', 'tags': [], 'visibility': u'public', 'updated_at': u'2020-04-17T21:22:03Z', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'owner_specified.shade.object': u'images/neutron-tempest-plugin-api-cntt-img_alt_a85e4fec-18a3-4244-b7b1-fdca32b7d5ac', 'min_disk': 0, 'is_public': True, 'virtual_size': 0, u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', 'properties': {u'self': u'/v2/images/62dab1b4-a5a6-48e7-8aaa-d687d06a0131', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/neutron-tempest-plugin-api-cntt-img_alt_a85e4fec-18a3-4244-b7b1-fdca32b7d5ac', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}, 'name': u'neutron-tempest-plugin-api-cntt-img_alt_a85e4fec-18a3-4244-b7b1-fdca32b7d5ac', 'created': u'2020-04-17T21:22:02Z', 'checksum': u'443b7623e27ecf03dc9e01ee93f67afe', 'created_at': u'2020-04-17T21:22:02Z', 'minDisk': 0, 'is_protected': False, 'metadata': {u'self': u'/v2/images/62dab1b4-a5a6-48e7-8aaa-d687d06a0131', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/neutron-tempest-plugin-api-cntt-img_alt_a85e4fec-18a3-4244-b7b1-fdca32b7d5ac', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}}) 2020-04-17 21:22:03,878 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'neutron-tempest-plugin-api-cntt-flavor_alt_a85e4fec-18a3-4244-b7b1-fdca32b7d5ac', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'4b2ba8e8c00d478286357c2bdc045e1a', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'd8163969-a2ef-4d60-8f6a-0e34d1b2e281', 'swap': 0}) 2020-04-17 21:22:03,922 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - flavor: Munch({'name': u'neutron-tempest-plugin-api-cntt-flavor_alt_a85e4fec-18a3-4244-b7b1-fdca32b7d5ac', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'4b2ba8e8c00d478286357c2bdc045e1a', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'd8163969-a2ef-4d60-8f6a-0e34d1b2e281', 'swap': 0}) 2020-04-17 21:22:07,101 - functest.opnfv_tests.openstack.tempest.tempest - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2020-04-17 21:22:07,101 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Looking for tempest.conf file... 2020-04-17 21:22:07,101 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Updating selected tempest.conf parameters... 2020-04-17 21:22:07,103 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2020-04-17 21:22:07,140 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2020-04-17 21:22:16,468 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-7ec90713-e238-4f31-9d48-786099eb1a2d/repo; stestr list '(?!.*admin.test_agent_availability_zone)(?!.*admin.test_dhcp_agent_scheduler)(?!.*admin.test_l3_agent_scheduler)(?!.*admin.test_logging)(?!.*admin.test_logging_negative)(?!.*admin.test_network_segment_range)(?!.*admin.test_ports.PortTestCasesAdmin.test_regenerate_mac_address)(?!.*admin.test_ports.PortTestCasesResourceRequest)(?!.*admin.test_routers_dvr)(?!.*admin.test_routers_flavors)(?!.*admin.test_routers_ha)(?!.*test_conntrack_helper)(?!.*test_floating_ips.FloatingIPPoolTestJSON)(?!.*test_floating_ips.FloatingIPTestJSON.test_create_update_floatingip_port_details)(?!.*test_metering_extensions)(?!.*test_metering_negative)(?!.*test_networks.NetworksSearchCriteriaTest.test_list_validation_filters)(?!.*test_networks.NetworksTestAdmin.test_create_tenant_network_vxlan)(?!.*test_networks.NetworksTestJSON.test_create_update_network_dns_domain)(?!.*test_ports.PortsTestJSON.test_create_port_with_propagate_uplink_status)(?!.*test_ports.PortsTestJSON.test_create_port_without_propagate_uplink_status)(?!.*test_ports.PortsTestJSON.test_create_update_port_with_dns_domain)(?!.*test_ports.PortsTestJSON.test_create_update_port_with_dns_name)(?!.*test_ports.PortsTestJSON.test_create_update_port_with_no_dns_name)(?!.*test_qos.QosMinimumBandwidthRuleTestJSON)(?!.*test_revisions.TestRevisions.test_update_dns_domain_bumps_revision)(?!.*test_revisions.TestRevisions.test_update_router_extra_attributes_bumps_revision)(?!.*test_router_interface_fip)(?!.*test_routers.DvrRoutersTest)(?!.*test_routers.HaRoutersTest)(?!.*test_routers.RoutersIpV6Test.test_extra_routes_atomic)(?!.*test_routers.RoutersTest.test_extra_routes_atomic)(?!.*test_routers_negative.DvrRoutersNegativeTest)(?!.*test_routers_negative.DvrRoutersNegativeTestExtended)(?!.*test_routers_negative.HaRoutersNegativeTest)(?!.*test_security_groups.RbacSharedSecurityGroupTest)(?!.*test_subnetpools.SubnetPoolsSearchCriteriaTest.test_list_validation_filters)(?!.*test_subnets.SubnetsSearchCriteriaTest.test_list_validation_filters)(?!.*test_timestamp.TestTimeStamp.test_segment_with_timestamp)(?!.*test_trunk.TrunkTestInheritJSONBase.test_add_subport)(?!.*test_trunk.TrunkTestMtusJSON)(?!.*test_trunk_negative.TrunkTestJSON.test_create_subport_invalid_inherit_network_segmentation_type)(?!.*test_trunk_negative.TrunkTestMtusJSON)(^neutron_tempest_plugin.api)' >/home/opnfv/functest/results/neutron-tempest-plugin-api-cntt/test_list.txt 2>/dev/null) 2020-04-17 21:22:16,469 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Applying tempest blacklist... 2020-04-17 21:22:16,478 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/neutron-tempest-plugin-api-cntt/test_list.txt', '--concurrency=3']'. 2020-04-17 21:34:58,946 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Verification UUID: 4bb71491-3c0b-43d8-a5b8-f2e3bee0bd2e 2020-04-17 21:34:58,955 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', u'4bb71491-3c0b-43d8-a5b8-f2e3bee0bd2e']'. 2020-04-17 21:35:00,129 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2020-04-17 21:35:00,130 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2020-04-17 21:35:00,130 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2020-04-17 21:35:00,130 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 4bb71491-3c0b-43d8-a5b8-f2e3bee0bd2e | 2020-04-17 21:35:00,130 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | failed | 2020-04-17 21:35:00,130 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2020-04-17 21:22:18 | 2020-04-17 21:35:00,130 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2020-04-17 21:34:58 | 2020-04-17 21:35:00,131 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:12:40 | 2020-04-17 21:35:00,131 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | concurrency: 3 | 2020-04-17 21:35:00,131 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | | load_list: (value is too long, use 'detailed' flag to display it) | 2020-04-17 21:35:00,131 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2020-04-17 21:35:00,131 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: 7ec90713-e238-4f31-9d48-786099eb1a2d) | 2020-04-17 21:35:00,131 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2020-04-17 21:35:00,131 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: d01a6403-9134-41ce-b5b6-bb991dbfccae) | 2020-04-17 21:35:00,132 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 478 | 2020-04-17 21:35:00,132 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 751.392 | 2020-04-17 21:35:00,132 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 205 | 2020-04-17 21:35:00,132 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 111 | 2020-04-17 21:35:00,132 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2020-04-17 21:35:00,132 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2020-04-17 21:35:00,132 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 162 | 2020-04-17 21:35:00,133 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2020-04-17 21:35:00,133 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2020-04-17 21:35:00,133 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests | 2020-04-17 21:35:00,441 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest neutron-tempest-plugin-api-cntt success_rate is 55.8583106267% 2020-04-17 21:35:00,443 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'verify', 'report', '--type', 'html', '--uuid', u'4bb71491-3c0b-43d8-a5b8-f2e3bee0bd2e', '--to', u'/home/opnfv/functest/results/neutron-tempest-plugin-api-cntt/tempest-report.html'] 2020-04-17 21:35:02,591 - functest.opnfv_tests.openstack.rally.rally - INFO - rally verify report --type html --uuid 4bb71491-3c0b-43d8-a5b8-f2e3bee0bd2e --to /home/opnfv/functest/results/neutron-tempest-plugin-api-cntt/tempest-report.html Saving the report to '/home/opnfv/functest/results/neutron-tempest-plugin-api-cntt/tempest-report.html' file. It may take some time. The report has been successfully saved. 2020-04-17 21:35:02,592 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'verify', 'report', '--type', 'junit-xml', '--uuid', u'4bb71491-3c0b-43d8-a5b8-f2e3bee0bd2e', '--to', u'/home/opnfv/functest/results/neutron-tempest-plugin-api-cntt/tempest-report.xml'] 2020-04-17 21:35:04,910 - functest.opnfv_tests.openstack.rally.rally - INFO - rally verify report --type junit-xml --uuid 4bb71491-3c0b-43d8-a5b8-f2e3bee0bd2e --to /home/opnfv/functest/results/neutron-tempest-plugin-api-cntt/tempest-report.xml Saving the report to '/home/opnfv/functest/results/neutron-tempest-plugin-api-cntt/tempest-report.xml' file. It may take some time. The report has been successfully saved. 2020-04-17 21:35:04,911 - xtesting.ci.run_tests - INFO - Test result: +-----------------------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------------------------+------------------+------------------+----------------+ | neutron-tempest-plugin-api-cntt | functest | 13:34 | FAIL | +-----------------------------------------+------------------+------------------+----------------+ 2020-04-17 21:35:20,819 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)