2020-03-09 20:17:46,597 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+----------------------------------------------------------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+----------------------------------------------------------------------------------------------------------------+ | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_DST_URL | s3://artifacts.opnfv.org/cntt/5NN6HAWVHI0Q/cntt-opnfv-functest-smoke-cntt-latest-tempest_full-run-12 | | S3_ENDPOINT_URL | https://storage.googleapis.com | | DEPLOY_SCENARIO | os-nosdn-nofeature-ha | | BUILD_TAG | 5NN6HAWVHI0Q | | DEBUG | true | | INSTALLER_TYPE | cntt | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | HTTP_DST_URL | http://artifacts.opnfv.org/cntt/5NN6HAWVHI0Q/cntt-opnfv-functest-smoke-cntt-latest-tempest_full-run-12 | | NODE_NAME | intel-pod15 | +-------------------------+----------------------------------------------------------------------------------------------------------------+ 2020-03-09 20:17:46,604 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file export OS_AUTH_URL=http://identity-airship.intel-pod15.opnfv.org/v3 export OS_USER_DOMAIN_NAME=default export OS_PROJECT_DOMAIN_NAME=default export OS_USERNAME=admin export OS_PROJECT_NAME=admin export OS_PASSWORD=password123 export OS_IDENTITY_API_VERSION=3 export OS_INTERFACE=public export OS_REGION_NAME=intel-pod15 2020-03-09 20:17:46,604 - xtesting.ci.run_tests - DEBUG - Test args: tempest_full 2020-03-09 20:17:46,656 - xtesting.ci.run_tests - INFO - Loading test case 'tempest_full'... 2020-03-09 20:17:47,645 - functest.core.tenantnetwork - DEBUG - password: pH^m7E-9finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 45b2d955-595d-4905-8fee-47355ff332a7 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-03-09 20:18:13,039 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-03-09 20:18:13,867 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Create verifier from existing repo... 2020-03-09 20:18:19,451 - functest.opnfv_tests.openstack.tempest.tempest - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide Using verifier 'opnfv-tempest' (UUID=71f35a3b-1483-4459-bfc2-19cecad4673b) as the default verifier for the future CLI operations. 2020-03-09 20:18:23,526 - functest.core.singlevm - DEBUG - image: Munch({'container_format': u'bare', 'min_ram': 0, 'locations': [], 'file': u'/v2/images/664aac26-d76c-4d83-9584-742f2c1002b9/file', 'owner': u'75cdc3a0d1d34bdcb49de372de4e8fdd', 'id': u'664aac26-d76c-4d83-9584-742f2c1002b9', 'size': 12716032, u'self': u'/v2/images/664aac26-d76c-4d83-9584-742f2c1002b9', 'disk_format': u'qcow2', 'protected': False, 'location': Munch({'project': Munch({'domain_id': None, 'id': u'75cdc3a0d1d34bdcb49de372de4e8fdd', 'name': 'tempest_full-project_d33c0255-3dfb-4c72-8261-1a549c12cee2', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), 'minRam': 0, 'direct_url': None, u'schema': u'/v2/schemas/image', 'status': u'active', 'updated': u'2020-03-09T20:18:23Z', 'tags': [], 'visibility': u'public', 'updated_at': u'2020-03-09T20:18:23Z', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'owner_specified.shade.object': u'images/tempest_full-img_alt_d33c0255-3dfb-4c72-8261-1a549c12cee2', 'min_disk': 0, 'is_public': True, 'virtual_size': 0, u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', 'properties': {u'self': u'/v2/images/664aac26-d76c-4d83-9584-742f2c1002b9', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/tempest_full-img_alt_d33c0255-3dfb-4c72-8261-1a549c12cee2', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}, 'name': u'tempest_full-img_alt_d33c0255-3dfb-4c72-8261-1a549c12cee2', 'created': u'2020-03-09T20:18:21Z', 'checksum': u'443b7623e27ecf03dc9e01ee93f67afe', 'created_at': u'2020-03-09T20:18:21Z', 'minDisk': 0, 'is_protected': False, 'metadata': {u'self': u'/v2/images/664aac26-d76c-4d83-9584-742f2c1002b9', u'owner_specified.shade.md5': u'443b7623e27ecf03dc9e01ee93f67afe', u'owner_specified.shade.object': u'images/tempest_full-img_alt_d33c0255-3dfb-4c72-8261-1a549c12cee2', u'owner_specified.shade.sha256': u'a8dd75ecffd4cdd96072d60c2237b448e0c8b2bc94d57f10fdbc8c481d9005b8', u'schema': u'/v2/schemas/image'}}) 2020-03-09 20:18:23,606 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'tempest_full-flavor_alt_d33c0255-3dfb-4c72-8261-1a549c12cee2', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'470b29175740455ab1a103d193728919', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'62dd014d-bd75-479f-8db7-0eb6b6ab4eab', 'swap': 0}) 2020-03-09 20:18:23,651 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - flavor: Munch({'name': u'tempest_full-flavor_alt_d33c0255-3dfb-4c72-8261-1a549c12cee2', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'470b29175740455ab1a103d193728919', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'62dd014d-bd75-479f-8db7-0eb6b6ab4eab', 'swap': 0}) 2020-03-09 20:18:26,715 - functest.opnfv_tests.openstack.tempest.tempest - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2020-03-09 20:18:26,715 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Looking for tempest.conf file... 2020-03-09 20:18:26,716 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Updating selected tempest.conf parameters... 2020-03-09 20:18:26,719 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2020-03-09 20:18:26,769 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2020-03-09 20:18:34,688 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-71f35a3b-1483-4459-bfc2-19cecad4673b/repo; stestr list '(?!.*test_fixed_ips)(?!.*test_fixed_ips_negative)(?!.*test_auto_allocate_network)(?!.*test_floating_ips_bulk)(?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_iscsi_volume)(?!.*test_live_migration.LiveAutoBlockMigrationV225Test.test_volume_backed_live_migration)(?!.*test_live_migration.LiveMigrationTest.test_iscsi_volume)(?!.*test_live_migration.LiveMigrationTest.test_volume_backed_live_migration)(?!.*test_live_migration.LiveMigrationRemoteConsolesV26Test)(?!.*certificates.test_certificates)(?!.*test_quotas_negative.QuotasSecurityGroupAdminNegativeTest)(?!.*test_novnc)(?!.*test_server_personality)(?!.*test_servers.ServerShowV263Test.test_show_update_rebuild_list_server)(?!.*test_servers_negative.ServersNegativeTestJSON.test_personality_file_contents_not_encoded)(?!.*servers.test_virtual_interfaces)(?!.*test_server_actions.ServerActionsTestJSON.test_change_server_password)(?!.*test_server_actions.ServerActionsTestJSON.test_get_vnc_console)(?!.*test_server_actions.ServerActionsTestJSON.test_reboot_server_soft)(?!.*test_security_group_default_rules)(?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_duplicate_name)(?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_invalid_group_description)(?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_security_group_create_with_invalid_group_name)(?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_des)(?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_id)(?!.*test_security_groups_negative.SecurityGroupsNegativeTestJSON.test_update_security_group_with_invalid_sg_name)(?!.*test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex)(?!.*compute.test_virtual_interfaces)(?!.*compute.test_virtual_interfaces_negative)(?!.*compute.test_networks)(?!.*test_attach_volume.AttachVolumeMultiAttach)(?!.*identity.admin.v2)(?!.*identity.v2)(?!.*image.v1)(?!.*admin.test_dhcp_agent_scheduler)(?!.*admin.test_routers_dvr)(?!.*test_metering_extensions)(?!.*network.test_tags)(?!.*test_routers_negative.DvrRoutersNegativeTest)(?!.*test_routers.RoutersIpV6Test.test_create_router_set_gateway_with_fixed_ip)(?!.*test_routers.RoutersTest.test_create_router_set_gateway_with_fixed_ip)(?!.*test_group_snapshots.GroupSnapshotsV319Test.test_reset_group_snapshot_status)(?!.*test_multi_backend)(?!.*test_volume_retype.VolumeRetypeWithMigrationTest)(?!.*test_volume_delete_cascade.VolumesDeleteCascade.test_volume_from_snapshot_cascade_delete)(?!.*test_volumes_backup.VolumesBackupsTest.test_volume_backup_create_get_detailed_list_restore_delete)(?!.*test_volumes_extend.VolumesExtendAttachedTest.test_extend_attached_volume)(?!.*\[.*\bslow\b.*\])(^tempest.api)' >/home/opnfv/functest/results/tempest_full/test_list.txt 2>/dev/null) 2020-03-09 20:18:34,688 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Applying tempest blacklist... 2020-03-09 20:18:34,697 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/tempest_full/test_list.txt', '--concurrency=4']'. 2020-03-09 21:59:21,616 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Verification UUID: 93fc3662-4d71-49ac-9a1b-4e983766c69c 2020-03-09 21:59:21,682 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', u'93fc3662-4d71-49ac-9a1b-4e983766c69c']'. 2020-03-09 21:59:22,820 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2020-03-09 21:59:22,821 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2020-03-09 21:59:22,821 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2020-03-09 21:59:22,821 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 93fc3662-4d71-49ac-9a1b-4e983766c69c | 2020-03-09 21:59:22,821 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | failed | 2020-03-09 21:59:22,822 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2020-03-09 20:18:36 | 2020-03-09 21:59:22,822 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2020-03-09 21:59:21 | 2020-03-09 21:59:22,822 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 1:40:45 | 2020-03-09 21:59:22,822 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | concurrency: 4 | 2020-03-09 21:59:22,822 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | | load_list: (value is too long, use 'detailed' flag to display it) | 2020-03-09 21:59:22,823 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2020-03-09 21:59:22,823 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: 71f35a3b-1483-4459-bfc2-19cecad4673b) | 2020-03-09 21:59:22,823 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2020-03-09 21:59:22,823 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 45b2d955-595d-4905-8fee-47355ff332a7) | 2020-03-09 21:59:22,823 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 1286 | 2020-03-09 21:59:22,824 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 6027.054 | 2020-03-09 21:59:22,824 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 1094 | 2020-03-09 21:59:22,824 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 3 | 2020-03-09 21:59:22,824 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2020-03-09 21:59:22,825 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2020-03-09 21:59:22,825 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 189 | 2020-03-09 21:59:22,825 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2020-03-09 21:59:22,825 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2020-03-09 21:59:22,825 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests | 2020-03-09 21:59:23,575 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest tempest_full success_rate is 85.2689010133% 2020-03-09 21:59:23,575 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'verify', 'report', '--type', 'html', '--uuid', u'93fc3662-4d71-49ac-9a1b-4e983766c69c', '--to', u'/home/opnfv/functest/results/tempest_full/tempest-report.html'] 2020-03-09 21:59:25,936 - functest.opnfv_tests.openstack.rally.rally - INFO - rally verify report --type html --uuid 93fc3662-4d71-49ac-9a1b-4e983766c69c --to /home/opnfv/functest/results/tempest_full/tempest-report.html Saving the report to '/home/opnfv/functest/results/tempest_full/tempest-report.html' file. It may take some time. The report has been successfully saved. 2020-03-09 21:59:25,937 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'verify', 'report', '--type', 'junit-xml', '--uuid', u'93fc3662-4d71-49ac-9a1b-4e983766c69c', '--to', u'/home/opnfv/functest/results/tempest_full/tempest-report.xml'] 2020-03-09 21:59:28,293 - functest.opnfv_tests.openstack.rally.rally - INFO - rally verify report --type junit-xml --uuid 93fc3662-4d71-49ac-9a1b-4e983766c69c --to /home/opnfv/functest/results/tempest_full/tempest-report.xml Saving the report to '/home/opnfv/functest/results/tempest_full/tempest-report.xml' file. It may take some time. The report has been successfully saved. 2020-03-09 21:59:28,294 - xtesting.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | tempest_full | functest | 101:39 | FAIL | +----------------------+------------------+------------------+----------------+ 2020-03-09 21:59:49,167 - functest.core.singlevm - DEBUG - Cleaning security group 8fe01247-1d7e-4152-bc16-1af4ceefad91 2020-03-09 21:59:52,264 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)