2020-11-28 15:34:26.793 6 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2020-11-28 15:34:26.794 6 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2020-11-28 15:34:26.794 6 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils [-] Unexpected exception in CLI: rally.exceptions.DBRecordNotFound: Record for uuid or name is opnfv-rally not found in table envs 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils Traceback (most recent call last): 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/cli/cliutils.py", line 674, in run 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils ret = fn(*fn_args, **fn_kwargs) 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils File "", line 2, in destroy 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/cli/envutils.py", line 68, in default_from_global 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils return f(*args, **kwargs) 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils File "", line 2, in destroy 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/plugins/__init__.py", line 51, in ensure_plugins_are_loaded 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils return f(*args, **kwargs) 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/cli/commands/deployment.py", line 157, in destroy 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils api.deployment.destroy(deployment=deployment) 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/api.py", line 115, in destroy 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils deploy = objects.Deployment.get(deployment) 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/common/objects/deploy.py", line 124, in get 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils return Deployment(env_mgr.EnvManager.get(deploy)) 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/env/env_mgr.py", line 212, in get 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils return cls(db.env_get(uuid_or_name)) 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/common/db/api.py", line 135, in wrapper 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils result = f(session, *args, **kwargs) 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/common/db/api.py", line 521, in env_get 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils criteria="uuid or name is %s" % uuid_or_name, table="envs") 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils rally.exceptions.DBRecordNotFound: Record for uuid or name is opnfv-rally not found in table envs 2020-11-28 15:34:28.738 6 ERROR rally.cli.cliutils 2020-11-28 15:34:30.125 8 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2020-11-28 15:34:30.125 8 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2020-11-28 15:34:30.125 8 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2020-11-28 15:34:33.625 10 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2020-11-28 15:34:33.625 10 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2020-11-28 15:34:33.625 10 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2020-11-28 15:34:38.777 13 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2020-11-28 15:34:38.777 13 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2020-11-28 15:34:38.777 13 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2020-11-28 15:34:40.039 15 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2020-11-28 15:34:40.039 15 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2020-11-28 15:34:40.039 15 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils [-] Unexpected exception in CLI: rally.exceptions.DBRecordNotFound: Record for name or uuid is opnfv-tempest not found in table verifiers 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils Traceback (most recent call last): 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/cli/cliutils.py", line 674, in run 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils ret = fn(*fn_args, **fn_kwargs) 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils File "", line 2, in delete_verifier 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/plugins/__init__.py", line 51, in ensure_plugins_are_loaded 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils return f(*args, **kwargs) 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/cli/commands/verify.py", line 242, in delete_verifier 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils force=force) 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/api.py", line 690, in delete 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils verifier = self._get(verifier_id) 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/api.py", line 664, in _get 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils return objects.Verifier.get(verifier_id) 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/common/objects/verifier.py", line 69, in get 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils return cls(db.verifier_get(verifier_id)) 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/common/db/api.py", line 135, in wrapper 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils result = f(session, *args, **kwargs) 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/common/db/api.py", line 669, in verifier_get 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils return _verifier_get(session, verifier_id) 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/common/db/api.py", line 679, in _verifier_get 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils criteria="name or uuid is %s" % verifier_id, table="verifiers") 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils rally.exceptions.DBRecordNotFound: Record for name or uuid is opnfv-tempest not found in table verifiers 2020-11-28 15:34:41.907 15 ERROR rally.cli.cliutils 2020-11-28 15:34:43.268 17 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2020-11-28 15:34:43.268 17 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2020-11-28 15:34:43.268 17 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2020-11-28 15:34:45.046 17 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2020-11-28 15:34:45.111 17 RALLYDEBUG rally.verification.manager [-] Cloning verifier repo from /src/tempest into /root/.rally/verification/verifier-dd706b80-b26f-4289-b784-4b0b3d531a81/repo. 2020-11-28 15:34:45.451 17 RALLYDEBUG rally.verification.utils [-] Subprocess output: 'Cloning into '/root/.rally/verification/verifier-dd706b80-b26f-4289-b784-4b0b3d531a81/repo'... done. Note: checking out 'a02e87556bc38156aa462a7e5ce3a814c060f2a9'. You are in 'detached HEAD' state. You can look around, make experimental changes and commit them, and you can discard any commits you make in this state without impacting any branches by performing another checkout. If you want to create a new branch to retain commits you create, you may do so (now or later) by using -b with the checkout command again. Example: git checkout -b ' 2020-11-28 15:34:45.465 17 RALLYDEBUG rally.verification.utils [-] Subprocess output: 'tags/21.0.0-1-ga02e87556 ' 2020-11-28 15:34:45.474 17 RALLYDEBUG rally.verification.utils [-] Subprocess output: 'a02e87556bc38156aa462a7e5ce3a814c060f2a9 ' 2020-11-28 15:34:45.495 17 RALLYDEBUG rally.verification.manager [-] Checking system-wide packages for verifier. 2020-11-28 15:34:45.540 17 RALLYDEBUG rally.plugins.common.verification.testr [-] Initializing testr. 2020-11-28 15:34:46.249 17 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=dd706b80-b26f-4289-b784-4b0b3d531a81) has been successfully created! 2020-11-28 15:34:47.624 25 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2020-11-28 15:34:47.624 25 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2020-11-28 15:34:47.624 25 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2020-11-28 15:34:53.531 28 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2020-11-28 15:34:53.532 28 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2020-11-28 15:34:53.532 28 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2020-11-28 15:34:55.373 28 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=dd706b80-b26f-4289-b784-4b0b3d531a81) for deployment 'opnfv-rally' (UUID=299120e9-9896-4a6e-8ed3-cf126a885b8c). 2020-11-28 15:34:56.228 28 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=dd706b80-b26f-4289-b784-4b0b3d531a81) has been successfully configured for deployment 'opnfv-rally' (UUID=299120e9-9896-4a6e-8ed3-cf126a885b8c)! 2020-11-28 15:35:03.312 32 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2020-11-28 15:35:03.312 32 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2020-11-28 15:35:03.313 32 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2020-11-28 15:35:05.237 32 INFO rally.api [-] Starting verification (UUID=5ab70ae1-8276-402a-b0a1-d315851f147a) for deployment 'opnfv-rally' (UUID=299120e9-9896-4a6e-8ed3-cf126a885b8c) by verifier 'opnfv-tempest' (UUID=dd706b80-b26f-4289-b784-4b0b3d531a81). 2020-11-28 15:35:06.342 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Creating role 'ResellerAdmin'. 2020-11-28 15:35:06.627 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Option 'log_file' from 'DEFAULT' section is not configured. 2020-11-28 15:35:06.627 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Setting value '/root/.rally/verification/verifier-dd706b80-b26f-4289-b784-4b0b3d531a81/for-deployment-299120e9-9896-4a6e-8ed3-cf126a885b8c/tempest.log' to option 'log_file'. 2020-11-28 15:35:06.628 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Option 'log_file' is configured. log_file = /root/.rally/verification/verifier-dd706b80-b26f-4289-b784-4b0b3d531a81/for-deployment-299120e9-9896-4a6e-8ed3-cf126a885b8c/tempest.log 2020-11-28 15:35:06.628 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Option 'lock_path' from 'oslo_concurrency' section is not configured. 2020-11-28 15:35:06.628 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Setting value '/root/.rally/verification/verifier-dd706b80-b26f-4289-b784-4b0b3d531a81/for-deployment-299120e9-9896-4a6e-8ed3-cf126a885b8c/lock_files' to option 'lock_path'. 2020-11-28 15:35:06.628 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Option 'lock_path' is configured. lock_path = /root/.rally/verification/verifier-dd706b80-b26f-4289-b784-4b0b3d531a81/for-deployment-299120e9-9896-4a6e-8ed3-cf126a885b8c/lock_files 2020-11-28 15:35:06.628 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Option 'img_dir' is already configured in Tempest config file. img_dir = /home/opnfv/functest/images 2020-11-28 15:35:06.629 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Option 'img_file' is already configured in Tempest config file. img_file = cirros-0.4.0-x86_64-disk.img 2020-11-28 15:35:06.629 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Option 'image_ref' is already configured in Tempest config file. image_ref = 2beaecca-286a-4856-939a-6aadacba25bc 2020-11-28 15:35:06.629 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Option 'image_ref_alt' is already configured in Tempest config file. image_ref_alt = b0d63138-87aa-4dee-a19c-c1f5d57b1862 2020-11-28 15:35:06.629 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Option 'flavor_ref' is already configured in Tempest config file. flavor_ref = b190b051-83b6-40c5-b8c9-39b77614350c 2020-11-28 15:35:06.630 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Option 'flavor_ref_alt' is already configured in Tempest config file. flavor_ref_alt = 1acbfeda-c657-4f94-bbfe-f61395ab7006 2020-11-28 15:35:06.860 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Shared networks found. 'fixed_network_name' option should be configured. 2020-11-28 15:35:06.860 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Option 'fixed_network_name' is already configured in Tempest config file. fixed_network_name = public 2020-11-28 15:35:06.860 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Option 'instance_type' from 'orchestration' section is not configured. 2020-11-28 15:35:06.923 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Trying to discover a flavor with the following properties: RAM = 64MB, VCPUs = 1, disk = 0GB. 2020-11-28 15:35:06.974 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] There is no flavor with the mentioned properties. 2020-11-28 15:35:06.975 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Creating flavor 'rally_verify_5ab70ae1_KVewW6rW' with the following properties: RAM = 64MB, VCPUs = 1, disk = 0GB. 2020-11-28 15:35:07.394 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Flavor 'rally_verify_5ab70ae1_KVewW6rW' (ID = ac5ccccf-634b-40f8-9a45-6fd4ad7341cd) has been successfully created! 2020-11-28 15:35:07.395 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Setting value 'ac5ccccf-634b-40f8-9a45-6fd4ad7341cd' to option 'instance_type'. 2020-11-28 15:35:07.395 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Option 'instance_type' is configured. instance_type = ac5ccccf-634b-40f8-9a45-6fd4ad7341cd 2020-11-28 15:35:07.397 32 INFO rally.task.context [-] Verification dd706b80-b26f-4289-b784-4b0b3d531a81 | Context tempest@default setup() finished in 1.54 sec 2020-11-28 15:35:07.398 32 INFO rally.task.context [-] Verification dd706b80-b26f-4289-b784-4b0b3d531a81 | Context testr@default setup() finished in 0.45 msec 2020-11-28 15:35:07.399 32 RALLYDEBUG rally.plugins.common.verification.testr [-] Test(s) started by the command: 'stestr run --subunit --concurrency 4 --load-list /tmp/374fd4e8-9174-47bd-8340-6a9a7375a38f'. 2020-11-28 15:35:12.660 32 INFO opnfv-tempest [-] {3} keystone_tempest_plugin.tests.scenario.test_federated_authentication.TestSaml2EcpFederatedAuthentication.test_request_scoped_token ... skip [0.000s]: b'Federated Identity feature not enabled' 2020-11-28 15:35:12.662 32 INFO opnfv-tempest [-] {3} keystone_tempest_plugin.tests.scenario.test_federated_authentication.TestSaml2EcpFederatedAuthentication.test_request_unscoped_token ... skip [0.000s]: b'Federated Identity feature not enabled' 2020-11-28 15:35:13.427 32 INFO opnfv-tempest [-] {1} keystone_tempest_plugin.tests.api.identity.v3.test_service_providers.ServiceProvidersTest.test_service_provider_create ... success [1.182s] 2020-11-28 15:35:13.515 32 INFO opnfv-tempest [-] {1} keystone_tempest_plugin.tests.api.identity.v3.test_service_providers.ServiceProvidersTest.test_service_provider_create_with_bad_attributes ... success [0.088s] 2020-11-28 15:35:13.586 32 INFO opnfv-tempest [-] {0} keystone_tempest_plugin.tests.api.identity.v3.test_mapping_rules.MappingRulesTest.test_mapping_rule_update ... success [1.364s] 2020-11-28 15:35:13.654 32 INFO opnfv-tempest [-] {1} keystone_tempest_plugin.tests.api.identity.v3.test_service_providers.ServiceProvidersTest.test_service_provider_create_with_enabled_true ... success [0.138s] 2020-11-28 15:35:13.685 32 INFO opnfv-tempest [-] {0} keystone_tempest_plugin.tests.api.identity.v3.test_mapping_rules.MappingRulesTest.test_mapping_rules_create ... success [0.100s] 2020-11-28 15:35:13.729 32 INFO opnfv-tempest [-] {0} keystone_tempest_plugin.tests.api.identity.v3.test_mapping_rules.MappingRulesTest.test_mapping_rules_create_without_mandatory_attributes_fails ... success [0.043s] 2020-11-28 15:35:14.029 32 INFO opnfv-tempest [-] {1} keystone_tempest_plugin.tests.api.identity.v3.test_service_providers.ServiceProvidersTest.test_service_provider_create_with_relay_state_prefix ... success [0.374s] 2020-11-28 15:35:14.079 32 INFO opnfv-tempest [-] {1} keystone_tempest_plugin.tests.api.identity.v3.test_service_providers.ServiceProvidersTest.test_service_provider_create_without_mandatory_attributes ... success [0.049s] 2020-11-28 15:35:14.120 32 INFO opnfv-tempest [-] {0} keystone_tempest_plugin.tests.api.identity.v3.test_mapping_rules.MappingRulesTest.test_mapping_rules_get ... success [0.390s] 2020-11-28 15:35:15.214 32 INFO opnfv-tempest [-] {2} keystone_tempest_plugin.tests.api.identity.v3.test_identity_providers.IndentityProvidersTest.test_add_protocol_to_identity_provider ... success [3.089s] 2020-11-28 15:35:15.555 32 INFO opnfv-tempest [-] {1} keystone_tempest_plugin.tests.api.identity.v3.test_service_providers.ServiceProvidersTest.test_service_provider_get ... success [1.476s] 2020-11-28 15:35:17.823 32 INFO opnfv-tempest [-] {0} keystone_tempest_plugin.tests.api.identity.v3.test_mapping_rules.MappingRulesTest.test_mapping_rules_list ... success [3.701s] 2020-11-28 15:35:18.044 32 INFO opnfv-tempest [-] {2} keystone_tempest_plugin.tests.api.identity.v3.test_identity_providers.IndentityProvidersTest.test_add_protocol_to_identity_provider_unknown_mapping ... success [2.830s] 2020-11-28 15:35:19.621 32 INFO opnfv-tempest [-] {1} keystone_tempest_plugin.tests.api.identity.v3.test_service_providers.ServiceProvidersTest.test_service_provider_list ... success [4.064s] 2020-11-28 15:35:20.727 32 INFO opnfv-tempest [-] {1} keystone_tempest_plugin.tests.api.identity.v3.test_service_providers.ServiceProvidersTest.test_service_provider_update ... success [1.106s] 2020-11-28 15:35:21.715 32 INFO opnfv-tempest [-] {0} keystone_tempest_plugin.tests.api.identity.v3.test_oauth1_tokens.OAUTH1TokensTest.test_authorize_request_token ... success [3.139s] 2020-11-28 15:35:22.153 32 INFO opnfv-tempest [-] {1} keystone_tempest_plugin.tests.api.identity.v3.test_service_providers.ServiceProvidersTest.test_service_provider_update_with_bad_attributes_fails ... success [1.425s] 2020-11-28 15:35:23.542 32 INFO opnfv-tempest [-] {2} keystone_tempest_plugin.tests.api.identity.v3.test_identity_providers.IndentityProvidersTest.test_get_protocol_from_identity_provider ... success [5.497s] 2020-11-28 15:35:25.502 32 INFO opnfv-tempest [-] {0} keystone_tempest_plugin.tests.api.identity.v3.test_oauth1_tokens.OAUTH1TokensTest.test_create_access_token ... success [3.786s] 2020-11-28 15:35:25.519 32 INFO opnfv-tempest [-] {1} keystone_tempest_plugin.tests.api.identity.v3.test_service_providers.ServiceProvidersTest.test_service_providers_in_token ... success [3.364s] 2020-11-28 15:35:26.827 32 INFO opnfv-tempest [-] {2} keystone_tempest_plugin.tests.api.identity.v3.test_identity_providers.IndentityProvidersTest.test_identity_provider_create ... success [3.284s] 2020-11-28 15:35:28.597 32 INFO opnfv-tempest [-] {0} keystone_tempest_plugin.tests.api.identity.v3.test_oauth1_tokens.OAUTH1TokensTest.test_create_and_show_consumer ... success [3.095s] 2020-11-28 15:35:30.419 32 INFO opnfv-tempest [-] {0} keystone_tempest_plugin.tests.api.identity.v3.test_oauth1_tokens.OAUTH1TokensTest.test_create_request_token ... success [1.821s] 2020-11-28 15:35:30.506 32 INFO opnfv-tempest [-] {2} keystone_tempest_plugin.tests.api.identity.v3.test_identity_providers.IndentityProvidersTest.test_identity_provider_create_with_enabled_true ... success [3.679s] 2020-11-28 15:35:32.546 32 INFO opnfv-tempest [-] {0} keystone_tempest_plugin.tests.api.identity.v3.test_oauth1_tokens.OAUTH1TokensTest.test_delete_consumer ... success [2.126s] 2020-11-28 15:35:33.242 32 INFO opnfv-tempest [-] {2} keystone_tempest_plugin.tests.api.identity.v3.test_identity_providers.IndentityProvidersTest.test_identity_provider_create_with_remote_ids ... success [2.734s] 2020-11-28 15:35:35.722 32 INFO opnfv-tempest [-] {2} keystone_tempest_plugin.tests.api.identity.v3.test_identity_providers.IndentityProvidersTest.test_identity_provider_get ... success [2.480s] 2020-11-28 15:35:37.364 32 INFO opnfv-tempest [-] {0} keystone_tempest_plugin.tests.api.identity.v3.test_oauth1_tokens.OAUTH1TokensTest.test_list_access_tokens ... success [4.816s] 2020-11-28 15:35:40.288 32 INFO opnfv-tempest [-] {0} keystone_tempest_plugin.tests.api.identity.v3.test_oauth1_tokens.OAUTH1TokensTest.test_list_consumers ... success [2.924s] 2020-11-28 15:35:42.116 32 INFO opnfv-tempest [-] {2} keystone_tempest_plugin.tests.api.identity.v3.test_identity_providers.IndentityProvidersTest.test_identity_provider_list ... success [6.392s] 2020-11-28 15:35:42.301 32 INFO opnfv-tempest [-] {0} keystone_tempest_plugin.tests.api.identity.v3.test_oauth1_tokens.OAUTH1TokensTest.test_list_roles_for_access_token ... success [2.011s] 2020-11-28 15:35:46.707 32 INFO opnfv-tempest [-] {0} keystone_tempest_plugin.tests.api.identity.v3.test_oauth1_tokens.OAUTH1TokensTest.test_revoke_access_token ... success [4.405s] 2020-11-28 15:35:46.743 32 INFO opnfv-tempest [-] {2} keystone_tempest_plugin.tests.api.identity.v3.test_identity_providers.IndentityProvidersTest.test_identity_provider_update ... success [4.627s] 2020-11-28 15:35:47.776 32 INFO opnfv-tempest [-] {0} keystone_tempest_plugin.tests.api.identity.v3.test_oauth1_tokens.OAUTH1TokensTest.test_show_role_for_access_token ... success [1.068s] 2020-11-28 15:35:48.319 32 INFO opnfv-tempest [-] {0} keystone_tempest_plugin.tests.api.identity.v3.test_oauth1_tokens.OAUTH1TokensTest.test_update_consumer ... success [0.544s] 2020-11-28 15:35:48.885 32 INFO opnfv-tempest [-] {2} keystone_tempest_plugin.tests.api.identity.v3.test_identity_providers.IndentityProvidersTest.test_list_protocols_from_identity_provider ... success [2.140s] 2020-11-28 15:35:52.050 32 INFO opnfv-tempest [-] {2} keystone_tempest_plugin.tests.api.identity.v3.test_identity_providers.IndentityProvidersTest.test_update_mapping_from_identity_provider_protocol ... success [3.164s] 2020-11-28 15:35:54.584 32 INFO opnfv-tempest [-] {2} keystone_tempest_plugin.tests.api.identity.v3.test_identity_providers.IndentityProvidersTest.test_update_protocol_from_identity_provider_unknown_mapping ... success [2.533s] 2020-11-28 15:35:54.807 32 INFO rally.task.context [-] Verification dd706b80-b26f-4289-b784-4b0b3d531a81 | Context testr@default cleanup() started 2020-11-28 15:35:54.807 32 INFO rally.task.context [-] Verification dd706b80-b26f-4289-b784-4b0b3d531a81 | Context testr@default cleanup() finished in 0.81 msec 2020-11-28 15:35:54.808 32 INFO rally.task.context [-] Verification dd706b80-b26f-4289-b784-4b0b3d531a81 | Context tempest@default cleanup() started 2020-11-28 15:35:55.420 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Deleting role 'ResellerAdmin'. 2020-11-28 15:35:56.038 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Role 'ResellerAdmin' has been deleted. 2020-11-28 15:35:56.069 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Deleting flavor 'rally_verify_5ab70ae1_KVewW6rW'. 2020-11-28 15:35:56.497 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Flavor 'rally_verify_5ab70ae1_KVewW6rW' has been deleted. 2020-11-28 15:35:56.498 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Removing value 'ac5ccccf-634b-40f8-9a45-6fd4ad7341cd' of option 'instance_type' from Tempest config file. 2020-11-28 15:35:56.498 32 RALLYDEBUG rally_openstack.verification.tempest.context [-] Value 'ac5ccccf-634b-40f8-9a45-6fd4ad7341cd' has been removed. 2020-11-28 15:35:56.507 32 INFO rally.task.context [-] Verification dd706b80-b26f-4289-b784-4b0b3d531a81 | Context tempest@default cleanup() finished in 1.70 sec 2020-11-28 15:35:56.530 32 INFO rally.api [-] Verification (UUID=5ab70ae1-8276-402a-b0a1-d315851f147a) has been successfully finished for deployment 'opnfv-rally' (UUID=299120e9-9896-4a6e-8ed3-cf126a885b8c)! 2020-11-28 15:35:58.048 43 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2020-11-28 15:35:58.049 43 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2020-11-28 15:35:58.049 43 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2020-11-28 15:35:59.406 44 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2020-11-28 15:35:59.407 44 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2020-11-28 15:35:59.407 44 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2020-11-28 15:36:01.212 44 INFO rally.api [-] Building 'html' report for the following verification(s): '5ab70ae1-8276-402a-b0a1-d315851f147a' 2020-11-28 15:36:01.243 44 INFO rally.api [-] The report has been successfully built. 2020-11-28 15:36:02.636 46 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2020-11-28 15:36:02.637 46 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2020-11-28 15:36:02.637 46 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2020-11-28 15:36:04.515 46 INFO rally.api [-] Building 'junit-xml' report for the following verification(s): '5ab70ae1-8276-402a-b0a1-d315851f147a' 2020-11-28 15:36:04.521 46 INFO rally.api [-] The report has been successfully built.