2021-04-29 13:59:17.664 6 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 13:59:17.664 6 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 13:59:17.664 6 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils [-] Unexpected exception in CLI: rally.exceptions.DBRecordNotFound: Record for uuid or name is opnfv-rally not found in table envs 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils Traceback (most recent call last): 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/cli/cliutils.py", line 674, in run 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils ret = fn(*fn_args, **fn_kwargs) 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils File "", line 2, in destroy 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/cli/envutils.py", line 68, in default_from_global 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils return f(*args, **kwargs) 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils File "", line 2, in destroy 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/plugins/__init__.py", line 51, in ensure_plugins_are_loaded 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils return f(*args, **kwargs) 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/cli/commands/deployment.py", line 157, in destroy 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils api.deployment.destroy(deployment=deployment) 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/api.py", line 115, in destroy 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils deploy = objects.Deployment.get(deployment) 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/common/objects/deploy.py", line 124, in get 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils return Deployment(env_mgr.EnvManager.get(deploy)) 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/env/env_mgr.py", line 212, in get 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils return cls(db.env_get(uuid_or_name)) 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/common/db/api.py", line 135, in wrapper 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils result = f(session, *args, **kwargs) 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils File "/usr/lib/python3.6/site-packages/rally/common/db/api.py", line 521, in env_get 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils criteria="uuid or name is %s" % uuid_or_name, table="envs") 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils rally.exceptions.DBRecordNotFound: Record for uuid or name is opnfv-rally not found in table envs 2021-04-29 13:59:19.491 6 ERROR rally.cli.cliutils 2021-04-29 13:59:20.783 8 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 13:59:20.783 8 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 13:59:20.783 8 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 13:59:24.226 10 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 13:59:24.226 10 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 13:59:24.227 10 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 13:59:29.161 13 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 13:59:29.161 13 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 13:59:29.162 13 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 13:59:57.239 15 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 13:59:57.239 15 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 13:59:57.239 15 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 13:59:59.135 15 INFO rally.task.engine [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Starting: Task validation. 2021-04-29 13:59:59.148 15 INFO rally.task.engine [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Starting: Task validation of syntax. 2021-04-29 13:59:59.207 15 INFO rally.task.engine [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Completed: Task validation of syntax. 2021-04-29 13:59:59.208 15 INFO rally.task.engine [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Starting: Task validation of required platforms. 2021-04-29 13:59:59.250 15 INFO rally.task.engine [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Completed: Task validation of required platforms. 2021-04-29 13:59:59.251 15 INFO rally.task.engine [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Starting: Task validation of semantic. 2021-04-29 13:59:59.251 15 INFO rally.task.engine [-] Check health of the environment '475eaff9-f5cd-46ab-8b1c-6c36dbc836ee'. 2021-04-29 14:00:00.641 15 INFO rally.task.engine [-] Platform existing@openstack (available: True): OK! 2021-04-29 14:00:00.657 15 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 1 tenants using 20 threads 2021-04-29 14:00:12.541 15 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 1 users using 20 threads 2021-04-29 14:00:28.648 15 INFO rally.task.context [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Context users@openstack setup() finished in 27.99 sec 2021-04-29 14:00:28.705 15 INFO rally.task.context [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Context users@openstack cleanup() started 2021-04-29 14:01:02.338 15 INFO rally.task.context [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Context users@openstack cleanup() finished in 33.63 sec 2021-04-29 14:01:02.339 15 INFO rally.task.engine [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Completed: Task validation of semantic. 2021-04-29 14:01:02.339 15 INFO rally.task.engine [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Completed: Task validation. 2021-04-29 14:01:02.340 15 INFO rally.api [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc input file is valid. 2021-04-29 14:01:02.340 15 INFO rally.api [-] Run Task 646f92ba-234b-483d-8b54-4ff0c46860bc against Deployment 475eaff9-f5cd-46ab-8b1c-6c36dbc836ee 2021-04-29 14:01:02.341 15 INFO rally.task.engine [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Starting: Running task. 2021-04-29 14:01:02.393 15 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=18f3eae2-8d07-4a21-8ead-e08fd1cceb51)", "subtasks": [ { "title": "Authenticate.keystone", "description": "Check Keystone Client.", "scenario": { "Authenticate.keystone": {} }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 14:01:02.406 15 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 14:01:18.518 15 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 14:01:53.203 15 INFO rally.task.context [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Context users@openstack setup() finished in 50.80 sec 2021-04-29 14:01:53.207 15 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: 646f92ba-234b-483d-8b54-4ff0c46860bc). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 14:01:53.210 15 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 14:01:53.211 15 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 14:01:53.212 15 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 14:01:53.213 15 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 14:01:53.222 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 1 START 2021-04-29 14:01:53.238 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 2 START 2021-04-29 14:01:53.243 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 3 START 2021-04-29 14:01:53.249 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 4 START 2021-04-29 14:01:54.201 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 1 END: OK 2021-04-29 14:01:54.208 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 5 START 2021-04-29 14:01:54.541 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 3 END: OK 2021-04-29 14:01:54.547 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 6 START 2021-04-29 14:01:55.189 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 5 END: OK 2021-04-29 14:01:55.195 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 7 START 2021-04-29 14:01:55.207 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 4 END: OK 2021-04-29 14:01:55.218 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 8 START 2021-04-29 14:01:55.690 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 2 END: OK 2021-04-29 14:01:55.700 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 6 END: OK 2021-04-29 14:01:55.705 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 9 START 2021-04-29 14:01:55.713 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 10 START 2021-04-29 14:01:55.999 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 8 END: OK 2021-04-29 14:01:56.080 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 7 END: OK 2021-04-29 14:01:56.796 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 10 END: OK 2021-04-29 14:01:57.144 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 9 END: OK 2021-04-29 14:01:57.162 15 INFO rally.task.context [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Context users@openstack cleanup() started 2021-04-29 14:03:54.172 15 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find user: cb0ab53c19804b64a9fd75323a966db2. (HTTP 404) (Request-ID: req-390f63e0-55c0-4e33-b3d8-7145fc4e622a) 2021-04-29 14:03:54.172 15 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 14:03:54.172 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 14:03:54.172 15 ERROR rally.common.broker consume(cache, args) 2021-04-29 14:03:54.172 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 14:03:54.172 15 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 14:03:54.172 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 14:03:54.172 15 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 14:03:54.172 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 14:03:54.172 15 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 14:03:54.172 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 14:03:54.172 15 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 14:03:54.172 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 14:03:54.172 15 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 14:03:54.172 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 14:03:54.172 15 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 14:03:54.172 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 14:03:54.172 15 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 14:03:54.172 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 14:03:54.172 15 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 14:03:54.172 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 14:03:54.172 15 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 14:03:54.172 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 14:03:54.172 15 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 14:03:54.172 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 14:03:54.172 15 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 14:03:54.172 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 14:03:54.172 15 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 14:03:54.172 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 14:03:54.172 15 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 14:03:54.172 15 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find user: cb0ab53c19804b64a9fd75323a966db2. (HTTP 404) (Request-ID: req-390f63e0-55c0-4e33-b3d8-7145fc4e622a) 2021-04-29 14:03:54.172 15 ERROR rally.common.broker 2021-04-29 14:04:37.844 15 INFO rally.task.context [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Context users@openstack cleanup() finished in 2.68 min 2021-04-29 14:04:39.271 15 INFO rally.task.engine [-] Load duration is: 3.92205 2021-04-29 14:04:39.272 15 INFO rally.task.engine [-] Full runner duration is: 3.954749 2021-04-29 14:04:39.272 15 INFO rally.task.engine [-] Full duration is: 215.438277 2021-04-29 14:04:39.353 15 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=ca1a0ec0-b87f-4226-9c8c-c4846c0d76e4)", "subtasks": [ { "title": "Authenticate.validate_cinder", "description": "Check Cinder Client to ensure validation of token.", "scenario": { "Authenticate.validate_cinder": { "repetitions": 2 } }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 14:04:39.369 15 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 14:04:53.581 15 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 14:05:39.827 15 INFO rally.task.context [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Context users@openstack setup() finished in 1.01 min 2021-04-29 14:05:39.838 15 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: 646f92ba-234b-483d-8b54-4ff0c46860bc). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 14:05:39.840 15 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"repetitions": 2} 2021-04-29 14:05:39.842 15 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"repetitions": 2} 2021-04-29 14:05:39.849 15 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"repetitions": 2} 2021-04-29 14:05:39.853 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 1 START 2021-04-29 14:05:39.856 15 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"repetitions": 2} 2021-04-29 14:05:39.861 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 2 START 2021-04-29 14:05:39.866 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 3 START 2021-04-29 14:05:39.869 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 4 START 2021-04-29 14:05:40.985 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 1 END: OK 2021-04-29 14:05:40.991 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 5 START 2021-04-29 14:05:41.025 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 4 END: OK 2021-04-29 14:05:41.030 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 6 START 2021-04-29 14:05:41.333 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 3 END: OK 2021-04-29 14:05:41.338 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 7 START 2021-04-29 14:05:41.655 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 5 END: OK 2021-04-29 14:05:41.659 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 8 START 2021-04-29 14:05:42.027 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 2 END: OK 2021-04-29 14:05:42.031 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 9 START 2021-04-29 14:05:42.678 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 9 END: OK 2021-04-29 14:05:42.682 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 10 START 2021-04-29 14:05:42.994 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 6 END: OK 2021-04-29 14:05:43.047 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 7 END: OK 2021-04-29 14:05:43.324 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 8 END: OK 2021-04-29 14:05:43.336 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 10 END: OK 2021-04-29 14:05:43.348 15 INFO rally.task.context [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Context users@openstack cleanup() started 2021-04-29 14:07:20.672 15 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find user: 7533e751f53f40c3a283a156e85f0da4. (HTTP 404) (Request-ID: req-71441d99-d220-4072-b73a-c043bd593a50) 2021-04-29 14:07:20.672 15 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 14:07:20.672 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 14:07:20.672 15 ERROR rally.common.broker consume(cache, args) 2021-04-29 14:07:20.672 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 14:07:20.672 15 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 14:07:20.672 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 14:07:20.672 15 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 14:07:20.672 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 14:07:20.672 15 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 14:07:20.672 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 14:07:20.672 15 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 14:07:20.672 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 14:07:20.672 15 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 14:07:20.672 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 14:07:20.672 15 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 14:07:20.672 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 14:07:20.672 15 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 14:07:20.672 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 14:07:20.672 15 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 14:07:20.672 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 14:07:20.672 15 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 14:07:20.672 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 14:07:20.672 15 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 14:07:20.672 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 14:07:20.672 15 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 14:07:20.672 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 14:07:20.672 15 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 14:07:20.672 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 14:07:20.672 15 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 14:07:20.672 15 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find user: 7533e751f53f40c3a283a156e85f0da4. (HTTP 404) (Request-ID: req-71441d99-d220-4072-b73a-c043bd593a50) 2021-04-29 14:07:20.672 15 ERROR rally.common.broker 2021-04-29 14:08:25.077 15 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find user: 2fb98aee87084633b156638bd60582b4. (HTTP 404) (Request-ID: req-9264d634-dfde-4aff-aebb-55f77b634b9c) 2021-04-29 14:08:25.077 15 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 14:08:25.077 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 14:08:25.077 15 ERROR rally.common.broker consume(cache, args) 2021-04-29 14:08:25.077 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 14:08:25.077 15 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 14:08:25.077 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 14:08:25.077 15 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 14:08:25.077 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 14:08:25.077 15 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 14:08:25.077 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 14:08:25.077 15 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 14:08:25.077 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 14:08:25.077 15 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 14:08:25.077 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 14:08:25.077 15 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 14:08:25.077 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 14:08:25.077 15 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 14:08:25.077 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 14:08:25.077 15 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 14:08:25.077 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 14:08:25.077 15 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 14:08:25.077 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 14:08:25.077 15 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 14:08:25.077 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 14:08:25.077 15 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 14:08:25.077 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 14:08:25.077 15 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 14:08:25.077 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 14:08:25.077 15 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 14:08:25.077 15 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find user: 2fb98aee87084633b156638bd60582b4. (HTTP 404) (Request-ID: req-9264d634-dfde-4aff-aebb-55f77b634b9c) 2021-04-29 14:08:25.077 15 ERROR rally.common.broker 2021-04-29 14:08:25.139 15 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find user: ca207733fbf3403bb692b4e8d9f10c69. (HTTP 404) (Request-ID: req-04c0b07e-44dc-47ad-bf17-30bb1881d700) 2021-04-29 14:08:25.139 15 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 14:08:25.139 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 14:08:25.139 15 ERROR rally.common.broker consume(cache, args) 2021-04-29 14:08:25.139 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 14:08:25.139 15 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 14:08:25.139 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 14:08:25.139 15 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 14:08:25.139 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 14:08:25.139 15 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 14:08:25.139 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 14:08:25.139 15 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 14:08:25.139 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 14:08:25.139 15 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 14:08:25.139 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 14:08:25.139 15 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 14:08:25.139 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 14:08:25.139 15 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 14:08:25.139 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 14:08:25.139 15 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 14:08:25.139 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 14:08:25.139 15 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 14:08:25.139 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 14:08:25.139 15 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 14:08:25.139 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 14:08:25.139 15 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 14:08:25.139 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 14:08:25.139 15 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 14:08:25.139 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 14:08:25.139 15 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 14:08:25.139 15 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find user: ca207733fbf3403bb692b4e8d9f10c69. (HTTP 404) (Request-ID: req-04c0b07e-44dc-47ad-bf17-30bb1881d700) 2021-04-29 14:08:25.139 15 ERROR rally.common.broker 2021-04-29 14:10:00.609 15 INFO rally.task.context [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Context users@openstack cleanup() finished in 4.29 min 2021-04-29 14:10:02.611 15 INFO rally.task.engine [-] Load duration is: 3.481599 2021-04-29 14:10:02.611 15 INFO rally.task.engine [-] Full runner duration is: 3.510514 2021-04-29 14:10:02.612 15 INFO rally.task.engine [-] Full duration is: 321.241811 2021-04-29 14:10:02.694 15 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=339ab939-e8dd-4c94-b19b-a79ad9673045)", "subtasks": [ { "title": "Authenticate.validate_glance", "description": "Check Glance Client to ensure validation of token.", "scenario": { "Authenticate.validate_glance": { "repetitions": 2 } }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 14:10:02.714 15 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 14:10:13.377 15 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.BadGateway: Bad Gateway (HTTP 502) 2021-04-29 14:10:13.377 15 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 14:10:13.377 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 14:10:13.377 15 ERROR rally.common.broker consume(cache, args) 2021-04-29 14:10:13.377 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 180, in consume 2021-04-29 14:10:13.377 15 ERROR rally.common.broker tenant = cache["client"].create_project(domain_name=domain) 2021-04-29 14:10:13.377 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 14:10:13.377 15 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 14:10:13.377 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 41, in create_project 2021-04-29 14:10:13.377 15 ERROR rally.common.broker domain_name=domain_name) 2021-04-29 14:10:13.377 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 14:10:13.377 15 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 14:10:13.377 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_v3.py", line 243, in create_project 2021-04-29 14:10:13.377 15 ERROR rally.common.broker domain_name=domain_name) 2021-04-29 14:10:13.377 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 14:10:13.377 15 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 14:10:13.377 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 14:10:13.377 15 ERROR rally.common.broker f = func(self, *args, **kwargs) 2021-04-29 14:10:13.377 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_v3.py", line 52, in create_project 2021-04-29 14:10:13.377 15 ERROR rally.common.broker domain=domain_id) 2021-04-29 14:10:13.377 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/projects.py", line 113, in create 2021-04-29 14:10:13.377 15 ERROR rally.common.broker **kwargs) 2021-04-29 14:10:13.377 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 14:10:13.377 15 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 14:10:13.377 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 386, in create 2021-04-29 14:10:13.377 15 ERROR rally.common.broker self.key) 2021-04-29 14:10:13.377 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 192, in _post 2021-04-29 14:10:13.377 15 ERROR rally.common.broker resp, body = self.client.post(url, body=body, **kwargs) 2021-04-29 14:10:13.377 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post 2021-04-29 14:10:13.377 15 ERROR rally.common.broker return self.request(url, 'POST', **kwargs) 2021-04-29 14:10:13.377 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 14:10:13.377 15 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 14:10:13.377 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 14:10:13.377 15 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 14:10:13.377 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 14:10:13.377 15 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 14:10:13.377 15 ERROR rally.common.broker keystoneauth1.exceptions.http.BadGateway: Bad Gateway (HTTP 502) 2021-04-29 14:10:13.377 15 ERROR rally.common.broker 2021-04-29 14:10:22.010 15 INFO rally.task.context [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Context users@openstack cleanup() started 2021-04-29 14:10:52.912 15 INFO rally.task.context [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Context users@openstack cleanup() finished in 30.90 sec 2021-04-29 14:10:53.018 15 INFO rally.task.engine [-] Load duration is: 0.0 2021-04-29 14:10:53.018 15 INFO rally.task.engine [-] Full runner duration is: 0.0 2021-04-29 14:10:53.019 15 INFO rally.task.engine [-] Full duration is: 50.199313 2021-04-29 14:10:53.041 15 ERROR rally.task.engine [-] Unexpected exception during the workload execution: rally.exceptions.ContextSetupFailure: Unable to setup context 'users': 'Failed to create the requested number of tenants.' 2021-04-29 14:10:53.041 15 ERROR rally.task.engine Traceback (most recent call last): 2021-04-29 14:10:53.041 15 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally/task/engine.py", line 513, in _run_workload 2021-04-29 14:10:53.041 15 ERROR rally.task.engine with ctx_manager: 2021-04-29 14:10:53.041 15 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally/task/context.py", line 311, in __enter__ 2021-04-29 14:10:53.041 15 ERROR rally.task.engine self.setup() 2021-04-29 14:10:53.041 15 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally/task/context.py", line 256, in setup 2021-04-29 14:10:53.041 15 ERROR rally.task.engine ctx.setup() 2021-04-29 14:10:53.041 15 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 334, in setup 2021-04-29 14:10:53.041 15 ERROR rally.task.engine self.create_users() 2021-04-29 14:10:53.041 15 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 286, in create_users 2021-04-29 14:10:53.041 15 ERROR rally.task.engine msg="Failed to create the requested number of tenants.") 2021-04-29 14:10:53.041 15 ERROR rally.task.engine rally.exceptions.ContextSetupFailure: Unable to setup context 'users': 'Failed to create the requested number of tenants.' 2021-04-29 14:10:53.041 15 ERROR rally.task.engine 2021-04-29 14:10:53.083 15 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=26b526bf-3975-407d-a1fa-f1d0ede60d59)", "subtasks": [ { "title": "Authenticate.validate_heat", "description": "Check Heat Client to ensure validation of token.", "scenario": { "Authenticate.validate_heat": { "repetitions": 2 } }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 14:10:53.096 15 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 14:11:29.840 15 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 14:12:32.040 15 INFO rally.task.context [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Context users@openstack setup() finished in 1.65 min 2021-04-29 14:12:32.052 15 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: 646f92ba-234b-483d-8b54-4ff0c46860bc). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 14:12:32.054 15 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"repetitions": 2} 2021-04-29 14:12:32.055 15 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"repetitions": 2} 2021-04-29 14:12:32.063 15 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"repetitions": 2} 2021-04-29 14:12:32.067 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 1 START 2021-04-29 14:12:32.069 15 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"repetitions": 2} 2021-04-29 14:12:32.074 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 2 START 2021-04-29 14:12:32.075 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 3 START 2021-04-29 14:12:32.076 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 4 START 2021-04-29 14:12:33.067 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 3 END: OK 2021-04-29 14:12:33.073 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 5 START 2021-04-29 14:12:33.269 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 2 END: OK 2021-04-29 14:12:33.273 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 6 START 2021-04-29 14:12:33.426 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 4 END: OK 2021-04-29 14:12:33.431 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 7 START 2021-04-29 14:12:33.871 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 1 END: OK 2021-04-29 14:12:33.876 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 8 START 2021-04-29 14:12:33.882 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 5 END: OK 2021-04-29 14:12:33.888 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 9 START 2021-04-29 14:12:34.282 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 6 END: OK 2021-04-29 14:12:34.286 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 10 START 2021-04-29 14:12:34.323 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 7 END: OK 2021-04-29 14:12:34.645 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 9 END: OK 2021-04-29 14:12:34.863 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 8 END: OK 2021-04-29 14:12:34.900 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 10 END: OK 2021-04-29 14:12:34.918 15 INFO rally.task.context [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Context users@openstack cleanup() started 2021-04-29 14:14:24.306 15 INFO rally.task.context [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Context users@openstack cleanup() finished in 1.82 min 2021-04-29 14:14:25.926 15 INFO rally.task.engine [-] Load duration is: 2.831736 2021-04-29 14:14:25.927 15 INFO rally.task.engine [-] Full runner duration is: 2.866661 2021-04-29 14:14:25.927 15 INFO rally.task.engine [-] Full duration is: 211.211516 2021-04-29 14:14:26.009 15 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=99a151a0-c209-48a2-9aa0-55ed016fb02d)", "subtasks": [ { "title": "Authenticate.validate_neutron", "description": "Check Neutron Client to ensure validation of token.", "scenario": { "Authenticate.validate_neutron": { "repetitions": 2 } }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 14:14:26.022 15 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 14:14:40.497 15 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 14:15:31.714 15 INFO rally.task.context [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Context users@openstack setup() finished in 1.09 min 2021-04-29 14:15:31.725 15 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: 646f92ba-234b-483d-8b54-4ff0c46860bc). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 14:15:31.727 15 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"repetitions": 2} 2021-04-29 14:15:31.728 15 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"repetitions": 2} 2021-04-29 14:15:31.729 15 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"repetitions": 2} 2021-04-29 14:15:31.736 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 1 START 2021-04-29 14:15:31.737 15 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"repetitions": 2} 2021-04-29 14:15:31.738 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 2 START 2021-04-29 14:15:31.742 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 3 START 2021-04-29 14:15:31.753 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 4 START 2021-04-29 14:15:33.559 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 1 END: OK 2021-04-29 14:15:33.564 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 5 START 2021-04-29 14:15:33.573 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 3 END: OK 2021-04-29 14:15:33.579 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 6 START 2021-04-29 14:15:33.975 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 2 END: OK 2021-04-29 14:15:33.981 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 7 START 2021-04-29 14:15:33.992 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 4 END: OK 2021-04-29 14:15:33.997 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 8 START 2021-04-29 14:15:35.534 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 8 END: OK 2021-04-29 14:15:35.539 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 9 START 2021-04-29 14:15:35.552 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 6 END: OK 2021-04-29 14:15:35.563 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 10 START 2021-04-29 14:15:35.608 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 7 END: OK 2021-04-29 14:15:35.760 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 5 END: OK 2021-04-29 14:15:36.343 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 9 END: OK 2021-04-29 14:15:36.652 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 10 END: OK 2021-04-29 14:15:36.671 15 INFO rally.task.context [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Context users@openstack cleanup() started 2021-04-29 14:18:13.540 15 INFO rally.task.context [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Context users@openstack cleanup() finished in 2.61 min 2021-04-29 14:18:14.928 15 INFO rally.task.engine [-] Load duration is: 4.908613 2021-04-29 14:18:14.928 15 INFO rally.task.engine [-] Full runner duration is: 4.946484 2021-04-29 14:18:14.929 15 INFO rally.task.engine [-] Full duration is: 227.519012 2021-04-29 14:18:15.010 15 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=97b54201-c03e-401b-83c9-216b926bd80e)", "subtasks": [ { "title": "Authenticate.validate_nova", "description": "Check Nova Client to ensure validation of token.", "scenario": { "Authenticate.validate_nova": { "repetitions": 2 } }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 14:18:15.031 15 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 14:18:33.796 15 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 14:19:35.962 15 INFO rally.task.context [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Context users@openstack setup() finished in 1.35 min 2021-04-29 14:19:35.973 15 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: 646f92ba-234b-483d-8b54-4ff0c46860bc). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 14:19:35.976 15 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"repetitions": 2} 2021-04-29 14:19:35.977 15 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"repetitions": 2} 2021-04-29 14:19:35.978 15 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"repetitions": 2} 2021-04-29 14:19:35.983 15 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"repetitions": 2} 2021-04-29 14:19:35.984 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 1 START 2021-04-29 14:19:35.988 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 2 START 2021-04-29 14:19:35.991 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 3 START 2021-04-29 14:19:35.995 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 4 START 2021-04-29 14:19:37.080 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 2 END: OK 2021-04-29 14:19:37.085 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 5 START 2021-04-29 14:19:37.447 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 4 END: OK 2021-04-29 14:19:37.452 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 6 START 2021-04-29 14:19:38.293 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 3 END: OK 2021-04-29 14:19:38.298 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 7 START 2021-04-29 14:19:39.102 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 1 END: OK 2021-04-29 14:19:39.108 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 8 START 2021-04-29 14:19:39.119 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 5 END: OK 2021-04-29 14:19:39.125 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 9 START 2021-04-29 14:19:39.153 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 6 END: OK 2021-04-29 14:19:39.157 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 10 START 2021-04-29 14:19:39.181 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 7 END: OK 2021-04-29 14:19:39.708 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 8 END: OK 2021-04-29 14:19:39.754 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 9 END: OK 2021-04-29 14:19:40.381 15 INFO rally.task.runner [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | ITER: 10 END: OK 2021-04-29 14:19:40.393 15 INFO rally.task.context [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Context users@openstack cleanup() started 2021-04-29 14:21:38.859 15 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find user: 48da884cde7940968130354866ac7340. (HTTP 404) (Request-ID: req-34e8860e-2d2b-4d89-ace6-1736192d40dd) 2021-04-29 14:21:38.859 15 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 14:21:38.859 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 14:21:38.859 15 ERROR rally.common.broker consume(cache, args) 2021-04-29 14:21:38.859 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 14:21:38.859 15 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 14:21:38.859 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 14:21:38.859 15 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 14:21:38.859 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 14:21:38.859 15 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 14:21:38.859 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 14:21:38.859 15 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 14:21:38.859 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 14:21:38.859 15 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 14:21:38.859 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 14:21:38.859 15 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 14:21:38.859 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 14:21:38.859 15 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 14:21:38.859 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 14:21:38.859 15 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 14:21:38.859 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 14:21:38.859 15 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 14:21:38.859 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 14:21:38.859 15 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 14:21:38.859 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 14:21:38.859 15 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 14:21:38.859 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 14:21:38.859 15 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 14:21:38.859 15 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 14:21:38.859 15 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 14:21:38.859 15 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find user: 48da884cde7940968130354866ac7340. (HTTP 404) (Request-ID: req-34e8860e-2d2b-4d89-ace6-1736192d40dd) 2021-04-29 14:21:38.859 15 ERROR rally.common.broker 2021-04-29 14:22:17.281 15 INFO rally.task.context [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Context users@openstack cleanup() finished in 2.61 min 2021-04-29 14:22:17.977 15 INFO rally.task.engine [-] Load duration is: 4.383903 2021-04-29 14:22:17.978 15 INFO rally.task.engine [-] Full runner duration is: 4.420485 2021-04-29 14:22:17.978 15 INFO rally.task.engine [-] Full duration is: 242.250658 2021-04-29 14:22:18.051 15 INFO rally.task.engine [-] Task 646f92ba-234b-483d-8b54-4ff0c46860bc | Completed: Running task. 2021-04-29 14:22:19.345 649 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 14:22:19.345 649 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 14:22:19.345 649 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 14:22:20.611 650 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 14:22:20.611 650 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 14:22:20.612 650 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 14:22:21.832 651 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 14:22:21.832 651 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 14:22:21.832 651 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 14:22:23.630 651 INFO rally.api [-] Building 'json' report for the following task(s): '646f92ba-234b-483d-8b54-4ff0c46860bc'. 2021-04-29 14:22:23.639 651 INFO rally.api [-] The report has been successfully built. 2021-04-29 14:22:25.351 653 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 14:22:25.351 653 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 14:22:25.351 653 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 14:22:27.295 653 INFO rally.task.engine [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Starting: Task validation. 2021-04-29 14:22:27.317 653 INFO rally.task.engine [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Starting: Task validation of syntax. 2021-04-29 14:22:27.408 653 INFO rally.task.engine [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Completed: Task validation of syntax. 2021-04-29 14:22:27.408 653 INFO rally.task.engine [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Starting: Task validation of required platforms. 2021-04-29 14:22:27.465 653 INFO rally.task.engine [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Completed: Task validation of required platforms. 2021-04-29 14:22:27.465 653 INFO rally.task.engine [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Starting: Task validation of semantic. 2021-04-29 14:22:27.466 653 INFO rally.task.engine [-] Check health of the environment '475eaff9-f5cd-46ab-8b1c-6c36dbc836ee'. 2021-04-29 14:22:29.339 653 INFO rally.task.engine [-] Platform existing@openstack (available: True): OK! 2021-04-29 14:22:29.351 653 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 1 tenants using 20 threads 2021-04-29 14:22:34.205 653 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 1 users using 20 threads 2021-04-29 14:22:45.663 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context users@openstack setup() finished in 16.31 sec 2021-04-29 14:22:50.687 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context users@openstack cleanup() started 2021-04-29 14:23:51.254 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context users@openstack cleanup() finished in 1.01 min 2021-04-29 14:23:51.255 653 INFO rally.task.engine [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Completed: Task validation of semantic. 2021-04-29 14:23:51.255 653 INFO rally.task.engine [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Completed: Task validation. 2021-04-29 14:23:51.256 653 INFO rally.api [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d input file is valid. 2021-04-29 14:23:51.256 653 INFO rally.api [-] Run Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d against Deployment 475eaff9-f5cd-46ab-8b1c-6c36dbc836ee 2021-04-29 14:23:51.256 653 INFO rally.task.engine [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Starting: Running task. 2021-04-29 14:23:51.308 653 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=db15916e-2995-4298-b759-83d1888f29e5)", "subtasks": [ { "title": "GlanceImages.create_and_delete_image", "description": "Create and then delete an image.", "scenario": { "GlanceImages.create_and_delete_image": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" } }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 14:23:51.321 653 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 14:24:06.159 653 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 14:25:01.283 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context users@openstack setup() finished in 1.17 min 2021-04-29 14:25:01.283 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context cleanup@openstack setup() finished in 0.01 msec 2021-04-29 14:25:01.296 653 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 14:25:01.300 653 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"} 2021-04-29 14:25:01.301 653 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"} 2021-04-29 14:25:01.302 653 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"} 2021-04-29 14:25:01.303 653 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img"} 2021-04-29 14:25:01.314 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 1 START 2021-04-29 14:25:01.320 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 2 START 2021-04-29 14:25:01.321 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 3 START 2021-04-29 14:25:01.323 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 4 START 2021-04-29 14:25:15.726 653 RALLYDEBUG rally.task.utils [-] Waiting for resource 'dd4643e9-3048-472b-9866-8030ec55ecd0'. Status changed: NONE => QUEUED in 0.07248163223266602 2021-04-29 14:25:15.754 653 RALLYDEBUG rally.task.utils [-] Waiting for resource 'fd87d51e-b41a-423d-beb3-bcd83efb1f0b'. Status changed: NONE => QUEUED in 0.060479164123535156 2021-04-29 14:25:16.102 653 RALLYDEBUG rally.task.utils [-] Waiting for resource '6a4da1eb-56fa-41ee-a861-9853b40b892c'. Status changed: NONE => QUEUED in 0.08503150939941406 2021-04-29 14:25:16.570 653 RALLYDEBUG rally.task.utils [-] Waiting for resource '5ba96998-8a56-4086-92da-01b419c96ea9'. Status changed: NONE => QUEUED in 0.06641602516174316 2021-04-29 14:25:36.919 653 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_db15916e_jNGZlqs8. Status changed: QUEUED => ACTIVE in 0.041939735412597656 2021-04-29 14:25:37.042 653 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_db15916e_pMBTdmUc. Status changed: QUEUED => ACTIVE in 0.03556489944458008 2021-04-29 14:25:38.608 653 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_db15916e_sKF6ZiSx. Status changed: QUEUED => ACTIVE in 0.049909114837646484 2021-04-29 14:25:38.637 653 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_db15916e_Sg295yvM. Status changed: QUEUED => ACTIVE in 0.03702116012573242 2021-04-29 14:26:00.641 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 4 END: OK 2021-04-29 14:26:00.651 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 5 START 2021-04-29 14:26:00.941 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 3 END: OK 2021-04-29 14:26:00.946 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 6 START 2021-04-29 14:26:03.940 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 2 END: OK 2021-04-29 14:26:03.945 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 7 START 2021-04-29 14:26:05.325 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 1 END: OK 2021-04-29 14:26:05.329 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 8 START 2021-04-29 14:26:10.002 653 RALLYDEBUG rally.task.utils [-] Waiting for resource 'd4f422af-a223-4da0-b3cb-1fcfbfd3a21d'. Status changed: NONE => QUEUED in 0.06044721603393555 2021-04-29 14:26:13.092 653 RALLYDEBUG rally.task.utils [-] Waiting for resource 'c0009eb3-965d-4a21-a71f-a534a861080d'. Status changed: NONE => QUEUED in 0.07720184326171875 2021-04-29 14:26:13.580 653 RALLYDEBUG rally.task.utils [-] Waiting for resource '9080b268-eb52-438e-a4a7-148c2fa4a2a0'. Status changed: NONE => QUEUED in 0.05890297889709473 2021-04-29 14:26:15.164 653 RALLYDEBUG rally.task.utils [-] Waiting for resource '30c911ca-7921-41de-8cc3-c88e0763ebcf'. Status changed: NONE => QUEUED in 0.07171249389648438 2021-04-29 14:26:28.892 653 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_db15916e_3q9dUNlq. Status changed: QUEUED => ACTIVE in 0.047989606857299805 2021-04-29 14:26:30.887 653 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_db15916e_XR3BH8c2. Status changed: QUEUED => ACTIVE in 0.03743457794189453 2021-04-29 14:26:33.763 653 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_db15916e_e3Rj8mO1. Status changed: QUEUED => ACTIVE in 0.04614114761352539 2021-04-29 14:26:33.793 653 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_db15916e_QvIYwGBU. Status changed: QUEUED => ACTIVE in 0.03768277168273926 2021-04-29 14:26:49.366 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 5 END: OK 2021-04-29 14:26:49.374 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 9 START 2021-04-29 14:26:51.005 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 6 END: OK 2021-04-29 14:26:51.010 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 10 START 2021-04-29 14:26:52.498 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 7 END: OK 2021-04-29 14:26:52.641 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 8 END: OK 2021-04-29 14:26:59.817 653 RALLYDEBUG rally.task.utils [-] Waiting for resource 'b263365c-8f0f-4214-a3f7-a87638df549d'. Status changed: NONE => QUEUED in 0.08359503746032715 2021-04-29 14:27:00.936 653 RALLYDEBUG rally.task.utils [-] Waiting for resource '9e818f7a-a17c-4b00-b561-b8647dbfc427'. Status changed: NONE => QUEUED in 0.08491802215576172 2021-04-29 14:27:09.938 653 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_db15916e_GUNVtw0I. Status changed: QUEUED => ACTIVE in 0.04513669013977051 2021-04-29 14:27:12.480 653 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_db15916e_mj0AyecR. Status changed: QUEUED => ACTIVE in 0.043670654296875 2021-04-29 14:27:20.382 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 9 END: OK 2021-04-29 14:27:20.759 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 10 END: OK 2021-04-29 14:27:20.774 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context cleanup@openstack cleanup() started 2021-04-29 14:27:20.780 653 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up glance images objects 2021-04-29 14:27:23.025 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context cleanup@openstack cleanup() finished in 2.25 sec 2021-04-29 14:27:23.026 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context users@openstack cleanup() started 2021-04-29 14:29:40.827 653 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find user: c4793e732a974227a8496ac9a38b9625. (HTTP 404) (Request-ID: req-7a48b9ba-7881-4422-b2f3-623e48d33242) 2021-04-29 14:29:40.827 653 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 14:29:40.827 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 14:29:40.827 653 ERROR rally.common.broker consume(cache, args) 2021-04-29 14:29:40.827 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 14:29:40.827 653 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 14:29:40.827 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 14:29:40.827 653 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 14:29:40.827 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 14:29:40.827 653 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 14:29:40.827 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 14:29:40.827 653 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 14:29:40.827 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 14:29:40.827 653 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 14:29:40.827 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 14:29:40.827 653 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 14:29:40.827 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 14:29:40.827 653 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 14:29:40.827 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 14:29:40.827 653 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 14:29:40.827 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 14:29:40.827 653 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 14:29:40.827 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 14:29:40.827 653 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 14:29:40.827 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 14:29:40.827 653 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 14:29:40.827 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 14:29:40.827 653 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 14:29:40.827 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 14:29:40.827 653 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 14:29:40.827 653 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find user: c4793e732a974227a8496ac9a38b9625. (HTTP 404) (Request-ID: req-7a48b9ba-7881-4422-b2f3-623e48d33242) 2021-04-29 14:29:40.827 653 ERROR rally.common.broker 2021-04-29 14:30:50.618 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context users@openstack cleanup() finished in 3.46 min 2021-04-29 14:30:51.063 653 INFO rally.task.engine [-] Load duration is: 137.90488 2021-04-29 14:30:51.063 653 INFO rally.task.engine [-] Full runner duration is: 139.478297 2021-04-29 14:30:51.064 653 INFO rally.task.engine [-] Full duration is: 419.298322 2021-04-29 14:30:51.153 653 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=da265c1f-4f51-466e-acb4-179e78fbeb42)", "subtasks": [ { "title": "GlanceImages.create_and_list_image", "description": "Create an image and then list all images.", "scenario": { "GlanceImages.create_and_list_image": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" } }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 14:30:51.167 653 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 14:31:09.781 653 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 14:31:40.184 653 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.BadGateway: Bad Gateway (HTTP 502) 2021-04-29 14:31:40.184 653 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 14:31:40.184 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 14:31:40.184 653 ERROR rally.common.broker consume(cache, args) 2021-04-29 14:31:40.184 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 221, in consume 2021-04-29 14:31:40.184 653 ERROR rally.common.broker default_role=default_role) 2021-04-29 14:31:40.184 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 14:31:40.184 653 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 14:31:40.184 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 92, in create_user 2021-04-29 14:31:40.184 653 ERROR rally.common.broker default_role=default_role) 2021-04-29 14:31:40.184 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 14:31:40.184 653 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 14:31:40.184 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_v3.py", line 285, in create_user 2021-04-29 14:31:40.184 653 ERROR rally.common.broker enabled=enabled)) 2021-04-29 14:31:40.184 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 14:31:40.184 653 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 14:31:40.184 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 14:31:40.184 653 ERROR rally.common.broker f = func(self, *args, **kwargs) 2021-04-29 14:31:40.184 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_v3.py", line 104, in create_user 2021-04-29 14:31:40.184 653 ERROR rally.common.broker domain=domain_id, enabled=enabled) 2021-04-29 14:31:40.184 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/debtcollector/renames.py", line 43, in decorator 2021-04-29 14:31:40.184 653 ERROR rally.common.broker return wrapped(*args, **kwargs) 2021-04-29 14:31:40.184 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 93, in create 2021-04-29 14:31:40.184 653 ERROR rally.common.broker log=not bool(password)) 2021-04-29 14:31:40.184 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 192, in _post 2021-04-29 14:31:40.184 653 ERROR rally.common.broker resp, body = self.client.post(url, body=body, **kwargs) 2021-04-29 14:31:40.184 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post 2021-04-29 14:31:40.184 653 ERROR rally.common.broker return self.request(url, 'POST', **kwargs) 2021-04-29 14:31:40.184 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 14:31:40.184 653 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 14:31:40.184 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 14:31:40.184 653 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 14:31:40.184 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 14:31:40.184 653 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 14:31:40.184 653 ERROR rally.common.broker keystoneauth1.exceptions.http.BadGateway: Bad Gateway (HTTP 502) 2021-04-29 14:31:40.184 653 ERROR rally.common.broker 2021-04-29 14:31:45.778 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context users@openstack cleanup() started 2021-04-29 14:33:31.588 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context users@openstack cleanup() finished in 1.76 min 2021-04-29 14:33:31.791 653 INFO rally.task.engine [-] Load duration is: 0.0 2021-04-29 14:33:31.791 653 INFO rally.task.engine [-] Full runner duration is: 0.0 2021-04-29 14:33:31.791 653 INFO rally.task.engine [-] Full duration is: 160.421989 2021-04-29 14:33:31.815 653 ERROR rally.task.engine [-] Unexpected exception during the workload execution: rally.exceptions.ContextSetupFailure: Unable to setup context 'users': 'Failed to create the requested number of users.' 2021-04-29 14:33:31.815 653 ERROR rally.task.engine Traceback (most recent call last): 2021-04-29 14:33:31.815 653 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally/task/engine.py", line 513, in _run_workload 2021-04-29 14:33:31.815 653 ERROR rally.task.engine with ctx_manager: 2021-04-29 14:33:31.815 653 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally/task/context.py", line 311, in __enter__ 2021-04-29 14:33:31.815 653 ERROR rally.task.engine self.setup() 2021-04-29 14:33:31.815 653 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally/task/context.py", line 256, in setup 2021-04-29 14:33:31.815 653 ERROR rally.task.engine ctx.setup() 2021-04-29 14:33:31.815 653 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 334, in setup 2021-04-29 14:33:31.815 653 ERROR rally.task.engine self.create_users() 2021-04-29 14:33:31.815 653 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 298, in create_users 2021-04-29 14:33:31.815 653 ERROR rally.task.engine msg="Failed to create the requested number of users.") 2021-04-29 14:33:31.815 653 ERROR rally.task.engine rally.exceptions.ContextSetupFailure: Unable to setup context 'users': 'Failed to create the requested number of users.' 2021-04-29 14:33:31.815 653 ERROR rally.task.engine 2021-04-29 14:33:31.862 653 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=b21b2436-e067-47c6-b3e4-c7a51f385ed0)", "subtasks": [ { "title": "GlanceImages.list_images", "description": "List all images.", "scenario": { "GlanceImages.list_images": {} }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 14:33:31.875 653 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 14:33:43.002 653 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 14:34:28.497 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context users@openstack setup() finished in 56.62 sec 2021-04-29 14:34:28.508 653 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 14:34:28.511 653 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 14:34:28.512 653 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 14:34:28.520 653 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 14:34:28.524 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 1 START 2021-04-29 14:34:28.530 653 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 14:34:28.536 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 2 START 2021-04-29 14:34:28.536 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 3 START 2021-04-29 14:34:28.553 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 4 START 2021-04-29 14:34:29.945 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 3 END: OK 2021-04-29 14:34:29.951 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 5 START 2021-04-29 14:34:30.238 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 1 END: OK 2021-04-29 14:34:30.243 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 6 START 2021-04-29 14:34:30.310 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 2 END: OK 2021-04-29 14:34:30.315 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 7 START 2021-04-29 14:34:30.372 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 4 END: OK 2021-04-29 14:34:30.376 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 8 START 2021-04-29 14:34:32.556 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 5 END: OK 2021-04-29 14:34:32.563 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 9 START 2021-04-29 14:34:33.133 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 6 END: OK 2021-04-29 14:34:33.137 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 10 START 2021-04-29 14:34:33.619 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 9 END: OK 2021-04-29 14:34:33.687 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 8 END: OK 2021-04-29 14:34:33.723 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 7 END: OK 2021-04-29 14:34:34.461 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 10 END: OK 2021-04-29 14:34:34.483 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context users@openstack cleanup() started 2021-04-29 14:36:20.747 653 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find user: ff4272ba52a84b7ba2c7b26ac954cb3e. (HTTP 404) (Request-ID: req-1772f4d5-967c-43f0-ad94-0775a11c9654) 2021-04-29 14:36:20.747 653 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 14:36:20.747 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 14:36:20.747 653 ERROR rally.common.broker consume(cache, args) 2021-04-29 14:36:20.747 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 14:36:20.747 653 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 14:36:20.747 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 14:36:20.747 653 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 14:36:20.747 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 14:36:20.747 653 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 14:36:20.747 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 14:36:20.747 653 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 14:36:20.747 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 14:36:20.747 653 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 14:36:20.747 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 14:36:20.747 653 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 14:36:20.747 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 14:36:20.747 653 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 14:36:20.747 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 14:36:20.747 653 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 14:36:20.747 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 14:36:20.747 653 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 14:36:20.747 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 14:36:20.747 653 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 14:36:20.747 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 14:36:20.747 653 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 14:36:20.747 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 14:36:20.747 653 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 14:36:20.747 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 14:36:20.747 653 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 14:36:20.747 653 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find user: ff4272ba52a84b7ba2c7b26ac954cb3e. (HTTP 404) (Request-ID: req-1772f4d5-967c-43f0-ad94-0775a11c9654) 2021-04-29 14:36:20.747 653 ERROR rally.common.broker 2021-04-29 14:37:03.867 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context users@openstack cleanup() finished in 2.49 min 2021-04-29 14:37:04.698 653 INFO rally.task.engine [-] Load duration is: 4.861771 2021-04-29 14:37:04.699 653 INFO rally.task.engine [-] Full runner duration is: 5.975199 2021-04-29 14:37:04.699 653 INFO rally.task.engine [-] Full duration is: 211.993183 2021-04-29 14:37:04.783 653 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=a7cf835c-86a3-4768-91de-320ea1a1259d)", "subtasks": [ { "title": "GlanceImages.create_image_and_boot_instances", "description": "Create an image and boot several instances from it.", "scenario": { "GlanceImages.create_image_and_boot_instances": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_full-flavor_f304654f-f1b7-402f-b023-816517b42bc7" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "bc94259e-dafc-43a4-bfb4-7cbcbff98a2b" } ] } } }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 14:37:04.799 653 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 14:37:19.357 653 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 14:38:05.712 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context users@openstack setup() finished in 1.02 min 2021-04-29 14:39:52.344 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context quotas@openstack setup() finished in 1.78 min 2021-04-29 14:39:52.345 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context cleanup@openstack setup() finished in 0.14 msec 2021-04-29 14:39:53.074 653 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 14:39:53.077 653 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": "473788a1-c805-4e8b-b0df-56ce9e687f4a", "number_instances": 2, "boot_server_kwargs": {"nics": [{"net-id": "bc94259e-dafc-43a4-bfb4-7cbcbff98a2b"}]}} 2021-04-29 14:39:53.078 653 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": "473788a1-c805-4e8b-b0df-56ce9e687f4a", "number_instances": 2, "boot_server_kwargs": {"nics": [{"net-id": "bc94259e-dafc-43a4-bfb4-7cbcbff98a2b"}]}} 2021-04-29 14:39:53.079 653 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": "473788a1-c805-4e8b-b0df-56ce9e687f4a", "number_instances": 2, "boot_server_kwargs": {"nics": [{"net-id": "bc94259e-dafc-43a4-bfb4-7cbcbff98a2b"}]}} 2021-04-29 14:39:53.080 653 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": "473788a1-c805-4e8b-b0df-56ce9e687f4a", "number_instances": 2, "boot_server_kwargs": {"nics": [{"net-id": "bc94259e-dafc-43a4-bfb4-7cbcbff98a2b"}]}} 2021-04-29 14:39:53.097 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 1 START 2021-04-29 14:39:53.104 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 2 START 2021-04-29 14:39:53.110 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 3 START 2021-04-29 14:39:53.117 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 4 START 2021-04-29 14:40:10.678 653 RALLYDEBUG rally.task.utils [-] Waiting for resource 'eb758ed0-530a-446f-90ec-d93750fe4373'. Status changed: NONE => QUEUED in 0.07906675338745117 2021-04-29 14:40:10.962 653 RALLYDEBUG rally.task.utils [-] Waiting for resource '5bfbbcc6-bd43-4783-81fd-4903d89dd3f4'. Status changed: NONE => QUEUED in 0.06464385986328125 2021-04-29 14:40:11.265 653 RALLYDEBUG rally.task.utils [-] Waiting for resource 'd22b5d4e-5d19-48c5-bb32-d25690f7d8d2'. Status changed: NONE => QUEUED in 0.0776820182800293 2021-04-29 14:40:11.312 653 RALLYDEBUG rally.task.utils [-] Waiting for resource 'b96d968a-8a62-494f-8b28-8c7359ce9a3a'. Status changed: NONE => QUEUED in 0.06345295906066895 2021-04-29 14:40:34.897 653 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_a7cf835c_VHpcKOW2. Status changed: QUEUED => ACTIVE in 0.03908991813659668 2021-04-29 14:40:35.029 653 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_a7cf835c_9bC0wEvW. Status changed: QUEUED => ACTIVE in 0.04214620590209961 2021-04-29 14:40:36.200 653 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_a7cf835c_k7E6Bjox. Status changed: QUEUED => ACTIVE in 0.04879641532897949 2021-04-29 14:40:36.409 653 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_a7cf835c_XTPGtFrC. Status changed: QUEUED => ACTIVE in 0.04082798957824707 2021-04-29 14:45:59.876 653 ERROR rally.task.runner [-] Iteration 4 raised Exception: rally.exceptions.TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_a7cf835c_QglK9k0n_1:cd0e53bf-90ae-421b-b4df-7d1406bb8b64 to become ('ACTIVE') current status BUILD 2021-04-29 14:45:59.876 653 ERROR rally.task.runner Traceback (most recent call last): 2021-04-29 14:45:59.876 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once 2021-04-29 14:45:59.876 653 ERROR rally.task.runner getattr(scenario_inst, method_name)(**scenario_kwargs) 2021-04-29 14:45:59.876 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run 2021-04-29 14:45:59.876 653 ERROR rally.task.runner **boot_server_kwargs) 2021-04-29 14:45:59.876 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 14:45:59.876 653 ERROR rally.task.runner f = func(self, *args, **kwargs) 2021-04-29 14:45:59.876 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers 2021-04-29 14:45:59.876 653 ERROR rally.task.runner ) for server in servers] 2021-04-29 14:45:59.876 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in 2021-04-29 14:45:59.876 653 ERROR rally.task.runner ) for server in servers] 2021-04-29 14:45:59.876 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 252, in wait_for_status 2021-04-29 14:45:59.876 653 ERROR rally.task.runner timeout=timeout) 2021-04-29 14:45:59.876 653 ERROR rally.task.runner rally.exceptions.TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_a7cf835c_QglK9k0n_1:cd0e53bf-90ae-421b-b4df-7d1406bb8b64 to become ('ACTIVE') current status BUILD 2021-04-29 14:45:59.876 653 ERROR rally.task.runner 2021-04-29 14:45:59.879 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 4 END: Error TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_a7cf835c_QglK9k0n_1:cd0e53bf-90ae-421b-b4df-7d1406bb8b64 to become ('ACTIVE') current status BUILD 2021-04-29 14:45:59.885 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 5 START 2021-04-29 14:46:02.068 653 ERROR rally.task.runner [-] Iteration 2 raised Exception: rally.exceptions.TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_a7cf835c_r3Eo2NLE_1:ba6b3fa0-df6f-4e24-aa11-e12b7105a8f3 to become ('ACTIVE') current status BUILD 2021-04-29 14:46:02.068 653 ERROR rally.task.runner Traceback (most recent call last): 2021-04-29 14:46:02.068 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once 2021-04-29 14:46:02.068 653 ERROR rally.task.runner getattr(scenario_inst, method_name)(**scenario_kwargs) 2021-04-29 14:46:02.068 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run 2021-04-29 14:46:02.068 653 ERROR rally.task.runner **boot_server_kwargs) 2021-04-29 14:46:02.068 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 14:46:02.068 653 ERROR rally.task.runner f = func(self, *args, **kwargs) 2021-04-29 14:46:02.068 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers 2021-04-29 14:46:02.068 653 ERROR rally.task.runner ) for server in servers] 2021-04-29 14:46:02.068 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in 2021-04-29 14:46:02.068 653 ERROR rally.task.runner ) for server in servers] 2021-04-29 14:46:02.068 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 252, in wait_for_status 2021-04-29 14:46:02.068 653 ERROR rally.task.runner timeout=timeout) 2021-04-29 14:46:02.068 653 ERROR rally.task.runner rally.exceptions.TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_a7cf835c_r3Eo2NLE_1:ba6b3fa0-df6f-4e24-aa11-e12b7105a8f3 to become ('ACTIVE') current status BUILD 2021-04-29 14:46:02.068 653 ERROR rally.task.runner 2021-04-29 14:46:02.070 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 2 END: Error TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_a7cf835c_r3Eo2NLE_1:ba6b3fa0-df6f-4e24-aa11-e12b7105a8f3 to become ('ACTIVE') current status BUILD 2021-04-29 14:46:06.096 653 ERROR rally.task.runner [-] Iteration 3 raised Exception: rally.exceptions.TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_a7cf835c_KCpajm4v_1:3d6fa598-8ed5-48f8-9b4a-62900a083ffc to become ('ACTIVE') current status BUILD 2021-04-29 14:46:06.096 653 ERROR rally.task.runner Traceback (most recent call last): 2021-04-29 14:46:06.096 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once 2021-04-29 14:46:06.096 653 ERROR rally.task.runner getattr(scenario_inst, method_name)(**scenario_kwargs) 2021-04-29 14:46:06.096 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run 2021-04-29 14:46:06.096 653 ERROR rally.task.runner **boot_server_kwargs) 2021-04-29 14:46:06.096 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 14:46:06.096 653 ERROR rally.task.runner f = func(self, *args, **kwargs) 2021-04-29 14:46:06.096 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers 2021-04-29 14:46:06.096 653 ERROR rally.task.runner ) for server in servers] 2021-04-29 14:46:06.096 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in 2021-04-29 14:46:06.096 653 ERROR rally.task.runner ) for server in servers] 2021-04-29 14:46:06.096 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 252, in wait_for_status 2021-04-29 14:46:06.096 653 ERROR rally.task.runner timeout=timeout) 2021-04-29 14:46:06.096 653 ERROR rally.task.runner rally.exceptions.TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_a7cf835c_KCpajm4v_1:3d6fa598-8ed5-48f8-9b4a-62900a083ffc to become ('ACTIVE') current status BUILD 2021-04-29 14:46:06.096 653 ERROR rally.task.runner 2021-04-29 14:46:06.097 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 3 END: Error TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_a7cf835c_KCpajm4v_1:3d6fa598-8ed5-48f8-9b4a-62900a083ffc to become ('ACTIVE') current status BUILD 2021-04-29 14:46:06.405 653 ERROR rally.task.runner [-] Iteration 1 raised Exception: rally.exceptions.TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_a7cf835c_WEsKS38J_1:60b2249b-d702-44f0-9eca-1b3212d87f75 to become ('ACTIVE') current status BUILD 2021-04-29 14:46:06.405 653 ERROR rally.task.runner Traceback (most recent call last): 2021-04-29 14:46:06.405 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once 2021-04-29 14:46:06.405 653 ERROR rally.task.runner getattr(scenario_inst, method_name)(**scenario_kwargs) 2021-04-29 14:46:06.405 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run 2021-04-29 14:46:06.405 653 ERROR rally.task.runner **boot_server_kwargs) 2021-04-29 14:46:06.405 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 14:46:06.405 653 ERROR rally.task.runner f = func(self, *args, **kwargs) 2021-04-29 14:46:06.405 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers 2021-04-29 14:46:06.405 653 ERROR rally.task.runner ) for server in servers] 2021-04-29 14:46:06.405 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in 2021-04-29 14:46:06.405 653 ERROR rally.task.runner ) for server in servers] 2021-04-29 14:46:06.405 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 252, in wait_for_status 2021-04-29 14:46:06.405 653 ERROR rally.task.runner timeout=timeout) 2021-04-29 14:46:06.405 653 ERROR rally.task.runner rally.exceptions.TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_a7cf835c_WEsKS38J_1:60b2249b-d702-44f0-9eca-1b3212d87f75 to become ('ACTIVE') current status BUILD 2021-04-29 14:46:06.405 653 ERROR rally.task.runner 2021-04-29 14:46:06.407 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 1 END: Error TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_a7cf835c_WEsKS38J_1:60b2249b-d702-44f0-9eca-1b3212d87f75 to become ('ACTIVE') current status BUILD 2021-04-29 14:46:26.133 653 RALLYDEBUG rally.task.utils [-] Waiting for resource '22f07530-e85a-4b1f-bcc0-1b8a70254695'. Status changed: NONE => QUEUED in 0.07496881484985352 2021-04-29 14:46:56.246 653 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_a7cf835c_KnZxScKj. Status changed: QUEUED => ACTIVE in 0.03554654121398926 2021-04-29 14:52:41.270 653 ERROR rally.task.runner [-] Iteration 5 raised Exception: rally.exceptions.TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_a7cf835c_tCxUyc23_1:2b07857e-9e2c-40bf-aab7-00f2837d47ba to become ('ACTIVE') current status BUILD 2021-04-29 14:52:41.270 653 ERROR rally.task.runner Traceback (most recent call last): 2021-04-29 14:52:41.270 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once 2021-04-29 14:52:41.270 653 ERROR rally.task.runner getattr(scenario_inst, method_name)(**scenario_kwargs) 2021-04-29 14:52:41.270 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/glance/images.py", line 250, in run 2021-04-29 14:52:41.270 653 ERROR rally.task.runner **boot_server_kwargs) 2021-04-29 14:52:41.270 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 14:52:41.270 653 ERROR rally.task.runner f = func(self, *args, **kwargs) 2021-04-29 14:52:41.270 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in _boot_servers 2021-04-29 14:52:41.270 653 ERROR rally.task.runner ) for server in servers] 2021-04-29 14:52:41.270 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 587, in 2021-04-29 14:52:41.270 653 ERROR rally.task.runner ) for server in servers] 2021-04-29 14:52:41.270 653 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 252, in wait_for_status 2021-04-29 14:52:41.270 653 ERROR rally.task.runner timeout=timeout) 2021-04-29 14:52:41.270 653 ERROR rally.task.runner rally.exceptions.TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_a7cf835c_tCxUyc23_1:2b07857e-9e2c-40bf-aab7-00f2837d47ba to become ('ACTIVE') current status BUILD 2021-04-29 14:52:41.270 653 ERROR rally.task.runner 2021-04-29 14:52:41.273 653 INFO rally.task.runner [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | ITER: 5 END: Error TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_a7cf835c_tCxUyc23_1:2b07857e-9e2c-40bf-aab7-00f2837d47ba to become ('ACTIVE') current status BUILD 2021-04-29 14:52:41.299 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context cleanup@openstack cleanup() started 2021-04-29 14:52:41.305 653 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up nova servers objects 2021-04-29 14:52:45.968 653 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting nova.servers object s_rally_a7cf835c_tCxUyc23_1 (2b07857e-9e2c-40bf-aab7-00f2837d47ba) 2021-04-29 14:52:45.974 653 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting nova.servers object s_rally_a7cf835c_tCxUyc23_0 (8c58bd8c-8d52-47ee-aedd-ed8a8fdaed78) 2021-04-29 14:52:45.981 653 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting nova.servers object s_rally_a7cf835c_r3Eo2NLE_1 (ba6b3fa0-df6f-4e24-aa11-e12b7105a8f3) 2021-04-29 14:52:45.989 653 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting nova.servers object s_rally_a7cf835c_r3Eo2NLE_0 (d000bc0d-3ad5-427c-b416-c2f18860d379) 2021-04-29 14:52:45.995 653 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting nova.servers object s_rally_a7cf835c_WEsKS38J_1 (60b2249b-d702-44f0-9eca-1b3212d87f75) 2021-04-29 14:52:46.016 653 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting nova.servers object s_rally_a7cf835c_QglK9k0n_1 (cd0e53bf-90ae-421b-b4df-7d1406bb8b64) 2021-04-29 14:52:46.038 653 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting nova.servers object s_rally_a7cf835c_WEsKS38J_0 (fd18a9d4-b4f5-4833-b8f3-044ce01daa29) 2021-04-29 14:52:46.044 653 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting nova.servers object s_rally_a7cf835c_QglK9k0n_0 (2ed76366-4e56-4ecb-b692-549465902ca3) 2021-04-29 14:52:46.049 653 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting nova.servers object s_rally_a7cf835c_KCpajm4v_1 (3d6fa598-8ed5-48f8-9b4a-62900a083ffc) 2021-04-29 14:52:46.067 653 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting nova.servers object s_rally_a7cf835c_KCpajm4v_0 (a7e40fc2-53d0-4760-96aa-f9ede9bea9d0) 2021-04-29 15:02:27.003 653 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up nova server_groups objects 2021-04-29 15:02:28.874 653 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up nova keypairs objects 2021-04-29 15:02:33.467 653 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up glance images objects 2021-04-29 15:02:35.555 653 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting glance.images object s_rally_a7cf835c_9bC0wEvW (d22b5d4e-5d19-48c5-bb32-d25690f7d8d2) 2021-04-29 15:02:35.556 653 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting glance.images object s_rally_a7cf835c_KnZxScKj (22f07530-e85a-4b1f-bcc0-1b8a70254695) 2021-04-29 15:02:35.561 653 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting glance.images object s_rally_a7cf835c_k7E6Bjox (eb758ed0-530a-446f-90ec-d93750fe4373) 2021-04-29 15:02:35.571 653 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting glance.images object s_rally_a7cf835c_VHpcKOW2 (5bfbbcc6-bd43-4783-81fd-4903d89dd3f4) 2021-04-29 15:02:35.582 653 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting glance.images object s_rally_a7cf835c_XTPGtFrC (b96d968a-8a62-494f-8b28-8c7359ce9a3a) 2021-04-29 15:03:35.561 653 DEBUG glanceclient.common.http [-] Request returned failure status 404. _handle_response /usr/lib/python3.6/site-packages/glanceclient/common/http.py:125 2021-04-29 15:03:35.631 653 DEBUG glanceclient.common.http [-] Request returned failure status 404. _handle_response /usr/lib/python3.6/site-packages/glanceclient/common/http.py:125 2021-04-29 15:03:36.033 653 DEBUG glanceclient.common.http [-] Request returned failure status 400. _handle_response /usr/lib/python3.6/site-packages/glanceclient/common/http.py:125 2021-04-29 15:03:36.078 653 DEBUG glanceclient.common.http [-] Request returned failure status 400. _handle_response /usr/lib/python3.6/site-packages/glanceclient/common/http.py:125 2021-04-29 15:03:36.106 653 DEBUG glanceclient.common.http [-] Request returned failure status 400. _handle_response /usr/lib/python3.6/site-packages/glanceclient/common/http.py:125 2021-04-29 15:03:36.113 653 DEBUG glanceclient.common.http [-] Request returned failure status 400. _handle_response /usr/lib/python3.6/site-packages/glanceclient/common/http.py:125 2021-04-29 15:03:36.120 653 DEBUG glanceclient.common.http [-] Request returned failure status 400. _handle_response /usr/lib/python3.6/site-packages/glanceclient/common/http.py:125 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager [-] Resource deletion failed, max retries exceeded for glance.images: 5bfbbcc6-bd43-4783-81fd-4903d89dd3f4.: glanceclient.exc.HTTPBadRequest: HTTP 400 Bad Request: Image status transition from deleted to deleted is not allowed 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 85, in _delete_single_resource 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager rutils.retry(resource._max_attempts, resource.delete) 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 624, in delete 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager client.delete_image(self.raw_resource.id) 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager return func(instance, *args, **kwargs) 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/image.py", line 123, in delete_image 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager self._impl.delete_image(image_id) 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_common.py", line 84, in delete_image 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager self._impl.delete_image(image_id=image_id) 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_common.py", line 45, in delete_image 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager self._get_client().images.delete(image_id) 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager return RequestIdProxy(wrapped(*args, **kwargs)) 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 342, in delete 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager resp, body = self.http_client.delete(url) 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager return self.request(url, 'DELETE', **kwargs) 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager return self._handle_response(resp) 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager raise exc.from_response(resp, resp.content) 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager glanceclient.exc.HTTPBadRequest: HTTP 400 Bad Request: Image status transition from deleted to deleted is not allowed 2021-04-29 15:03:36.121 653 ERROR rally_openstack.cleanup.manager 2021-04-29 15:03:36.163 653 DEBUG glanceclient.common.http [-] Request returned failure status 400. _handle_response /usr/lib/python3.6/site-packages/glanceclient/common/http.py:125 2021-04-29 15:03:36.181 653 DEBUG glanceclient.common.http [-] Request returned failure status 400. _handle_response /usr/lib/python3.6/site-packages/glanceclient/common/http.py:125 2021-04-29 15:03:36.236 653 DEBUG glanceclient.common.http [-] Request returned failure status 400. _handle_response /usr/lib/python3.6/site-packages/glanceclient/common/http.py:125 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager [-] Resource deletion failed, max retries exceeded for glance.images: d22b5d4e-5d19-48c5-bb32-d25690f7d8d2.: glanceclient.exc.HTTPBadRequest: HTTP 400 Bad Request: Image status transition from deleted to deleted is not allowed 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 85, in _delete_single_resource 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager rutils.retry(resource._max_attempts, resource.delete) 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 624, in delete 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager client.delete_image(self.raw_resource.id) 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager return func(instance, *args, **kwargs) 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/image.py", line 123, in delete_image 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager self._impl.delete_image(image_id) 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_common.py", line 84, in delete_image 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager self._impl.delete_image(image_id=image_id) 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_common.py", line 45, in delete_image 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager self._get_client().images.delete(image_id) 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager return RequestIdProxy(wrapped(*args, **kwargs)) 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 342, in delete 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager resp, body = self.http_client.delete(url) 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager return self.request(url, 'DELETE', **kwargs) 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager return self._handle_response(resp) 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager raise exc.from_response(resp, resp.content) 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager glanceclient.exc.HTTPBadRequest: HTTP 400 Bad Request: Image status transition from deleted to deleted is not allowed 2021-04-29 15:03:36.237 653 ERROR rally_openstack.cleanup.manager 2021-04-29 15:03:36.260 653 DEBUG glanceclient.common.http [-] Request returned failure status 404. _handle_response /usr/lib/python3.6/site-packages/glanceclient/common/http.py:125 2021-04-29 15:03:36.269 653 DEBUG glanceclient.common.http [-] Request returned failure status 400. _handle_response /usr/lib/python3.6/site-packages/glanceclient/common/http.py:125 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager [-] Resource deletion failed, max retries exceeded for glance.images: eb758ed0-530a-446f-90ec-d93750fe4373.: glanceclient.exc.HTTPBadRequest: HTTP 400 Bad Request: Image status transition from deleted to deleted is not allowed 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 85, in _delete_single_resource 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager rutils.retry(resource._max_attempts, resource.delete) 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 624, in delete 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager client.delete_image(self.raw_resource.id) 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager return func(instance, *args, **kwargs) 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/image.py", line 123, in delete_image 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager self._impl.delete_image(image_id) 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_common.py", line 84, in delete_image 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager self._impl.delete_image(image_id=image_id) 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/services/image/glance_common.py", line 45, in delete_image 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager self._get_client().images.delete(image_id) 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/glanceclient/common/utils.py", line 598, in inner 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager return RequestIdProxy(wrapped(*args, **kwargs)) 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/glanceclient/v2/images.py", line 342, in delete 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager resp, body = self.http_client.delete(url) 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager return self.request(url, 'DELETE', **kwargs) 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 377, in request 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager return self._handle_response(resp) 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/glanceclient/common/http.py", line 126, in _handle_response 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager raise exc.from_response(resp, resp.content) 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager glanceclient.exc.HTTPBadRequest: HTTP 400 Bad Request: Image status transition from deleted to deleted is not allowed 2021-04-29 15:03:36.270 653 ERROR rally_openstack.cleanup.manager 2021-04-29 15:03:36.299 653 DEBUG glanceclient.common.http [-] Request returned failure status 404. _handle_response /usr/lib/python3.6/site-packages/glanceclient/common/http.py:125 2021-04-29 15:03:37.303 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context cleanup@openstack cleanup() finished in 10.93 min 2021-04-29 15:03:37.304 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context quotas@openstack cleanup() started 2021-04-29 15:04:16.406 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context quotas@openstack cleanup() finished in 39.10 sec 2021-04-29 15:04:16.407 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context users@openstack cleanup() started 2021-04-29 15:06:25.381 653 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find user: 72b5578b0a9f49d58a8e2c5fec3ae8fc. (HTTP 404) (Request-ID: req-206bf724-4549-44a7-a8d3-048eacb1c1b8) 2021-04-29 15:06:25.381 653 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 15:06:25.381 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 15:06:25.381 653 ERROR rally.common.broker consume(cache, args) 2021-04-29 15:06:25.381 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 15:06:25.381 653 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 15:06:25.381 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 15:06:25.381 653 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 15:06:25.381 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 15:06:25.381 653 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 15:06:25.381 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 15:06:25.381 653 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 15:06:25.381 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 15:06:25.381 653 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 15:06:25.381 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 15:06:25.381 653 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 15:06:25.381 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 15:06:25.381 653 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 15:06:25.381 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 15:06:25.381 653 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 15:06:25.381 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 15:06:25.381 653 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 15:06:25.381 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 15:06:25.381 653 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 15:06:25.381 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 15:06:25.381 653 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 15:06:25.381 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 15:06:25.381 653 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 15:06:25.381 653 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 15:06:25.381 653 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 15:06:25.381 653 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find user: 72b5578b0a9f49d58a8e2c5fec3ae8fc. (HTTP 404) (Request-ID: req-206bf724-4549-44a7-a8d3-048eacb1c1b8) 2021-04-29 15:06:25.381 653 ERROR rally.common.broker 2021-04-29 15:06:41.519 653 INFO rally.task.context [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Context users@openstack cleanup() finished in 2.42 min 2021-04-29 15:06:41.998 653 INFO rally.task.engine [-] Load duration is: 766.069717 2021-04-29 15:06:41.999 653 INFO rally.task.engine [-] Full runner duration is: 768.223995 2021-04-29 15:06:41.999 653 INFO rally.task.engine [-] Full duration is: 1776.721975 2021-04-29 15:06:42.090 653 INFO rally.task.engine [-] Received aborting signal. 2021-04-29 15:06:42.102 653 INFO rally.task.engine [-] Task 4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d | Completed: Running task. 2021-04-29 15:06:43.503 1206 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 15:06:43.503 1206 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 15:06:43.503 1206 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 15:06:44.663 1207 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 15:06:44.663 1207 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 15:06:44.663 1207 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 15:06:45.889 1208 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 15:06:45.890 1208 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 15:06:45.890 1208 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 15:06:47.725 1208 INFO rally.api [-] Building 'json' report for the following task(s): '4b6a76ad-58b9-4e60-b294-9ca6b0dc3a0d'. 2021-04-29 15:06:47.733 1208 INFO rally.api [-] The report has been successfully built. 2021-04-29 15:06:49.595 1210 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 15:06:49.595 1210 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 15:06:49.596 1210 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 15:06:51.807 1210 INFO rally.task.engine [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Starting: Task validation. 2021-04-29 15:06:51.820 1210 INFO rally.task.engine [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Starting: Task validation of syntax. 2021-04-29 15:06:52.209 1210 INFO rally.task.engine [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Completed: Task validation of syntax. 2021-04-29 15:06:52.209 1210 INFO rally.task.engine [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Starting: Task validation of required platforms. 2021-04-29 15:06:52.382 1210 INFO rally.task.engine [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Completed: Task validation of required platforms. 2021-04-29 15:06:52.382 1210 INFO rally.task.engine [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Starting: Task validation of semantic. 2021-04-29 15:06:52.383 1210 INFO rally.task.engine [-] Check health of the environment '475eaff9-f5cd-46ab-8b1c-6c36dbc836ee'. 2021-04-29 15:06:53.761 1210 INFO rally.task.engine [-] Platform existing@openstack (available: True): OK! 2021-04-29 15:06:53.774 1210 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 1 tenants using 20 threads 2021-04-29 15:06:57.182 1210 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 1 users using 20 threads 2021-04-29 15:07:02.372 1210 INFO rally.task.context [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Context users@openstack setup() finished in 8.60 sec 2021-04-29 15:07:22.340 1210 INFO rally.task.context [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Context users@openstack cleanup() started 2021-04-29 15:08:12.611 1210 INFO rally.task.context [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Context users@openstack cleanup() finished in 50.27 sec 2021-04-29 15:08:12.612 1210 INFO rally.task.engine [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Completed: Task validation of semantic. 2021-04-29 15:08:12.613 1210 INFO rally.task.engine [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Completed: Task validation. 2021-04-29 15:08:12.613 1210 INFO rally.api [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 input file is valid. 2021-04-29 15:08:12.613 1210 INFO rally.api [-] Run Task 0abb981b-0dc5-4055-94cb-a0facd865f16 against Deployment 475eaff9-f5cd-46ab-8b1c-6c36dbc836ee 2021-04-29 15:08:12.614 1210 INFO rally.task.engine [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Starting: Running task. 2021-04-29 15:08:12.666 1210 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=b8bfb3fb-828c-42d9-8322-d4eaff9379a6)", "subtasks": [ { "title": "CinderVolumes.create_and_attach_volume", "description": "Create a VM and attach a volume to it.", "scenario": { "CinderVolumes.create_and_attach_volume": { "flavor": { "name": "rally_full-flavor_f304654f-f1b7-402f-b023-816517b42bc7" }, "image": { "name": "rally_full-img_f304654f-f1b7-402f-b023-816517b42bc7" }, "size": 1, "nics": [ { "net-id": "bc94259e-dafc-43a4-bfb4-7cbcbff98a2b" } ] } }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 15:08:12.682 1210 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 15:08:40.783 1210 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 15:10:05.193 1210 INFO rally.task.context [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Context users@openstack setup() finished in 1.88 min 2021-04-29 15:10:05.777 1210 INFO rally.task.context [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Context api_versions@openstack setup() finished in 0.58 sec 2021-04-29 15:12:17.659 1210 INFO rally.task.context [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Context quotas@openstack setup() finished in 2.20 min 2021-04-29 15:12:17.659 1210 INFO rally.task.context [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Context cleanup@openstack setup() finished in 0.01 msec 2021-04-29 15:12:19.603 1210 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: 0abb981b-0dc5-4055-94cb-a0facd865f16). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 15:12:19.607 1210 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"flavor": "473788a1-c805-4e8b-b0df-56ce9e687f4a", "image": "1284b2a2-5f8d-4182-944a-f32bd08cd1fa", "size": 1, "nics": [{"net-id": "bc94259e-dafc-43a4-bfb4-7cbcbff98a2b"}]} 2021-04-29 15:12:19.613 1210 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"flavor": "473788a1-c805-4e8b-b0df-56ce9e687f4a", "image": "1284b2a2-5f8d-4182-944a-f32bd08cd1fa", "size": 1, "nics": [{"net-id": "bc94259e-dafc-43a4-bfb4-7cbcbff98a2b"}]} 2021-04-29 15:12:19.618 1210 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"flavor": "473788a1-c805-4e8b-b0df-56ce9e687f4a", "image": "1284b2a2-5f8d-4182-944a-f32bd08cd1fa", "size": 1, "nics": [{"net-id": "bc94259e-dafc-43a4-bfb4-7cbcbff98a2b"}]} 2021-04-29 15:12:19.623 1210 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"flavor": "473788a1-c805-4e8b-b0df-56ce9e687f4a", "image": "1284b2a2-5f8d-4182-944a-f32bd08cd1fa", "size": 1, "nics": [{"net-id": "bc94259e-dafc-43a4-bfb4-7cbcbff98a2b"}]} 2021-04-29 15:12:19.624 1210 INFO rally.task.runner [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | ITER: 2 START 2021-04-29 15:12:19.639 1210 INFO rally.task.runner [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | ITER: 3 START 2021-04-29 15:12:19.648 1210 INFO rally.task.runner [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | ITER: 1 START 2021-04-29 15:12:19.660 1210 INFO rally.task.runner [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | ITER: 4 START 2021-04-29 15:16:36.746 1210 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_b8bfb3fb_d0HvTvT7. Status changed: BUILD => ACTIVE in 249.67358374595642 2021-04-29 15:16:46.578 1210 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_b8bfb3fb_CbViyu2B. Status changed: BUILD => ACTIVE in 254.35383677482605 2021-04-29 15:17:29.847 1210 ERROR rally.task.runner [-] Iteration 3 raised Exception: rally.exceptions.TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_b8bfb3fb_6o8hIZXY:3532b792-b53a-408f-96ce-a9a672f85f79 to become ('ACTIVE') current status BUILD 2021-04-29 15:17:29.847 1210 ERROR rally.task.runner Traceback (most recent call last): 2021-04-29 15:17:29.847 1210 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once 2021-04-29 15:17:29.847 1210 ERROR rally.task.runner getattr(scenario_inst, method_name)(**scenario_kwargs) 2021-04-29 15:17:29.847 1210 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/common/logging.py", line 329, in wrapper 2021-04-29 15:17:29.847 1210 ERROR rally.task.runner return f(*args, **kwargs) 2021-04-29 15:17:29.847 1210 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/cinder/volumes.py", line 458, in run 2021-04-29 15:17:29.847 1210 ERROR rally.task.runner server = self._boot_server(image, flavor, **create_vm_params) 2021-04-29 15:17:29.847 1210 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 15:17:29.847 1210 ERROR rally.task.runner f = func(self, *args, **kwargs) 2021-04-29 15:17:29.847 1210 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 88, in _boot_server 2021-04-29 15:17:29.847 1210 ERROR rally.task.runner check_interval=CONF.openstack.nova_server_boot_poll_interval 2021-04-29 15:17:29.847 1210 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 252, in wait_for_status 2021-04-29 15:17:29.847 1210 ERROR rally.task.runner timeout=timeout) 2021-04-29 15:17:29.847 1210 ERROR rally.task.runner rally.exceptions.TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_b8bfb3fb_6o8hIZXY:3532b792-b53a-408f-96ce-a9a672f85f79 to become ('ACTIVE') current status BUILD 2021-04-29 15:17:29.847 1210 ERROR rally.task.runner 2021-04-29 15:17:29.849 1210 INFO rally.task.runner [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | ITER: 3 END: Error TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_b8bfb3fb_6o8hIZXY:3532b792-b53a-408f-96ce-a9a672f85f79 to become ('ACTIVE') current status BUILD 2021-04-29 15:17:29.857 1210 INFO rally.task.runner [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | ITER: 5 START 2021-04-29 15:17:30.783 1210 ERROR rally.task.runner [-] Iteration 4 raised Exception: rally.exceptions.TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_b8bfb3fb_nuofxbrK:57be8a05-05ef-40d7-b93f-027765839fe7 to become ('ACTIVE') current status BUILD 2021-04-29 15:17:30.783 1210 ERROR rally.task.runner Traceback (most recent call last): 2021-04-29 15:17:30.783 1210 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once 2021-04-29 15:17:30.783 1210 ERROR rally.task.runner getattr(scenario_inst, method_name)(**scenario_kwargs) 2021-04-29 15:17:30.783 1210 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/common/logging.py", line 329, in wrapper 2021-04-29 15:17:30.783 1210 ERROR rally.task.runner return f(*args, **kwargs) 2021-04-29 15:17:30.783 1210 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/cinder/volumes.py", line 458, in run 2021-04-29 15:17:30.783 1210 ERROR rally.task.runner server = self._boot_server(image, flavor, **create_vm_params) 2021-04-29 15:17:30.783 1210 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 15:17:30.783 1210 ERROR rally.task.runner f = func(self, *args, **kwargs) 2021-04-29 15:17:30.783 1210 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 88, in _boot_server 2021-04-29 15:17:30.783 1210 ERROR rally.task.runner check_interval=CONF.openstack.nova_server_boot_poll_interval 2021-04-29 15:17:30.783 1210 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 252, in wait_for_status 2021-04-29 15:17:30.783 1210 ERROR rally.task.runner timeout=timeout) 2021-04-29 15:17:30.783 1210 ERROR rally.task.runner rally.exceptions.TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_b8bfb3fb_nuofxbrK:57be8a05-05ef-40d7-b93f-027765839fe7 to become ('ACTIVE') current status BUILD 2021-04-29 15:17:30.783 1210 ERROR rally.task.runner 2021-04-29 15:17:30.784 1210 INFO rally.task.runner [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | ITER: 4 END: Error TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_b8bfb3fb_nuofxbrK:57be8a05-05ef-40d7-b93f-027765839fe7 to become ('ACTIVE') current status BUILD 2021-04-29 15:18:32.071 1210 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_b8bfb3fb_ONgzo1TB. Status changed: CREATING => AVAILABLE in 61.07196760177612 2021-04-29 15:18:53.968 1210 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_b8bfb3fb_XgxehxiQ. Status changed: CREATING => AVAILABLE in 75.47171139717102 2021-04-29 15:19:07.282 1210 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_b8bfb3fb_ONgzo1TB. Status changed: AVAILABLE => RESERVED in 0.6727113723754883 2021-04-29 15:19:44.203 1210 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_b8bfb3fb_ONgzo1TB. Status changed: RESERVED => ATTACHING in 36.92092490196228 2021-04-29 15:19:48.309 1210 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_b8bfb3fb_XgxehxiQ. Status changed: AVAILABLE => RESERVED in 0.672215461730957 2021-04-29 15:20:27.884 1210 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_b8bfb3fb_XgxehxiQ. Status changed: RESERVED => ATTACHING in 39.57498741149902 2021-04-29 15:20:39.524 1210 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_b8bfb3fb_ONgzo1TB. Status changed: ATTACHING => IN-USE in 55.32162117958069 2021-04-29 15:21:11.527 1210 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_b8bfb3fb_ONgzo1TB. Status changed: AVAILABLE => DETACHING in 0.6243855953216553 2021-04-29 15:21:31.281 1210 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_b8bfb3fb_XgxehxiQ. Status changed: ATTACHING => IN-USE in 63.396631717681885 2021-04-29 15:21:43.062 1210 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_b8bfb3fb_ONgzo1TB. Status changed: DETACHING => AVAILABLE in 31.534753561019897 2021-04-29 15:22:04.740 1210 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_b8bfb3fb_XgxehxiQ. Status changed: AVAILABLE => DETACHING in 0.6329481601715088 2021-04-29 15:22:40.649 1210 ERROR rally.task.runner [-] Iteration 5 raised Exception: rally.exceptions.TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_b8bfb3fb_al2YfvJZ:a5e407e7-ccb7-47a7-9f51-24f277d07d40 to become ('ACTIVE') current status BUILD 2021-04-29 15:22:40.649 1210 ERROR rally.task.runner Traceback (most recent call last): 2021-04-29 15:22:40.649 1210 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once 2021-04-29 15:22:40.649 1210 ERROR rally.task.runner getattr(scenario_inst, method_name)(**scenario_kwargs) 2021-04-29 15:22:40.649 1210 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/common/logging.py", line 329, in wrapper 2021-04-29 15:22:40.649 1210 ERROR rally.task.runner return f(*args, **kwargs) 2021-04-29 15:22:40.649 1210 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/cinder/volumes.py", line 458, in run 2021-04-29 15:22:40.649 1210 ERROR rally.task.runner server = self._boot_server(image, flavor, **create_vm_params) 2021-04-29 15:22:40.649 1210 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 15:22:40.649 1210 ERROR rally.task.runner f = func(self, *args, **kwargs) 2021-04-29 15:22:40.649 1210 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 88, in _boot_server 2021-04-29 15:22:40.649 1210 ERROR rally.task.runner check_interval=CONF.openstack.nova_server_boot_poll_interval 2021-04-29 15:22:40.649 1210 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/utils.py", line 252, in wait_for_status 2021-04-29 15:22:40.649 1210 ERROR rally.task.runner timeout=timeout) 2021-04-29 15:22:40.649 1210 ERROR rally.task.runner rally.exceptions.TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_b8bfb3fb_al2YfvJZ:a5e407e7-ccb7-47a7-9f51-24f277d07d40 to become ('ACTIVE') current status BUILD 2021-04-29 15:22:40.649 1210 ERROR rally.task.runner 2021-04-29 15:22:40.651 1210 INFO rally.task.runner [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | ITER: 5 END: Error TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_b8bfb3fb_al2YfvJZ:a5e407e7-ccb7-47a7-9f51-24f277d07d40 to become ('ACTIVE') current status BUILD 2021-04-29 15:22:42.346 1210 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_b8bfb3fb_ONgzo1TB. Status changed: AVAILABLE => DELETING in 0.26360535621643066 2021-04-29 15:22:46.965 1210 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_b8bfb3fb_XgxehxiQ. Status changed: DETACHING => AVAILABLE in 42.224892377853394 2021-04-29 15:23:20.044 1210 RALLYDEBUG rally.task.utils [-] Waiting for resource s_rally_b8bfb3fb_XgxehxiQ. Status changed: AVAILABLE => DELETING in 0.0925450325012207 2021-04-29 15:25:07.887 1210 INFO rally.task.runner [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | ITER: 1 END: OK 2021-04-29 15:25:31.989 1210 INFO rally.task.runner [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | ITER: 2 END: OK 2021-04-29 15:25:32.005 1210 INFO rally.task.context [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Context cleanup@openstack cleanup() started 2021-04-29 15:25:32.015 1210 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up nova servers objects 2021-04-29 15:25:35.776 1210 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting nova.servers object s_rally_b8bfb3fb_al2YfvJZ (a5e407e7-ccb7-47a7-9f51-24f277d07d40) 2021-04-29 15:25:35.781 1210 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting nova.servers object s_rally_b8bfb3fb_CbViyu2B (476972f2-bf88-4f64-a521-ab54756adbfa) 2021-04-29 15:25:35.785 1210 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting nova.servers object s_rally_b8bfb3fb_6o8hIZXY (3532b792-b53a-408f-96ce-a9a672f85f79) 2021-04-29 15:25:35.790 1210 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting nova.servers object s_rally_b8bfb3fb_nuofxbrK (57be8a05-05ef-40d7-b93f-027765839fe7) 2021-04-29 15:27:51.073 1210 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up nova server_groups objects 2021-04-29 15:27:53.060 1210 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up nova keypairs objects 2021-04-29 15:27:56.873 1210 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up cinder backups objects 2021-04-29 15:27:58.615 1210 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up cinder volume_snapshots objects 2021-04-29 15:28:00.472 1210 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up cinder transfers objects 2021-04-29 15:28:02.170 1210 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up cinder volumes objects 2021-04-29 15:28:04.139 1210 INFO rally.task.context [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Context cleanup@openstack cleanup() finished in 2.54 min 2021-04-29 15:28:04.140 1210 INFO rally.task.context [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Context quotas@openstack cleanup() started 2021-04-29 15:28:33.902 1210 INFO rally.task.context [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Context quotas@openstack cleanup() finished in 29.76 sec 2021-04-29 15:28:33.903 1210 INFO rally.task.context [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Context api_versions@openstack cleanup() started 2021-04-29 15:28:33.904 1210 INFO rally.task.context [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Context api_versions@openstack cleanup() finished in 0.60 msec 2021-04-29 15:28:33.904 1210 INFO rally.task.context [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Context users@openstack cleanup() started 2021-04-29 15:30:54.401 1210 INFO rally.task.context [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Context users@openstack cleanup() finished in 2.34 min 2021-04-29 15:30:54.570 1210 INFO rally.task.engine [-] Load duration is: 791.361036 2021-04-29 15:30:54.570 1210 INFO rally.task.engine [-] Full runner duration is: 792.403066 2021-04-29 15:30:54.571 1210 INFO rally.task.engine [-] Full duration is: 1361.721297 2021-04-29 15:30:54.665 1210 INFO rally.task.engine [-] Received aborting signal. 2021-04-29 15:30:54.677 1210 INFO rally.task.engine [-] Task 0abb981b-0dc5-4055-94cb-a0facd865f16 | Completed: Running task. 2021-04-29 15:30:56.042 1525 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 15:30:56.042 1525 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 15:30:56.042 1525 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 15:30:57.235 1526 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 15:30:57.236 1526 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 15:30:57.236 1526 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 15:30:58.405 1527 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 15:30:58.405 1527 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 15:30:58.405 1527 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 15:31:00.190 1527 INFO rally.api [-] Building 'json' report for the following task(s): '0abb981b-0dc5-4055-94cb-a0facd865f16'. 2021-04-29 15:31:00.194 1527 INFO rally.api [-] The report has been successfully built. 2021-04-29 15:31:01.861 1529 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 15:31:01.861 1529 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 15:31:01.862 1529 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 15:31:03.816 1529 INFO rally.task.engine [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | Starting: Task validation. 2021-04-29 15:31:03.828 1529 INFO rally.task.engine [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | Starting: Task validation of syntax. 2021-04-29 15:31:03.947 1529 INFO rally.task.engine [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | Completed: Task validation of syntax. 2021-04-29 15:31:03.948 1529 INFO rally.task.engine [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | Starting: Task validation of required platforms. 2021-04-29 15:31:04.021 1529 INFO rally.task.engine [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | Completed: Task validation of required platforms. 2021-04-29 15:31:04.022 1529 INFO rally.task.engine [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | Starting: Task validation of semantic. 2021-04-29 15:31:04.022 1529 INFO rally.task.engine [-] Check health of the environment '475eaff9-f5cd-46ab-8b1c-6c36dbc836ee'. 2021-04-29 15:31:05.406 1529 INFO rally.task.engine [-] Platform existing@openstack (available: True): OK! 2021-04-29 15:31:05.423 1529 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 1 tenants using 20 threads 2021-04-29 15:31:18.243 1529 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 1 users using 20 threads 2021-04-29 15:31:40.270 1529 INFO rally.task.context [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | Context users@openstack setup() finished in 34.85 sec 2021-04-29 15:31:41.284 1529 RALLYDEBUG rally_openstack.contexts.keystone.roles [-] Adding role heat_stack_owner having ID 69ce0ab727b3477f892259e4f6d37464 to all users using 30 threads 2021-04-29 15:31:55.973 1529 RALLYDEBUG rally_openstack.contexts.keystone.roles [-] Removing assigned role 69ce0ab727b3477f892259e4f6d37464 from all users 2021-04-29 15:32:08.071 1529 RALLYDEBUG rally_openstack.contexts.keystone.roles [-] Adding role heat_stack_owner having ID 69ce0ab727b3477f892259e4f6d37464 to all users using 30 threads 2021-04-29 15:32:22.586 1529 RALLYDEBUG rally_openstack.contexts.keystone.roles [-] Removing assigned role 69ce0ab727b3477f892259e4f6d37464 from all users 2021-04-29 15:32:33.639 1529 RALLYDEBUG rally_openstack.contexts.keystone.roles [-] Adding role heat_stack_owner having ID 69ce0ab727b3477f892259e4f6d37464 to all users using 30 threads 2021-04-29 15:32:42.777 1529 RALLYDEBUG rally_openstack.contexts.keystone.roles [-] Removing assigned role 69ce0ab727b3477f892259e4f6d37464 from all users 2021-04-29 15:32:51.096 1529 RALLYDEBUG rally_openstack.contexts.keystone.roles [-] Adding role heat_stack_owner having ID 69ce0ab727b3477f892259e4f6d37464 to all users using 30 threads 2021-04-29 15:33:01.864 1529 RALLYDEBUG rally_openstack.contexts.keystone.roles [-] Removing assigned role 69ce0ab727b3477f892259e4f6d37464 from all users 2021-04-29 15:33:15.023 1529 RALLYDEBUG rally_openstack.contexts.keystone.roles [-] Adding role heat_stack_owner having ID 69ce0ab727b3477f892259e4f6d37464 to all users using 30 threads 2021-04-29 15:33:28.004 1529 RALLYDEBUG rally_openstack.contexts.keystone.roles [-] Removing assigned role 69ce0ab727b3477f892259e4f6d37464 from all users 2021-04-29 15:33:44.817 1529 RALLYDEBUG rally_openstack.contexts.keystone.roles [-] Adding role heat_stack_owner having ID 69ce0ab727b3477f892259e4f6d37464 to all users using 30 threads 2021-04-29 15:33:57.224 1529 RALLYDEBUG rally_openstack.contexts.keystone.roles [-] Removing assigned role 69ce0ab727b3477f892259e4f6d37464 from all users 2021-04-29 15:34:12.316 1529 RALLYDEBUG rally_openstack.contexts.keystone.roles [-] Adding role heat_stack_owner having ID 69ce0ab727b3477f892259e4f6d37464 to all users using 30 threads 2021-04-29 15:34:18.636 1529 RALLYDEBUG rally_openstack.contexts.keystone.roles [-] Removing assigned role 69ce0ab727b3477f892259e4f6d37464 from all users 2021-04-29 15:34:27.070 1529 RALLYDEBUG rally_openstack.contexts.keystone.roles [-] Adding role heat_stack_owner having ID 69ce0ab727b3477f892259e4f6d37464 to all users using 30 threads 2021-04-29 15:34:30.635 1529 RALLYDEBUG rally_openstack.contexts.keystone.roles [-] Removing assigned role 69ce0ab727b3477f892259e4f6d37464 from all users 2021-04-29 15:34:36.966 1529 RALLYDEBUG rally_openstack.contexts.keystone.roles [-] Adding role heat_stack_owner having ID 69ce0ab727b3477f892259e4f6d37464 to all users using 30 threads 2021-04-29 15:34:48.697 1529 RALLYDEBUG rally_openstack.contexts.keystone.roles [-] Removing assigned role 69ce0ab727b3477f892259e4f6d37464 from all users 2021-04-29 15:34:58.573 1529 INFO rally.task.context [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | Context users@openstack cleanup() started 2021-04-29 15:35:47.215 1529 INFO rally.task.context [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | Context users@openstack cleanup() finished in 48.64 sec 2021-04-29 15:35:47.216 1529 INFO rally.task.engine [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | Completed: Task validation of semantic. 2021-04-29 15:35:47.216 1529 INFO rally.task.engine [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | Completed: Task validation. 2021-04-29 15:35:47.217 1529 INFO rally.api [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a input file is valid. 2021-04-29 15:35:47.217 1529 INFO rally.api [-] Run Task 9a9b4606-9f2a-45b6-b29d-fe107594440a against Deployment 475eaff9-f5cd-46ab-8b1c-6c36dbc836ee 2021-04-29 15:35:47.218 1529 INFO rally.task.engine [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | Starting: Running task. 2021-04-29 15:35:47.269 1529 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=3cb1940a-2feb-4ffb-93d2-c07a18a8518a)", "subtasks": [ { "title": "HeatStacks.create_and_list_stack", "description": "Create a stack and then list all stacks.", "scenario": { "HeatStacks.create_and_list_stack": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/default.yaml.template" } }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "roles": [ "heat_stack_owner" ] }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 15:35:47.284 1529 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 15:35:51.331 1529 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 15:36:42.444 1529 INFO rally.task.context [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | Context users@openstack setup() finished in 55.16 sec 2021-04-29 15:36:43.510 1529 RALLYDEBUG rally_openstack.contexts.keystone.roles [-] Adding role heat_stack_owner having ID 69ce0ab727b3477f892259e4f6d37464 to all users using 30 threads 2021-04-29 15:37:11.585 1529 INFO rally.task.context [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | Context roles@openstack setup() finished in 29.14 sec 2021-04-29 15:37:11.586 1529 INFO rally.task.context [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | Context cleanup@openstack setup() finished in 0.01 msec 2021-04-29 15:37:11.598 1529 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: 9a9b4606-9f2a-45b6-b29d-fe107594440a). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 15:37:11.601 1529 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"template_path": "heat_template_version: 2014-10-16"} 2021-04-29 15:37:11.602 1529 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"template_path": "heat_template_version: 2014-10-16"} 2021-04-29 15:37:11.603 1529 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"template_path": "heat_template_version: 2014-10-16"} 2021-04-29 15:37:11.612 1529 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"template_path": "heat_template_version: 2014-10-16"} 2021-04-29 15:37:11.613 1529 INFO rally.task.runner [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | ITER: 1 START 2021-04-29 15:37:11.622 1529 INFO rally.task.runner [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | ITER: 2 START 2021-04-29 15:37:11.633 1529 INFO rally.task.runner [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | ITER: 3 START 2021-04-29 15:37:11.642 1529 INFO rally.task.runner [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | ITER: 4 START 2021-04-29 15:38:12.299 1529 ERROR rally.task.runner [-] Iteration 1 raised Exception: heatclient.exc.HTTPException: ERROR: b'\r\n504 Gateway Time-out\r\n\r\n

504 Gateway Time-out

\r\n
nginx
\r\n\r\n\r\n' 2021-04-29 15:38:12.299 1529 ERROR rally.task.runner Traceback (most recent call last): 2021-04-29 15:38:12.299 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once 2021-04-29 15:38:12.299 1529 ERROR rally.task.runner getattr(scenario_inst, method_name)(**scenario_kwargs) 2021-04-29 15:38:12.299 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/heat/stacks.py", line 50, in run 2021-04-29 15:38:12.299 1529 ERROR rally.task.runner files, environment) 2021-04-29 15:38:12.299 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 15:38:12.299 1529 ERROR rally.task.runner f = func(self, *args, **kwargs) 2021-04-29 15:38:12.299 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/heat/utils.py", line 65, in _create_stack 2021-04-29 15:38:12.299 1529 ERROR rally.task.runner stack_id = self.clients("heat").stacks.create(**kw)["stack"]["id"] 2021-04-29 15:38:12.299 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/heatclient/v1/stacks.py", line 171, in create 2021-04-29 15:38:12.299 1529 ERROR rally.task.runner data=kwargs, headers=headers) 2021-04-29 15:38:12.299 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post 2021-04-29 15:38:12.299 1529 ERROR rally.task.runner return self.request(url, 'POST', **kwargs) 2021-04-29 15:38:12.299 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/heatclient/common/http.py", line 323, in request 2021-04-29 15:38:12.299 1529 ERROR rally.task.runner raise exc.from_response(resp) 2021-04-29 15:38:12.299 1529 ERROR rally.task.runner heatclient.exc.HTTPException: ERROR: b'\r\n504 Gateway Time-out\r\n\r\n

504 Gateway Time-out

\r\n
nginx
\r\n\r\n\r\n' 2021-04-29 15:38:12.299 1529 ERROR rally.task.runner 2021-04-29 15:38:12.301 1529 ERROR rally.task.runner [-] Iteration 4 raised Exception: heatclient.exc.HTTPException: ERROR: b'\r\n504 Gateway Time-out\r\n\r\n

504 Gateway Time-out

\r\n
nginx
\r\n\r\n\r\n' 2021-04-29 15:38:12.301 1529 ERROR rally.task.runner Traceback (most recent call last): 2021-04-29 15:38:12.301 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once 2021-04-29 15:38:12.301 1529 ERROR rally.task.runner getattr(scenario_inst, method_name)(**scenario_kwargs) 2021-04-29 15:38:12.301 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/heat/stacks.py", line 50, in run 2021-04-29 15:38:12.301 1529 ERROR rally.task.runner files, environment) 2021-04-29 15:38:12.301 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 15:38:12.301 1529 ERROR rally.task.runner f = func(self, *args, **kwargs) 2021-04-29 15:38:12.301 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/heat/utils.py", line 65, in _create_stack 2021-04-29 15:38:12.301 1529 ERROR rally.task.runner stack_id = self.clients("heat").stacks.create(**kw)["stack"]["id"] 2021-04-29 15:38:12.301 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/heatclient/v1/stacks.py", line 171, in create 2021-04-29 15:38:12.301 1529 ERROR rally.task.runner data=kwargs, headers=headers) 2021-04-29 15:38:12.301 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post 2021-04-29 15:38:12.301 1529 ERROR rally.task.runner return self.request(url, 'POST', **kwargs) 2021-04-29 15:38:12.301 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/heatclient/common/http.py", line 323, in request 2021-04-29 15:38:12.301 1529 ERROR rally.task.runner raise exc.from_response(resp) 2021-04-29 15:38:12.301 1529 ERROR rally.task.runner heatclient.exc.HTTPException: ERROR: b'\r\n504 Gateway Time-out\r\n\r\n

504 Gateway Time-out

\r\n
nginx
\r\n\r\n\r\n' 2021-04-29 15:38:12.301 1529 ERROR rally.task.runner 2021-04-29 15:38:12.302 1529 INFO rally.task.runner [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | ITER: 1 END: Error HTTPException: ERROR: b'\r\n504 Gateway Time-out\r\n\r\n

504 Gateway Time-out

\r\n
nginx
\r\n\r\n\r\n' 2021-04-29 15:38:12.304 1529 INFO rally.task.runner [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | ITER: 4 END: Error HTTPException: ERROR: b'\r\n504 Gateway Time-out\r\n\r\n

504 Gateway Time-out

\r\n
nginx
\r\n\r\n\r\n' 2021-04-29 15:38:12.309 1529 INFO rally.task.runner [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | ITER: 5 START 2021-04-29 15:38:12.322 1529 INFO rally.task.runner [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | ITER: 6 START 2021-04-29 15:38:12.893 1529 ERROR rally.task.runner [-] Iteration 3 raised Exception: heatclient.exc.HTTPException: ERROR: b'\r\n504 Gateway Time-out\r\n\r\n

504 Gateway Time-out

\r\n
nginx
\r\n\r\n\r\n' 2021-04-29 15:38:12.893 1529 ERROR rally.task.runner Traceback (most recent call last): 2021-04-29 15:38:12.893 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once 2021-04-29 15:38:12.893 1529 ERROR rally.task.runner getattr(scenario_inst, method_name)(**scenario_kwargs) 2021-04-29 15:38:12.893 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/heat/stacks.py", line 50, in run 2021-04-29 15:38:12.893 1529 ERROR rally.task.runner files, environment) 2021-04-29 15:38:12.893 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 15:38:12.893 1529 ERROR rally.task.runner f = func(self, *args, **kwargs) 2021-04-29 15:38:12.893 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/heat/utils.py", line 65, in _create_stack 2021-04-29 15:38:12.893 1529 ERROR rally.task.runner stack_id = self.clients("heat").stacks.create(**kw)["stack"]["id"] 2021-04-29 15:38:12.893 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/heatclient/v1/stacks.py", line 171, in create 2021-04-29 15:38:12.893 1529 ERROR rally.task.runner data=kwargs, headers=headers) 2021-04-29 15:38:12.893 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post 2021-04-29 15:38:12.893 1529 ERROR rally.task.runner return self.request(url, 'POST', **kwargs) 2021-04-29 15:38:12.893 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/heatclient/common/http.py", line 323, in request 2021-04-29 15:38:12.893 1529 ERROR rally.task.runner raise exc.from_response(resp) 2021-04-29 15:38:12.893 1529 ERROR rally.task.runner heatclient.exc.HTTPException: ERROR: b'\r\n504 Gateway Time-out\r\n\r\n

504 Gateway Time-out

\r\n
nginx
\r\n\r\n\r\n' 2021-04-29 15:38:12.893 1529 ERROR rally.task.runner 2021-04-29 15:38:12.895 1529 INFO rally.task.runner [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | ITER: 3 END: Error HTTPException: ERROR: b'\r\n504 Gateway Time-out\r\n\r\n

504 Gateway Time-out

\r\n
nginx
\r\n\r\n\r\n' 2021-04-29 15:38:13.450 1529 ERROR rally.task.runner [-] Iteration 2 raised Exception: heatclient.exc.HTTPException: ERROR: b'\r\n504 Gateway Time-out\r\n\r\n

504 Gateway Time-out

\r\n
nginx
\r\n\r\n\r\n' 2021-04-29 15:38:13.450 1529 ERROR rally.task.runner Traceback (most recent call last): 2021-04-29 15:38:13.450 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once 2021-04-29 15:38:13.450 1529 ERROR rally.task.runner getattr(scenario_inst, method_name)(**scenario_kwargs) 2021-04-29 15:38:13.450 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/heat/stacks.py", line 50, in run 2021-04-29 15:38:13.450 1529 ERROR rally.task.runner files, environment) 2021-04-29 15:38:13.450 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 15:38:13.450 1529 ERROR rally.task.runner f = func(self, *args, **kwargs) 2021-04-29 15:38:13.450 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/heat/utils.py", line 65, in _create_stack 2021-04-29 15:38:13.450 1529 ERROR rally.task.runner stack_id = self.clients("heat").stacks.create(**kw)["stack"]["id"] 2021-04-29 15:38:13.450 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/heatclient/v1/stacks.py", line 171, in create 2021-04-29 15:38:13.450 1529 ERROR rally.task.runner data=kwargs, headers=headers) 2021-04-29 15:38:13.450 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post 2021-04-29 15:38:13.450 1529 ERROR rally.task.runner return self.request(url, 'POST', **kwargs) 2021-04-29 15:38:13.450 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/heatclient/common/http.py", line 323, in request 2021-04-29 15:38:13.450 1529 ERROR rally.task.runner raise exc.from_response(resp) 2021-04-29 15:38:13.450 1529 ERROR rally.task.runner heatclient.exc.HTTPException: ERROR: b'\r\n504 Gateway Time-out\r\n\r\n

504 Gateway Time-out

\r\n
nginx
\r\n\r\n\r\n' 2021-04-29 15:38:13.450 1529 ERROR rally.task.runner 2021-04-29 15:38:13.451 1529 INFO rally.task.runner [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | ITER: 2 END: Error HTTPException: ERROR: b'\r\n504 Gateway Time-out\r\n\r\n

504 Gateway Time-out

\r\n
nginx
\r\n\r\n\r\n' 2021-04-29 15:39:12.971 1529 ERROR rally.task.runner [-] Iteration 5 raised Exception: heatclient.exc.HTTPException: ERROR: b'\r\n504 Gateway Time-out\r\n\r\n

504 Gateway Time-out

\r\n
nginx
\r\n\r\n\r\n' 2021-04-29 15:39:12.971 1529 ERROR rally.task.runner Traceback (most recent call last): 2021-04-29 15:39:12.971 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once 2021-04-29 15:39:12.971 1529 ERROR rally.task.runner getattr(scenario_inst, method_name)(**scenario_kwargs) 2021-04-29 15:39:12.971 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/heat/stacks.py", line 50, in run 2021-04-29 15:39:12.971 1529 ERROR rally.task.runner files, environment) 2021-04-29 15:39:12.971 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 15:39:12.971 1529 ERROR rally.task.runner f = func(self, *args, **kwargs) 2021-04-29 15:39:12.971 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/heat/utils.py", line 65, in _create_stack 2021-04-29 15:39:12.971 1529 ERROR rally.task.runner stack_id = self.clients("heat").stacks.create(**kw)["stack"]["id"] 2021-04-29 15:39:12.971 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/heatclient/v1/stacks.py", line 171, in create 2021-04-29 15:39:12.971 1529 ERROR rally.task.runner data=kwargs, headers=headers) 2021-04-29 15:39:12.971 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post 2021-04-29 15:39:12.971 1529 ERROR rally.task.runner return self.request(url, 'POST', **kwargs) 2021-04-29 15:39:12.971 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/heatclient/common/http.py", line 323, in request 2021-04-29 15:39:12.971 1529 ERROR rally.task.runner raise exc.from_response(resp) 2021-04-29 15:39:12.971 1529 ERROR rally.task.runner heatclient.exc.HTTPException: ERROR: b'\r\n504 Gateway Time-out\r\n\r\n

504 Gateway Time-out

\r\n
nginx
\r\n\r\n\r\n' 2021-04-29 15:39:12.971 1529 ERROR rally.task.runner 2021-04-29 15:39:12.973 1529 INFO rally.task.runner [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | ITER: 5 END: Error HTTPException: ERROR: b'\r\n504 Gateway Time-out\r\n\r\n

504 Gateway Time-out

\r\n
nginx
\r\n\r\n\r\n' 2021-04-29 15:39:19.253 1529 ERROR rally.task.runner [-] Iteration 6 raised Exception: heatclient.exc.HTTPException: ERROR: b'\r\n504 Gateway Time-out\r\n\r\n

504 Gateway Time-out

\r\n
nginx
\r\n\r\n\r\n' 2021-04-29 15:39:19.253 1529 ERROR rally.task.runner Traceback (most recent call last): 2021-04-29 15:39:19.253 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once 2021-04-29 15:39:19.253 1529 ERROR rally.task.runner getattr(scenario_inst, method_name)(**scenario_kwargs) 2021-04-29 15:39:19.253 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/heat/stacks.py", line 50, in run 2021-04-29 15:39:19.253 1529 ERROR rally.task.runner files, environment) 2021-04-29 15:39:19.253 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 15:39:19.253 1529 ERROR rally.task.runner f = func(self, *args, **kwargs) 2021-04-29 15:39:19.253 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/heat/utils.py", line 65, in _create_stack 2021-04-29 15:39:19.253 1529 ERROR rally.task.runner stack_id = self.clients("heat").stacks.create(**kw)["stack"]["id"] 2021-04-29 15:39:19.253 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/heatclient/v1/stacks.py", line 171, in create 2021-04-29 15:39:19.253 1529 ERROR rally.task.runner data=kwargs, headers=headers) 2021-04-29 15:39:19.253 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post 2021-04-29 15:39:19.253 1529 ERROR rally.task.runner return self.request(url, 'POST', **kwargs) 2021-04-29 15:39:19.253 1529 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/heatclient/common/http.py", line 323, in request 2021-04-29 15:39:19.253 1529 ERROR rally.task.runner raise exc.from_response(resp) 2021-04-29 15:39:19.253 1529 ERROR rally.task.runner heatclient.exc.HTTPException: ERROR: b'\r\n504 Gateway Time-out\r\n\r\n

504 Gateway Time-out

\r\n
nginx
\r\n\r\n\r\n' 2021-04-29 15:39:19.253 1529 ERROR rally.task.runner 2021-04-29 15:39:19.255 1529 INFO rally.task.runner [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | ITER: 6 END: Error HTTPException: ERROR: b'\r\n504 Gateway Time-out\r\n\r\n

504 Gateway Time-out

\r\n
nginx
\r\n\r\n\r\n' 2021-04-29 15:39:19.268 1529 INFO rally.task.context [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | Context cleanup@openstack cleanup() started 2021-04-29 15:39:19.273 1529 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up heat stacks objects 2021-04-29 15:39:22.030 1529 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting heat.stacks object s_rally_3cb1940a_CdBACzq1 (73cfcba4-983e-4702-88fa-262024c99f0f) 2021-04-29 15:39:22.035 1529 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting heat.stacks object s_rally_3cb1940a_2uGGv5mb (ee460e0b-ddc3-471e-8292-d526f591d651) 2021-04-29 15:39:22.044 1529 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting heat.stacks object s_rally_3cb1940a_xxSe6iPB (247a92a7-2665-4c1b-ba7b-6204ec6a61ef) 2021-04-29 15:39:22.060 1529 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting heat.stacks object s_rally_3cb1940a_LHrQOT9A (2fc414dd-7a53-48d8-b050-28b76c3af16c) 2021-04-29 15:39:22.072 1529 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting heat.stacks object s_rally_3cb1940a_E4h5hbmG (9b18bbf9-c1e0-4f38-9c1b-64dcffd821ae) 2021-04-29 15:39:22.086 1529 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting heat.stacks object s_rally_3cb1940a_WITXYfQX (08b654ee-0ca3-4586-9643-a47479588b9e) 2021-04-29 15:49:58.770 1529 WARNING rally_openstack.cleanup.manager [-] Resource deletion failed, timeout occurred for heat.stacks: 2fc414dd-7a53-48d8-b050-28b76c3af16c. 2021-04-29 15:49:58.774 1529 INFO rally.task.context [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | Context cleanup@openstack cleanup() finished in 10.66 min 2021-04-29 15:49:58.774 1529 INFO rally.task.context [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | Context roles@openstack cleanup() started 2021-04-29 15:49:58.775 1529 RALLYDEBUG rally_openstack.contexts.keystone.roles [-] Removing assigned role 69ce0ab727b3477f892259e4f6d37464 from all users 2021-04-29 15:50:46.765 1529 INFO rally.task.context [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | Context roles@openstack cleanup() finished in 47.99 sec 2021-04-29 15:50:46.766 1529 INFO rally.task.context [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | Context users@openstack cleanup() started 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find user: 95f29b1dee404735967fcb7d161d57aa. (HTTP 404) (Request-ID: req-b026469e-9a41-4308-8b79-5f38ae91c98b) 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker consume(cache, args) 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find user: 95f29b1dee404735967fcb7d161d57aa. (HTTP 404) (Request-ID: req-b026469e-9a41-4308-8b79-5f38ae91c98b) 2021-04-29 15:54:48.146 1529 ERROR rally.common.broker 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find user: aab9bfa7fde940fa8302ac0c4545feda. (HTTP 404) (Request-ID: req-ac491591-4312-463d-9d71-54267afc0570) 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker consume(cache, args) 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find user: aab9bfa7fde940fa8302ac0c4545feda. (HTTP 404) (Request-ID: req-ac491591-4312-463d-9d71-54267afc0570) 2021-04-29 15:54:55.702 1529 ERROR rally.common.broker 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.GatewayTimeout: Gateway Timeout (HTTP 504) 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker consume(cache, args) 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker keystoneauth1.exceptions.http.GatewayTimeout: Gateway Timeout (HTTP 504) 2021-04-29 15:55:47.743 1529 ERROR rally.common.broker 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.GatewayTimeout: Gateway Timeout (HTTP 504) 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker consume(cache, args) 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker keystoneauth1.exceptions.http.GatewayTimeout: Gateway Timeout (HTTP 504) 2021-04-29 15:55:47.746 1529 ERROR rally.common.broker 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.GatewayTimeout: Gateway Timeout (HTTP 504) 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker consume(cache, args) 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker keystoneauth1.exceptions.http.GatewayTimeout: Gateway Timeout (HTTP 504) 2021-04-29 15:55:47.749 1529 ERROR rally.common.broker 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.GatewayTimeout: Gateway Timeout (HTTP 504) 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker consume(cache, args) 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker keystoneauth1.exceptions.http.GatewayTimeout: Gateway Timeout (HTTP 504) 2021-04-29 15:55:47.750 1529 ERROR rally.common.broker 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find project: 339d5842407d44f4838a2fbba1aa0df4. (HTTP 404) (Request-ID: req-d0296d7b-02d3-48a2-93d5-8fd9ba65ca4e) 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker consume(cache, args) 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 59, in delete_project 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker return self._impl.delete_project(project_id) 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_v3.py", line 260, in delete_project 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker return self._impl.delete_project(project_id) 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker f = func(self, *args, **kwargs) 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_v3.py", line 75, in delete_project 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker self._clients.keystone("3").projects.delete(project_id) 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/projects.py", line 261, in delete 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker project_id=base.getid(project)) 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find project: 339d5842407d44f4838a2fbba1aa0df4. (HTTP 404) (Request-ID: req-d0296d7b-02d3-48a2-93d5-8fd9ba65ca4e) 2021-04-29 15:56:49.867 1529 ERROR rally.common.broker 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find project: 116e42b80e5b4520931aa18c27003768. (HTTP 404) (Request-ID: req-6a01c92f-00ff-4bf7-b481-c9923e8280cc) 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker consume(cache, args) 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 59, in delete_project 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker return self._impl.delete_project(project_id) 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_v3.py", line 260, in delete_project 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker return self._impl.delete_project(project_id) 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker f = func(self, *args, **kwargs) 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_v3.py", line 75, in delete_project 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker self._clients.keystone("3").projects.delete(project_id) 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/projects.py", line 261, in delete 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker project_id=base.getid(project)) 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find project: 116e42b80e5b4520931aa18c27003768. (HTTP 404) (Request-ID: req-6a01c92f-00ff-4bf7-b481-c9923e8280cc) 2021-04-29 15:56:49.919 1529 ERROR rally.common.broker 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find project: 51091fcf84654c7891ed46be3193b6b1. (HTTP 404) (Request-ID: req-947bed68-4e17-4ffa-a0cc-14eec847fbea) 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker consume(cache, args) 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 59, in delete_project 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker return self._impl.delete_project(project_id) 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_v3.py", line 260, in delete_project 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker return self._impl.delete_project(project_id) 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker f = func(self, *args, **kwargs) 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_v3.py", line 75, in delete_project 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker self._clients.keystone("3").projects.delete(project_id) 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/projects.py", line 261, in delete 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker project_id=base.getid(project)) 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find project: 51091fcf84654c7891ed46be3193b6b1. (HTTP 404) (Request-ID: req-947bed68-4e17-4ffa-a0cc-14eec847fbea) 2021-04-29 15:57:40.527 1529 ERROR rally.common.broker 2021-04-29 15:57:40.530 1529 INFO rally.task.context [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | Context users@openstack cleanup() finished in 6.90 min 2021-04-29 15:57:40.633 1529 INFO rally.task.engine [-] Load duration is: 127.638959 2021-04-29 15:57:40.634 1529 INFO rally.task.engine [-] Full runner duration is: 127.670154 2021-04-29 15:57:40.634 1529 INFO rally.task.engine [-] Full duration is: 1313.248278 2021-04-29 15:57:40.726 1529 INFO rally.task.engine [-] Received aborting signal. 2021-04-29 15:57:40.739 1529 INFO rally.task.engine [-] Task 9a9b4606-9f2a-45b6-b29d-fe107594440a | Completed: Running task. 2021-04-29 15:57:42.054 2325 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 15:57:42.054 2325 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 15:57:42.054 2325 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 15:57:43.267 2326 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 15:57:43.267 2326 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 15:57:43.268 2326 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 15:57:44.491 2327 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 15:57:44.492 2327 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 15:57:44.492 2327 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 15:57:46.247 2327 INFO rally.api [-] Building 'json' report for the following task(s): '9a9b4606-9f2a-45b6-b29d-fe107594440a'. 2021-04-29 15:57:46.250 2327 INFO rally.api [-] The report has been successfully built. 2021-04-29 15:57:47.906 2329 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 15:57:47.906 2329 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 15:57:47.906 2329 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 15:57:49.830 2329 INFO rally.task.engine [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Starting: Task validation. 2021-04-29 15:57:49.842 2329 INFO rally.task.engine [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Starting: Task validation of syntax. 2021-04-29 15:57:49.952 2329 INFO rally.task.engine [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Completed: Task validation of syntax. 2021-04-29 15:57:49.953 2329 INFO rally.task.engine [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Starting: Task validation of required platforms. 2021-04-29 15:57:50.023 2329 INFO rally.task.engine [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Completed: Task validation of required platforms. 2021-04-29 15:57:50.023 2329 INFO rally.task.engine [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Starting: Task validation of semantic. 2021-04-29 15:57:50.023 2329 INFO rally.task.engine [-] Check health of the environment '475eaff9-f5cd-46ab-8b1c-6c36dbc836ee'. 2021-04-29 15:57:51.881 2329 INFO rally.task.engine [-] Platform existing@openstack (available: True): OK! 2021-04-29 15:57:51.896 2329 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 1 tenants using 20 threads 2021-04-29 15:58:24.325 2329 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 1 users using 20 threads 2021-04-29 15:59:00.019 2329 INFO rally.task.context [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Context users@openstack setup() finished in 1.14 min 2021-04-29 15:59:00.120 2329 INFO rally.task.context [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Context users@openstack cleanup() started 2021-04-29 16:00:26.269 2329 INFO rally.task.context [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Context users@openstack cleanup() finished in 1.44 min 2021-04-29 16:00:26.270 2329 INFO rally.task.engine [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Completed: Task validation of semantic. 2021-04-29 16:00:26.270 2329 INFO rally.task.engine [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Completed: Task validation. 2021-04-29 16:00:26.270 2329 INFO rally.api [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 input file is valid. 2021-04-29 16:00:26.271 2329 INFO rally.api [-] Run Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 against Deployment 475eaff9-f5cd-46ab-8b1c-6c36dbc836ee 2021-04-29 16:00:26.271 2329 INFO rally.task.engine [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Starting: Running task. 2021-04-29 16:00:26.325 2329 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=1547739b-70f9-40fa-8dca-12e3c2e15690)", "subtasks": [ { "title": "KeystoneBasic.add_and_remove_user_role", "description": "Create a user role add to a user and disassociate.", "scenario": { "KeystoneBasic.add_and_remove_user_role": {} }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 16:00:26.339 2329 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.BadGateway: Bad Gateway (HTTP 502) 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker consume(cache, args) 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 180, in consume 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker tenant = cache["client"].create_project(domain_name=domain) 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 41, in create_project 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker domain_name=domain_name) 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_v3.py", line 243, in create_project 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker domain_name=domain_name) 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker f = func(self, *args, **kwargs) 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_v3.py", line 52, in create_project 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker domain=domain_id) 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/projects.py", line 113, in create 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker **kwargs) 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 386, in create 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker self.key) 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 192, in _post 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker resp, body = self.client.post(url, body=body, **kwargs) 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker return self.request(url, 'POST', **kwargs) 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker keystoneauth1.exceptions.http.BadGateway: Bad Gateway (HTTP 502) 2021-04-29 16:01:20.190 2329 ERROR rally.common.broker 2021-04-29 16:01:20.199 2329 INFO rally.task.context [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Context users@openstack cleanup() started 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find project: 57e286579e0e40b7b246e596794f41d3. (HTTP 404) (Request-ID: req-bd3ed279-c2a9-4836-b6c3-ef3d26302f94) 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker consume(cache, args) 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 59, in delete_project 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker return self._impl.delete_project(project_id) 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_v3.py", line 260, in delete_project 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker return self._impl.delete_project(project_id) 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker f = func(self, *args, **kwargs) 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_v3.py", line 75, in delete_project 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker self._clients.keystone("3").projects.delete(project_id) 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/projects.py", line 261, in delete 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker project_id=base.getid(project)) 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find project: 57e286579e0e40b7b246e596794f41d3. (HTTP 404) (Request-ID: req-bd3ed279-c2a9-4836-b6c3-ef3d26302f94) 2021-04-29 16:02:15.313 2329 ERROR rally.common.broker 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find project: 43919adbd0c3433c914948e7fdfea563. (HTTP 404) (Request-ID: req-e2419ca0-4a59-4bec-b62c-a5285af8fb05) 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker consume(cache, args) 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 59, in delete_project 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker return self._impl.delete_project(project_id) 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_v3.py", line 260, in delete_project 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker return self._impl.delete_project(project_id) 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker f = func(self, *args, **kwargs) 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_v3.py", line 75, in delete_project 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker self._clients.keystone("3").projects.delete(project_id) 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/projects.py", line 261, in delete 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker project_id=base.getid(project)) 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find project: 43919adbd0c3433c914948e7fdfea563. (HTTP 404) (Request-ID: req-e2419ca0-4a59-4bec-b62c-a5285af8fb05) 2021-04-29 16:03:13.742 2329 ERROR rally.common.broker 2021-04-29 16:03:13.746 2329 INFO rally.task.context [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Context users@openstack cleanup() finished in 1.89 min 2021-04-29 16:03:15.007 2329 INFO rally.task.engine [-] Load duration is: 0.0 2021-04-29 16:03:15.008 2329 INFO rally.task.engine [-] Full runner duration is: 0.0 2021-04-29 16:03:15.008 2329 INFO rally.task.engine [-] Full duration is: 167.407807 2021-04-29 16:03:15.034 2329 ERROR rally.task.engine [-] Unexpected exception during the workload execution: rally.exceptions.ContextSetupFailure: Unable to setup context 'users': 'Failed to create the requested number of tenants.' 2021-04-29 16:03:15.034 2329 ERROR rally.task.engine Traceback (most recent call last): 2021-04-29 16:03:15.034 2329 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally/task/engine.py", line 513, in _run_workload 2021-04-29 16:03:15.034 2329 ERROR rally.task.engine with ctx_manager: 2021-04-29 16:03:15.034 2329 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally/task/context.py", line 311, in __enter__ 2021-04-29 16:03:15.034 2329 ERROR rally.task.engine self.setup() 2021-04-29 16:03:15.034 2329 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally/task/context.py", line 256, in setup 2021-04-29 16:03:15.034 2329 ERROR rally.task.engine ctx.setup() 2021-04-29 16:03:15.034 2329 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 334, in setup 2021-04-29 16:03:15.034 2329 ERROR rally.task.engine self.create_users() 2021-04-29 16:03:15.034 2329 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 286, in create_users 2021-04-29 16:03:15.034 2329 ERROR rally.task.engine msg="Failed to create the requested number of tenants.") 2021-04-29 16:03:15.034 2329 ERROR rally.task.engine rally.exceptions.ContextSetupFailure: Unable to setup context 'users': 'Failed to create the requested number of tenants.' 2021-04-29 16:03:15.034 2329 ERROR rally.task.engine 2021-04-29 16:03:15.079 2329 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=3548dba8-73ab-46d9-970d-aaf617414a01)", "subtasks": [ { "title": "KeystoneBasic.create_add_and_list_user_roles", "description": "Create user role, add it and list user roles for given user.", "scenario": { "KeystoneBasic.create_add_and_list_user_roles": {} }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 16:03:15.094 2329 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.GatewayTimeout: Gateway Timeout (HTTP 504) 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker consume(cache, args) 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 180, in consume 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker tenant = cache["client"].create_project(domain_name=domain) 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 41, in create_project 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker domain_name=domain_name) 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_v3.py", line 243, in create_project 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker domain_name=domain_name) 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker f = func(self, *args, **kwargs) 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_v3.py", line 52, in create_project 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker domain=domain_id) 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/projects.py", line 113, in create 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker **kwargs) 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 386, in create 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker self.key) 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 192, in _post 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker resp, body = self.client.post(url, body=body, **kwargs) 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker return self.request(url, 'POST', **kwargs) 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker keystoneauth1.exceptions.http.GatewayTimeout: Gateway Timeout (HTTP 504) 2021-04-29 16:04:17.322 2329 ERROR rally.common.broker 2021-04-29 16:04:17.325 2329 INFO rally.task.context [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Context users@openstack cleanup() started 2021-04-29 16:05:58.707 2329 INFO rally.task.context [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Context users@openstack cleanup() finished in 1.69 min 2021-04-29 16:05:59.739 2329 INFO rally.task.engine [-] Load duration is: 0.0 2021-04-29 16:05:59.739 2329 INFO rally.task.engine [-] Full runner duration is: 0.0 2021-04-29 16:05:59.740 2329 INFO rally.task.engine [-] Full duration is: 163.613436 2021-04-29 16:05:59.762 2329 ERROR rally.task.engine [-] Unexpected exception during the workload execution: rally.exceptions.ContextSetupFailure: Unable to setup context 'users': 'Failed to create the requested number of tenants.' 2021-04-29 16:05:59.762 2329 ERROR rally.task.engine Traceback (most recent call last): 2021-04-29 16:05:59.762 2329 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally/task/engine.py", line 513, in _run_workload 2021-04-29 16:05:59.762 2329 ERROR rally.task.engine with ctx_manager: 2021-04-29 16:05:59.762 2329 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally/task/context.py", line 311, in __enter__ 2021-04-29 16:05:59.762 2329 ERROR rally.task.engine self.setup() 2021-04-29 16:05:59.762 2329 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally/task/context.py", line 256, in setup 2021-04-29 16:05:59.762 2329 ERROR rally.task.engine ctx.setup() 2021-04-29 16:05:59.762 2329 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 334, in setup 2021-04-29 16:05:59.762 2329 ERROR rally.task.engine self.create_users() 2021-04-29 16:05:59.762 2329 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 286, in create_users 2021-04-29 16:05:59.762 2329 ERROR rally.task.engine msg="Failed to create the requested number of tenants.") 2021-04-29 16:05:59.762 2329 ERROR rally.task.engine rally.exceptions.ContextSetupFailure: Unable to setup context 'users': 'Failed to create the requested number of tenants.' 2021-04-29 16:05:59.762 2329 ERROR rally.task.engine 2021-04-29 16:05:59.806 2329 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=cdb5bf0f-f16b-40a7-93ea-b5e1eef182e7)", "subtasks": [ { "title": "KeystoneBasic.create_and_list_tenants", "description": "Create a keystone tenant with random name and list all tenants.", "scenario": { "KeystoneBasic.create_and_list_tenants": {} }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 16:05:59.818 2329 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.BadGateway: Bad Gateway (HTTP 502) 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker consume(cache, args) 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 180, in consume 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker tenant = cache["client"].create_project(domain_name=domain) 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 41, in create_project 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker domain_name=domain_name) 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_v3.py", line 243, in create_project 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker domain_name=domain_name) 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker f = func(self, *args, **kwargs) 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_v3.py", line 52, in create_project 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker domain=domain_id) 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/projects.py", line 113, in create 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker **kwargs) 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 386, in create 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker self.key) 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 192, in _post 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker resp, body = self.client.post(url, body=body, **kwargs) 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker return self.request(url, 'POST', **kwargs) 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker keystoneauth1.exceptions.http.BadGateway: Bad Gateway (HTTP 502) 2021-04-29 16:06:47.728 2329 ERROR rally.common.broker 2021-04-29 16:06:47.731 2329 INFO rally.task.context [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Context users@openstack cleanup() started 2021-04-29 16:07:23.657 2329 INFO rally.task.context [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Context users@openstack cleanup() finished in 35.93 sec 2021-04-29 16:07:24.158 2329 INFO rally.task.engine [-] Load duration is: 0.0 2021-04-29 16:07:24.159 2329 INFO rally.task.engine [-] Full runner duration is: 0.0 2021-04-29 16:07:24.159 2329 INFO rally.task.engine [-] Full duration is: 83.83953 2021-04-29 16:07:24.181 2329 ERROR rally.task.engine [-] Unexpected exception during the workload execution: rally.exceptions.ContextSetupFailure: Unable to setup context 'users': 'Failed to create the requested number of tenants.' 2021-04-29 16:07:24.181 2329 ERROR rally.task.engine Traceback (most recent call last): 2021-04-29 16:07:24.181 2329 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally/task/engine.py", line 513, in _run_workload 2021-04-29 16:07:24.181 2329 ERROR rally.task.engine with ctx_manager: 2021-04-29 16:07:24.181 2329 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally/task/context.py", line 311, in __enter__ 2021-04-29 16:07:24.181 2329 ERROR rally.task.engine self.setup() 2021-04-29 16:07:24.181 2329 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally/task/context.py", line 256, in setup 2021-04-29 16:07:24.181 2329 ERROR rally.task.engine ctx.setup() 2021-04-29 16:07:24.181 2329 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 334, in setup 2021-04-29 16:07:24.181 2329 ERROR rally.task.engine self.create_users() 2021-04-29 16:07:24.181 2329 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 286, in create_users 2021-04-29 16:07:24.181 2329 ERROR rally.task.engine msg="Failed to create the requested number of tenants.") 2021-04-29 16:07:24.181 2329 ERROR rally.task.engine rally.exceptions.ContextSetupFailure: Unable to setup context 'users': 'Failed to create the requested number of tenants.' 2021-04-29 16:07:24.181 2329 ERROR rally.task.engine 2021-04-29 16:07:24.226 2329 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=7c4617bc-8466-4dc6-b070-904e014d40b4)", "subtasks": [ { "title": "KeystoneBasic.create_and_delete_role", "description": "Create a user role and delete it.", "scenario": { "KeystoneBasic.create_and_delete_role": {} }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 16:07:24.238 2329 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 16:07:40.604 2329 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 16:08:35.056 2329 INFO rally.task.context [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Context users@openstack setup() finished in 1.18 min 2021-04-29 16:08:35.056 2329 INFO rally.task.context [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Context admin_cleanup@openstack setup() finished in 0.01 msec 2021-04-29 16:08:35.068 2329 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: 3fcaca2f-d79b-4c22-b918-018bdeb74c78). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 16:08:35.072 2329 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 16:08:35.073 2329 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 16:08:35.078 2329 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 16:08:35.086 2329 INFO rally.task.runner [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | ITER: 2 START 2021-04-29 16:08:35.091 2329 INFO rally.task.runner [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | ITER: 3 START 2021-04-29 16:08:35.097 2329 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 16:08:35.104 2329 INFO rally.task.runner [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | ITER: 4 START 2021-04-29 16:08:35.111 2329 INFO rally.task.runner [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | ITER: 1 START 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner [-] Iteration 3 raised Exception: keystoneauth1.exceptions.http.BadGateway: Bad Gateway (HTTP 502) 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner Traceback (most recent call last): 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner getattr(scenario_inst, method_name)(**scenario_kwargs) 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/keystone/basic.py", line 210, in run 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner role = self.admin_keystone.create_role() 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner return func(instance, *args, **kwargs) 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 162, in create_role 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner return self._impl.create_role(name=name, domain_name=domain_name) 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner return func(instance, *args, **kwargs) 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_v3.py", line 315, in create_role 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner name, domain_name=domain_name)) 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner return func(instance, *args, **kwargs) 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner f = func(self, *args, **kwargs) 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_v3.py", line 176, in create_role 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner return self._clients.keystone("3").roles.create(name, domain=domain_id) 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/keystoneclient/v3/roles.py", line 144, in create 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner **kwargs) 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner return f(*args, **new_kwargs) 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 386, in create 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner self.key) 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 192, in _post 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner resp, body = self.client.post(url, body=body, **kwargs) 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner return self.request(url, 'POST', **kwargs) 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner return self.session.request(url, method, **kwargs) 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner raise exceptions.from_response(resp, method, url) 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner keystoneauth1.exceptions.http.BadGateway: Bad Gateway (HTTP 502) 2021-04-29 16:09:27.742 2329 ERROR rally.task.runner 2021-04-29 16:09:27.744 2329 INFO rally.task.runner [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | ITER: 3 END: Error BadGateway: Bad Gateway (HTTP 502) 2021-04-29 16:09:27.750 2329 INFO rally.task.runner [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | ITER: 5 START 2021-04-29 16:09:31.445 2329 INFO rally.task.runner [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | ITER: 1 END: OK 2021-04-29 16:09:51.009 2329 INFO rally.task.runner [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | ITER: 4 END: OK 2021-04-29 16:10:00.236 2329 INFO rally.task.runner [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | ITER: 2 END: OK 2021-04-29 16:10:20.464 2329 INFO rally.task.runner [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | ITER: 5 END: OK 2021-04-29 16:10:20.477 2329 INFO rally.task.context [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Context admin_cleanup@openstack cleanup() started 2021-04-29 16:10:20.483 2329 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up keystone user objects 2021-04-29 16:10:21.901 2329 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up keystone project objects 2021-04-29 16:10:23.179 2329 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up keystone service objects 2021-04-29 16:10:24.332 2329 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up keystone role objects 2021-04-29 16:10:25.421 2329 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting keystone.role object s_rally_7c4617bc_xPYEPOpD (08689daf52f1495eae293eb6cf23274a) 2021-04-29 16:10:32.390 2329 INFO rally.task.context [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Context admin_cleanup@openstack cleanup() finished in 11.91 sec 2021-04-29 16:10:32.391 2329 INFO rally.task.context [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Context users@openstack cleanup() started 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find user: 020857c72d894378bb0026d6edbb2c1f. (HTTP 404) (Request-ID: req-eeebc8e4-b893-4f47-887f-7a84b49e8055) 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker consume(cache, args) 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find user: 020857c72d894378bb0026d6edbb2c1f. (HTTP 404) (Request-ID: req-eeebc8e4-b893-4f47-887f-7a84b49e8055) 2021-04-29 16:12:34.919 2329 ERROR rally.common.broker 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find user: d68dd847c8494be98698d74cdd4a85ef. (HTTP 404) (Request-ID: req-e0cfc798-b73d-4af1-a502-0a7d28281a14) 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker consume(cache, args) 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find user: d68dd847c8494be98698d74cdd4a85ef. (HTTP 404) (Request-ID: req-e0cfc798-b73d-4af1-a502-0a7d28281a14) 2021-04-29 16:13:31.306 2329 ERROR rally.common.broker 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find user: e8fb7f9e5c954cc7a8fb03978690f00e. (HTTP 404) (Request-ID: req-66cd0cad-e8bb-45aa-a681-b12e0f79926e) 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker consume(cache, args) 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find user: e8fb7f9e5c954cc7a8fb03978690f00e. (HTTP 404) (Request-ID: req-66cd0cad-e8bb-45aa-a681-b12e0f79926e) 2021-04-29 16:13:31.383 2329 ERROR rally.common.broker 2021-04-29 16:14:25.277 2329 INFO rally.task.context [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Context users@openstack cleanup() finished in 3.88 min 2021-04-29 16:14:26.097 2329 INFO rally.task.engine [-] Load duration is: 102.962359 2021-04-29 16:14:26.098 2329 INFO rally.task.engine [-] Full runner duration is: 105.409601 2021-04-29 16:14:26.098 2329 INFO rally.task.engine [-] Full duration is: 421.039414 2021-04-29 16:14:26.187 2329 INFO rally.task.engine [-] Received aborting signal. 2021-04-29 16:14:26.199 2329 INFO rally.task.engine [-] Task 3fcaca2f-d79b-4c22-b918-018bdeb74c78 | Completed: Running task. 2021-04-29 16:14:27.506 2770 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 16:14:27.506 2770 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 16:14:27.506 2770 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 16:14:28.708 2771 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 16:14:28.709 2771 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 16:14:28.709 2771 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 16:14:29.970 2772 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 16:14:29.971 2772 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 16:14:29.971 2772 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 16:14:31.805 2772 INFO rally.api [-] Building 'json' report for the following task(s): '3fcaca2f-d79b-4c22-b918-018bdeb74c78'. 2021-04-29 16:14:31.810 2772 INFO rally.api [-] The report has been successfully built. 2021-04-29 16:14:33.554 2774 RALLYDEBUG rally.api [-] INFO logs from urllib3 and requests module are hide. 2021-04-29 16:14:33.555 2774 RALLYDEBUG rally.api [-] urllib3 insecure warnings are hidden. 2021-04-29 16:14:33.555 2774 RALLYDEBUG rally.api [-] ERROR log from boto module is hide. 2021-04-29 16:14:35.647 2774 INFO rally.task.engine [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Starting: Task validation. 2021-04-29 16:14:35.661 2774 INFO rally.task.engine [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Starting: Task validation of syntax. 2021-04-29 16:14:35.875 2774 INFO rally.task.engine [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Completed: Task validation of syntax. 2021-04-29 16:14:35.875 2774 INFO rally.task.engine [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Starting: Task validation of required platforms. 2021-04-29 16:14:35.982 2774 INFO rally.task.engine [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Completed: Task validation of required platforms. 2021-04-29 16:14:35.982 2774 INFO rally.task.engine [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Starting: Task validation of semantic. 2021-04-29 16:14:35.982 2774 INFO rally.task.engine [-] Check health of the environment '475eaff9-f5cd-46ab-8b1c-6c36dbc836ee'. 2021-04-29 16:14:37.345 2774 INFO rally.task.engine [-] Platform existing@openstack (available: True): OK! 2021-04-29 16:14:37.358 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 1 tenants using 20 threads 2021-04-29 16:14:46.890 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 1 users using 20 threads 2021-04-29 16:15:02.753 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack setup() finished in 25.39 sec 2021-04-29 16:15:09.721 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() started 2021-04-29 16:16:03.306 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() finished in 53.58 sec 2021-04-29 16:16:03.306 2774 INFO rally.task.engine [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Completed: Task validation of semantic. 2021-04-29 16:16:03.307 2774 INFO rally.task.engine [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Completed: Task validation. 2021-04-29 16:16:03.307 2774 INFO rally.api [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 input file is valid. 2021-04-29 16:16:03.308 2774 INFO rally.api [-] Run Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 against Deployment 475eaff9-f5cd-46ab-8b1c-6c36dbc836ee 2021-04-29 16:16:03.308 2774 INFO rally.task.engine [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Starting: Running task. 2021-04-29 16:16:03.363 2774 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=42c39616-4264-48b5-9a8b-4051eacb2379)", "subtasks": [ { "title": "NeutronNetworks.create_and_update_networks", "description": "Create and update a network.", "scenario": { "NeutronNetworks.create_and_update_networks": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } } }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 16:16:03.377 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 16:16:13.797 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 16:16:47.032 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack setup() finished in 43.66 sec 2021-04-29 16:17:06.718 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack setup() finished in 19.68 sec 2021-04-29 16:17:06.718 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack setup() finished in 0.01 msec 2021-04-29 16:17:06.729 2774 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: c93253ff-a6bd-4f00-89e5-1ef609c7bfb6). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 16:17:06.732 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "network_update_args": {"admin_state_up": false}} 2021-04-29 16:17:06.733 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "network_update_args": {"admin_state_up": false}} 2021-04-29 16:17:06.734 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "network_update_args": {"admin_state_up": false}} 2021-04-29 16:17:06.742 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "network_update_args": {"admin_state_up": false}} 2021-04-29 16:17:06.743 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 START 2021-04-29 16:17:06.758 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 START 2021-04-29 16:17:06.763 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 START 2021-04-29 16:17:06.778 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 START 2021-04-29 16:18:14.998 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 END: OK 2021-04-29 16:18:15.007 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 START 2021-04-29 16:18:18.195 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 END: OK 2021-04-29 16:18:18.200 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 START 2021-04-29 16:18:18.621 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 END: OK 2021-04-29 16:18:18.626 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 START 2021-04-29 16:18:22.454 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 END: OK 2021-04-29 16:18:22.462 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 START 2021-04-29 16:18:46.669 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 END: OK 2021-04-29 16:18:46.676 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 START 2021-04-29 16:18:47.580 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 END: OK 2021-04-29 16:18:47.585 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 START 2021-04-29 16:18:47.609 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 END: OK 2021-04-29 16:18:47.825 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 END: OK 2021-04-29 16:18:58.303 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 END: OK 2021-04-29 16:18:59.348 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 END: OK 2021-04-29 16:18:59.371 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() started 2021-04-29 16:18:59.377 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron vip objects 2021-04-29 16:19:01.170 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron health_monitor objects 2021-04-29 16:19:02.898 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron pool objects 2021-04-29 16:19:04.598 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron loadbalancer objects 2021-04-29 16:19:06.273 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron floatingip objects 2021-04-29 16:19:06.797 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:19:06.825 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:19:06.855 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-13653a9a-d417-402f-9378-41d874489a6e'] 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-13653a9a-d417-402f-9378-41d874489a6e'] 2021-04-29 16:19:06.855 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:19:07.417 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:19:07.450 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:19:07.477 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-adee0472-1071-4da8-8634-f14b043b9086'] 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-adee0472-1071-4da8-8634-f14b043b9086'] 2021-04-29 16:19:07.478 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:19:08.020 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:19:08.052 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:19:08.071 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-602650a5-0a19-424d-82fa-5fa5650cd92d'] 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-602650a5-0a19-424d-82fa-5fa5650cd92d'] 2021-04-29 16:19:08.072 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:19:08.080 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron trunk objects 2021-04-29 16:19:09.698 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron port objects 2021-04-29 16:19:11.409 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron subnet objects 2021-04-29 16:19:13.199 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron network objects 2021-04-29 16:19:22.511 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_42c39616_SawgRabb (356cb2f5-30b2-4d9c-953c-c570d6c5f417) 2021-04-29 16:19:22.515 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_42c39616_26aUqy1l (392896ec-c31e-4789-8c0e-35ff9ecb709e) 2021-04-29 16:19:22.528 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_42c39616_DP8sj1cx (71bb3974-abca-4344-9907-522874725eaa) 2021-04-29 16:19:22.537 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_42c39616_tWdG8hZB (7f034e90-101f-493b-96b2-f9cd7b09373d) 2021-04-29 16:19:22.542 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_42c39616_HyC5KBla (57624689-8928-42c3-a51d-5382c15119dc) 2021-04-29 16:19:22.553 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_42c39616_M35Lqncw (88fecaf8-d4d4-4cce-a4a3-96d637387bd3) 2021-04-29 16:19:22.575 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_42c39616_XqMDONUj (92cd22fc-e37a-4d18-b6aa-eda0b6f3201a) 2021-04-29 16:19:22.586 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_42c39616_IaJjFhdn (0c348583-eaa7-4326-ba3c-a84ecfb83290) 2021-04-29 16:19:22.589 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_42c39616_9pMJmW0Q (b61cb8e9-8584-4eb2-9980-42286db3e972) 2021-04-29 16:19:22.599 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_42c39616_aMqD0VSI (c2da7dcf-c0d1-497c-84fc-88b7235e227f) 2021-04-29 16:20:08.820 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron router objects 2021-04-29 16:20:09.403 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:20:09.435 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:20:09.456 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-1a92356b-85df-4433-9546-f7a566b8b6b7'] 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-1a92356b-85df-4433-9546-f7a566b8b6b7'] 2021-04-29 16:20:09.457 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:20:10.013 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:20:10.036 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:20:10.054 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-1062ebb2-c96b-4c36-b2b4-0484610301c0'] 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-1062ebb2-c96b-4c36-b2b4-0484610301c0'] 2021-04-29 16:20:10.055 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:20:10.605 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:20:10.643 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:20:10.675 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-8b8b3e99-1ecb-419b-870f-5355d2c9e251'] 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-8b8b3e99-1ecb-419b-870f-5355d2c9e251'] 2021-04-29 16:20:10.676 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:20:10.685 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron security_group objects 2021-04-29 16:20:12.669 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() finished in 1.22 min 2021-04-29 16:20:12.669 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() started 2021-04-29 16:20:48.685 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() finished in 36.02 sec 2021-04-29 16:20:48.685 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() started 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find user: b7addb54e49c4e9c994a87babc5bc0ad. (HTTP 404) (Request-ID: req-ec6775f1-5bb6-4cfb-8e16-568af820625c) 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker consume(cache, args) 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find user: b7addb54e49c4e9c994a87babc5bc0ad. (HTTP 404) (Request-ID: req-ec6775f1-5bb6-4cfb-8e16-568af820625c) 2021-04-29 16:22:30.441 2774 ERROR rally.common.broker 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find user: 57a946ae3da54b0f97349d1ce393e558. (HTTP 404) (Request-ID: req-c1ae1da5-0844-4a51-a64e-ed88bad56876) 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker consume(cache, args) 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find user: 57a946ae3da54b0f97349d1ce393e558. (HTTP 404) (Request-ID: req-c1ae1da5-0844-4a51-a64e-ed88bad56876) 2021-04-29 16:23:20.237 2774 ERROR rally.common.broker 2021-04-29 16:24:50.998 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() finished in 4.04 min 2021-04-29 16:24:51.505 2774 INFO rally.task.engine [-] Load duration is: 112.601249 2021-04-29 16:24:51.506 2774 INFO rally.task.engine [-] Full runner duration is: 112.642603 2021-04-29 16:24:51.506 2774 INFO rally.task.engine [-] Full duration is: 527.623167 2021-04-29 16:24:51.600 2774 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=60c9b411-4052-432f-8abd-5d34671fb544)", "subtasks": [ { "title": "NeutronNetworks.create_and_update_ports", "description": "Create and update a given number of ports.", "scenario": { "NeutronNetworks.create_and_update_ports": { "network_create_args": {}, "port_create_args": {}, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" }, "ports_per_network": 1 } }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 16:24:51.617 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 16:25:10.541 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 16:25:34.823 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack setup() finished in 43.21 sec 2021-04-29 16:26:04.679 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack setup() finished in 29.86 sec 2021-04-29 16:26:33.533 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.0.0/24 2021-04-29 16:27:26.152 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.1.0/24 2021-04-29 16:28:00.933 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.2.0/24 2021-04-29 16:28:21.793 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context network@openstack setup() finished in 2.29 min 2021-04-29 16:28:21.794 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack setup() finished in 0.03 msec 2021-04-29 16:28:21.805 2774 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: c93253ff-a6bd-4f00-89e5-1ef609c7bfb6). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 16:28:21.807 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "port_create_args": {}, "port_update_args": {"admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner"}, "ports_per_network": 1} 2021-04-29 16:28:21.808 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "port_create_args": {}, "port_update_args": {"admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner"}, "ports_per_network": 1} 2021-04-29 16:28:21.817 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "port_create_args": {}, "port_update_args": {"admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner"}, "ports_per_network": 1} 2021-04-29 16:28:21.822 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "port_create_args": {}, "port_update_args": {"admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner"}, "ports_per_network": 1} 2021-04-29 16:28:21.823 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 START 2021-04-29 16:28:21.834 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 START 2021-04-29 16:28:21.840 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 START 2021-04-29 16:28:21.848 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 START 2021-04-29 16:28:50.439 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 END: OK 2021-04-29 16:28:50.447 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 START 2021-04-29 16:28:51.023 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 END: OK 2021-04-29 16:28:51.029 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 START 2021-04-29 16:28:51.672 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 END: OK 2021-04-29 16:28:51.678 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 START 2021-04-29 16:28:51.733 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 END: OK 2021-04-29 16:28:51.739 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 START 2021-04-29 16:29:13.323 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 END: OK 2021-04-29 16:29:13.329 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 END: OK 2021-04-29 16:29:13.339 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 START 2021-04-29 16:29:13.358 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 START 2021-04-29 16:29:14.838 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 END: OK 2021-04-29 16:29:17.234 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 END: OK 2021-04-29 16:29:29.602 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 END: OK 2021-04-29 16:29:31.091 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 END: OK 2021-04-29 16:29:31.105 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() started 2021-04-29 16:29:31.111 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron vip objects 2021-04-29 16:29:32.833 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron health_monitor objects 2021-04-29 16:29:34.569 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron pool objects 2021-04-29 16:29:36.166 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron loadbalancer objects 2021-04-29 16:29:37.803 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron floatingip objects 2021-04-29 16:29:38.348 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:29:38.376 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:29:38.396 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-a12f63fb-a566-4d46-af42-a2a4e6fcee51'] 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-a12f63fb-a566-4d46-af42-a2a4e6fcee51'] 2021-04-29 16:29:38.397 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:29:38.995 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:29:39.021 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:29:39.043 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-47f13534-41da-4e40-9a5a-79ac4f4c7b50'] 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-47f13534-41da-4e40-9a5a-79ac4f4c7b50'] 2021-04-29 16:29:39.044 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:29:40.878 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:29:40.902 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:29:40.923 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-f5173e69-c0df-441f-acba-64eaac713f6c'] 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-f5173e69-c0df-441f-acba-64eaac713f6c'] 2021-04-29 16:29:40.923 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:29:40.932 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron trunk objects 2021-04-29 16:29:42.718 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron port objects 2021-04-29 16:29:50.969 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.port object s_rally_60c9b411_1GRqtug5 (1a7763c0-2a5b-4d1d-bda6-e571f1b04ef7) 2021-04-29 16:29:50.973 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.port object s_rally_60c9b411_vkcWwwhg (2d0765f4-4375-481d-8dca-d773839d92ce) 2021-04-29 16:29:50.985 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.port object s_rally_60c9b411_8Lk7JL5n (afa2245e-7c64-4255-a033-12be51e8ec83) 2021-04-29 16:29:50.991 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.port object s_rally_60c9b411_G4rrO9xB (dac781b0-7e22-4097-90fa-5bc3a6a844fe) 2021-04-29 16:29:51.000 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.port object s_rally_60c9b411_q8s1sQUi (2c230dc3-5f0e-477b-853c-bc9ade6a01e1) 2021-04-29 16:29:51.005 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.port object s_rally_60c9b411_JvwfuuVZ (5833cc5b-0bf0-4b2f-84a9-81ea807866e9) 2021-04-29 16:29:51.010 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.port object s_rally_60c9b411_wN9TzHHp (712a3da2-ef56-4556-a91b-178b264b1e5c) 2021-04-29 16:29:51.025 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.port object s_rally_60c9b411_kBj4LQhD (ee7e27a8-daee-4d97-99dd-e0c12b2feb0b) 2021-04-29 16:29:51.041 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.port object s_rally_60c9b411_58gGv7ZO (1db09d10-bc7c-425b-8c24-ab6df2242a83) 2021-04-29 16:29:51.057 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.port object s_rally_60c9b411_2w9QSod3 (dc0b6be1-1fcc-40ed-af42-2c94d1f50d9d) 2021-04-29 16:30:05.575 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron subnet objects 2021-04-29 16:30:13.598 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron network objects 2021-04-29 16:30:25.661 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron router objects 2021-04-29 16:30:26.207 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:30:26.240 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:30:26.265 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-0ac57e5a-2fb3-48e2-b5fe-2f779b9c93cf'] 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-0ac57e5a-2fb3-48e2-b5fe-2f779b9c93cf'] 2021-04-29 16:30:26.265 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:30:26.835 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:30:26.862 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:30:26.894 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-3faf8d09-b043-4ef6-9b9d-4835cf866151'] 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-3faf8d09-b043-4ef6-9b9d-4835cf866151'] 2021-04-29 16:30:26.895 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:30:27.510 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:30:27.539 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:30:27.558 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-9637e87b-86cc-4d27-8046-a3d290339615'] 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-9637e87b-86cc-4d27-8046-a3d290339615'] 2021-04-29 16:30:27.559 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:30:27.568 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron security_group objects 2021-04-29 16:30:33.923 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() finished in 1.05 min 2021-04-29 16:30:33.923 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context network@openstack cleanup() started 2021-04-29 16:31:46.448 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context network@openstack cleanup() finished in 1.21 min 2021-04-29 16:31:46.449 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() started 2021-04-29 16:31:51.996 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() finished in 5.55 sec 2021-04-29 16:31:51.996 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() started 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find user: ddb52be5bf144d96ad890b31d2b8a2f8. (HTTP 404) (Request-ID: req-c57cc77f-bc55-4283-aadd-93b84b7f6be1) 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker consume(cache, args) 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find user: ddb52be5bf144d96ad890b31d2b8a2f8. (HTTP 404) (Request-ID: req-c57cc77f-bc55-4283-aadd-93b84b7f6be1) 2021-04-29 16:33:20.753 2774 ERROR rally.common.broker 2021-04-29 16:33:43.082 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() finished in 1.85 min 2021-04-29 16:33:43.732 2774 INFO rally.task.engine [-] Load duration is: 69.267126 2021-04-29 16:33:43.732 2774 INFO rally.task.engine [-] Full runner duration is: 69.300427 2021-04-29 16:33:43.733 2774 INFO rally.task.engine [-] Full duration is: 531.467185 2021-04-29 16:33:43.818 2774 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=4259c9b8-1f02-41f8-8f5a-4d0ce410dea0)", "subtasks": [ { "title": "NeutronNetworks.create_and_update_subnets", "description": "Create and update a subnet.", "scenario": { "NeutronNetworks.create_and_update_subnets": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnet_create_args": {}, "subnet_update_args": { "enable_dhcp": false }, "subnets_per_network": 1 } }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 16:33:43.841 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 16:33:49.215 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 16:34:23.175 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack setup() finished in 39.33 sec 2021-04-29 16:34:43.597 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack setup() finished in 20.42 sec 2021-04-29 16:34:43.598 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack setup() finished in 0.01 msec 2021-04-29 16:34:43.609 2774 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: c93253ff-a6bd-4f00-89e5-1ef609c7bfb6). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 16:34:43.611 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnet_create_args": {}, "subnet_update_args": {"enable_dhcp": false}, "subnets_per_network": 1} 2021-04-29 16:34:43.612 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnet_create_args": {}, "subnet_update_args": {"enable_dhcp": false}, "subnets_per_network": 1} 2021-04-29 16:34:43.613 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnet_create_args": {}, "subnet_update_args": {"enable_dhcp": false}, "subnets_per_network": 1} 2021-04-29 16:34:43.620 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnet_create_args": {}, "subnet_update_args": {"enable_dhcp": false}, "subnets_per_network": 1} 2021-04-29 16:34:43.628 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 START 2021-04-29 16:34:43.635 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 START 2021-04-29 16:34:43.644 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 START 2021-04-29 16:34:43.649 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 START 2021-04-29 16:34:57.277 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.7.0.0/16 2021-04-29 16:34:57.520 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.8.0.0/16 2021-04-29 16:34:57.914 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.9.0.0/16 2021-04-29 16:34:59.497 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.10.0.0/16 2021-04-29 16:35:16.733 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 END: OK 2021-04-29 16:35:16.740 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 START 2021-04-29 16:35:18.631 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 END: OK 2021-04-29 16:35:18.637 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 START 2021-04-29 16:35:19.587 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 END: OK 2021-04-29 16:35:19.593 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 START 2021-04-29 16:35:21.899 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 END: OK 2021-04-29 16:35:21.907 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 START 2021-04-29 16:35:39.899 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.11.0.0/16 2021-04-29 16:35:45.649 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.12.0.0/16 2021-04-29 16:35:51.332 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.13.0.0/16 2021-04-29 16:35:52.005 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.14.0.0/16 2021-04-29 16:36:19.795 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 END: OK 2021-04-29 16:36:19.803 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 START 2021-04-29 16:36:20.740 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 END: OK 2021-04-29 16:36:20.745 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 START 2021-04-29 16:36:28.269 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 END: OK 2021-04-29 16:36:31.954 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 END: OK 2021-04-29 16:36:41.448 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.15.0.0/16 2021-04-29 16:36:43.933 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.16.0.0/16 2021-04-29 16:37:03.986 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 END: OK 2021-04-29 16:37:07.691 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 END: OK 2021-04-29 16:37:07.706 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() started 2021-04-29 16:37:07.712 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron vip objects 2021-04-29 16:37:09.397 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron health_monitor objects 2021-04-29 16:37:11.140 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron pool objects 2021-04-29 16:37:12.855 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron loadbalancer objects 2021-04-29 16:37:14.599 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron floatingip objects 2021-04-29 16:37:15.165 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:37:15.189 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:37:15.209 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-a45ba879-8dfd-438a-a2b1-e6b0236d8a13'] 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-a45ba879-8dfd-438a-a2b1-e6b0236d8a13'] 2021-04-29 16:37:15.209 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:37:15.797 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:37:15.825 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:37:15.847 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-2efef6f0-d0c6-4ead-8d2d-486d5218b087'] 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-2efef6f0-d0c6-4ead-8d2d-486d5218b087'] 2021-04-29 16:37:15.847 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:37:16.394 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:37:16.411 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:37:16.429 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-3b06153b-a112-4e7c-8e7d-2bdeda346029'] 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-3b06153b-a112-4e7c-8e7d-2bdeda346029'] 2021-04-29 16:37:16.430 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:37:16.438 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron trunk objects 2021-04-29 16:37:18.043 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron port objects 2021-04-29 16:37:19.868 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron subnet objects 2021-04-29 16:37:43.473 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_4259c9b8_H48VU07v (c696859b-2cbc-4322-a1fd-0436a76cbe86) 2021-04-29 16:37:43.475 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_4259c9b8_v3NYKukD (98458d94-e6a2-4214-8ace-cfc9ef9a592e) 2021-04-29 16:37:43.481 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_4259c9b8_OyQDExCU (54be01bc-e2f7-4384-9d2d-a112cd422da9) 2021-04-29 16:37:43.486 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_4259c9b8_d8fTajVS (16e84690-5cdd-463e-8f86-326652d49ff7) 2021-04-29 16:37:43.491 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_4259c9b8_t6nK4H8y (98fc4f65-020e-4f84-bd9d-10457d065fea) 2021-04-29 16:37:43.496 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_4259c9b8_9tpBsBpN (93b386ac-0707-420b-bf8d-8841348462f3) 2021-04-29 16:37:43.502 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_4259c9b8_f37mULkz (0fdb170a-eccb-412b-a767-fe8ecc2e2a36) 2021-04-29 16:37:43.506 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_4259c9b8_R1xeRVsp (aff587a5-6f5a-4053-9f5d-71a0a71a96be) 2021-04-29 16:37:43.512 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_4259c9b8_IgO1ydLc (c0e2a1b1-0071-4163-bf4a-7fa35bf7f310) 2021-04-29 16:37:43.522 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_4259c9b8_6PEnQNqQ (f43cc76e-c245-4d66-b861-377f5a78e34b) 2021-04-29 16:38:06.300 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron network objects 2021-04-29 16:38:27.684 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_4259c9b8_YSEodWoc (01af7ba8-f163-4c4e-8571-0931e6c87d0f) 2021-04-29 16:38:27.691 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_4259c9b8_OpBQz4iY (7c1f2d1a-7a40-4453-ae7d-98f0de5e6082) 2021-04-29 16:38:27.696 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_4259c9b8_YvNAypzw (083238ca-b329-4637-92ef-f2d459ba3f3d) 2021-04-29 16:38:27.705 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_4259c9b8_adP6Uv8V (2bfe8db8-7f14-4dfa-ba44-15876a596355) 2021-04-29 16:38:27.710 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_4259c9b8_lKEaohd9 (30300741-134e-426c-83c3-367028340712) 2021-04-29 16:38:27.720 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_4259c9b8_RcXGnn9C (09059e8d-855b-411a-ad40-dba5699550e9) 2021-04-29 16:38:27.716 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_4259c9b8_Nd32JM00 (ae4ab48a-4d89-4a53-ad00-46b1ec695a4e) 2021-04-29 16:38:27.729 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_4259c9b8_ujIICZiQ (0bf1eb60-0d10-436a-9115-343ab1434c1e) 2021-04-29 16:38:27.739 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_4259c9b8_K04luijw (828e09dd-5842-4fbf-8e2c-4efb603ee2f9) 2021-04-29 16:38:27.749 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_4259c9b8_gbnb7JV4 (b924406f-f5c1-4f9f-9fab-df3bb711305a) 2021-04-29 16:38:52.366 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron router objects 2021-04-29 16:38:52.957 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:38:52.978 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:38:53.004 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-c8914fe4-ed12-40de-87a5-7a4c76c7c48d'] 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-c8914fe4-ed12-40de-87a5-7a4c76c7c48d'] 2021-04-29 16:38:53.005 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:38:53.575 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:38:53.604 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:38:53.632 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-ce872cf6-f706-4ccd-bd74-b83204d10b9a'] 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-ce872cf6-f706-4ccd-bd74-b83204d10b9a'] 2021-04-29 16:38:53.633 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:38:54.166 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:38:54.210 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:38:54.236 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-fcbcac5d-a00a-4c11-b41b-1790c535f50b'] 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-fcbcac5d-a00a-4c11-b41b-1790c535f50b'] 2021-04-29 16:38:54.237 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:38:54.246 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron security_group objects 2021-04-29 16:39:02.312 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() finished in 1.91 min 2021-04-29 16:39:02.313 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() started 2021-04-29 16:39:21.701 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() finished in 19.39 sec 2021-04-29 16:39:21.702 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() started 2021-04-29 16:41:41.858 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() finished in 2.34 min 2021-04-29 16:41:43.820 2774 INFO rally.task.engine [-] Load duration is: 144.062809 2021-04-29 16:41:43.820 2774 INFO rally.task.engine [-] Full runner duration is: 144.097584 2021-04-29 16:41:43.821 2774 INFO rally.task.engine [-] Full duration is: 478.018463 2021-04-29 16:41:43.908 2774 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=246a9f63-c6f0-4aac-a4d9-077fe421bd16)", "subtasks": [ { "title": "NeutronNetworks.create_and_delete_networks", "description": "Create and delete a network.", "scenario": { "NeutronNetworks.create_and_delete_networks": { "network_create_args": {} } }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 16:41:43.923 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 16:41:54.487 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 16:42:53.127 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack setup() finished in 1.15 min 2021-04-29 16:43:09.795 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack setup() finished in 16.67 sec 2021-04-29 16:43:09.795 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack setup() finished in 0.16 msec 2021-04-29 16:43:09.808 2774 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: c93253ff-a6bd-4f00-89e5-1ef609c7bfb6). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 16:43:09.810 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}} 2021-04-29 16:43:09.811 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}} 2021-04-29 16:43:09.813 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}} 2021-04-29 16:43:09.814 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}} 2021-04-29 16:43:09.826 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 START 2021-04-29 16:43:09.834 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 START 2021-04-29 16:43:09.841 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 START 2021-04-29 16:43:09.852 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 START 2021-04-29 16:43:47.681 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 END: OK 2021-04-29 16:43:47.689 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 START 2021-04-29 16:43:48.281 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 END: OK 2021-04-29 16:43:48.287 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 START 2021-04-29 16:43:48.587 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 END: OK 2021-04-29 16:43:48.593 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 START 2021-04-29 16:43:48.938 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 END: OK 2021-04-29 16:43:48.944 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 START 2021-04-29 16:44:12.714 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 END: OK 2021-04-29 16:44:12.722 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 START 2021-04-29 16:44:14.201 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 END: OK 2021-04-29 16:44:14.207 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 START 2021-04-29 16:44:19.992 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 END: OK 2021-04-29 16:44:26.216 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 END: OK 2021-04-29 16:44:45.880 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 END: OK 2021-04-29 16:44:49.104 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 END: OK 2021-04-29 16:44:49.119 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() started 2021-04-29 16:44:49.125 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron vip objects 2021-04-29 16:44:50.895 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron health_monitor objects 2021-04-29 16:44:52.437 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron pool objects 2021-04-29 16:44:54.104 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron loadbalancer objects 2021-04-29 16:44:55.766 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron floatingip objects 2021-04-29 16:44:56.261 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:44:56.282 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:44:56.303 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-56f77519-4233-4c33-af4d-922644f86b25'] 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-56f77519-4233-4c33-af4d-922644f86b25'] 2021-04-29 16:44:56.304 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:44:56.834 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:44:56.862 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:44:56.885 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-600a9863-35b9-4a9e-95d5-e3de80242250'] 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-600a9863-35b9-4a9e-95d5-e3de80242250'] 2021-04-29 16:44:56.886 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:44:57.407 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:44:57.426 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:44:57.447 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-ac58f060-a831-47b0-b7a3-6ca90d6da51c'] 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-ac58f060-a831-47b0-b7a3-6ca90d6da51c'] 2021-04-29 16:44:57.447 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:44:57.456 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron trunk objects 2021-04-29 16:44:59.208 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron port objects 2021-04-29 16:45:01.016 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron subnet objects 2021-04-29 16:45:02.797 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron network objects 2021-04-29 16:45:11.919 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron router objects 2021-04-29 16:45:12.433 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:45:12.456 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:45:12.478 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-2ecb7fe4-9888-4561-9b25-19319a18858a'] 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-2ecb7fe4-9888-4561-9b25-19319a18858a'] 2021-04-29 16:45:12.478 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:45:13.082 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:45:13.109 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:45:13.131 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-3160e8a0-a711-47f1-9d75-f243f87b7723'] 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-3160e8a0-a711-47f1-9d75-f243f87b7723'] 2021-04-29 16:45:13.132 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:45:13.719 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:45:14.017 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:45:14.048 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-e4353043-5620-4a9d-9bff-73451ab96add'] 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-e4353043-5620-4a9d-9bff-73451ab96add'] 2021-04-29 16:45:14.048 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:45:14.057 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron security_group objects 2021-04-29 16:45:19.166 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() finished in 30.05 sec 2021-04-29 16:45:19.167 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() started 2021-04-29 16:45:30.411 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() finished in 11.24 sec 2021-04-29 16:45:30.412 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() started 2021-04-29 16:46:56.859 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() finished in 1.44 min 2021-04-29 16:46:57.240 2774 INFO rally.task.engine [-] Load duration is: 99.278078 2021-04-29 16:46:57.241 2774 INFO rally.task.engine [-] Full runner duration is: 99.312289 2021-04-29 16:46:57.241 2774 INFO rally.task.engine [-] Full duration is: 312.938243 2021-04-29 16:46:57.326 2774 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=1ccce0be-e122-494c-a5eb-d31ffb235e69)", "subtasks": [ { "title": "NeutronNetworks.create_and_delete_ports", "description": "Create and delete a port.", "scenario": { "NeutronNetworks.create_and_delete_ports": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 } }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 16:46:57.340 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 16:47:13.403 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 16:47:41.819 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack setup() finished in 44.48 sec 2021-04-29 16:47:57.348 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack setup() finished in 15.53 sec 2021-04-29 16:48:12.512 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.13.0/24 2021-04-29 16:48:32.562 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.14.0/24 2021-04-29 16:49:23.415 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.15.0/24 2021-04-29 16:49:38.782 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context network@openstack setup() finished in 1.69 min 2021-04-29 16:49:38.783 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack setup() finished in 0.14 msec 2021-04-29 16:49:38.795 2774 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: c93253ff-a6bd-4f00-89e5-1ef609c7bfb6). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 16:49:38.798 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "port_create_args": {}, "ports_per_network": 1} 2021-04-29 16:49:38.799 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "port_create_args": {}, "ports_per_network": 1} 2021-04-29 16:49:38.800 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "port_create_args": {}, "ports_per_network": 1} 2021-04-29 16:49:38.809 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "port_create_args": {}, "ports_per_network": 1} 2021-04-29 16:49:38.810 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 START 2021-04-29 16:49:38.825 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 START 2021-04-29 16:49:38.835 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 START 2021-04-29 16:49:38.841 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 START 2021-04-29 16:50:17.200 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 END: OK 2021-04-29 16:50:17.211 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 START 2021-04-29 16:50:18.620 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 END: OK 2021-04-29 16:50:18.626 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 START 2021-04-29 16:50:19.235 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 END: OK 2021-04-29 16:50:19.240 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 START 2021-04-29 16:50:19.650 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 END: OK 2021-04-29 16:50:19.655 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 START 2021-04-29 16:51:06.122 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 END: OK 2021-04-29 16:51:06.129 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 START 2021-04-29 16:51:08.412 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 END: OK 2021-04-29 16:51:08.417 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 START 2021-04-29 16:51:08.593 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 END: OK 2021-04-29 16:51:08.669 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 END: OK 2021-04-29 16:51:36.711 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 END: OK 2021-04-29 16:51:40.459 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 END: OK 2021-04-29 16:51:40.479 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() started 2021-04-29 16:51:40.485 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron vip objects 2021-04-29 16:51:42.128 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron health_monitor objects 2021-04-29 16:51:43.767 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron pool objects 2021-04-29 16:51:45.328 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron loadbalancer objects 2021-04-29 16:51:47.295 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron floatingip objects 2021-04-29 16:51:47.819 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:51:47.849 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:51:47.878 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-53b25385-81c4-4324-b020-bf663cf8dc83'] 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-53b25385-81c4-4324-b020-bf663cf8dc83'] 2021-04-29 16:51:47.879 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:51:48.410 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:51:48.437 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:51:48.471 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-151b6fdc-f774-4eef-8c34-dcc39ef0e12b'] 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-151b6fdc-f774-4eef-8c34-dcc39ef0e12b'] 2021-04-29 16:51:48.472 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:51:49.000 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:51:49.021 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:51:49.047 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-645e27b4-9ff6-46cd-a8bc-8b56bf06eb72'] 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-645e27b4-9ff6-46cd-a8bc-8b56bf06eb72'] 2021-04-29 16:51:49.048 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:51:49.057 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron trunk objects 2021-04-29 16:51:50.738 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron port objects 2021-04-29 16:52:11.010 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron subnet objects 2021-04-29 16:52:22.369 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron network objects 2021-04-29 16:52:24.498 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron router objects 2021-04-29 16:52:25.062 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:52:25.082 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:52:25.103 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-3a6ed976-3611-432b-9a14-39567e1c71fd'] 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-3a6ed976-3611-432b-9a14-39567e1c71fd'] 2021-04-29 16:52:25.104 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:52:25.705 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:52:25.730 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:52:25.746 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-7e700ce8-e520-445c-bd2a-d0641136c25b'] 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-7e700ce8-e520-445c-bd2a-d0641136c25b'] 2021-04-29 16:52:25.747 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:52:26.430 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:52:26.480 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:52:26.509 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-5b9a7cc0-4d7f-47e4-96be-7d76c9df4c02'] 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-5b9a7cc0-4d7f-47e4-96be-7d76c9df4c02'] 2021-04-29 16:52:26.510 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:52:26.519 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron security_group objects 2021-04-29 16:52:31.041 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() finished in 50.56 sec 2021-04-29 16:52:31.041 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context network@openstack cleanup() started 2021-04-29 16:52:56.693 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context network@openstack cleanup() finished in 25.65 sec 2021-04-29 16:52:56.693 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() started 2021-04-29 16:53:01.026 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() finished in 4.33 sec 2021-04-29 16:53:01.026 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() started 2021-04-29 16:54:08.293 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() finished in 1.12 min 2021-04-29 16:54:09.184 2774 INFO rally.task.engine [-] Load duration is: 121.647587 2021-04-29 16:54:09.185 2774 INFO rally.task.engine [-] Full runner duration is: 121.684573 2021-04-29 16:54:09.185 2774 INFO rally.task.engine [-] Full duration is: 430.954429 2021-04-29 16:54:09.271 2774 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=6d958cc9-0bb5-458c-9a97-fa0e0e8be14d)", "subtasks": [ { "title": "NeutronNetworks.create_and_delete_subnets", "description": "Create and delete a given number of subnets.", "scenario": { "NeutronNetworks.create_and_delete_subnets": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 } }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 16:54:09.287 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 16:54:22.490 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 16:54:56.499 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack setup() finished in 47.21 sec 2021-04-29 16:55:22.857 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack setup() finished in 26.36 sec 2021-04-29 16:55:22.858 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack setup() finished in 0.04 msec 2021-04-29 16:55:22.869 2774 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: c93253ff-a6bd-4f00-89e5-1ef609c7bfb6). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 16:55:22.871 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1} 2021-04-29 16:55:22.875 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 START 2021-04-29 16:55:22.876 2774 WARNING rally_openstack.scenarios.neutron.utils [-] Running this scenario without either the 'network' or 'existing_network' context is deprecated 2021-04-29 16:55:22.882 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1} 2021-04-29 16:55:22.888 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 START 2021-04-29 16:55:22.888 2774 WARNING rally_openstack.scenarios.neutron.utils [-] Running this scenario without either the 'network' or 'existing_network' context is deprecated 2021-04-29 16:55:22.894 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1} 2021-04-29 16:55:22.896 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1} 2021-04-29 16:55:22.901 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 START 2021-04-29 16:55:22.907 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 START 2021-04-29 16:55:22.908 2774 WARNING rally_openstack.scenarios.neutron.utils [-] Running this scenario without either the 'network' or 'existing_network' context is deprecated 2021-04-29 16:55:22.914 2774 WARNING rally_openstack.scenarios.neutron.utils [-] Running this scenario without either the 'network' or 'existing_network' context is deprecated 2021-04-29 16:55:41.740 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.1.0.64/30 2021-04-29 16:55:42.532 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.1.0.68/30 2021-04-29 16:55:43.039 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.1.0.72/30 2021-04-29 16:55:45.300 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.1.0.76/30 2021-04-29 16:56:00.487 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 END: OK 2021-04-29 16:56:00.496 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 START 2021-04-29 16:56:00.497 2774 WARNING rally_openstack.scenarios.neutron.utils [-] Running this scenario without either the 'network' or 'existing_network' context is deprecated 2021-04-29 16:56:03.095 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 END: OK 2021-04-29 16:56:03.101 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 START 2021-04-29 16:56:03.102 2774 WARNING rally_openstack.scenarios.neutron.utils [-] Running this scenario without either the 'network' or 'existing_network' context is deprecated 2021-04-29 16:56:04.215 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 END: OK 2021-04-29 16:56:04.221 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 START 2021-04-29 16:56:04.222 2774 WARNING rally_openstack.scenarios.neutron.utils [-] Running this scenario without either the 'network' or 'existing_network' context is deprecated 2021-04-29 16:56:05.580 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 END: OK 2021-04-29 16:56:05.586 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 START 2021-04-29 16:56:05.587 2774 WARNING rally_openstack.scenarios.neutron.utils [-] Running this scenario without either the 'network' or 'existing_network' context is deprecated 2021-04-29 16:56:18.461 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.1.0.80/30 2021-04-29 16:56:19.037 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.1.0.84/30 2021-04-29 16:56:19.247 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.1.0.88/30 2021-04-29 16:56:19.286 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.1.0.92/30 2021-04-29 16:56:38.556 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 END: OK 2021-04-29 16:56:38.563 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 START 2021-04-29 16:56:38.565 2774 WARNING rally_openstack.scenarios.neutron.utils [-] Running this scenario without either the 'network' or 'existing_network' context is deprecated 2021-04-29 16:56:40.751 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 END: OK 2021-04-29 16:56:40.762 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 START 2021-04-29 16:56:40.764 2774 WARNING rally_openstack.scenarios.neutron.utils [-] Running this scenario without either the 'network' or 'existing_network' context is deprecated 2021-04-29 16:56:45.713 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 END: OK 2021-04-29 16:56:45.754 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 END: OK 2021-04-29 16:56:58.035 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.1.0.96/30 2021-04-29 16:57:04.160 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.1.0.100/30 2021-04-29 16:57:27.967 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 END: OK 2021-04-29 16:57:35.836 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 END: OK 2021-04-29 16:57:35.858 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() started 2021-04-29 16:57:35.864 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron vip objects 2021-04-29 16:57:37.635 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron health_monitor objects 2021-04-29 16:57:39.288 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron pool objects 2021-04-29 16:57:40.881 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron loadbalancer objects 2021-04-29 16:57:42.363 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron floatingip objects 2021-04-29 16:57:42.891 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:57:42.919 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:57:42.944 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-961179bd-2034-40b9-b9f9-5c409845a9dd'] 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-961179bd-2034-40b9-b9f9-5c409845a9dd'] 2021-04-29 16:57:42.945 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:57:43.516 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:57:43.538 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:57:43.563 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-fd95bdec-0391-4719-b42e-5feb1b20c56d'] 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-fd95bdec-0391-4719-b42e-5feb1b20c56d'] 2021-04-29 16:57:43.564 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:57:44.093 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:57:44.122 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:57:44.149 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-9fd36e6d-8fff-405e-8cd9-d6b9814c6e55'] 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-9fd36e6d-8fff-405e-8cd9-d6b9814c6e55'] 2021-04-29 16:57:44.150 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:57:44.159 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron trunk objects 2021-04-29 16:57:45.736 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron port objects 2021-04-29 16:57:47.453 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron subnet objects 2021-04-29 16:58:00.733 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron network objects 2021-04-29 16:58:02.624 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_6d958cc9_jK65ls4r (05c656f0-101e-4697-89b7-ca461e75d2b5) 2021-04-29 16:58:02.634 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_6d958cc9_3CMTq56b (86b0ca12-4006-495c-ae40-c98c2de65436) 2021-04-29 16:58:02.634 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_6d958cc9_Y9VnYCU9 (6302c7bf-09f3-4617-b74e-1f42b4899899) 2021-04-29 16:58:02.639 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_6d958cc9_TObwbPzy (9577f027-07a6-4481-a870-704105d2cc69) 2021-04-29 16:58:02.668 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_6d958cc9_0ULjTPfC (add26b19-8028-4617-a72f-f796db73c81c) 2021-04-29 16:58:02.674 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_6d958cc9_xp32Vce0 (b1c2766a-e56c-4d46-af69-8c7703a54f23) 2021-04-29 16:58:02.696 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_6d958cc9_AXjWHgzP (311a9f44-b47c-4442-a0b1-054d08d87142) 2021-04-29 16:58:02.702 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_6d958cc9_A5grT87R (bfb2cdf2-4931-4e17-bbb5-b25ec586ca54) 2021-04-29 16:58:02.708 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_6d958cc9_9pvMW8lh (e4520881-1175-442e-8c78-81d8b6453855) 2021-04-29 16:58:02.731 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_6d958cc9_X90q64lK (f8716936-4865-466b-9129-90d2069b5fc3) 2021-04-29 16:58:28.445 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron router objects 2021-04-29 16:58:28.989 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:58:29.030 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:58:29.053 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-5b2eac0a-7edd-4e20-9adc-96e163d98588'] 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-5b2eac0a-7edd-4e20-9adc-96e163d98588'] 2021-04-29 16:58:29.054 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:58:29.617 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:58:29.656 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:58:29.677 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-37e80a17-fd3b-45dd-9e54-f4a6646128cb'] 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-37e80a17-fd3b-45dd-9e54-f4a6646128cb'] 2021-04-29 16:58:29.678 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:58:30.224 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:58:30.266 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:58:30.292 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-b7cba999-aa28-4e27-80e7-555a66b47e5c'] 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-b7cba999-aa28-4e27-80e7-555a66b47e5c'] 2021-04-29 16:58:30.293 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 16:58:30.302 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron security_group objects 2021-04-29 16:58:55.363 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() finished in 1.33 min 2021-04-29 16:58:55.363 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() started 2021-04-29 16:59:24.144 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() finished in 28.78 sec 2021-04-29 16:59:24.144 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() started 2021-04-29 17:00:59.014 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6e7756c1-68e4-4faf-a6c7-cfd1cd84d0cf does not exist", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:00:59.016 2774 WARNING rally_openstack.contexts.keystone.users [-] Unable to delete default security group: neutronclient.common.exceptions.NotFound: Security group 6e7756c1-68e4-4faf-a6c7-cfd1cd84d0cf does not exist 2021-04-29 17:00:59.016 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Security group 6e7756c1-68e4-4faf-a6c7-cfd1cd84d0cf does not exist Neutron server returns request_ids: ['req-3d51098b-37ab-4e95-89ed-71ab1f897773'] 2021-04-29 17:00:59.222 2774 WARNING /usr/lib/python3.6/site-packages/rally/common/logging.py:161 [-] [self.logger.exception(value)] Do not transmit an exception objects to logging. It will be included automagically. Transmit a user-friendly explanation instead.: neutronclient.common.exceptions.NotFound: Security group 6e7756c1-68e4-4faf-a6c7-cfd1cd84d0cf does not exist 2021-04-29 17:00:59.222 2774 ERROR rally_openstack.contexts.keystone.users [-] Security group 6e7756c1-68e4-4faf-a6c7-cfd1cd84d0cf does not exist Neutron server returns request_ids: ['req-3d51098b-37ab-4e95-89ed-71ab1f897773']: neutronclient.common.exceptions.NotFound: Security group 6e7756c1-68e4-4faf-a6c7-cfd1cd84d0cf does not exist Neutron server returns request_ids: ['req-3d51098b-37ab-4e95-89ed-71ab1f897773'] 2021-04-29 17:00:59.222 2774 ERROR rally_openstack.contexts.keystone.users Traceback (most recent call last): 2021-04-29 17:00:59.222 2774 ERROR rally_openstack.contexts.keystone.users File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 162, in _remove_default_security_group 2021-04-29 17:00:59.222 2774 ERROR rally_openstack.contexts.keystone.users clients.neutron().delete_security_group(default[0]["id"]) 2021-04-29 17:00:59.222 2774 ERROR rally_openstack.contexts.keystone.users File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 994, in delete_security_group 2021-04-29 17:00:59.222 2774 ERROR rally_openstack.contexts.keystone.users return self.delete(self.security_group_path % (security_group)) 2021-04-29 17:00:59.222 2774 ERROR rally_openstack.contexts.keystone.users File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 350, in delete 2021-04-29 17:00:59.222 2774 ERROR rally_openstack.contexts.keystone.users headers=headers, params=params) 2021-04-29 17:00:59.222 2774 ERROR rally_openstack.contexts.keystone.users File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:00:59.222 2774 ERROR rally_openstack.contexts.keystone.users headers=headers, params=params) 2021-04-29 17:00:59.222 2774 ERROR rally_openstack.contexts.keystone.users File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:00:59.222 2774 ERROR rally_openstack.contexts.keystone.users self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:00:59.222 2774 ERROR rally_openstack.contexts.keystone.users File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:00:59.222 2774 ERROR rally_openstack.contexts.keystone.users exception_handler_v20(status_code, error_body) 2021-04-29 17:00:59.222 2774 ERROR rally_openstack.contexts.keystone.users File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:00:59.222 2774 ERROR rally_openstack.contexts.keystone.users request_ids=request_ids) 2021-04-29 17:00:59.222 2774 ERROR rally_openstack.contexts.keystone.users neutronclient.common.exceptions.NotFound: Security group 6e7756c1-68e4-4faf-a6c7-cfd1cd84d0cf does not exist 2021-04-29 17:00:59.222 2774 ERROR rally_openstack.contexts.keystone.users Neutron server returns request_ids: ['req-3d51098b-37ab-4e95-89ed-71ab1f897773'] 2021-04-29 17:00:59.222 2774 ERROR rally_openstack.contexts.keystone.users 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find user: 7b7b2f2c92f94bac9a22928241bb9817. (HTTP 404) (Request-ID: req-ca29f9c9-5042-4c24-afee-6b35ea40172d) 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker consume(cache, args) 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find user: 7b7b2f2c92f94bac9a22928241bb9817. (HTTP 404) (Request-ID: req-ca29f9c9-5042-4c24-afee-6b35ea40172d) 2021-04-29 17:02:24.579 2774 ERROR rally.common.broker 2021-04-29 17:03:45.410 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() finished in 4.35 min 2021-04-29 17:03:45.591 2774 INFO rally.task.engine [-] Load duration is: 132.958665 2021-04-29 17:03:45.592 2774 INFO rally.task.engine [-] Full runner duration is: 132.989467 2021-04-29 17:03:45.592 2774 INFO rally.task.engine [-] Full duration is: 576.124607 2021-04-29 17:03:45.676 2774 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=28265ecd-8b84-454c-ba34-6b488b6dce1b)", "subtasks": [ { "title": "NeutronNetworks.create_and_list_networks", "description": "Create a network and then list all networks.", "scenario": { "NeutronNetworks.create_and_list_networks": { "network_create_args": {} } }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1 } } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 17:03:45.692 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 17:03:53.868 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 17:04:28.211 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack setup() finished in 42.52 sec 2021-04-29 17:05:00.159 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack setup() finished in 31.95 sec 2021-04-29 17:05:00.160 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack setup() finished in 0.14 msec 2021-04-29 17:05:00.172 2774 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: c93253ff-a6bd-4f00-89e5-1ef609c7bfb6). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 17:05:00.174 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}} 2021-04-29 17:05:00.175 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}} 2021-04-29 17:05:00.176 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}} 2021-04-29 17:05:00.184 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}} 2021-04-29 17:05:00.184 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 START 2021-04-29 17:05:00.185 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 START 2021-04-29 17:05:00.189 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 START 2021-04-29 17:05:00.193 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 START 2021-04-29 17:05:42.185 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 END: OK 2021-04-29 17:05:42.192 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 START 2021-04-29 17:05:42.757 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 END: OK 2021-04-29 17:05:42.762 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 START 2021-04-29 17:05:43.335 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 END: OK 2021-04-29 17:05:43.340 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 START 2021-04-29 17:05:47.502 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 END: OK 2021-04-29 17:05:47.508 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 START 2021-04-29 17:05:56.237 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 END: OK 2021-04-29 17:05:56.245 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 START 2021-04-29 17:05:59.559 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 END: OK 2021-04-29 17:05:59.565 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 START 2021-04-29 17:06:00.284 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 END: OK 2021-04-29 17:06:11.565 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 END: OK 2021-04-29 17:06:17.485 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 END: OK 2021-04-29 17:06:19.571 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 END: OK 2021-04-29 17:06:19.585 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() started 2021-04-29 17:06:19.590 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron vip objects 2021-04-29 17:06:21.277 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron health_monitor objects 2021-04-29 17:06:22.962 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron pool objects 2021-04-29 17:06:24.590 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron loadbalancer objects 2021-04-29 17:06:26.254 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron floatingip objects 2021-04-29 17:06:26.778 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:06:26.816 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:06:26.837 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-ec39acea-354a-43b0-8683-a9c8c547c0c7'] 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-ec39acea-354a-43b0-8683-a9c8c547c0c7'] 2021-04-29 17:06:26.837 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:06:27.322 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:06:27.341 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:06:27.364 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-b7625ed8-6c48-4d38-bd60-7a939278183c'] 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-b7625ed8-6c48-4d38-bd60-7a939278183c'] 2021-04-29 17:06:27.364 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:06:27.908 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:06:27.935 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:06:27.956 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-3714816d-96c7-4316-a794-9e9194118359'] 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-3714816d-96c7-4316-a794-9e9194118359'] 2021-04-29 17:06:27.956 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:06:27.965 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron trunk objects 2021-04-29 17:06:29.627 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron port objects 2021-04-29 17:06:31.373 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron subnet objects 2021-04-29 17:06:33.425 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron network objects 2021-04-29 17:06:35.538 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_28265ecd_OqpubL9V (57223c38-633d-4bf9-a655-dfbd1a192683) 2021-04-29 17:06:35.544 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_28265ecd_tK4UuJRx (35de1ce2-a141-4d8e-af67-58d99e4a1e65) 2021-04-29 17:06:35.544 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_28265ecd_EOWKBvyp (31e69922-a5c3-4406-a4fe-cb343dc7444f) 2021-04-29 17:06:35.545 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_28265ecd_V8h6LUfG (e9d22b35-4027-4808-94e5-fde12fd01dd8) 2021-04-29 17:06:35.546 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_28265ecd_uw3mNQ1U (065d14b8-88d5-4ae7-b43d-44aee78af9c0) 2021-04-29 17:06:35.546 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_28265ecd_XudwaMbY (0a5fbfe3-7fd2-4378-aa7c-926fed938f76) 2021-04-29 17:06:35.547 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_28265ecd_7fDMcgiv (032b45b4-7fd4-41ad-be9b-c78a5937f5c4) 2021-04-29 17:06:35.569 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_28265ecd_FQuvbHVR (05145c55-7e77-411b-a7bb-512c65e10326) 2021-04-29 17:06:35.574 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_28265ecd_eRU8jBWC (7ea629cf-94c8-44de-b631-93c1432156db) 2021-04-29 17:06:35.579 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_28265ecd_bnGNkeOg (c270635c-dd3c-4a73-a4aa-098a2de7d8a0) 2021-04-29 17:06:58.340 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron router objects 2021-04-29 17:06:58.859 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:06:58.890 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:06:58.917 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-a8ef88bb-34f4-4500-8edd-04ad11b85965'] 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-a8ef88bb-34f4-4500-8edd-04ad11b85965'] 2021-04-29 17:06:58.918 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:06:59.482 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:06:59.503 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:06:59.534 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-1ecb784b-54a3-4c98-a4a7-9e9a54c7cfa1'] 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-1ecb784b-54a3-4c98-a4a7-9e9a54c7cfa1'] 2021-04-29 17:06:59.535 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:07:00.108 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:07:00.136 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:07:00.166 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-7b89542f-1130-466d-8e36-bc2fa87a7e0c'] 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-7b89542f-1130-466d-8e36-bc2fa87a7e0c'] 2021-04-29 17:07:00.167 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:07:00.176 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron security_group objects 2021-04-29 17:07:14.774 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() finished in 55.19 sec 2021-04-29 17:07:14.775 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() started 2021-04-29 17:07:34.788 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() finished in 20.01 sec 2021-04-29 17:07:34.789 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() started 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find user: 5036ed6e15f54e13be94c4341a94b83f. (HTTP 404) (Request-ID: req-b8353857-509a-4bbc-a8a8-b3472e820654) 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker consume(cache, args) 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find user: 5036ed6e15f54e13be94c4341a94b83f. (HTTP 404) (Request-ID: req-b8353857-509a-4bbc-a8a8-b3472e820654) 2021-04-29 17:10:14.179 2774 ERROR rally.common.broker 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find user: a0b92979b45f4901aed26a550a8c4ed9. (HTTP 404) (Request-ID: req-94457023-e505-438e-8472-3f2082520813) 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker consume(cache, args) 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find user: a0b92979b45f4901aed26a550a8c4ed9. (HTTP 404) (Request-ID: req-94457023-e505-438e-8472-3f2082520813) 2021-04-29 17:10:14.247 2774 ERROR rally.common.broker 2021-04-29 17:10:51.362 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() finished in 3.28 min 2021-04-29 17:10:51.467 2774 INFO rally.task.engine [-] Load duration is: 79.376422 2021-04-29 17:10:51.467 2774 INFO rally.task.engine [-] Full runner duration is: 79.413633 2021-04-29 17:10:51.468 2774 INFO rally.task.engine [-] Full duration is: 425.672584 2021-04-29 17:10:51.558 2774 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=303d02f0-a2bc-4cf6-a6e9-aa5a3299a830)", "subtasks": [ { "title": "NeutronNetworks.create_and_list_ports", "description": "Create and a given number of ports and list all ports.", "scenario": { "NeutronNetworks.create_and_list_ports": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 } }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 17:10:51.575 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 17:11:24.978 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 17:12:27.828 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack setup() finished in 1.60 min 2021-04-29 17:12:56.584 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack setup() finished in 28.75 sec 2021-04-29 17:13:27.395 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.26.0/24 2021-04-29 17:13:57.165 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.27.0/24 2021-04-29 17:14:42.554 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.28.0/24 2021-04-29 17:14:58.660 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context network@openstack setup() finished in 2.03 min 2021-04-29 17:14:58.661 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack setup() finished in 0.02 msec 2021-04-29 17:14:58.674 2774 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: c93253ff-a6bd-4f00-89e5-1ef609c7bfb6). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 17:14:58.676 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "port_create_args": {}, "ports_per_network": 1} 2021-04-29 17:14:58.681 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "port_create_args": {}, "ports_per_network": 1} 2021-04-29 17:14:58.686 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 START 2021-04-29 17:14:58.692 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 START 2021-04-29 17:14:58.700 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "port_create_args": {}, "ports_per_network": 1} 2021-04-29 17:14:58.704 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 START 2021-04-29 17:14:58.714 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "port_create_args": {}, "ports_per_network": 1} 2021-04-29 17:14:58.718 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 START 2021-04-29 17:15:22.362 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 END: OK 2021-04-29 17:15:22.370 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 START 2021-04-29 17:15:26.863 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 END: OK 2021-04-29 17:15:26.870 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 START 2021-04-29 17:15:34.023 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 END: OK 2021-04-29 17:15:34.030 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 START 2021-04-29 17:15:34.447 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 END: OK 2021-04-29 17:15:34.453 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 START 2021-04-29 17:15:58.486 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 END: OK 2021-04-29 17:15:58.494 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 START 2021-04-29 17:16:00.075 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 END: OK 2021-04-29 17:16:00.083 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 START 2021-04-29 17:16:00.576 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 END: OK 2021-04-29 17:16:00.599 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 END: OK 2021-04-29 17:16:12.899 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 END: OK 2021-04-29 17:16:20.728 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 END: OK 2021-04-29 17:16:20.749 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() started 2021-04-29 17:16:20.755 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron vip objects 2021-04-29 17:16:22.422 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron health_monitor objects 2021-04-29 17:16:24.079 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron pool objects 2021-04-29 17:16:25.631 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron loadbalancer objects 2021-04-29 17:16:27.408 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron floatingip objects 2021-04-29 17:16:27.976 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:16:28.011 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:16:28.048 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-cb12a9f5-159c-4b50-b249-e0292d564abb'] 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-cb12a9f5-159c-4b50-b249-e0292d564abb'] 2021-04-29 17:16:28.049 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:16:28.642 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:16:28.664 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:16:28.686 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-f212509b-3124-4ab3-ab10-a326f8c9fe96'] 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-f212509b-3124-4ab3-ab10-a326f8c9fe96'] 2021-04-29 17:16:28.687 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:16:29.162 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:16:29.186 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:16:29.208 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-5a7479fc-1aa1-4810-b5f3-6ccd3607f6f2'] 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-5a7479fc-1aa1-4810-b5f3-6ccd3607f6f2'] 2021-04-29 17:16:29.208 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:16:29.217 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron trunk objects 2021-04-29 17:16:30.910 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron port objects 2021-04-29 17:16:32.850 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.port object s_rally_303d02f0_vnzjM15d (be24f958-8ba3-4d47-99f8-321dd4e6ef53) 2021-04-29 17:16:32.851 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.port object s_rally_303d02f0_W77TNyCv (492fa9b6-e540-4a39-adef-94174c5a501b) 2021-04-29 17:16:32.855 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.port object s_rally_303d02f0_Ps0jWj6C (e856d0a9-25b6-4a56-9845-0ce796851b7c) 2021-04-29 17:16:32.856 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.port object s_rally_303d02f0_23KEn8Ry (9bdbcd65-78a9-4169-9375-85cb0061e57b) 2021-04-29 17:16:32.856 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.port object s_rally_303d02f0_9fl7gbCc (46e73a9e-b5f6-45d4-b4a3-29709b992a3c) 2021-04-29 17:16:32.858 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.port object s_rally_303d02f0_Y9Y9EhTi (268d2118-118a-48ac-a4c4-6a1cbf436b5b) 2021-04-29 17:16:32.858 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.port object s_rally_303d02f0_hEYVvhb2 (f1fd5b97-66e1-4231-a331-00e20ef3e722) 2021-04-29 17:16:32.864 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.port object s_rally_303d02f0_KtawaRci (dcfb48a8-5c8f-4692-8cb4-01f8168d943b) 2021-04-29 17:16:32.869 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.port object s_rally_303d02f0_yb9Dv4Yb (4540bded-f779-4be3-a89c-769447066af0) 2021-04-29 17:16:32.879 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.port object s_rally_303d02f0_MIobjCWa (8526bcbd-2a91-4862-9269-5518ba8118f9) 2021-04-29 17:16:49.385 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron subnet objects 2021-04-29 17:16:56.401 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron network objects 2021-04-29 17:17:03.049 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron router objects 2021-04-29 17:17:03.525 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:17:03.553 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:17:03.572 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-0b76f450-7945-4487-b3d7-96992dc488b4'] 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-0b76f450-7945-4487-b3d7-96992dc488b4'] 2021-04-29 17:17:03.572 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:17:04.113 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:17:04.143 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:17:04.170 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-c6eff3f3-56a0-488a-a6ee-34c451f000c5'] 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-c6eff3f3-56a0-488a-a6ee-34c451f000c5'] 2021-04-29 17:17:04.171 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:17:04.749 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:17:04.769 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:17:04.790 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-9b4b5000-a41a-4cd7-aebc-a663c69d0154'] 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-9b4b5000-a41a-4cd7-aebc-a663c69d0154'] 2021-04-29 17:17:04.790 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:17:04.799 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron security_group objects 2021-04-29 17:17:11.229 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() finished in 50.48 sec 2021-04-29 17:17:11.229 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context network@openstack cleanup() started 2021-04-29 17:18:43.158 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context network@openstack cleanup() finished in 1.53 min 2021-04-29 17:18:43.158 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() started 2021-04-29 17:19:16.115 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() finished in 32.96 sec 2021-04-29 17:19:16.116 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() started 2021-04-29 17:22:29.716 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() finished in 3.23 min 2021-04-29 17:22:30.479 2774 INFO rally.task.engine [-] Load duration is: 82.041528 2021-04-29 17:22:30.479 2774 INFO rally.task.engine [-] Full runner duration is: 82.076018 2021-04-29 17:22:30.480 2774 INFO rally.task.engine [-] Full duration is: 698.143152 2021-04-29 17:22:30.567 2774 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=5770006e-4f2a-48cc-ba0b-8d8edb0d8b6f)", "subtasks": [ { "title": "NeutronNetworks.create_and_list_subnets", "description": "Create and a given number of subnets and list all subnets.", "scenario": { "NeutronNetworks.create_and_list_subnets": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 } }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 17:22:30.591 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 17:22:50.101 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 17:23:25.990 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack setup() finished in 55.40 sec 2021-04-29 17:24:20.075 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack setup() finished in 54.08 sec 2021-04-29 17:24:20.076 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack setup() finished in 0.14 msec 2021-04-29 17:24:20.088 2774 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: c93253ff-a6bd-4f00-89e5-1ef609c7bfb6). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 17:24:20.091 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1} 2021-04-29 17:24:20.095 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1} 2021-04-29 17:24:20.101 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1} 2021-04-29 17:24:20.102 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 START 2021-04-29 17:24:20.109 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 START 2021-04-29 17:24:20.110 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1} 2021-04-29 17:24:20.114 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 START 2021-04-29 17:24:20.124 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 START 2021-04-29 17:24:46.145 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.1.0.116/30 2021-04-29 17:24:48.247 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.1.0.120/30 2021-04-29 17:24:51.827 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.1.0.124/30 2021-04-29 17:24:52.475 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.1.0.128/30 2021-04-29 17:25:22.109 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 END: OK 2021-04-29 17:25:22.118 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 START 2021-04-29 17:25:23.816 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 END: OK 2021-04-29 17:25:23.822 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 START 2021-04-29 17:25:35.974 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 END: OK 2021-04-29 17:25:35.984 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 START 2021-04-29 17:25:38.818 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 END: OK 2021-04-29 17:25:38.824 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 START 2021-04-29 17:25:51.558 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.1.0.132/30 2021-04-29 17:25:58.223 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.1.0.136/30 2021-04-29 17:26:00.115 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.1.0.140/30 2021-04-29 17:26:01.239 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.1.0.144/30 2021-04-29 17:26:29.736 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 END: OK 2021-04-29 17:26:29.743 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 START 2021-04-29 17:26:34.936 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 END: OK 2021-04-29 17:26:34.941 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 START 2021-04-29 17:26:35.494 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 END: OK 2021-04-29 17:26:36.705 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 END: OK 2021-04-29 17:26:51.523 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.1.0.148/30 2021-04-29 17:27:03.674 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 1.1.0.152/30 2021-04-29 17:27:33.009 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 END: OK 2021-04-29 17:27:40.849 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 END: OK 2021-04-29 17:27:40.866 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() started 2021-04-29 17:27:40.872 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron vip objects 2021-04-29 17:27:42.574 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron health_monitor objects 2021-04-29 17:27:44.168 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron pool objects 2021-04-29 17:27:45.719 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron loadbalancer objects 2021-04-29 17:27:47.397 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron floatingip objects 2021-04-29 17:27:47.914 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:27:47.936 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:27:47.959 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-13cf8b06-4545-48e1-a3f1-a51d33ca9d8e'] 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-13cf8b06-4545-48e1-a3f1-a51d33ca9d8e'] 2021-04-29 17:27:47.960 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:27:48.528 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:27:48.547 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:27:48.568 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-0b9dc36d-9890-42b5-a1ea-6593f2880510'] 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-0b9dc36d-9890-42b5-a1ea-6593f2880510'] 2021-04-29 17:27:48.568 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:27:49.075 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:27:49.104 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:27:49.132 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-e47c5c9e-1676-4802-839d-35ce1b34044e'] 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-e47c5c9e-1676-4802-839d-35ce1b34044e'] 2021-04-29 17:27:49.133 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:27:49.141 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron trunk objects 2021-04-29 17:27:50.819 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron port objects 2021-04-29 17:27:52.676 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron subnet objects 2021-04-29 17:28:06.950 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_5770006e_zfLJPA5l (c96aefed-c177-4e13-89d9-462b8a1e0e00) 2021-04-29 17:28:06.956 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_5770006e_cE47ebf0 (3e29aef5-bb46-4c7a-b00f-d857cccb8d14) 2021-04-29 17:28:06.960 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_5770006e_elNfoQou (fb793940-4fb1-4299-916a-4f337f5176b9) 2021-04-29 17:28:06.965 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_5770006e_8nfwfOpm (204a6782-4fdb-4bc7-a037-33751233be4a) 2021-04-29 17:28:06.966 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_5770006e_wwXS9kxO (69496326-5764-4f06-8ed8-172acf07dc56) 2021-04-29 17:28:06.966 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_5770006e_W05cju09 (8d2082db-2278-4db0-80c4-591f021d9f5d) 2021-04-29 17:28:06.967 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_5770006e_ezowU3Lg (6ecee907-2b40-47f0-969b-517d66d13e61) 2021-04-29 17:28:06.967 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_5770006e_y85jkCoY (7bd0b6d7-55fe-4ea9-9e94-7f6cf9500e33) 2021-04-29 17:28:06.968 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_5770006e_YWf4MxLN (ca9ddf2f-da51-48bb-8b71-c2e711c07e1b) 2021-04-29 17:28:06.968 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_5770006e_PsLYcCKP (dc8c0d0c-615c-48ab-ad01-6662c53b2dce) 2021-04-29 17:28:40.134 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron network objects 2021-04-29 17:29:01.752 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_5770006e_MsIv981Q (200aa4a1-1156-46a8-9c9e-c1868ac80dad) 2021-04-29 17:29:01.760 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_5770006e_dDOaeMNI (201750a9-eecd-4390-a0ac-7a7971509e21) 2021-04-29 17:29:01.774 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_5770006e_E88cw2w8 (3af71fba-cac9-48a4-b727-800dfe3cd939) 2021-04-29 17:29:01.790 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_5770006e_OhMsw2ry (ac65373b-4f83-4f9e-8ecf-24ba2997c499) 2021-04-29 17:29:01.795 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_5770006e_oSjXWWST (079b41b4-c400-4289-9c1c-46eb583a9d77) 2021-04-29 17:29:01.810 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_5770006e_036ajkth (c6a19c66-23e6-43ed-b833-8b8416c8c824) 2021-04-29 17:29:01.816 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_5770006e_ArGxrRTe (628c880b-e874-49fb-9217-7c2395653f83) 2021-04-29 17:29:01.827 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_5770006e_PL14gWn7 (56871fff-7a7e-4b0b-b02c-b77247d331fb) 2021-04-29 17:29:01.832 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_5770006e_YbAxyvi7 (affeb2fb-a76c-47b6-b3ca-fd11483c24ae) 2021-04-29 17:29:01.842 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.network object s_rally_5770006e_kUMmaahP (e8ed7c43-5943-4c8c-85bb-790159fc1557) 2021-04-29 17:29:38.902 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron router objects 2021-04-29 17:29:39.465 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:29:39.495 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:29:39.524 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-cf74e95b-7c47-4e5b-9e55-2762372ac5f8'] 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-cf74e95b-7c47-4e5b-9e55-2762372ac5f8'] 2021-04-29 17:29:39.525 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:29:40.083 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:29:40.103 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:29:40.121 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-0f47832f-c1e6-4aed-a7e4-abcaa9cd268a'] 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-0f47832f-c1e6-4aed-a7e4-abcaa9cd268a'] 2021-04-29 17:29:40.122 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:29:40.693 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:29:40.732 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:29:40.761 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-b1783595-3c4e-47a1-8a40-06f50019a7b2'] 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-b1783595-3c4e-47a1-8a40-06f50019a7b2'] 2021-04-29 17:29:40.762 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:29:40.770 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron security_group objects 2021-04-29 17:29:59.264 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() finished in 2.31 min 2021-04-29 17:29:59.265 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() started 2021-04-29 17:30:43.883 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() finished in 44.62 sec 2021-04-29 17:30:43.884 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() started 2021-04-29 17:32:22.882 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() finished in 1.65 min 2021-04-29 17:32:22.995 2774 INFO rally.task.engine [-] Load duration is: 200.747144 2021-04-29 17:32:22.995 2774 INFO rally.task.engine [-] Full runner duration is: 200.778042 2021-04-29 17:32:22.996 2774 INFO rally.task.engine [-] Full duration is: 592.293967 2021-04-29 17:32:23.083 2774 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=47820ab5-4c6d-4114-8193-904ed7089561)", "subtasks": [ { "title": "NeutronSecurityGroup.create_and_delete_security_groups", "description": "Create and delete Neutron security-groups.", "scenario": { "NeutronSecurityGroup.create_and_delete_security_groups": {} }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 17:32:23.098 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 17:32:34.462 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 17:33:11.128 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack setup() finished in 48.03 sec 2021-04-29 17:33:33.823 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack setup() finished in 22.69 sec 2021-04-29 17:33:33.823 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack setup() finished in 0.02 msec 2021-04-29 17:33:33.835 2774 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: c93253ff-a6bd-4f00-89e5-1ef609c7bfb6). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 17:33:33.837 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 17:33:33.838 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 17:33:33.839 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 17:33:33.846 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 START 2021-04-29 17:33:33.847 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 17:33:33.863 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 START 2021-04-29 17:33:33.869 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 START 2021-04-29 17:33:33.878 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 START 2021-04-29 17:34:03.349 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 END: OK 2021-04-29 17:34:03.357 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 START 2021-04-29 17:34:03.378 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 END: OK 2021-04-29 17:34:03.384 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 START 2021-04-29 17:34:04.307 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 END: OK 2021-04-29 17:34:04.313 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 START 2021-04-29 17:34:04.453 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 END: OK 2021-04-29 17:34:04.458 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 START 2021-04-29 17:34:36.706 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 END: OK 2021-04-29 17:34:36.713 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 START 2021-04-29 17:34:38.031 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 END: OK 2021-04-29 17:34:38.037 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 START 2021-04-29 17:34:38.213 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 END: OK 2021-04-29 17:34:38.502 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 END: OK 2021-04-29 17:34:59.226 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 END: OK 2021-04-29 17:35:07.228 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 END: OK 2021-04-29 17:35:07.251 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() started 2021-04-29 17:35:07.258 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron vip objects 2021-04-29 17:35:08.957 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron health_monitor objects 2021-04-29 17:35:10.629 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron pool objects 2021-04-29 17:35:12.303 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron loadbalancer objects 2021-04-29 17:35:13.963 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron floatingip objects 2021-04-29 17:35:14.478 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:35:14.518 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:35:14.540 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-60d87228-3523-4c00-9d9a-86e368d48e65'] 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-60d87228-3523-4c00-9d9a-86e368d48e65'] 2021-04-29 17:35:14.541 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:35:15.062 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:35:15.081 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:35:15.103 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-aac318a6-8e71-4ece-8854-4fedd111e1c3'] 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-aac318a6-8e71-4ece-8854-4fedd111e1c3'] 2021-04-29 17:35:15.104 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:35:15.639 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:35:15.664 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:35:15.692 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-ea80ddcd-61d6-4cd2-9094-d530c7072a56'] 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-ea80ddcd-61d6-4cd2-9094-d530c7072a56'] 2021-04-29 17:35:15.692 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:35:15.701 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron trunk objects 2021-04-29 17:35:17.248 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron port objects 2021-04-29 17:35:19.056 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron subnet objects 2021-04-29 17:35:20.846 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron network objects 2021-04-29 17:35:22.603 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron router objects 2021-04-29 17:35:23.142 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:35:23.164 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:35:23.183 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-a2c74785-19c3-4c45-b24b-99c1ffabf2ab'] 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-a2c74785-19c3-4c45-b24b-99c1ffabf2ab'] 2021-04-29 17:35:23.183 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:35:23.734 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:35:23.763 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:35:23.787 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-8dccfbb4-dd0c-4757-9032-c63b3a9d583e'] 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-8dccfbb4-dd0c-4757-9032-c63b3a9d583e'] 2021-04-29 17:35:23.788 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:35:24.312 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:35:24.335 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:35:24.363 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-74728f4e-332b-42da-b9b1-6ca282a4f43a'] 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-74728f4e-332b-42da-b9b1-6ca282a4f43a'] 2021-04-29 17:35:24.364 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:35:24.373 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron security_group objects 2021-04-29 17:35:42.376 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() finished in 35.12 sec 2021-04-29 17:35:42.377 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() started 2021-04-29 17:35:50.703 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() finished in 8.33 sec 2021-04-29 17:35:50.704 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() started 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find user: 48d1e1543bca45c098c30f2de88d5f7f. (HTTP 404) (Request-ID: req-59751886-c939-42ab-8cec-1bb6fe809a74) 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker consume(cache, args) 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find user: 48d1e1543bca45c098c30f2de88d5f7f. (HTTP 404) (Request-ID: req-59751886-c939-42ab-8cec-1bb6fe809a74) 2021-04-29 17:37:21.476 2774 ERROR rally.common.broker 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker [-] Failed to consume a task from the queue: keystoneauth1.exceptions.http.NotFound: Could not find user: d07560900cf44f5f89a7fb4908138301. (HTTP 404) (Request-ID: req-3477969e-12d8-4140-84c6-7e2a5fd7f922) 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker Traceback (most recent call last): 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/common/broker.py", line 42, in _consumer 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker consume(cache, args) 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/keystone/users.py", line 250, in consume 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker getattr(cache["client"], func_name)(resource_id) 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally/task/service.py", line 116, in wrapper 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker return func(instance, *args, **kwargs) 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/identity.py", line 109, in delete_user 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker self._impl.delete_user(user_id) 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 32, in delete_user 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker return self._impl.delete_user(user_id) 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/rally_openstack/services/identity/keystone_common.py", line 104, in delete_user 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker self._clients.keystone(self.version).users.delete(user_id) 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/v3/users.py", line 296, in delete 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker user_id=base.getid(user)) 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 86, in func 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker return f(*args, **new_kwargs) 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 480, in delete 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker self.build_url(dict_args_in_out=kwargs)) 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneclient/base.py", line 246, in _delete 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker resp, body = self.client.delete(url, **kwargs) 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 390, in delete 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker return self.request(url, 'DELETE', **kwargs) 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 534, in request 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker resp = super(LegacyJsonAdapter, self).request(*args, **kwargs) 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 237, in request 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker return self.session.request(url, method, **kwargs) 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker File "/usr/lib/python3.6/site-packages/keystoneauth1/session.py", line 890, in request 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker raise exceptions.from_response(resp, method, url) 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker keystoneauth1.exceptions.http.NotFound: Could not find user: d07560900cf44f5f89a7fb4908138301. (HTTP 404) (Request-ID: req-3477969e-12d8-4140-84c6-7e2a5fd7f922) 2021-04-29 17:37:27.810 2774 ERROR rally.common.broker 2021-04-29 17:38:28.395 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() finished in 2.63 min 2021-04-29 17:38:28.571 2774 INFO rally.task.engine [-] Load duration is: 93.376043 2021-04-29 17:38:28.572 2774 INFO rally.task.engine [-] Full runner duration is: 93.416609 2021-04-29 17:38:28.572 2774 INFO rally.task.engine [-] Full duration is: 365.298717 2021-04-29 17:38:28.656 2774 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=aef91a20-b0d4-4dad-914f-151de202733d)", "subtasks": [ { "title": "NeutronSecurityGroup.create_and_delete_security_group_rule", "description": "Create and delete Neutron security-group-rule.", "scenario": { "NeutronSecurityGroup.create_and_delete_security_group_rule": {} }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 17:38:28.670 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 17:38:42.652 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 17:39:27.521 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack setup() finished in 58.85 sec 2021-04-29 17:40:12.972 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack setup() finished in 45.45 sec 2021-04-29 17:40:12.973 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack setup() finished in 0.13 msec 2021-04-29 17:40:12.985 2774 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: c93253ff-a6bd-4f00-89e5-1ef609c7bfb6). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 17:40:12.987 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 17:40:12.992 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 17:40:12.996 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 START 2021-04-29 17:40:13.002 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 START 2021-04-29 17:40:13.009 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 17:40:13.011 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 17:40:13.018 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 START 2021-04-29 17:40:13.036 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 START 2021-04-29 17:41:25.646 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 END: OK 2021-04-29 17:41:25.654 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 START 2021-04-29 17:41:28.284 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 END: OK 2021-04-29 17:41:28.289 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 START 2021-04-29 17:41:30.222 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 END: OK 2021-04-29 17:41:30.227 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 START 2021-04-29 17:41:31.695 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 END: OK 2021-04-29 17:41:31.701 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 START 2021-04-29 17:42:26.470 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 END: OK 2021-04-29 17:42:26.477 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 START 2021-04-29 17:42:35.894 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 END: OK 2021-04-29 17:42:35.905 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 START 2021-04-29 17:42:36.960 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 END: OK 2021-04-29 17:42:37.780 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 END: OK 2021-04-29 17:43:21.501 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 END: OK 2021-04-29 17:43:30.965 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 END: OK 2021-04-29 17:43:30.987 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() started 2021-04-29 17:43:30.993 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron vip objects 2021-04-29 17:43:32.574 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron health_monitor objects 2021-04-29 17:43:34.110 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron pool objects 2021-04-29 17:43:35.823 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron loadbalancer objects 2021-04-29 17:43:37.520 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron floatingip objects 2021-04-29 17:43:38.084 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:43:38.115 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:43:38.149 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-b1847618-90cc-4152-ac8e-bc8987a7148b'] 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-b1847618-90cc-4152-ac8e-bc8987a7148b'] 2021-04-29 17:43:38.150 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:43:38.724 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:43:38.754 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:43:38.779 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-e3326db9-1ce7-4c59-b339-8fa642961458'] 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-e3326db9-1ce7-4c59-b339-8fa642961458'] 2021-04-29 17:43:38.780 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:43:39.336 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:43:39.359 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:43:39.386 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-aebb37bc-3604-40a0-a8ce-d238933cadfb'] 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-aebb37bc-3604-40a0-a8ce-d238933cadfb'] 2021-04-29 17:43:39.387 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:43:39.396 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron trunk objects 2021-04-29 17:43:41.049 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron port objects 2021-04-29 17:43:42.836 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron subnet objects 2021-04-29 17:43:44.891 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron network objects 2021-04-29 17:43:46.653 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron router objects 2021-04-29 17:43:47.193 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:43:47.214 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:43:47.235 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-47047f7f-d26f-47a1-bec0-4a10899174e8'] 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-47047f7f-d26f-47a1-bec0-4a10899174e8'] 2021-04-29 17:43:47.236 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:43:47.718 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:43:47.739 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:43:47.758 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-1aadcc66-e11a-4790-983f-61480a7c2000'] 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-1aadcc66-e11a-4790-983f-61480a7c2000'] 2021-04-29 17:43:47.758 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:43:48.291 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:43:48.320 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:43:48.346 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-7f762913-8d48-4ef0-87cd-4d3e580d3636'] 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-7f762913-8d48-4ef0-87cd-4d3e580d3636'] 2021-04-29 17:43:48.347 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:43:48.355 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron security_group objects 2021-04-29 17:44:14.353 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() finished in 43.37 sec 2021-04-29 17:44:14.353 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() started 2021-04-29 17:44:29.855 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() finished in 15.50 sec 2021-04-29 17:44:29.856 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() started 2021-04-29 17:46:59.679 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() finished in 2.50 min 2021-04-29 17:47:00.736 2774 INFO rally.task.engine [-] Load duration is: 197.968069 2021-04-29 17:47:00.736 2774 INFO rally.task.engine [-] Full runner duration is: 198.00324 2021-04-29 17:47:00.737 2774 INFO rally.task.engine [-] Full duration is: 511.010197 2021-04-29 17:47:00.824 2774 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=16f7c945-79ad-4718-9c20-bc3d42caaa82)", "subtasks": [ { "title": "NeutronSecurityGroup.create_and_list_security_group_rules", "description": "Create and list Neutron security-group-rules.", "scenario": { "NeutronSecurityGroup.create_and_list_security_group_rules": {} }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 17:47:00.839 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 17:47:27.397 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 17:48:03.921 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack setup() finished in 1.05 min 2021-04-29 17:48:29.036 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack setup() finished in 25.11 sec 2021-04-29 17:48:29.037 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack setup() finished in 0.04 msec 2021-04-29 17:48:29.048 2774 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: c93253ff-a6bd-4f00-89e5-1ef609c7bfb6). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 17:48:29.050 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 17:48:29.054 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 17:48:29.059 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 START 2021-04-29 17:48:29.065 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 17:48:29.070 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 17:48:29.075 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 START 2021-04-29 17:48:29.080 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 START 2021-04-29 17:48:29.088 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 START 2021-04-29 17:49:25.008 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 END: OK 2021-04-29 17:49:25.017 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 START 2021-04-29 17:49:29.831 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 END: OK 2021-04-29 17:49:29.837 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 START 2021-04-29 17:49:30.351 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 END: OK 2021-04-29 17:49:30.356 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 END: OK 2021-04-29 17:49:30.361 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 START 2021-04-29 17:49:30.372 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 START 2021-04-29 17:50:03.993 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 END: OK 2021-04-29 17:50:04.002 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 START 2021-04-29 17:50:06.696 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 END: OK 2021-04-29 17:50:06.706 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 START 2021-04-29 17:50:10.958 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 END: OK 2021-04-29 17:50:11.018 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 END: OK 2021-04-29 17:50:39.897 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 END: OK 2021-04-29 17:50:55.859 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 END: OK 2021-04-29 17:50:55.882 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() started 2021-04-29 17:50:55.888 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron vip objects 2021-04-29 17:50:57.892 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron health_monitor objects 2021-04-29 17:50:59.424 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron pool objects 2021-04-29 17:51:01.107 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron loadbalancer objects 2021-04-29 17:51:02.830 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron floatingip objects 2021-04-29 17:51:03.390 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:51:03.420 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:51:03.453 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-87fc25c6-30fe-45a0-9fc3-55ac4fdc41dd'] 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-87fc25c6-30fe-45a0-9fc3-55ac4fdc41dd'] 2021-04-29 17:51:03.454 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:51:03.991 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:51:04.012 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:51:04.034 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-0db98c8d-c8a5-462c-b879-8b76a66cd48e'] 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-0db98c8d-c8a5-462c-b879-8b76a66cd48e'] 2021-04-29 17:51:04.035 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:51:04.603 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:51:04.635 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:51:04.656 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-7acb6ce4-f9a9-4a6b-9917-3b943fd4a8c2'] 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-7acb6ce4-f9a9-4a6b-9917-3b943fd4a8c2'] 2021-04-29 17:51:04.656 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:51:04.665 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron trunk objects 2021-04-29 17:51:06.323 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron port objects 2021-04-29 17:51:08.136 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron subnet objects 2021-04-29 17:51:09.919 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron network objects 2021-04-29 17:51:11.638 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron router objects 2021-04-29 17:51:12.198 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:51:12.214 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:51:12.235 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-248c6b96-b602-4c5b-8dfa-a0e1e7b68383'] 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-248c6b96-b602-4c5b-8dfa-a0e1e7b68383'] 2021-04-29 17:51:12.236 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:51:12.820 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:51:12.842 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:51:12.870 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-84aa04ae-77a3-494e-b4a6-0813564580c9'] 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-84aa04ae-77a3-494e-b4a6-0813564580c9'] 2021-04-29 17:51:12.870 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:51:13.462 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:51:13.488 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:51:13.507 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-a7674814-1838-433a-a72f-9caf294e6fe6'] 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-a7674814-1838-433a-a72f-9caf294e6fe6'] 2021-04-29 17:51:13.508 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:51:13.517 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron security_group objects 2021-04-29 17:51:20.437 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.security_group object s_rally_16f7c945_h9NrkAQI (753888d9-54ff-4d4e-a3b4-8a6873f0e236) 2021-04-29 17:51:20.441 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.security_group object s_rally_16f7c945_D0pMxux7 (cba9b39a-d883-4027-8e06-f599e1483dda) 2021-04-29 17:51:20.456 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.security_group object s_rally_16f7c945_bBIntJC5 (165317b8-5b24-4aed-abe0-3bc36804acf3) 2021-04-29 17:51:20.462 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.security_group object s_rally_16f7c945_Znz1eo3i (9222f9ad-b8d0-49bd-9728-91a103670d88) 2021-04-29 17:51:20.481 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.security_group object s_rally_16f7c945_inapEvo6 (1cc9446a-8d77-46e6-8522-6ec61af1dfce) 2021-04-29 17:51:20.488 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.security_group object s_rally_16f7c945_Kl1gC08R (29fc35eb-0260-44fd-ad37-43f353aed85e) 2021-04-29 17:51:20.499 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.security_group object s_rally_16f7c945_1jxtfdhk (8c27c008-7b74-4334-80ee-0920133ffb69) 2021-04-29 17:51:20.510 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.security_group object s_rally_16f7c945_PWEBGB5f (a16cae7d-bc19-4a23-96ff-ba4d8c19e02c) 2021-04-29 17:51:20.521 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.security_group object s_rally_16f7c945_vU3PzlWk (c38f2ca7-8a9a-44cc-9caa-4a3ac2e2cfc5) 2021-04-29 17:51:20.532 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.security_group object s_rally_16f7c945_nwstp1XS (f086066c-af3d-4024-b5b8-0d21e2759af4) 2021-04-29 17:51:39.066 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() finished in 43.18 sec 2021-04-29 17:51:39.067 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() started 2021-04-29 17:51:57.542 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() finished in 18.47 sec 2021-04-29 17:51:57.542 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() started 2021-04-29 17:53:58.143 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() finished in 2.01 min 2021-04-29 17:53:58.577 2774 INFO rally.task.engine [-] Load duration is: 146.79973 2021-04-29 17:53:58.578 2774 INFO rally.task.engine [-] Full runner duration is: 146.833953 2021-04-29 17:53:58.578 2774 INFO rally.task.engine [-] Full duration is: 417.305264 2021-04-29 17:53:58.665 2774 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=b5c88a4a-3faa-4b0c-8b97-d5ad2191b06c)", "subtasks": [ { "title": "NeutronSecurityGroup.create_and_show_security_group", "description": "Create and show Neutron security-group.", "scenario": { "NeutronSecurityGroup.create_and_show_security_group": {} }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "quotas": { "neutron": { "security_group": -1 } } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 17:53:58.680 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 17:54:10.632 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 17:54:34.704 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack setup() finished in 36.02 sec 2021-04-29 17:54:44.211 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack setup() finished in 9.51 sec 2021-04-29 17:54:44.212 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack setup() finished in 0.14 msec 2021-04-29 17:54:44.224 2774 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: c93253ff-a6bd-4f00-89e5-1ef609c7bfb6). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 17:54:44.226 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 17:54:44.227 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 17:54:44.232 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 17:54:44.232 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 START 2021-04-29 17:54:44.236 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {} 2021-04-29 17:54:44.237 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 START 2021-04-29 17:54:44.242 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 START 2021-04-29 17:54:44.254 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 START 2021-04-29 17:55:10.104 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 END: OK 2021-04-29 17:55:10.112 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 START 2021-04-29 17:55:10.233 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 END: OK 2021-04-29 17:55:10.238 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 START 2021-04-29 17:55:10.299 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 END: OK 2021-04-29 17:55:10.305 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 START 2021-04-29 17:55:11.152 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 END: OK 2021-04-29 17:55:11.158 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 START 2021-04-29 17:55:43.860 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 END: OK 2021-04-29 17:55:43.867 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 START 2021-04-29 17:55:47.338 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 END: OK 2021-04-29 17:55:47.343 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 START 2021-04-29 17:55:47.601 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 END: OK 2021-04-29 17:55:48.518 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 END: OK 2021-04-29 17:56:28.801 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 END: OK 2021-04-29 17:56:32.404 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 END: OK 2021-04-29 17:56:32.424 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() started 2021-04-29 17:56:32.429 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron vip objects 2021-04-29 17:56:34.162 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron health_monitor objects 2021-04-29 17:56:35.791 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron pool objects 2021-04-29 17:56:37.497 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron loadbalancer objects 2021-04-29 17:56:39.195 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron floatingip objects 2021-04-29 17:56:39.720 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:56:39.749 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:56:39.774 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-e5cbf064-77d2-466e-a59f-b84bdea6e68e'] 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-e5cbf064-77d2-466e-a59f-b84bdea6e68e'] 2021-04-29 17:56:39.775 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:56:40.292 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:56:40.311 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:56:40.332 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-4757c58a-b135-43a6-be6d-5108582c4663'] 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-4757c58a-b135-43a6-be6d-5108582c4663'] 2021-04-29 17:56:40.332 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:56:40.876 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:56:40.902 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:56:40.927 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-3138847a-ce8a-4fa3-967e-aef66e6b505d'] 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-3138847a-ce8a-4fa3-967e-aef66e6b505d'] 2021-04-29 17:56:40.928 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:56:40.937 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron trunk objects 2021-04-29 17:56:42.608 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron port objects 2021-04-29 17:56:44.414 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron subnet objects 2021-04-29 17:56:46.150 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron network objects 2021-04-29 17:56:47.845 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron router objects 2021-04-29 17:56:48.392 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:56:48.412 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:56:48.434 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-f09a15e9-806f-4661-abca-020fcf13f163'] 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-f09a15e9-806f-4661-abca-020fcf13f163'] 2021-04-29 17:56:48.435 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:56:49.001 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:56:49.023 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:56:49.039 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-a5be6703-622c-4955-8b80-a7cf93a3a1f2'] 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-a5be6703-622c-4955-8b80-a7cf93a3a1f2'] 2021-04-29 17:56:49.039 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:56:49.641 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:56:49.671 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:56:49.689 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-88ef6ced-66c6-47c1-8bb6-c9edf52c47b3'] 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-88ef6ced-66c6-47c1-8bb6-c9edf52c47b3'] 2021-04-29 17:56:49.689 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 17:56:49.697 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron security_group objects 2021-04-29 17:57:11.180 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.security_group object s_rally_b5c88a4a_KgFVzWvw (30713be4-075b-4dc7-985f-223f66997b09) 2021-04-29 17:57:11.190 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.security_group object s_rally_b5c88a4a_eQaDPoqW (3d4052bb-da57-4b72-91a1-76bbf57865c0) 2021-04-29 17:57:11.199 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.security_group object s_rally_b5c88a4a_LCymbHCW (c1fab996-1ad3-46a2-8d50-25b6b4b50f3f) 2021-04-29 17:57:11.211 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.security_group object s_rally_b5c88a4a_SpN9xeuk (086aaf17-f63c-4b11-83bf-0d898e121e81) 2021-04-29 17:57:11.221 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.security_group object s_rally_b5c88a4a_dryayN2l (1038d544-e1f2-4bd9-ac40-b29431015c1c) 2021-04-29 17:57:11.226 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.security_group object s_rally_b5c88a4a_pGhX0IIN (38ccc972-5fa9-4963-a81e-0b7cf711ae5f) 2021-04-29 17:57:11.247 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.security_group object s_rally_b5c88a4a_P7hkRTFO (8c63babe-1793-447e-bea1-f4f597cc8f8e) 2021-04-29 17:57:11.253 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.security_group object s_rally_b5c88a4a_KDtnNJML (4b6efcb6-71ea-4580-ba62-81480bb15efc) 2021-04-29 17:57:11.276 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.security_group object s_rally_b5c88a4a_DcWAija9 (925119f1-4594-4b3a-b56a-22e1c0fc5076) 2021-04-29 17:57:11.287 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.security_group object s_rally_b5c88a4a_GC6LxJ3V (99bb1c90-48cd-494f-9227-81227d6ad96d) 2021-04-29 17:57:45.388 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() finished in 1.22 min 2021-04-29 17:57:45.388 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() started 2021-04-29 17:59:09.622 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() finished in 1.40 min 2021-04-29 17:59:09.622 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() started 2021-04-29 18:00:50.687 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() finished in 1.68 min 2021-04-29 18:00:52.488 2774 INFO rally.task.engine [-] Load duration is: 108.161206 2021-04-29 18:00:52.488 2774 INFO rally.task.engine [-] Full runner duration is: 108.200812 2021-04-29 18:00:52.488 2774 INFO rally.task.engine [-] Full duration is: 412.008889 2021-04-29 18:00:52.575 2774 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=04006d6d-5746-4ae3-85a7-be529aac79ae)", "subtasks": [ { "title": "NeutronNetworks.create_and_show_ports", "description": "Create a given number of ports and show created ports in trun.", "scenario": { "NeutronNetworks.create_and_show_ports": { "ports_per_network": 2 } }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "router": -1 } } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 18:00:52.590 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 18:00:59.908 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 18:01:18.137 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack setup() finished in 25.55 sec 2021-04-29 18:01:18.819 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPBadRequest", "message": "Unrecognized attribute(s) 'router'", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:01:18.821 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() started 2021-04-29 18:01:18.865 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "TenantQuotaNotFound", "message": "Quota for tenant b26007c90f624da682675bb637316faf could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:01:18.865 2774 WARNING rally_openstack.contexts.quotas.quotas [-] Failed to remove quotas for tenant b26007c90f624da682675bb637316faf in service neutron reason: Quota for tenant b26007c90f624da682675bb637316faf could not be found. Neutron server returns request_ids: ['req-4a675cf9-faf2-4304-959d-03ecd4424341']: neutronclient.common.exceptions.NotFound: Quota for tenant b26007c90f624da682675bb637316faf could not be found. 2021-04-29 18:01:18.913 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "TenantQuotaNotFound", "message": "Quota for tenant 83f3a38ab3a54f71a4527dbdabedd397 could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:01:18.913 2774 WARNING rally_openstack.contexts.quotas.quotas [-] Failed to remove quotas for tenant 83f3a38ab3a54f71a4527dbdabedd397 in service neutron reason: Quota for tenant 83f3a38ab3a54f71a4527dbdabedd397 could not be found. Neutron server returns request_ids: ['req-7d4b565f-fa03-41ef-8b93-d4b1e0466b78']: neutronclient.common.exceptions.NotFound: Quota for tenant 83f3a38ab3a54f71a4527dbdabedd397 could not be found. 2021-04-29 18:01:18.952 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "TenantQuotaNotFound", "message": "Quota for tenant d08b9d84c06c4268950866ed9b04d049 could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:01:18.952 2774 WARNING rally_openstack.contexts.quotas.quotas [-] Failed to remove quotas for tenant d08b9d84c06c4268950866ed9b04d049 in service neutron reason: Quota for tenant d08b9d84c06c4268950866ed9b04d049 could not be found. Neutron server returns request_ids: ['req-a077f963-16a8-442a-9d85-e191d8974784']: neutronclient.common.exceptions.NotFound: Quota for tenant d08b9d84c06c4268950866ed9b04d049 could not be found. 2021-04-29 18:01:18.953 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() finished in 0.13 sec 2021-04-29 18:01:18.954 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() started 2021-04-29 18:03:35.147 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() finished in 2.27 min 2021-04-29 18:03:35.240 2774 INFO rally.task.engine [-] Load duration is: 0.0 2021-04-29 18:03:35.241 2774 INFO rally.task.engine [-] Full runner duration is: 0.0 2021-04-29 18:03:35.241 2774 INFO rally.task.engine [-] Full duration is: 162.559083 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine [-] Unexpected exception during the workload execution: neutronclient.common.exceptions.BadRequest: Unrecognized attribute(s) 'router' Neutron server returns request_ids: ['req-7cab9d9e-3429-4926-b252-05d8fdc13263'] 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine Traceback (most recent call last): 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally/task/engine.py", line 513, in _run_workload 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine with ctx_manager: 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally/task/context.py", line 311, in __enter__ 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine self.setup() 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally/task/context.py", line 256, in setup 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine ctx.setup() 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/quotas/quotas.py", line 79, in setup 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine **self.config[service]) 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/rally_openstack/contexts/quotas/neutron_quotas.py", line 75, in update 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine self.clients.neutron().update_quota(tenant_id, body=body) 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/debtcollector/renames.py", line 43, in decorator 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine return wrapped(*args, **kwargs) 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 775, in update_quota 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine return self.put(self.quota_path % (project_id), body=body) 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 363, in put 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine headers=headers, params=params) 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine headers=headers, params=params) 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine self._handle_fault_response(status_code, replybody, resp) 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine exception_handler_v20(status_code, error_body) 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine request_ids=request_ids) 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine neutronclient.common.exceptions.BadRequest: Unrecognized attribute(s) 'router' 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine Neutron server returns request_ids: ['req-7cab9d9e-3429-4926-b252-05d8fdc13263'] 2021-04-29 18:03:35.264 2774 ERROR rally.task.engine 2021-04-29 18:03:35.309 2774 INFO rally.task.engine [-] Running workload: position = 0 config = { "version": 2, "title": "A cropped version of a bigger task.", "description": "Auto-generated task from a single workload (uuid=296f0ebc-8d8f-4f95-ab42-86b6430100e7)", "subtasks": [ { "title": "NeutronNetworks.create_and_show_subnets", "description": "Create and show a subnet details.", "scenario": { "NeutronNetworks.create_and_show_subnets": { "subnets_per_network": 2 } }, "contexts": { "users": { "tenants": 3, "users_per_tenant": 2 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "runner": { "constant": { "concurrency": 4, "times": 10 } }, "hooks": [], "sla": { "failure_rate": { "max": 0 } } } ] } 2021-04-29 18:03:35.328 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 3 tenants using 20 threads 2021-04-29 18:03:46.556 2774 RALLYDEBUG rally_openstack.contexts.keystone.users [-] Creating 6 users using 20 threads 2021-04-29 18:04:15.017 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack setup() finished in 39.69 sec 2021-04-29 18:04:50.552 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack setup() finished in 35.53 sec 2021-04-29 18:05:24.829 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.39.0/24 2021-04-29 18:06:33.300 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.40.0/24 2021-04-29 18:07:23.997 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.41.0/24 2021-04-29 18:07:45.624 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context network@openstack setup() finished in 2.92 min 2021-04-29 18:07:45.624 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack setup() finished in 0.01 msec 2021-04-29 18:07:45.635 2774 RALLYDEBUG rally.task.runner [-] Starting the constant runner (task UUID: c93253ff-a6bd-4f00-89e5-1ef609c7bfb6). times: 10 concurrency: 4 timeout: 0 max_cpu_used: 88 processes_to_start: 4 concurrency_per_worker: 1 concurrency_overhead: 0 2021-04-29 18:07:45.637 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"subnets_per_network": 2} 2021-04-29 18:07:45.638 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"subnets_per_network": 2} 2021-04-29 18:07:45.647 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"subnets_per_network": 2} 2021-04-29 18:07:45.648 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 START 2021-04-29 18:07:45.649 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.42.0/24 2021-04-29 18:07:45.660 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 START 2021-04-29 18:07:45.661 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.43.0/24 2021-04-29 18:07:45.666 2774 RALLYDEBUG rally.task.runner [-] Starting a worker. times: 10 duration: None concurrency: 1 timeout: 0 cls: method_name: run args: {"subnets_per_network": 2} 2021-04-29 18:07:45.673 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 START 2021-04-29 18:07:45.674 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.44.0/24 2021-04-29 18:07:45.681 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 START 2021-04-29 18:07:45.682 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.45.0/24 2021-04-29 18:08:00.694 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.46.0/24 2021-04-29 18:08:05.681 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.47.0/24 2021-04-29 18:08:15.262 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.48.0/24 2021-04-29 18:08:28.220 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.49.0/24 2021-04-29 18:08:49.639 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 3 END: OK 2021-04-29 18:08:49.656 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 START 2021-04-29 18:08:49.657 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.50.0/24 2021-04-29 18:08:49.733 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 4 END: OK 2021-04-29 18:08:49.739 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 START 2021-04-29 18:08:49.740 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.51.0/24 2021-04-29 18:08:54.675 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 1 END: OK 2021-04-29 18:08:54.678 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 2 END: OK 2021-04-29 18:08:54.684 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 START 2021-04-29 18:08:54.685 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.52.0/24 2021-04-29 18:08:54.694 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 START 2021-04-29 18:08:54.695 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.53.0/24 2021-04-29 18:09:12.200 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.54.0/24 2021-04-29 18:09:12.478 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.55.0/24 2021-04-29 18:09:14.554 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.56.0/24 2021-04-29 18:09:20.531 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.57.0/24 2021-04-29 18:09:50.508 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 8 END: OK 2021-04-29 18:09:50.516 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 START 2021-04-29 18:09:50.518 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.58.0/24 2021-04-29 18:09:54.864 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 7 END: OK 2021-04-29 18:09:54.870 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 START 2021-04-29 18:09:54.872 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.59.0/24 2021-04-29 18:09:54.958 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 6 END: OK 2021-04-29 18:09:57.173 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 5 END: OK 2021-04-29 18:10:16.794 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.60.0/24 2021-04-29 18:10:20.222 2774 RALLYDEBUG rally_openstack.wrappers.network [-] CIDR generated: 10.2.61.0/24 2021-04-29 18:10:40.096 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 9 END: OK 2021-04-29 18:10:44.717 2774 INFO rally.task.runner [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | ITER: 10 END: OK 2021-04-29 18:10:44.731 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() started 2021-04-29 18:10:44.735 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron vip objects 2021-04-29 18:10:46.615 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron health_monitor objects 2021-04-29 18:10:48.324 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron pool objects 2021-04-29 18:10:50.068 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron loadbalancer objects 2021-04-29 18:10:51.706 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron floatingip objects 2021-04-29 18:10:52.287 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:10:52.317 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:10:52.341 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-66906af3-2eb2-447f-b982-a2b632c899f0'] 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-66906af3-2eb2-447f-b982-a2b632c899f0'] 2021-04-29 18:10:52.342 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 18:10:52.810 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:10:52.835 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:10:52.862 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-7e144786-a86d-4c83-8298-f6928870bd8a'] 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-7e144786-a86d-4c83-8298-f6928870bd8a'] 2021-04-29 18:10:52.863 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 18:10:53.461 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:10:53.491 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:10:53.511 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronFloatingIP.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-ae5afec1-505a-46d2-bef7-b854589a166d'] 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 386, in list 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager return super(NeutronFloatingIP, self).list() 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 951, in list_floatingips 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-ae5afec1-505a-46d2-bef7-b854589a166d'] 2021-04-29 18:10:53.512 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 18:10:53.521 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron trunk objects 2021-04-29 18:10:55.605 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron port objects 2021-04-29 18:10:57.408 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron subnet objects 2021-04-29 18:10:59.452 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_296f0ebc_2vWIPaf2 (4fd77f37-c16f-40cc-9c82-6d943dbd4dad) 2021-04-29 18:10:59.454 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_296f0ebc_LpxM9KrI (488a61af-850b-4776-9fb6-9707563ea336) 2021-04-29 18:10:59.463 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_296f0ebc_U4vtbrFj (6682f0b0-60ef-49ae-87bb-05ac5ec56ba1) 2021-04-29 18:10:59.464 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_296f0ebc_8wDE9LzW (260a319e-b8a4-4228-abc8-c6a4d8d957f7) 2021-04-29 18:10:59.474 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_296f0ebc_8pWO5Bz8 (6d8ac27d-83db-4d82-a663-8cc76df791e4) 2021-04-29 18:10:59.497 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_296f0ebc_4JejX5Q3 (721071db-db91-46a9-989a-2865fdb04c15) 2021-04-29 18:10:59.501 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_296f0ebc_qGEnsXfd (8d9c9d5e-1969-4006-9a49-e7f62b9c9d04) 2021-04-29 18:10:59.505 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_296f0ebc_743aDid8 (a03f5661-07a6-4e6c-a831-b1b5d8cf4e68) 2021-04-29 18:10:59.512 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_296f0ebc_nvSN57bU (a3efce88-8309-446e-8bfe-5f0cf5cf3c84) 2021-04-29 18:10:59.530 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_296f0ebc_7DjE86BL (b6edab63-a186-4da0-a2b7-0c51009ac0a3) 2021-04-29 18:10:59.546 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_296f0ebc_pfRqcupT (bd53d1d3-5d69-460d-82fe-0b8043f27927) 2021-04-29 18:10:59.552 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_296f0ebc_OdZ62P6h (da25ef92-6893-4e98-9c15-bfaff7b955be) 2021-04-29 18:10:59.572 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_296f0ebc_PdK2BJ9x (f6f45198-c8e8-4447-ad02-c3ffd07c52c6) 2021-04-29 18:10:59.588 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_296f0ebc_QO6ybc0v (ff4fe9ce-b5cc-43c2-9c18-d73ce0b934a6) 2021-04-29 18:10:59.616 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_296f0ebc_iez9ErHl (e272cf5a-49a3-461c-8f34-7d858bad3708) 2021-04-29 18:10:59.620 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_296f0ebc_dRxy8fhX (dcebb03e-b44b-4133-bea4-f4bcac3c8baa) 2021-04-29 18:10:59.632 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_296f0ebc_2IAyhYs2 (1ce14ede-d979-4649-8f6f-8e7513bfc21e) 2021-04-29 18:10:59.638 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_296f0ebc_Y0mBRCck (7e8f9a65-5180-40ec-bea9-e5029090d570) 2021-04-29 18:10:59.650 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_296f0ebc_jtwybzlP (a36cac31-aba3-4b97-8df0-3d4e214c1ad7) 2021-04-29 18:10:59.660 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Deleting neutron.subnet object s_rally_296f0ebc_wTLpz3TR (b5d2e488-e4a5-4faf-b75b-72f92439519d) 2021-04-29 18:12:04.366 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "SubnetNotFound", "message": "Subnet f6f45198-c8e8-4447-ad02-c3ffd07c52c6 could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:04.456 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "SubnetNotFound", "message": "Subnet f6f45198-c8e8-4447-ad02-c3ffd07c52c6 could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:04.512 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "SubnetNotFound", "message": "Subnet f6f45198-c8e8-4447-ad02-c3ffd07c52c6 could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager [-] Resource deletion failed, max retries exceeded for neutron.subnet: f6f45198-c8e8-4447-ad02-c3ffd07c52c6.: neutronclient.common.exceptions.NotFound: Subnet f6f45198-c8e8-4447-ad02-c3ffd07c52c6 could not be found. Neutron server returns request_ids: ['req-82c8adc9-0e43-43ea-9e9e-03000faf84e8'] 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 85, in _delete_single_resource 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager rutils.retry(resource._max_attempts, resource.delete) 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 265, in delete 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager delete_method(self.id()) 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 857, in delete_subnet 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager return self.delete(self.subnet_path % (subnet)) 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 350, in delete 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: Subnet f6f45198-c8e8-4447-ad02-c3ffd07c52c6 could not be found. 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-82c8adc9-0e43-43ea-9e9e-03000faf84e8'] 2021-04-29 18:12:04.513 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 18:12:10.311 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "SubnetNotFound", "message": "Subnet 8d9c9d5e-1969-4006-9a49-e7f62b9c9d04 could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:10.385 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "SubnetNotFound", "message": "Subnet 8d9c9d5e-1969-4006-9a49-e7f62b9c9d04 could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:10.462 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "SubnetNotFound", "message": "Subnet 8d9c9d5e-1969-4006-9a49-e7f62b9c9d04 could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager [-] Resource deletion failed, max retries exceeded for neutron.subnet: 8d9c9d5e-1969-4006-9a49-e7f62b9c9d04.: neutronclient.common.exceptions.NotFound: Subnet 8d9c9d5e-1969-4006-9a49-e7f62b9c9d04 could not be found. Neutron server returns request_ids: ['req-9615bd65-3c3d-4827-8cd8-4bf738ea2fcf'] 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 85, in _delete_single_resource 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager rutils.retry(resource._max_attempts, resource.delete) 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 265, in delete 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager delete_method(self.id()) 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 857, in delete_subnet 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager return self.delete(self.subnet_path % (subnet)) 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 350, in delete 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: Subnet 8d9c9d5e-1969-4006-9a49-e7f62b9c9d04 could not be found. 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-9615bd65-3c3d-4827-8cd8-4bf738ea2fcf'] 2021-04-29 18:12:10.463 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 18:12:20.174 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "SubnetNotFound", "message": "Subnet ff4fe9ce-b5cc-43c2-9c18-d73ce0b934a6 could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:20.235 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "SubnetNotFound", "message": "Subnet ff4fe9ce-b5cc-43c2-9c18-d73ce0b934a6 could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:20.288 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "SubnetNotFound", "message": "Subnet ff4fe9ce-b5cc-43c2-9c18-d73ce0b934a6 could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager [-] Resource deletion failed, max retries exceeded for neutron.subnet: ff4fe9ce-b5cc-43c2-9c18-d73ce0b934a6.: neutronclient.common.exceptions.NotFound: Subnet ff4fe9ce-b5cc-43c2-9c18-d73ce0b934a6 could not be found. Neutron server returns request_ids: ['req-3891ec8a-3be4-434b-b01a-daf4e66f37f1'] 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 85, in _delete_single_resource 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager rutils.retry(resource._max_attempts, resource.delete) 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 265, in delete 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager delete_method(self.id()) 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 857, in delete_subnet 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager return self.delete(self.subnet_path % (subnet)) 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 350, in delete 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: Subnet ff4fe9ce-b5cc-43c2-9c18-d73ce0b934a6 could not be found. 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-3891ec8a-3be4-434b-b01a-daf4e66f37f1'] 2021-04-29 18:12:20.289 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 18:12:28.886 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "SubnetNotFound", "message": "Subnet a3efce88-8309-446e-8bfe-5f0cf5cf3c84 could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:28.963 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "SubnetNotFound", "message": "Subnet a3efce88-8309-446e-8bfe-5f0cf5cf3c84 could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:29.041 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "SubnetNotFound", "message": "Subnet a3efce88-8309-446e-8bfe-5f0cf5cf3c84 could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager [-] Resource deletion failed, max retries exceeded for neutron.subnet: a3efce88-8309-446e-8bfe-5f0cf5cf3c84.: neutronclient.common.exceptions.NotFound: Subnet a3efce88-8309-446e-8bfe-5f0cf5cf3c84 could not be found. Neutron server returns request_ids: ['req-e057b2c9-2665-4920-adf8-072a07aacff6'] 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 85, in _delete_single_resource 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager rutils.retry(resource._max_attempts, resource.delete) 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 265, in delete 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager delete_method(self.id()) 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 857, in delete_subnet 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager return self.delete(self.subnet_path % (subnet)) 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 350, in delete 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: Subnet a3efce88-8309-446e-8bfe-5f0cf5cf3c84 could not be found. 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-e057b2c9-2665-4920-adf8-072a07aacff6'] 2021-04-29 18:12:29.041 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 18:12:31.917 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "SubnetNotFound", "message": "Subnet bd53d1d3-5d69-460d-82fe-0b8043f27927 could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:31.987 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "SubnetNotFound", "message": "Subnet bd53d1d3-5d69-460d-82fe-0b8043f27927 could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:32.044 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "SubnetNotFound", "message": "Subnet bd53d1d3-5d69-460d-82fe-0b8043f27927 could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager [-] Resource deletion failed, max retries exceeded for neutron.subnet: bd53d1d3-5d69-460d-82fe-0b8043f27927.: neutronclient.common.exceptions.NotFound: Subnet bd53d1d3-5d69-460d-82fe-0b8043f27927 could not be found. Neutron server returns request_ids: ['req-a49b6ab8-10ac-443e-b082-dd404cf90d4f'] 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 85, in _delete_single_resource 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager rutils.retry(resource._max_attempts, resource.delete) 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 265, in delete 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager delete_method(self.id()) 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 857, in delete_subnet 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager return self.delete(self.subnet_path % (subnet)) 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 350, in delete 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: Subnet bd53d1d3-5d69-460d-82fe-0b8043f27927 could not be found. 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-a49b6ab8-10ac-443e-b082-dd404cf90d4f'] 2021-04-29 18:12:32.045 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 18:12:36.604 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "SubnetNotFound", "message": "Subnet b6edab63-a186-4da0-a2b7-0c51009ac0a3 could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:36.681 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "SubnetNotFound", "message": "Subnet b6edab63-a186-4da0-a2b7-0c51009ac0a3 could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:36.785 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "SubnetNotFound", "message": "Subnet b6edab63-a186-4da0-a2b7-0c51009ac0a3 could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager [-] Resource deletion failed, max retries exceeded for neutron.subnet: b6edab63-a186-4da0-a2b7-0c51009ac0a3.: neutronclient.common.exceptions.NotFound: Subnet b6edab63-a186-4da0-a2b7-0c51009ac0a3 could not be found. Neutron server returns request_ids: ['req-910dea39-d8a6-490c-ad5a-20049513819c'] 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 85, in _delete_single_resource 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager rutils.retry(resource._max_attempts, resource.delete) 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 265, in delete 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager delete_method(self.id()) 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 857, in delete_subnet 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager return self.delete(self.subnet_path % (subnet)) 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 350, in delete 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: Subnet b6edab63-a186-4da0-a2b7-0c51009ac0a3 could not be found. 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-910dea39-d8a6-490c-ad5a-20049513819c'] 2021-04-29 18:12:36.786 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 18:12:36.788 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron network objects 2021-04-29 18:12:44.549 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron router objects 2021-04-29 18:12:45.066 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:45.084 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:45.104 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-012ff102-22fa-4977-a157-e70365966407'] 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-012ff102-22fa-4977-a157-e70365966407'] 2021-04-29 18:12:45.105 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 18:12:45.701 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:45.731 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:45.757 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-16ee7065-efce-4d35-bb5f-9aa5f096fa54'] 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-16ee7065-efce-4d35-bb5f-9aa5f096fa54'] 2021-04-29 18:12:45.758 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 18:12:46.288 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:46.316 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:46.333 2774 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": {"type": "HTTPNotFound", "message": "The resource could not be found.", "detail": ""}} _handle_fault_response /usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py:259 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager [-] Seems like rally_openstack.cleanup.resources.NeutronRouter.list(self) method is broken. It shouldn't raise any exceptions.: neutronclient.common.exceptions.NotFound: The resource could not be found. Neutron server returns request_ids: ['req-0e91e35b-2086-4617-9dcb-f7c141e87200'] 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager Traceback (most recent call last): 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/manager.py", line 133, in _publish 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager for raw_resource in rutils.retry(3, manager.list): 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally/common/utils.py", line 230, in retry 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager return func(*args, **kwargs) 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/rally_openstack/cleanup/resources.py", line 273, in list 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager result = list_method(tenant_id=self.tenant_uuid)[resources] 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 886, in list_routers 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager **_params) 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 369, in list 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager for r in self._pagination(collection, path, **params): 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 384, in _pagination 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager res = self.get(path, params=params) 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 354, in get 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 331, in retry_request 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager headers=headers, params=params) 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 294, in do_request 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager self._handle_fault_response(status_code, replybody, resp) 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 269, in _handle_fault_response 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager exception_handler_v20(status_code, error_body) 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager File "/usr/lib/python3.6/site-packages/neutronclient/v2_0/client.py", line 93, in exception_handler_v20 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager request_ids=request_ids) 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager neutronclient.common.exceptions.NotFound: The resource could not be found. 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager Neutron server returns request_ids: ['req-0e91e35b-2086-4617-9dcb-f7c141e87200'] 2021-04-29 18:12:46.334 2774 ERROR rally_openstack.cleanup.manager 2021-04-29 18:12:46.342 2774 RALLYDEBUG rally_openstack.cleanup.manager [-] Cleaning up neutron security_group objects 2021-04-29 18:12:49.882 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context cleanup@openstack cleanup() finished in 2.09 min 2021-04-29 18:12:49.883 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context network@openstack cleanup() started 2021-04-29 18:13:41.143 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context network@openstack cleanup() finished in 51.26 sec 2021-04-29 18:13:41.143 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() started 2021-04-29 18:13:58.026 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context quotas@openstack cleanup() finished in 16.88 sec 2021-04-29 18:13:58.027 2774 INFO rally.task.context [-] Task c93253ff-a6bd-4f00-89e5-1ef609c7bfb6 | Context users@openstack cleanup() started