2021-06-01 23:01:13,997 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | false | | DEPLOY_SCENARIO | os-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 03M37I43D4EK | | NODE_NAME | lf-pod4-3 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest/03M37I43D4EK/fun | | | ctest-opnfv-functest-benchmarking-kali-rally_jobs- | | | run-143 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest/03M37I43D4EK/f | | | unctest-opnfv-functest-benchmarking-kali- | | | rally_jobs-run-143 | +-------------------------+------------------------------------------------------------+ 2021-06-01 23:01:14,044 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs'... 2021-06-01 23:01:16,480 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs'... 2021-06-01 23:01:24,888 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2021-06-01 23:01:33,419 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 398cfc22-f8be-4dc5-a4f7-ea2b732bf0b7 | 2021-06-01T23:01:33.047334 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 398cfc22-f8be-4dc5-a4f7-ea2b732bf0b7 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2021-06-01 23:01:37,616 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | accelerator | Available | | __unknown__ | alarming | Available | | __unknown__ | compute_legacy | Available | | __unknown__ | event | Available | | __unknown__ | placement | Available | | barbican | key-manager | Available | | cinder | block-storage | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2021-06-01 23:01:39,767 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2021-06-01 23:28:28,822 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 03576aac-25e7-4159-a5d8-e978470e7cd5 2021-06-01 23:28:30,684 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 03576aac-25e7-4159-a5d8-e978470e7cd5 -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": {}, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": 119 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.365 | 1.754 | 17.006 | 22.469 | 38.559 | 5.468 | 100.0% | 100 | | neutron.list_networks | 0.146 | 0.359 | 0.623 | 0.927 | 1.421 | 0.392 | 100.0% | 100 | | total | 0.611 | 2.212 | 17.461 | 22.859 | 38.939 | 5.861 | 100.0% | 100 | | -> duration | 0.611 | 2.212 | 17.461 | 22.859 | 38.939 | 5.861 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 46.0711 Full duration: 62.201645 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.362 | 3.105 | 19.133 | 20.082 | 30.885 | 6.654 | 100.0% | 40 | | neutron.update_network | 0.201 | 0.276 | 0.476 | 0.536 | 0.911 | 0.324 | 100.0% | 40 | | total | 0.69 | 3.453 | 19.397 | 20.467 | 31.094 | 6.978 | 100.0% | 40 | | -> duration | 0.69 | 3.453 | 19.397 | 20.467 | 31.094 | 6.978 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 31.280398 Full duration: 42.950804 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "args": {}, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.422 | 3.135 | 9.776 | 11.925 | 19.272 | 4.407 | 100.0% | 40 | | neutron.delete_network | 0.287 | 0.373 | 1.038 | 1.247 | 1.424 | 0.517 | 100.0% | 40 | | total | 0.727 | 3.687 | 10.088 | 12.223 | 19.603 | 4.924 | 100.0% | 40 | | -> duration | 0.727 | 3.687 | 10.088 | 12.223 | 19.603 | 4.924 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.11512 Full duration: 25.25349 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.372 | 4.135 | 13.486 | 17.883 | 26.194 | 6.166 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.234 | 2.746 | 4.723 | 5.323 | 5.675 | 2.839 | 100.0% | 40 | | neutron.list_subnets | 0.084 | 0.219 | 0.885 | 1.147 | 1.57 | 0.351 | 100.0% | 40 | | total | 2.11 | 7.126 | 17.455 | 19.506 | 28.159 | 9.355 | 100.0% | 40 | | -> duration | 2.11 | 7.126 | 17.455 | 19.506 | 28.159 | 9.355 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 28.456871 Full duration: 53.932572 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_update_args": { "enable_dhcp": true } }, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 5 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.35 | 2.215 | 9.897 | 17.202 | 39.214 | 4.63 | 100.0% | 100 | | neutron.create_subnet (x2) | 1.073 | 3.337 | 6.123 | 6.781 | 9.349 | 3.621 | 100.0% | 100 | | neutron.update_subnet (x2) | 0.529 | 1.327 | 2.398 | 2.738 | 5.296 | 1.443 | 100.0% | 100 | | total | 2.507 | 7.933 | 14.664 | 21.864 | 44.913 | 9.695 | 100.0% | 100 | | -> duration | 2.507 | 7.933 | 14.664 | 21.864 | 44.913 | 9.695 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 57.350451 Full duration: 108.099697 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.373 | 2.47 | 12.85 | 20.07 | 28.518 | 5.413 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.215 | 2.6 | 3.765 | 3.861 | 4.188 | 2.637 | 100.0% | 40 | | neutron.delete_subnet (x2) | 0.803 | 1.739 | 3.052 | 3.561 | 3.871 | 1.876 | 100.0% | 40 | | total | 2.612 | 8.718 | 17.535 | 23.555 | 30.695 | 9.978 | 100.0% | 40 | | -> duration | 2.612 | 8.718 | 17.535 | 23.555 | 30.695 | 9.978 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 30.882331 Full duration: 40.815395 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "args": { "network_create_args": null, "subnet_create_args": null, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": null }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.377 | 1.903 | 5.471 | 6.052 | 14.76 | 2.697 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.297 | 4.945 | 6.639 | 7.656 | 10.3 | 4.775 | 100.0% | 40 | | neutron.create_router (x2) | 0.155 | 0.931 | 1.847 | 2.128 | 3.039 | 1.033 | 100.0% | 40 | | neutron.add_interface_router (x2) | 4.454 | 14.939 | 19.036 | 21.428 | 22.061 | 14.661 | 100.0% | 40 | | neutron.list_routers | 0.157 | 0.468 | 1.575 | 1.685 | 2.083 | 0.709 | 100.0% | 40 | | total | 7.12 | 25.219 | 31.518 | 33.021 | 38.805 | 23.876 | 100.0% | 40 | | -> duration | 7.12 | 25.219 | 31.518 | 33.021 | 38.805 | 23.876 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 60.116529 Full duration: 133.775581 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {}, "router_update_args": { "admin_state_up": false } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.426 | 1.909 | 10.485 | 15.133 | 19.623 | 4.146 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.269 | 4.404 | 7.376 | 7.831 | 8.063 | 4.645 | 100.0% | 40 | | neutron.create_router (x2) | 0.156 | 0.829 | 1.679 | 1.814 | 2.15 | 0.953 | 100.0% | 40 | | neutron.add_interface_router (x2) | 4.818 | 15.079 | 17.845 | 18.738 | 19.403 | 14.267 | 100.0% | 40 | | neutron.update_router (x2) | 1.277 | 5.139 | 7.585 | 8.061 | 8.471 | 4.937 | 100.0% | 40 | | total | 8.656 | 28.31 | 38.271 | 41.589 | 51.822 | 28.949 | 100.0% | 40 | | -> duration | 8.656 | 28.31 | 38.271 | 41.589 | 51.822 | 28.949 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 65.318256 Full duration: 138.779254 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {} }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.462 | 1.949 | 10.304 | 11.06 | 16.894 | 3.707 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.342 | 4.606 | 7.504 | 8.846 | 9.271 | 4.786 | 100.0% | 40 | | neutron.create_router (x2) | 0.194 | 0.721 | 1.939 | 2.173 | 2.358 | 0.916 | 100.0% | 40 | | neutron.add_interface_router (x2) | 4.784 | 16.148 | 20.774 | 23.628 | 25.859 | 15.023 | 100.0% | 40 | | neutron.remove_interface_router (x2) | 5.028 | 13.301 | 21.673 | 24.073 | 26.156 | 13.894 | 100.0% | 40 | | neutron.delete_router (x2) | 0.927 | 2.282 | 4.15 | 4.679 | 5.163 | 2.432 | 100.0% | 40 | | total | 14.321 | 41.053 | 56.862 | 58.16 | 69.217 | 40.758 | 100.0% | 40 | | -> duration | 14.321 | 41.053 | 56.862 | 58.16 | 69.217 | 40.758 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 101.967523 Full duration: 127.416215 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 50 }, "runner": { "times": 8, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1, "port": 811 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.379 | 1.554 | 2.903 | 3.141 | 3.38 | 1.611 | 100.0% | 8 | | neutron.create_port (x50) | 24.57 | 25.757 | 44.819 | 45.163 | 45.507 | 30.376 | 100.0% | 8 | | neutron.list_ports | 0.693 | 1.209 | 1.717 | 2.012 | 2.308 | 1.208 | 100.0% | 8 | | total | 26.234 | 28.913 | 47.526 | 48.876 | 50.225 | 33.203 | 100.0% | 8 | | -> duration | 26.234 | 28.913 | 47.526 | 48.876 | 50.225 | 33.203 | 100.0% | 8 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 77.929745 Full duration: 135.05898 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.492 | 1.804 | 9.761 | 13.137 | 29.259 | 4.08 | 100.0% | 40 | | neutron.create_port (x5) | 2.61 | 6.854 | 10.5 | 11.349 | 12.585 | 6.874 | 100.0% | 40 | | neutron.update_port (x5) | 1.768 | 4.738 | 7.623 | 8.902 | 9.782 | 4.844 | 100.0% | 40 | | total | 5.531 | 13.469 | 26.536 | 28.559 | 37.28 | 15.84 | 100.0% | 40 | | -> duration | 5.531 | 13.469 | 26.536 | 28.559 | 37.28 | 15.84 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 39.127254 Full duration: 76.263809 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_bind_ports args position 2 args values: { "args": { "ports_per_network": 5 }, "runner": { "times": 3, "concurrency": 2 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1 } }, "network": {}, "networking_agents": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet (x2) | 1.0 | 1.254 | 1.709 | 1.766 | 1.823 | 1.359 | 100.0% | 3 | | neutron.create_port (x5) | 3.385 | 3.414 | 3.613 | 3.638 | 3.663 | 3.488 | 100.0% | 3 | | neutron.update_port (x5) | 4.62 | 4.66 | 4.965 | 5.003 | 5.041 | 4.774 | 100.0% | 3 | | total | 9.075 | 9.829 | 9.932 | 9.945 | 9.958 | 9.621 | 100.0% | 3 | | -> duration | 9.075 | 9.829 | 9.932 | 9.945 | 9.958 | 9.621 | 100.0% | 3 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 3 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.911549 Full duration: 45.019584 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 3 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.662 | 2.257 | 12.507 | 15.754 | 29.071 | 4.799 | 100.0% | 40 | | neutron.create_port (x5) | 2.826 | 7.667 | 11.202 | 11.585 | 12.395 | 7.571 | 100.0% | 40 | | neutron.delete_port (x5) | 2.068 | 6.041 | 9.74 | 10.806 | 11.894 | 6.55 | 100.0% | 40 | | total | 10.173 | 16.587 | 27.758 | 29.727 | 49.436 | 18.968 | 100.0% | 40 | | -> duration | 10.173 | 16.587 | 27.758 | 29.727 | 49.436 | 18.968 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 49.926706 Full duration: 61.810142 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 20, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.237 | 0.36 | 0.496 | 0.515 | 0.533 | 0.378 | 100.0% | 40 | | total | 0.401 | 0.57 | 0.835 | 0.851 | 0.913 | 0.61 | 100.0% | 40 | | -> duration | 0.401 | 0.57 | 0.835 | 0.851 | 0.913 | 0.61 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.786166 Full duration: 21.842714 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunks args position 0 args values: { "args": { "subport_count": 125 }, "runner": { "times": 4, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.672 | 1.698 | 2.672 | 2.807 | 2.943 | 1.753 | 100.0% | 4 | | neutron.create_port (x126) | 65.817 | 72.117 | 91.168 | 94.567 | 97.967 | 77.005 | 100.0% | 4 | | neutron.create_trunk | 12.282 | 15.122 | 16.834 | 17.04 | 17.247 | 14.943 | 100.0% | 4 | | neutron.update_port | 1.204 | 1.699 | 1.811 | 1.813 | 1.814 | 1.604 | 100.0% | 4 | | neutron.list_trunks | 0.044 | 0.058 | 0.09 | 0.094 | 0.098 | 0.064 | 100.0% | 4 | | neutron.list_subports_by_trunk | 0.056 | 0.067 | 0.067 | 0.067 | 0.067 | 0.064 | 100.0% | 4 | | neutron.list_ports_by_device_id | 0.101 | 0.105 | 0.142 | 0.149 | 0.157 | 0.117 | 100.0% | 4 | | total | 82.679 | 90.777 | 111.686 | 114.84 | 117.993 | 95.557 | 100.0% | 4 | | -> duration | 82.679 | 90.777 | 111.686 | 114.84 | 117.993 | 95.557 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 118.016581 Full duration: 188.850862 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_floating_ips args position 0 args values: { "args": { "floating_network": "public", "floating_ip_args": {} }, "runner": { "times": 10, "concurrency": 5 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "floatingip": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_floating_ip | 1.374 | 2.557 | 5.12 | 5.398 | 5.676 | 3.153 | 100.0% | 10 | | -> neutron.list_networks | 0.252 | 0.542 | 0.678 | 0.872 | 1.067 | 0.544 | 100.0% | 10 | | neutron.delete_floating_ip | 0.541 | 0.873 | 1.412 | 1.444 | 1.476 | 0.934 | 100.0% | 10 | | total | 2.601 | 3.426 | 6.548 | 6.607 | 6.666 | 4.087 | 100.0% | 10 | | -> duration | 2.601 | 3.426 | 6.548 | 6.607 | 6.666 | 4.087 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.59885 Full duration: 17.121052 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_floating_ips args position 1 args values: { "args": { "floating_network": "public", "floating_ip_args": {} }, "runner": { "times": 10, "concurrency": 5 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "floatingip": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_floating_ip | 1.229 | 2.115 | 3.407 | 3.526 | 3.645 | 2.271 | 100.0% | 10 | | -> neutron.list_networks | 0.252 | 0.393 | 0.492 | 0.524 | 0.555 | 0.385 | 100.0% | 10 | | neutron.list_floating_ips | 0.062 | 0.073 | 0.104 | 0.127 | 0.15 | 0.082 | 100.0% | 10 | | total | 1.302 | 2.191 | 3.549 | 3.628 | 3.708 | 2.353 | 100.0% | 10 | | -> duration | 1.302 | 2.191 | 3.549 | 3.628 | 3.708 | 2.353 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.002057 Full duration: 18.856981 -------------------------------------------------------------------------------- test scenario NeutronNetworks.associate_and_dissociate_floating_ips args position 2 args values: { "args": { "floating_network": "public" }, "runner": { "times": 10, "concurrency": 5 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "floatingip": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_floating_ip | 1.434 | 2.13 | 2.751 | 2.84 | 2.93 | 2.107 | 100.0% | 10 | | -> neutron.list_networks | 0.354 | 0.513 | 1.088 | 1.088 | 1.089 | 0.629 | 100.0% | 10 | | neutron.create_network | 0.278 | 0.498 | 1.631 | 1.816 | 2.001 | 0.765 | 100.0% | 10 | | neutron.create_subnet | 0.623 | 1.15 | 1.76 | 1.83 | 1.901 | 1.238 | 100.0% | 10 | | neutron.create_port | 0.545 | 1.039 | 1.319 | 1.363 | 1.408 | 1.023 | 100.0% | 10 | | neutron.create_router | 0.073 | 0.126 | 0.325 | 0.354 | 0.384 | 0.161 | 100.0% | 10 | | neutron.list_networks | 0.12 | 0.195 | 0.224 | 0.241 | 0.258 | 0.187 | 100.0% | 10 | | neutron.add_gateway_router | 1.367 | 2.219 | 4.376 | 4.494 | 4.612 | 2.606 | 100.0% | 10 | | neutron.add_interface_router | 2.282 | 3.155 | 5.611 | 5.688 | 5.765 | 3.886 | 100.0% | 10 | | neutron.associate_floating_ip | 1.179 | 1.923 | 3.072 | 3.085 | 3.097 | 2.165 | 100.0% | 10 | | neutron.dissociate_floating_ip | 0.713 | 1.182 | 2.044 | 2.125 | 2.206 | 1.344 | 100.0% | 10 | | total | 9.996 | 13.395 | 21.005 | 21.042 | 21.08 | 15.483 | 100.0% | 10 | | -> duration | 9.996 | 13.395 | 21.005 | 21.042 | 21.08 | 15.483 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 33.647494 Full duration: 69.865924 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.3 | 0.514 | 1.107 | 1.448 | 1.78 | 0.639 | 100.0% | 50 | | neutron.create_security_group_rule | 0.111 | 0.219 | 0.439 | 0.695 | 0.928 | 0.271 | 100.0% | 50 | | neutron.delete_security_group_rule | 0.069 | 0.124 | 0.264 | 0.276 | 0.299 | 0.152 | 100.0% | 50 | | neutron.delete_security_group | 0.114 | 0.198 | 0.417 | 0.664 | 0.937 | 0.275 | 100.0% | 50 | | total | 0.727 | 1.256 | 1.972 | 2.36 | 2.664 | 1.338 | 100.0% | 50 | | -> duration | 0.727 | 1.256 | 1.972 | 2.36 | 2.664 | 1.338 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.695658 Full duration: 15.804294 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 1 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.321 | 0.526 | 0.809 | 1.051 | 1.27 | 0.59 | 100.0% | 50 | | neutron.delete_security_group | 0.121 | 0.297 | 0.509 | 0.564 | 0.985 | 0.317 | 100.0% | 50 | | total | 0.446 | 0.903 | 1.383 | 1.464 | 1.66 | 0.907 | 100.0% | 50 | | -> duration | 0.446 | 0.903 | 1.383 | 1.464 | 1.66 | 0.907 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.816901 Full duration: 13.90252 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 2 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {}, "security_group_rules_count": 20 }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.32 | 0.503 | 1.169 | 1.36 | 1.916 | 0.63 | 100.0% | 50 | | neutron.create_security_group_rule (x20) | 3.428 | 5.324 | 8.773 | 9.168 | 9.442 | 5.626 | 100.0% | 50 | | neutron.list_security_group_rules | 0.139 | 0.411 | 0.853 | 0.916 | 1.062 | 0.452 | 100.0% | 50 | | total | 4.216 | 6.318 | 10.285 | 10.643 | 11.127 | 6.715 | 100.0% | 50 | | -> duration | 4.216 | 6.318 | 10.285 | 10.643 | 11.127 | 6.715 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 36.129533 Full duration: 51.261387 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_groups args position 3 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.306 | 0.508 | 1.191 | 1.606 | 1.798 | 0.651 | 100.0% | 50 | | neutron.list_security_groups | 0.077 | 0.282 | 1.015 | 1.322 | 1.425 | 0.398 | 100.0% | 50 | | total | 0.401 | 0.876 | 2.003 | 2.03 | 2.046 | 1.049 | 100.0% | 50 | | -> duration | 0.401 | 0.876 | 2.003 | 2.03 | 2.046 | 1.049 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.187767 Full duration: 19.318288 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group_rule args position 4 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.336 | 0.515 | 1.005 | 1.082 | 1.227 | 0.605 | 100.0% | 50 | | neutron.create_security_group_rule | 0.122 | 0.226 | 0.657 | 0.706 | 0.893 | 0.292 | 100.0% | 50 | | neutron.show_security_group_rule | 0.015 | 0.03 | 0.058 | 0.065 | 0.091 | 0.035 | 100.0% | 50 | | total | 0.472 | 0.842 | 1.508 | 1.6 | 1.733 | 0.933 | 100.0% | 50 | | -> duration | 0.472 | 0.842 | 1.508 | 1.6 | 1.733 | 0.933 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.136517 Full duration: 18.301491 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 5 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.257 | 0.47 | 1.503 | 1.802 | 2.181 | 0.684 | 100.0% | 50 | | neutron.show_security_group | 0.034 | 0.07 | 0.122 | 0.136 | 0.148 | 0.079 | 100.0% | 50 | | total | 0.293 | 0.56 | 1.636 | 1.939 | 2.282 | 0.763 | 100.0% | 50 | | -> duration | 0.293 | 0.56 | 1.636 | 1.939 | 2.282 | 0.763 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.469713 Full duration: 18.00987 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_update_security_groups args position 6 args values: { "args": { "security_group_create_args": {}, "security_group_update_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.303 | 0.508 | 1.355 | 1.374 | 1.419 | 0.664 | 100.0% | 50 | | neutron.update_security_group | 0.088 | 0.156 | 0.286 | 0.379 | 0.398 | 0.182 | 100.0% | 50 | | total | 0.4 | 0.712 | 1.503 | 1.536 | 1.616 | 0.847 | 100.0% | 50 | | -> duration | 0.4 | 0.712 | 1.503 | 1.536 | 1.616 | 0.847 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.562019 Full duration: 18.533768 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "args": { "flavor": { "name": "rally_jobs-flavor_bad57c0c-acbb-40f8-b2ca-1f635061ed4d" }, "image": { "name": "rally_jobs-img_bad57c0c-acbb-40f8-b2ca-1f635061ed4d" }, "auto_assign_nic": true }, "runner": { "times": 2, "concurrency": 2 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 2 }, "network": {} }, "sla": { "failure_rate": { "max": 100 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 03576aac-25e7-4159-a5d8-e978470e7cd5 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 13.173 | 13.935 | 14.545 | 14.621 | 14.697 | 13.935 | 100.0% | 2 | | nova.delete_server | 4.824 | 5.27 | 5.627 | 5.671 | 5.716 | 5.27 | 100.0% | 2 | | total | 18.889 | 19.206 | 19.459 | 19.49 | 19.522 | 19.206 | 100.0% | 2 | | -> duration | 17.889 | 18.206 | 18.459 | 18.49 | 18.522 | 18.206 | 100.0% | 2 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 2 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.521871 Full duration: 46.689074 HINTS: * To plot HTML graphics with this data, run: rally task report 03576aac-25e7-4159-a5d8-e978470e7cd5 --out output.html * To generate a JUnit report, run: rally task export 03576aac-25e7-4159-a5d8-e978470e7cd5 --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report 03576aac-25e7-4159-a5d8-e978470e7cd5 --json --out output.json 2021-06-01 23:28:35,177 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 03576aac-25e7-4159-a5d8-e978470e7cd5 --out /home/opnfv/functest/results/rally_jobs/neutron.json 2021-06-01 23:28:35,331 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2021-06-01 23:28:35,332 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 00:26:09 | 997 | 100.00% | | | | | | | TOTAL: | 00:26:09 | 997 | 100.00% | +-----------+------------+----------------+-----------+ 2021-06-01 23:28:35,332 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs' success_rate is 100.00% in 1/1 modules 2021-06-01 23:28:39,477 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.html 2021-06-01 23:28:43,304 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.xml 2021-06-01 23:28:43,305 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_jobs | functest | 27:26 | PASS | +--------------------+------------------+------------------+----------------+