2020-09-29 10:33:03,899 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | os-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 07XMXVGY9BT8 | | NODE_NAME | lf-pod4 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest/07XMXVGY9BT8/fun | | | ctest-pi-ollivier-functest-benchmarking-jerma- | | | rally_jobs-run-4 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest/07XMXVGY9BT8/f | | | unctest-pi-ollivier-functest-benchmarking-jerma- | | | rally_jobs-run-4 | +-------------------------+------------------------------------------------------------+ 2020-09-29 10:33:03,918 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs'... 2020-09-29 10:33:06,302 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs'... 2020-09-29 10:33:21,713 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2020-09-29 10:33:29,408 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 81462bdd-d20b-4022-a8d2-470ab91aa9c9 | 2020-09-29T10:33:28.984546 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 81462bdd-d20b-4022-a8d2-470ab91aa9c9 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-09-29 10:33:33,739 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | compute_legacy | Available | | __unknown__ | event | Available | | __unknown__ | placement | Available | | barbican | key-manager | Available | | cinder | block-storage | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | octavia | load-balancer | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-09-29 10:33:35,917 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-09-29 11:09:42,286 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 2020-09-29 11:09:44,060 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": {}, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": 119 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.467 | 1.714 | 9.826 | 17.524 | 40.459 | 4.119 | 100.0% | 100 | | neutron.list_networks | 0.148 | 0.368 | 0.492 | 0.631 | 1.203 | 0.376 | 100.0% | 100 | | total | 0.728 | 2.108 | 10.152 | 17.941 | 40.852 | 4.495 | 100.0% | 100 | | -> duration | 0.728 | 2.108 | 10.152 | 17.941 | 40.852 | 4.495 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 41.034497 Full duration: 67.263617 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.521 | 3.569 | 6.712 | 9.141 | 12.397 | 3.993 | 100.0% | 40 | | neutron.update_network | 0.441 | 0.552 | 0.897 | 0.917 | 6.252 | 0.759 | 100.0% | 40 | | total | 1.09 | 4.526 | 7.61 | 10.055 | 12.855 | 4.752 | 100.0% | 40 | | -> duration | 1.09 | 4.526 | 7.61 | 10.055 | 12.855 | 4.752 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.889936 Full duration: 31.685571 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "args": {}, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.499 | 2.815 | 11.238 | 12.893 | 17.719 | 4.496 | 100.0% | 40 | | neutron.delete_network | 0.628 | 1.089 | 1.799 | 2.098 | 6.458 | 1.288 | 100.0% | 40 | | total | 1.517 | 3.945 | 12.571 | 13.703 | 18.429 | 5.784 | 100.0% | 40 | | -> duration | 1.517 | 3.945 | 12.571 | 13.703 | 18.429 | 5.784 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.804056 Full duration: 33.491582 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.558 | 7.435 | 20.848 | 29.251 | 32.582 | 8.577 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.654 | 6.758 | 13.302 | 16.01 | 16.543 | 7.276 | 100.0% | 40 | | neutron.list_subnets | 0.087 | 0.318 | 0.56 | 0.759 | 6.156 | 0.49 | 100.0% | 40 | | total | 4.127 | 14.516 | 28.291 | 37.393 | 38.836 | 16.343 | 100.0% | 40 | | -> duration | 4.127 | 14.516 | 28.291 | 37.393 | 38.836 | 16.343 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 39.930932 Full duration: 90.936117 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_update_args": { "enable_dhcp": true } }, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 5 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.458 | 1.538 | 6.044 | 11.508 | 36.638 | 3.109 | 100.0% | 100 | | neutron.create_subnet (x2) | 1.55 | 4.915 | 11.237 | 12.284 | 14.581 | 5.658 | 100.0% | 100 | | neutron.update_subnet (x2) | 0.819 | 2.37 | 9.064 | 9.557 | 12.385 | 3.497 | 100.0% | 100 | | total | 3.104 | 10.366 | 18.963 | 22.295 | 42.349 | 12.264 | 100.0% | 100 | | -> duration | 3.104 | 10.366 | 18.963 | 22.295 | 42.349 | 12.264 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 71.034825 Full duration: 152.729738 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.513 | 2.158 | 8.192 | 13.724 | 23.799 | 4.031 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.601 | 3.702 | 9.376 | 12.167 | 12.879 | 4.733 | 100.0% | 40 | | neutron.delete_subnet (x2) | 1.12 | 3.011 | 11.634 | 12.092 | 15.265 | 5.045 | 100.0% | 40 | | total | 4.263 | 12.792 | 23.026 | 24.315 | 29.319 | 13.87 | 100.0% | 40 | | -> duration | 4.263 | 12.792 | 23.026 | 24.315 | 29.319 | 13.87 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 33.709914 Full duration: 55.936173 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "args": { "network_create_args": null, "subnet_create_args": null, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": null }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.447 | 1.898 | 13.074 | 22.374 | 45.235 | 5.09 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.797 | 6.042 | 11.595 | 13.152 | 14.303 | 6.555 | 100.0% | 40 | | neutron.create_router (x2) | 0.464 | 1.342 | 6.361 | 6.751 | 7.446 | 1.887 | 100.0% | 40 | | neutron.add_interface_router (x2) | 4.372 | 20.054 | 25.344 | 25.888 | 32.574 | 17.777 | 100.0% | 40 | | neutron.list_routers | 0.152 | 0.661 | 0.906 | 0.975 | 6.093 | 0.731 | 100.0% | 40 | | total | 10.314 | 30.984 | 44.717 | 51.094 | 70.722 | 32.041 | 100.0% | 40 | | -> duration | 10.314 | 30.984 | 44.717 | 51.094 | 70.722 | 32.041 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 75.614385 Full duration: 183.73128 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {}, "router_update_args": { "admin_state_up": false } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.499 | 1.47 | 9.502 | 12.657 | 18.107 | 3.357 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.633 | 4.691 | 11.159 | 12.788 | 18.166 | 6.342 | 100.0% | 40 | | neutron.create_router (x2) | 0.432 | 1.027 | 2.173 | 2.376 | 6.532 | 1.277 | 100.0% | 40 | | neutron.add_interface_router (x2) | 4.658 | 16.837 | 39.965 | 40.051 | 40.732 | 17.884 | 100.0% | 40 | | neutron.update_router (x2) | 1.206 | 3.921 | 11.464 | 12.949 | 14.318 | 5.522 | 100.0% | 40 | | total | 9.783 | 29.501 | 70.801 | 71.83 | 74.371 | 34.383 | 100.0% | 40 | | -> duration | 9.783 | 29.501 | 70.801 | 71.83 | 74.371 | 34.383 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 80.656454 Full duration: 190.580801 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {} }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.472 | 1.23 | 8.335 | 13.592 | 23.218 | 3.523 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.686 | 4.126 | 18.219 | 18.678 | 21.647 | 6.925 | 100.0% | 40 | | neutron.create_router (x2) | 0.454 | 0.929 | 3.37 | 7.28 | 10.574 | 1.792 | 100.0% | 40 | | neutron.add_interface_router (x2) | 4.356 | 17.017 | 52.608 | 55.204 | 63.369 | 20.937 | 100.0% | 40 | | neutron.remove_interface_router (x2) | 3.889 | 13.011 | 34.328 | 35.027 | 42.833 | 16.72 | 100.0% | 40 | | neutron.delete_router (x2) | 0.837 | 1.791 | 7.888 | 8.382 | 8.799 | 3.045 | 100.0% | 40 | | total | 15.053 | 41.237 | 118.33 | 124.891 | 125.976 | 52.941 | 100.0% | 40 | | -> duration | 15.053 | 41.237 | 118.33 | 124.891 | 125.976 | 52.941 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 126.414974 Full duration: 172.468709 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 50 }, "runner": { "times": 8, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1, "port": 811 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.512 | 0.807 | 3.181 | 5.02 | 6.858 | 1.636 | 100.0% | 8 | | neutron.create_port (x50) | 42.725 | 61.901 | 80.225 | 80.433 | 80.642 | 62.141 | 100.0% | 8 | | neutron.list_ports | 0.546 | 1.343 | 1.972 | 2.012 | 2.051 | 1.287 | 100.0% | 8 | | total | 47.629 | 64.958 | 82.33 | 82.718 | 83.107 | 65.073 | 100.0% | 8 | | -> duration | 47.629 | 64.958 | 82.33 | 82.718 | 83.107 | 65.073 | 100.0% | 8 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 134.641509 Full duration: 209.090461 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.455 | 2.499 | 12.281 | 15.139 | 24.751 | 4.666 | 100.0% | 40 | | neutron.create_port (x5) | 4.003 | 10.746 | 18.987 | 23.161 | 25.297 | 12.354 | 100.0% | 40 | | neutron.update_port (x5) | 2.015 | 7.747 | 11.727 | 14.321 | 15.861 | 7.465 | 100.0% | 40 | | total | 7.339 | 24.753 | 34.831 | 35.95 | 41.846 | 24.55 | 100.0% | 40 | | -> duration | 7.339 | 24.753 | 34.831 | 35.95 | 41.846 | 24.55 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 59.807383 Full duration: 101.899574 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_bind_ports args position 2 args values: { "args": { "ports_per_network": 5 }, "runner": { "times": 3, "concurrency": 2 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1 } }, "network": {}, "networking_agents": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet (x2) | 1.369 | 1.525 | 1.65 | 1.665 | 1.681 | 1.525 | 100.0% | 3 | | neutron.create_port (x5) | 4.201 | 4.359 | 9.346 | 9.97 | 10.593 | 6.384 | 100.0% | 3 | | neutron.update_port (x5) | 4.253 | 4.448 | 4.764 | 4.804 | 4.843 | 4.515 | 100.0% | 3 | | total | 9.98 | 10.884 | 15.305 | 15.858 | 16.411 | 12.425 | 100.0% | 3 | | -> duration | 9.98 | 10.884 | 15.305 | 15.858 | 16.411 | 12.425 | 100.0% | 3 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 3 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 26.396713 Full duration: 69.01459 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 3 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.452 | 2.684 | 10.681 | 13.673 | 20.759 | 4.495 | 100.0% | 40 | | neutron.create_port (x5) | 3.719 | 12.705 | 39.518 | 39.836 | 42.695 | 15.815 | 100.0% | 40 | | neutron.delete_port (x5) | 2.467 | 6.312 | 26.985 | 32.831 | 35.246 | 11.536 | 100.0% | 40 | | total | 6.887 | 22.445 | 75.277 | 77.001 | 78.207 | 31.912 | 100.0% | 40 | | -> duration | 6.887 | 22.445 | 75.277 | 77.001 | 78.207 | 31.912 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 78.206836 Full duration: 94.004849 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 20, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.409 | 0.788 | 1.113 | 1.307 | 1.32 | 0.808 | 100.0% | 40 | | total | 0.468 | 0.987 | 1.294 | 1.378 | 1.54 | 0.976 | 100.0% | 40 | | -> duration | 0.468 | 0.987 | 1.294 | 1.378 | 1.54 | 0.976 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.781317 Full duration: 29.86826 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunks args position 0 args values: { "args": { "subport_count": 125 }, "runner": { "times": 4, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.723 | 1.632 | 2.184 | 2.23 | 2.275 | 1.565 | 100.0% | 4 | | neutron.create_port (x126) | 105.845 | 106.763 | 109.194 | 109.603 | 110.012 | 107.346 | 100.0% | 4 | | neutron.create_trunk | 8.39 | 8.627 | 11.956 | 12.633 | 13.311 | 9.739 | 100.0% | 4 | | neutron.update_port | 1.175 | 1.36 | 4.847 | 5.569 | 6.29 | 2.546 | 100.0% | 4 | | neutron.list_trunks | 0.038 | 0.072 | 0.08 | 0.081 | 0.082 | 0.066 | 100.0% | 4 | | neutron.list_subports_by_trunk | 0.053 | 0.057 | 0.059 | 0.059 | 0.059 | 0.056 | 100.0% | 4 | | neutron.list_ports_by_device_id | 0.246 | 0.389 | 0.515 | 0.531 | 0.547 | 0.393 | 100.0% | 4 | | total | 116.613 | 121.252 | 126.704 | 127.229 | 127.754 | 121.718 | 100.0% | 4 | | -> duration | 116.613 | 121.252 | 126.704 | 127.229 | 127.754 | 121.718 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 127.762772 Full duration: 210.548068 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_floating_ips args position 0 args values: { "args": { "floating_network": "public", "floating_ip_args": {} }, "runner": { "times": 10, "concurrency": 5 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "floatingip": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_floating_ip | 1.815 | 2.969 | 3.971 | 3.987 | 4.003 | 2.936 | 100.0% | 10 | | -> neutron.list_networks | 0.376 | 0.485 | 0.583 | 0.648 | 0.714 | 0.498 | 100.0% | 10 | | neutron.delete_floating_ip | 0.63 | 1.303 | 6.686 | 6.689 | 6.692 | 2.745 | 100.0% | 10 | | total | 2.445 | 4.272 | 10.662 | 10.674 | 10.685 | 5.681 | 100.0% | 10 | | -> duration | 2.445 | 4.272 | 10.662 | 10.674 | 10.685 | 5.681 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.141239 Full duration: 21.577825 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_floating_ips args position 1 args values: { "args": { "floating_network": "public", "floating_ip_args": {} }, "runner": { "times": 10, "concurrency": 5 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "floatingip": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_floating_ip | 1.706 | 2.018 | 4.921 | 5.609 | 6.296 | 3.171 | 100.0% | 10 | | -> neutron.list_networks | 0.304 | 0.527 | 1.236 | 3.14 | 5.045 | 0.979 | 100.0% | 10 | | neutron.list_floating_ips | 0.062 | 0.09 | 0.157 | 0.17 | 0.183 | 0.106 | 100.0% | 10 | | total | 1.772 | 2.108 | 5.066 | 5.712 | 6.358 | 3.277 | 100.0% | 10 | | -> duration | 1.772 | 2.108 | 5.066 | 5.712 | 6.358 | 3.277 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.407638 Full duration: 27.216004 -------------------------------------------------------------------------------- test scenario NeutronNetworks.associate_and_dissociate_floating_ips args position 2 args values: { "args": { "floating_network": "public" }, "runner": { "times": 10, "concurrency": 5 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "floatingip": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_floating_ip | 1.816 | 2.964 | 3.131 | 3.191 | 3.25 | 2.619 | 100.0% | 10 | | -> neutron.list_networks | 0.357 | 0.516 | 0.579 | 0.586 | 0.593 | 0.492 | 100.0% | 10 | | neutron.create_network | 0.284 | 0.53 | 1.352 | 1.66 | 1.967 | 0.687 | 100.0% | 10 | | neutron.create_subnet | 0.779 | 1.251 | 7.45 | 7.482 | 7.514 | 2.422 | 100.0% | 10 | | neutron.create_port | 0.934 | 1.508 | 1.763 | 1.77 | 1.778 | 1.398 | 100.0% | 10 | | neutron.create_router | 0.219 | 0.357 | 0.458 | 0.492 | 0.526 | 0.36 | 100.0% | 10 | | neutron.list_networks | 0.134 | 0.212 | 0.371 | 0.381 | 0.391 | 0.242 | 100.0% | 10 | | neutron.add_gateway_router | 1.561 | 2.603 | 3.012 | 3.021 | 3.03 | 2.36 | 100.0% | 10 | | neutron.add_interface_router | 2.342 | 4.203 | 9.603 | 10.034 | 10.466 | 5.186 | 100.0% | 10 | | neutron.associate_floating_ip | 0.998 | 1.843 | 6.704 | 7.319 | 7.933 | 2.766 | 100.0% | 10 | | neutron.dissociate_floating_ip | 0.707 | 0.964 | 2.026 | 2.032 | 2.038 | 1.138 | 100.0% | 10 | | total | 10.093 | 22.74 | 24.785 | 25.012 | 25.238 | 19.176 | 100.0% | 10 | | -> duration | 10.093 | 22.74 | 24.785 | 25.012 | 25.238 | 19.176 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 47.914179 Full duration: 95.96001 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.399 | 0.909 | 1.257 | 1.581 | 6.381 | 1.022 | 100.0% | 50 | | neutron.create_security_group_rule | 0.268 | 0.567 | 0.803 | 3.864 | 6.622 | 0.918 | 100.0% | 50 | | neutron.delete_security_group_rule | 0.084 | 0.24 | 0.423 | 0.501 | 6.007 | 0.367 | 100.0% | 50 | | neutron.delete_security_group | 0.126 | 0.355 | 0.616 | 0.687 | 6.047 | 0.509 | 100.0% | 50 | | total | 0.999 | 2.332 | 7.111 | 8.186 | 8.731 | 2.816 | 100.0% | 50 | | -> duration | 0.999 | 2.332 | 7.111 | 8.186 | 8.731 | 2.816 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.174087 Full duration: 27.355048 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 1 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.4 | 0.944 | 1.361 | 2.098 | 2.376 | 1.004 | 100.0% | 50 | | neutron.delete_security_group | 0.119 | 0.361 | 0.708 | 0.792 | 0.89 | 0.409 | 100.0% | 50 | | total | 0.534 | 1.416 | 1.87 | 2.481 | 3.074 | 1.414 | 100.0% | 50 | | -> duration | 0.534 | 1.416 | 1.87 | 2.481 | 3.074 | 1.414 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.731161 Full duration: 16.643982 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 2 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {}, "security_group_rules_count": 20 }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.384 | 0.749 | 1.343 | 1.986 | 6.538 | 1.07 | 100.0% | 50 | | neutron.create_security_group_rule (x20) | 5.943 | 11.687 | 17.729 | 19.665 | 20.289 | 12.161 | 100.0% | 50 | | neutron.list_security_group_rules | 0.165 | 0.554 | 0.835 | 0.922 | 5.734 | 0.722 | 100.0% | 50 | | total | 6.577 | 13.879 | 21.538 | 22.04 | 22.161 | 13.96 | 100.0% | 50 | | -> duration | 6.577 | 13.879 | 21.538 | 22.04 | 22.161 | 13.96 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 74.808825 Full duration: 89.59087 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_groups args position 3 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.394 | 0.86 | 1.539 | 2.209 | 5.442 | 1.091 | 100.0% | 50 | | neutron.list_security_groups | 0.092 | 0.351 | 0.747 | 0.856 | 0.9 | 0.419 | 100.0% | 50 | | total | 0.563 | 1.358 | 1.972 | 3.063 | 5.91 | 1.51 | 100.0% | 50 | | -> duration | 0.563 | 1.358 | 1.972 | 3.063 | 5.91 | 1.51 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.540394 Full duration: 23.287518 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group_rule args position 4 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.409 | 0.704 | 1.619 | 5.823 | 6.092 | 1.193 | 100.0% | 50 | | neutron.create_security_group_rule | 0.223 | 0.421 | 0.697 | 0.721 | 0.903 | 0.427 | 100.0% | 50 | | neutron.show_security_group_rule | 0.017 | 0.032 | 0.044 | 0.047 | 0.051 | 0.033 | 100.0% | 50 | | total | 0.706 | 1.138 | 2.154 | 6.627 | 6.711 | 1.653 | 100.0% | 50 | | -> duration | 0.706 | 1.138 | 2.154 | 6.627 | 6.711 | 1.653 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.738216 Full duration: 23.026477 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 5 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.442 | 0.953 | 6.004 | 6.245 | 6.969 | 2.458 | 100.0% | 50 | | neutron.show_security_group | 0.037 | 0.076 | 0.144 | 0.25 | 4.554 | 0.179 | 100.0% | 50 | | total | 0.496 | 1.073 | 6.211 | 6.339 | 7.099 | 2.638 | 100.0% | 50 | | -> duration | 0.496 | 1.073 | 6.211 | 6.339 | 7.099 | 2.638 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.500778 Full duration: 28.655464 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_update_security_groups args position 6 args values: { "args": { "security_group_create_args": {}, "security_group_update_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.42 | 0.727 | 1.118 | 1.174 | 1.63 | 0.774 | 100.0% | 50 | | neutron.update_security_group | 0.078 | 0.151 | 0.242 | 0.274 | 0.455 | 0.169 | 100.0% | 50 | | total | 0.506 | 0.908 | 1.342 | 1.414 | 1.756 | 0.944 | 100.0% | 50 | | -> duration | 0.506 | 0.908 | 1.342 | 1.414 | 1.756 | 0.944 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.194096 Full duration: 19.885344 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "args": { "flavor": { "name": "rally_jobs-flavor_f99a45af-f1e8-4f1f-a96b-c65253d3d003" }, "image": { "name": "rally_jobs-img_f99a45af-f1e8-4f1f-a96b-c65253d3d003" }, "auto_assign_nic": true }, "runner": { "times": 2, "concurrency": 2 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 2 }, "network": {} }, "sla": { "failure_rate": { "max": 100 } }, "hooks": [] } -------------------------------------------------------------------------------- Task afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 19.232 | 20.341 | 21.228 | 21.339 | 21.45 | 20.341 | 100.0% | 2 | | nova.delete_server | 2.532 | 3.594 | 4.443 | 4.549 | 4.655 | 3.594 | 100.0% | 2 | | total | 23.888 | 23.935 | 23.973 | 23.978 | 23.982 | 23.935 | 100.0% | 2 | | -> duration | 22.888 | 22.935 | 22.973 | 22.978 | 22.982 | 22.935 | 100.0% | 2 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 2 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.985098 Full duration: 60.106208 HINTS: * To plot HTML graphics with this data, run: rally task report afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 --out output.html * To generate a JUnit report, run: rally task export afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 --json --out output.json 2020-09-29 11:09:48,306 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid afe2dc1f-b19f-4f8d-80e1-7bfa9cceec25 --out /home/opnfv/functest/results/rally_jobs/neutron.json 2020-09-29 11:09:48,528 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2020-09-29 11:09:48,531 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 00:35:26 | 997 | 100.00% | | | | | | | TOTAL: | 00:35:26 | 997 | 100.00% | +-----------+------------+----------------+-----------+ 2020-09-29 11:09:48,531 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs' success_rate is 100.00% in 1/1 modules 2020-09-29 11:09:52,743 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.html 2020-09-29 11:09:56,672 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.xml 2020-09-29 11:09:56,673 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_jobs | functest | 36:50 | PASS | +--------------------+------------------+------------------+----------------+