2021-08-16 21:03:02,033 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | false | | DEPLOY_SCENARIO | os-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 02QYZBF7GWDB | | NODE_NAME | lf-virtual6 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest/02QYZBF7GWDB/fun | | | ctest-opnfv-functest-benchmarking-wallaby- | | | rally_jobs-run-9 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest/02QYZBF7GWDB/f | | | unctest-opnfv-functest-benchmarking-wallaby- | | | rally_jobs-run-9 | +-------------------------+------------------------------------------------------------+ 2021-08-16 21:03:02,051 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs'... 2021-08-16 21:03:04,374 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs'... 2021-08-16 21:03:10,052 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2021-08-16 21:03:18,532 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | f025ba13-7b4b-4cb5-bd36-97c838a494ea | 2021-08-16T21:03:18.269818 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: f025ba13-7b4b-4cb5-bd36-97c838a494ea ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2021-08-16 21:03:23,222 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | compute_legacy | Available | | __unknown__ | placement | Available | | barbican | key-manager | Available | | cinder | block-storage | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2021-08-16 21:03:25,328 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2021-08-16 21:21:59,608 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: fcea0cb9-96cd-49a0-b3c1-195622bc3651 2021-08-16 21:22:01,709 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid fcea0cb9-96cd-49a0-b3c1-195622bc3651 -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": {}, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": 119 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.323 | 0.969 | 1.558 | 2.032 | 3.672 | 1.058 | 100.0% | 100 | | neutron.list_networks | 0.156 | 0.711 | 1.302 | 1.484 | 1.863 | 0.775 | 100.0% | 100 | | total | 0.633 | 1.714 | 2.663 | 3.279 | 4.175 | 1.834 | 100.0% | 100 | | -> duration | 0.633 | 1.714 | 2.663 | 3.279 | 4.175 | 1.834 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.60802 Full duration: 24.858492 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.351 | 0.698 | 1.332 | 1.463 | 2.135 | 0.779 | 100.0% | 40 | | neutron.update_network | 0.191 | 0.378 | 0.76 | 0.915 | 0.995 | 0.424 | 100.0% | 40 | | total | 0.611 | 1.088 | 1.697 | 1.781 | 2.459 | 1.203 | 100.0% | 40 | | -> duration | 0.611 | 1.088 | 1.697 | 1.781 | 2.459 | 1.203 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.54582 Full duration: 12.355718 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "args": {}, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.325 | 0.655 | 1.873 | 1.943 | 1.971 | 0.908 | 100.0% | 40 | | neutron.delete_network | 0.281 | 0.584 | 1.999 | 2.008 | 2.028 | 0.846 | 100.0% | 40 | | total | 0.626 | 1.298 | 3.877 | 3.963 | 3.984 | 1.754 | 100.0% | 40 | | -> duration | 0.626 | 1.298 | 3.877 | 3.963 | 3.984 | 1.754 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.362498 Full duration: 7.726487 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.347 | 0.72 | 1.371 | 2.086 | 2.349 | 0.893 | 100.0% | 40 | | neutron.create_subnet (x2) | 0.674 | 1.55 | 3.448 | 3.511 | 3.567 | 1.94 | 100.0% | 40 | | neutron.list_subnets | 0.161 | 0.349 | 0.719 | 0.835 | 0.969 | 0.404 | 100.0% | 40 | | total | 1.434 | 2.709 | 5.622 | 5.779 | 6.189 | 3.238 | 100.0% | 40 | | -> duration | 1.434 | 2.709 | 5.622 | 5.779 | 6.189 | 3.238 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.203382 Full duration: 26.87817 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_update_args": { "enable_dhcp": true } }, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 5 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.312 | 0.61 | 0.999 | 1.161 | 1.725 | 0.66 | 100.0% | 100 | | neutron.create_subnet (x2) | 0.726 | 1.497 | 2.724 | 2.954 | 3.509 | 1.676 | 100.0% | 100 | | neutron.update_subnet (x2) | 0.478 | 1.062 | 1.774 | 2.172 | 2.594 | 1.112 | 100.0% | 100 | | total | 1.854 | 3.193 | 5.16 | 5.871 | 6.713 | 3.448 | 100.0% | 100 | | -> duration | 1.854 | 3.193 | 5.16 | 5.871 | 6.713 | 3.448 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.76421 Full duration: 52.683553 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.353 | 0.688 | 1.151 | 1.261 | 1.863 | 0.729 | 100.0% | 40 | | neutron.create_subnet (x2) | 0.787 | 1.549 | 2.92 | 3.362 | 3.536 | 1.807 | 100.0% | 40 | | neutron.delete_subnet (x2) | 0.545 | 1.227 | 2.665 | 2.739 | 2.826 | 1.426 | 100.0% | 40 | | total | 1.841 | 3.552 | 6.722 | 7.012 | 7.094 | 3.999 | 100.0% | 40 | | -> duration | 1.841 | 3.552 | 6.722 | 7.012 | 7.094 | 3.999 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.331382 Full duration: 19.394571 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "args": { "network_create_args": null, "subnet_create_args": null, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": null }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.317 | 0.627 | 1.002 | 1.116 | 1.762 | 0.677 | 100.0% | 40 | | neutron.create_router (x2) | 0.125 | 0.289 | 0.663 | 0.913 | 0.96 | 0.36 | 100.0% | 40 | | neutron.create_subnet (x2) | 4.969 | 8.81 | 14.422 | 19.005 | 20.461 | 9.849 | 100.0% | 40 | | -> neutron.add_interface_router (x2) | 3.951 | 7.314 | 12.199 | 15.799 | 17.175 | 8.127 | 100.0% | 40 | | neutron.list_routers | 0.19 | 0.488 | 0.823 | 0.842 | 0.863 | 0.486 | 100.0% | 40 | | total | 5.829 | 10.09 | 16.558 | 21.725 | 22.648 | 11.372 | 100.0% | 40 | | -> duration | 5.829 | 10.09 | 16.558 | 21.725 | 22.648 | 11.372 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 26.279599 Full duration: 74.884822 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {}, "router_update_args": { "admin_state_up": false } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.349 | 0.684 | 1.312 | 1.743 | 1.994 | 0.793 | 100.0% | 40 | | neutron.create_router (x2) | 0.129 | 0.228 | 0.565 | 0.678 | 1.041 | 0.292 | 100.0% | 40 | | neutron.create_subnet (x2) | 4.726 | 8.792 | 18.754 | 18.889 | 20.588 | 10.085 | 100.0% | 40 | | -> neutron.add_interface_router (x2) | 3.966 | 7.21 | 15.374 | 15.783 | 17.923 | 8.363 | 100.0% | 40 | | neutron.update_router (x2) | 1.271 | 2.303 | 4.543 | 5.037 | 5.18 | 2.489 | 100.0% | 40 | | total | 6.984 | 12.224 | 24.986 | 25.128 | 25.405 | 13.659 | 100.0% | 40 | | -> duration | 6.984 | 12.224 | 24.986 | 25.128 | 25.405 | 13.659 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 33.653181 Full duration: 82.434967 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {} }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.317 | 0.645 | 1.361 | 1.441 | 1.704 | 0.77 | 100.0% | 40 | | neutron.create_router (x2) | 0.116 | 0.338 | 0.749 | 0.851 | 0.954 | 0.397 | 100.0% | 40 | | neutron.create_subnet (x2) | 4.758 | 8.951 | 14.568 | 17.664 | 18.785 | 9.73 | 100.0% | 40 | | -> neutron.add_interface_router (x2) | 3.813 | 7.269 | 12.025 | 14.02 | 14.62 | 7.832 | 100.0% | 40 | | neutron.remove_interface_router (x2) | 3.514 | 6.837 | 11.136 | 13.865 | 14.545 | 7.333 | 100.0% | 40 | | neutron.delete_router (x2) | 0.606 | 1.281 | 2.029 | 2.276 | 2.43 | 1.339 | 100.0% | 40 | | total | 10.261 | 17.734 | 28.756 | 35.264 | 36.604 | 19.57 | 100.0% | 40 | | -> duration | 10.261 | 17.734 | 28.756 | 35.264 | 36.604 | 19.57 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 46.952058 Full duration: 64.439263 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 50 }, "runner": { "times": 8, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1, "port": 811 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.347 | 0.564 | 1.785 | 1.794 | 1.803 | 0.817 | 100.0% | 8 | | neutron.create_port (x50) | 20.237 | 22.282 | 61.163 | 61.174 | 61.185 | 36.285 | 100.0% | 8 | | neutron.list_ports | 0.43 | 1.454 | 1.886 | 2.169 | 2.453 | 1.376 | 100.0% | 8 | | total | 22.111 | 23.999 | 64.56 | 65.003 | 65.446 | 38.486 | 100.0% | 8 | | -> duration | 22.111 | 23.999 | 64.56 | 65.003 | 65.446 | 38.486 | 100.0% | 8 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 86.42461 Full duration: 131.828684 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.346 | 0.6 | 1.096 | 1.755 | 1.862 | 0.72 | 100.0% | 40 | | neutron.create_port (x5) | 2.261 | 4.407 | 7.092 | 8.313 | 8.92 | 4.648 | 100.0% | 40 | | neutron.update_port (x5) | 1.473 | 2.892 | 4.376 | 4.525 | 5.409 | 2.997 | 100.0% | 40 | | total | 4.66 | 8.181 | 11.804 | 15.126 | 15.289 | 8.43 | 100.0% | 40 | | -> duration | 4.66 | 8.181 | 11.804 | 15.126 | 15.289 | 8.43 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.264191 Full duration: 49.334089 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_bind_ports args position 2 args values: { "args": { "ports_per_network": 5 }, "runner": { "times": 3, "concurrency": 2 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1 } }, "network": {}, "networking_agents": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet (x2) | 0.661 | 0.685 | 0.735 | 0.742 | 0.748 | 0.698 | 100.0% | 3 | | neutron.create_port (x5) | 3.149 | 3.741 | 3.887 | 3.905 | 3.924 | 3.604 | 100.0% | 3 | | neutron.update_port (x5) | 4.68 | 5.192 | 5.241 | 5.247 | 5.254 | 5.042 | 100.0% | 3 | | total | 9.026 | 9.17 | 9.705 | 9.772 | 9.839 | 9.345 | 100.0% | 3 | | -> duration | 9.026 | 9.17 | 9.705 | 9.772 | 9.839 | 9.345 | 100.0% | 3 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 3 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.201533 Full duration: 44.30315 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 3 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.338 | 0.581 | 1.439 | 3.011 | 3.127 | 0.842 | 100.0% | 40 | | neutron.create_port (x5) | 2.011 | 4.149 | 15.644 | 15.778 | 16.297 | 5.86 | 100.0% | 40 | | neutron.delete_port (x5) | 2.115 | 3.922 | 13.411 | 13.667 | 14.347 | 5.407 | 100.0% | 40 | | total | 4.642 | 8.46 | 30.912 | 32.008 | 32.028 | 12.169 | 100.0% | 40 | | -> duration | 4.642 | 8.46 | 30.912 | 32.008 | 32.028 | 12.169 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 32.040729 Full duration: 41.238008 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 20, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.117 | 0.22 | 0.294 | 0.313 | 0.346 | 0.226 | 100.0% | 40 | | total | 0.27 | 0.403 | 0.486 | 0.511 | 0.552 | 0.405 | 100.0% | 40 | | -> duration | 0.27 | 0.403 | 0.486 | 0.511 | 0.552 | 0.405 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.620708 Full duration: 9.030348 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunks args position 0 args values: { "args": { "subport_count": 125 }, "runner": { "times": 4, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.533 | 1.309 | 1.575 | 1.577 | 1.578 | 1.182 | 100.0% | 4 | | neutron.create_port (x126) | 65.036 | 86.644 | 101.097 | 101.112 | 101.126 | 84.862 | 100.0% | 4 | | neutron.create_trunk | 9.811 | 12.161 | 14.335 | 14.352 | 14.369 | 12.126 | 100.0% | 4 | | neutron.update_port | 1.143 | 1.789 | 2.212 | 2.213 | 2.213 | 1.734 | 100.0% | 4 | | neutron.list_trunks | 0.035 | 0.075 | 0.266 | 0.301 | 0.336 | 0.13 | 100.0% | 4 | | neutron.list_subports_by_trunk | 0.047 | 0.089 | 0.256 | 0.287 | 0.319 | 0.136 | 100.0% | 4 | | neutron.list_ports | 0.081 | 0.198 | 0.308 | 0.329 | 0.35 | 0.207 | 100.0% | 4 | | total | 77.469 | 102.125 | 119.819 | 119.822 | 119.825 | 100.386 | 100.0% | 4 | | -> duration | 77.469 | 102.125 | 119.819 | 119.822 | 119.825 | 100.386 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 119.830758 Full duration: 176.238852 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_floating_ips args position 0 args values: { "args": { "floating_network": "public", "floating_ip_args": {} }, "runner": { "times": 10, "concurrency": 5 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "floatingip": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_floating_ip | 1.294 | 2.555 | 5.713 | 6.002 | 6.291 | 3.12 | 100.0% | 10 | | -> neutron.list_networks | 0.222 | 0.518 | 0.691 | 0.698 | 0.706 | 0.484 | 100.0% | 10 | | neutron.delete_floating_ip | 0.565 | 0.926 | 1.901 | 2.114 | 2.326 | 1.147 | 100.0% | 10 | | total | 1.879 | 3.454 | 7.212 | 7.339 | 7.466 | 4.266 | 100.0% | 10 | | -> duration | 1.879 | 3.454 | 7.212 | 7.339 | 7.466 | 4.266 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.314729 Full duration: 15.609795 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_floating_ips args position 1 args values: { "args": { "floating_network": "public", "floating_ip_args": {} }, "runner": { "times": 10, "concurrency": 5 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "floatingip": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_floating_ip | 1.585 | 2.603 | 3.644 | 3.73 | 3.817 | 2.587 | 100.0% | 10 | | -> neutron.list_networks | 0.256 | 0.654 | 0.809 | 0.81 | 0.811 | 0.575 | 100.0% | 10 | | neutron.list_floating_ips | 0.055 | 0.076 | 0.119 | 0.12 | 0.12 | 0.083 | 100.0% | 10 | | total | 1.657 | 2.694 | 3.729 | 3.802 | 3.875 | 2.67 | 100.0% | 10 | | -> duration | 1.657 | 2.694 | 3.729 | 3.802 | 3.875 | 2.67 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.619944 Full duration: 15.784628 -------------------------------------------------------------------------------- test scenario NeutronNetworks.associate_and_dissociate_floating_ips args position 2 args values: { "args": { "floating_network": "public" }, "runner": { "times": 10, "concurrency": 5 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "floatingip": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.list_networks | 0.297 | 0.351 | 0.517 | 0.521 | 0.525 | 0.406 | 100.0% | 10 | | neutron.create_floating_ip | 0.841 | 1.418 | 3.103 | 3.328 | 3.553 | 1.759 | 100.0% | 10 | | neutron.create_network | 0.221 | 0.532 | 0.735 | 0.755 | 0.775 | 0.514 | 100.0% | 10 | | neutron.create_subnet | 0.315 | 0.53 | 1.137 | 1.161 | 1.186 | 0.63 | 100.0% | 10 | | neutron.create_port | 0.561 | 1.142 | 1.911 | 1.952 | 1.992 | 1.164 | 100.0% | 10 | | neutron.create_router | 0.068 | 0.118 | 0.36 | 0.384 | 0.408 | 0.178 | 100.0% | 10 | | neutron.add_gateway_router | 1.93 | 2.897 | 5.093 | 5.422 | 5.752 | 3.348 | 100.0% | 10 | | neutron.add_interface_router | 2.206 | 3.378 | 6.265 | 6.36 | 6.454 | 3.907 | 100.0% | 10 | | neutron.associate_floating_ip | 1.161 | 1.696 | 3.337 | 3.357 | 3.376 | 2.008 | 100.0% | 10 | | -> neutron.update_floating_ip | 1.161 | 1.696 | 3.337 | 3.356 | 3.375 | 2.008 | 100.0% | 10 | | neutron.dissociate_floating_ip | 0.545 | 0.95 | 1.761 | 1.917 | 2.074 | 1.093 | 100.0% | 10 | | -> neutron.update_floating_ip | 0.544 | 0.95 | 1.761 | 1.917 | 2.074 | 1.093 | 100.0% | 10 | | total | 9.148 | 13.236 | 23.665 | 23.895 | 24.125 | 15.006 | 100.0% | 10 | | -> duration | 9.148 | 13.236 | 23.665 | 23.895 | 24.125 | 15.006 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 33.629777 Full duration: 60.554934 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.222 | 0.306 | 1.212 | 1.298 | 1.343 | 0.464 | 100.0% | 50 | | neutron.create_security_group_rule | 0.088 | 0.164 | 0.317 | 0.346 | 0.412 | 0.188 | 100.0% | 50 | | neutron.delete_security_group_rule | 0.061 | 0.109 | 0.201 | 0.224 | 0.385 | 0.127 | 100.0% | 50 | | neutron.delete_security_group | 0.101 | 0.183 | 0.319 | 0.375 | 0.385 | 0.199 | 100.0% | 50 | | total | 0.529 | 0.841 | 1.853 | 2.173 | 2.233 | 0.979 | 100.0% | 50 | | -> duration | 0.529 | 0.841 | 1.853 | 2.173 | 2.233 | 0.979 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.30288 Full duration: 11.035436 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 1 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.268 | 0.403 | 1.039 | 1.124 | 1.487 | 0.509 | 100.0% | 50 | | neutron.delete_security_group | 0.113 | 0.152 | 0.385 | 0.457 | 0.576 | 0.214 | 100.0% | 50 | | total | 0.381 | 0.584 | 1.243 | 1.316 | 1.68 | 0.724 | 100.0% | 50 | | -> duration | 0.381 | 0.584 | 1.243 | 1.316 | 1.68 | 0.724 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.956146 Full duration: 10.190664 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 2 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {}, "security_group_rules_count": 20 }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.227 | 0.342 | 1.083 | 1.157 | 1.207 | 0.471 | 100.0% | 50 | | neutron.create_security_group_rule (x20) | 2.155 | 3.57 | 5.453 | 5.723 | 6.181 | 3.58 | 100.0% | 50 | | neutron.list_security_group_rules | 0.108 | 0.476 | 0.877 | 0.97 | 1.022 | 0.501 | 100.0% | 50 | | total | 2.557 | 4.523 | 6.747 | 7.099 | 7.664 | 4.562 | 100.0% | 50 | | -> duration | 2.557 | 4.523 | 6.747 | 7.099 | 7.664 | 4.562 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.723951 Full duration: 36.762412 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_groups args position 3 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.25 | 0.412 | 1.095 | 1.306 | 1.442 | 0.567 | 100.0% | 50 | | neutron.list_security_groups | 0.062 | 0.244 | 0.435 | 0.457 | 0.567 | 0.259 | 100.0% | 50 | | total | 0.504 | 0.702 | 1.298 | 1.54 | 1.745 | 0.827 | 100.0% | 50 | | -> duration | 0.504 | 0.702 | 1.298 | 1.54 | 1.745 | 0.827 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.51264 Full duration: 15.5132 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group_rule args position 4 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.238 | 0.38 | 1.104 | 1.16 | 1.583 | 0.506 | 100.0% | 50 | | neutron.create_security_group_rule | 0.099 | 0.166 | 0.393 | 0.496 | 0.526 | 0.214 | 100.0% | 50 | | neutron.show_security_group_rule | 0.017 | 0.025 | 0.037 | 0.039 | 0.054 | 0.027 | 100.0% | 50 | | total | 0.393 | 0.592 | 1.638 | 1.699 | 1.998 | 0.747 | 100.0% | 50 | | -> duration | 0.393 | 0.592 | 1.638 | 1.699 | 1.998 | 0.747 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.13517 Full duration: 16.365853 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 5 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.235 | 0.36 | 0.705 | 1.184 | 1.289 | 0.462 | 100.0% | 50 | | neutron.show_security_group | 0.033 | 0.06 | 0.118 | 0.275 | 0.39 | 0.083 | 100.0% | 50 | | total | 0.271 | 0.432 | 0.941 | 1.26 | 1.409 | 0.545 | 100.0% | 50 | | -> duration | 0.271 | 0.432 | 0.941 | 1.26 | 1.409 | 0.545 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.005521 Full duration: 15.130999 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_update_security_groups args position 6 args values: { "args": { "security_group_create_args": {}, "security_group_update_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.275 | 0.451 | 1.075 | 1.253 | 1.325 | 0.55 | 100.0% | 50 | | neutron.update_security_group | 0.077 | 0.136 | 0.216 | 0.221 | 0.238 | 0.141 | 100.0% | 50 | | total | 0.365 | 0.58 | 1.21 | 1.405 | 1.564 | 0.691 | 100.0% | 50 | | -> duration | 0.365 | 0.58 | 1.21 | 1.405 | 1.564 | 0.691 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.963961 Full duration: 15.277669 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "args": { "flavor": { "name": "rally_jobs-flavor_2863b971-5cea-47a5-9210-2d86381915d1" }, "image": { "name": "rally_jobs-img_2863b971-5cea-47a5-9210-2d86381915d1" }, "auto_assign_nic": true }, "runner": { "times": 2, "concurrency": 2 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 2 }, "network": {} }, "sla": { "failure_rate": { "max": 100 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fcea0cb9-96cd-49a0-b3c1-195622bc3651 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 11.049 | 11.179 | 11.283 | 11.295 | 11.308 | 11.179 | 100.0% | 2 | | nova.delete_server | 2.475 | 2.491 | 2.503 | 2.505 | 2.506 | 2.491 | 100.0% | 2 | | total | 13.525 | 13.67 | 13.786 | 13.801 | 13.815 | 13.67 | 100.0% | 2 | | -> duration | 12.525 | 12.67 | 12.786 | 12.801 | 12.815 | 12.67 | 100.0% | 2 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 2 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.822134 Full duration: 41.167016 HINTS: * To plot HTML graphics with this data, run: rally task report fcea0cb9-96cd-49a0-b3c1-195622bc3651 --out output.html * To generate a JUnit report, run: rally task export fcea0cb9-96cd-49a0-b3c1-195622bc3651 --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report fcea0cb9-96cd-49a0-b3c1-195622bc3651 --json --out output.json 2021-08-16 21:22:07,224 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid fcea0cb9-96cd-49a0-b3c1-195622bc3651 --out /home/opnfv/functest/results/rally_jobs/neutron.json 2021-08-16 21:22:07,392 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2021-08-16 21:22:07,393 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 00:17:51 | 997 | 100.00% | | | | | | | TOTAL: | 00:17:51 | 997 | 100.00% | +-----------+------------+----------------+-----------+ 2021-08-16 21:22:07,393 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs' success_rate is 100.00% in 1/1 modules 2021-08-16 21:22:12,471 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.html 2021-08-16 21:22:17,535 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.xml 2021-08-16 21:22:17,536 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_jobs | functest | 19:13 | PASS | +--------------------+------------------+------------------+----------------+