2021-06-02 01:39:02,513 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | false | | DEPLOY_SCENARIO | os-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 03M37I43D4EK | | NODE_NAME | lf-pod4-3 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest/03M37I43D4EK/fun | | | ctest-opnfv-functest-benchmarking-cntt-kali- | | | rally_jobs_cntt-run-124 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest/03M37I43D4EK/f | | | unctest-opnfv-functest-benchmarking-cntt-kali- | | | rally_jobs_cntt-run-124 | +-------------------------+------------------------------------------------------------+ 2021-06-02 01:39:02,545 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs_cntt'... 2021-06-02 01:39:04,982 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs_cntt'... 2021-06-02 01:39:11,096 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2021-06-02 01:39:18,811 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 0721bfae-f626-4486-b658-5e985d8132cf | 2021-06-02T01:39:18.560111 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 0721bfae-f626-4486-b658-5e985d8132cf ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2021-06-02 01:39:23,320 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | accelerator | Available | | __unknown__ | alarming | Available | | __unknown__ | compute_legacy | Available | | __unknown__ | event | Available | | __unknown__ | placement | Available | | barbican | key-manager | Available | | cinder | block-storage | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2021-06-02 01:39:25,494 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2021-06-02 02:01:02,791 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: ed600e2e-83c2-427d-85bd-9d36880697d3 2021-06-02 02:01:04,728 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid ed600e2e-83c2-427d-85bd-9d36880697d3 -------------------------------------------------------------------------------- Task ed600e2e-83c2-427d-85bd-9d36880697d3: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": {}, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": 119 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ed600e2e-83c2-427d-85bd-9d36880697d3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.381 | 2.307 | 15.999 | 30.292 | 41.407 | 6.126 | 100.0% | 100 | | neutron.list_networks | 0.138 | 0.355 | 0.521 | 0.891 | 1.411 | 0.384 | 100.0% | 100 | | total | 0.717 | 2.644 | 16.389 | 30.807 | 42.818 | 6.511 | 100.0% | 100 | | -> duration | 0.717 | 2.644 | 16.389 | 30.807 | 42.818 | 6.511 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 50.740717 Full duration: 68.987715 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ed600e2e-83c2-427d-85bd-9d36880697d3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.37 | 3.191 | 13.921 | 15.817 | 19.093 | 5.463 | 100.0% | 40 | | neutron.update_network | 0.204 | 0.291 | 0.521 | 0.585 | 0.935 | 0.338 | 100.0% | 40 | | total | 0.591 | 3.528 | 14.26 | 16.128 | 19.297 | 5.8 | 100.0% | 40 | | -> duration | 0.591 | 3.528 | 14.26 | 16.128 | 19.297 | 5.8 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.297286 Full duration: 30.454701 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "args": {}, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ed600e2e-83c2-427d-85bd-9d36880697d3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.431 | 2.663 | 13.014 | 15.63 | 21.421 | 5.153 | 100.0% | 40 | | neutron.delete_network | 0.293 | 0.379 | 0.674 | 0.793 | 1.149 | 0.449 | 100.0% | 40 | | total | 0.814 | 3.13 | 13.345 | 15.924 | 22.109 | 5.602 | 100.0% | 40 | | -> duration | 0.814 | 3.13 | 13.345 | 15.924 | 22.109 | 5.602 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.883396 Full duration: 28.616811 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ed600e2e-83c2-427d-85bd-9d36880697d3 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.407 | 2.964 | 16.906 | 19.672 | 22.198 | 6.164 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.157 | 2.436 | 3.497 | 4.033 | 4.335 | 2.457 | 100.0% | 40 | | neutron.list_subnets | 0.105 | 0.209 | 0.32 | 0.392 | 1.01 | 0.251 | 100.0% | 40 | | total | 2.422 | 6.497 | 18.898 | 21.862 | 24.394 | 8.873 | 100.0% | 40 | | -> duration | 2.422 | 6.497 | 18.898 | 21.862 | 24.394 | 8.873 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.53723 Full duration: 50.306899 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_update_args": { "enable_dhcp": true } }, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 5 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ed600e2e-83c2-427d-85bd-9d36880697d3 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.371 | 1.869 | 9.371 | 23.452 | 53.825 | 4.576 | 100.0% | 100 | | neutron.create_subnet (x2) | 1.168 | 3.18 | 5.014 | 5.85 | 6.813 | 3.208 | 100.0% | 100 | | neutron.update_subnet (x2) | 0.48 | 1.099 | 2.192 | 2.533 | 2.717 | 1.292 | 100.0% | 100 | | total | 2.273 | 6.844 | 13.282 | 28.142 | 56.151 | 9.076 | 100.0% | 100 | | -> duration | 2.273 | 6.844 | 13.282 | 28.142 | 56.151 | 9.076 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 56.53444 Full duration: 105.629301 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ed600e2e-83c2-427d-85bd-9d36880697d3 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.388 | 2.364 | 8.989 | 15.457 | 26.185 | 4.128 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.206 | 3.324 | 7.769 | 8.893 | 9.397 | 3.746 | 100.0% | 40 | | neutron.delete_subnet (x2) | 0.799 | 2.057 | 4.009 | 5.229 | 6.031 | 2.38 | 100.0% | 40 | | total | 2.929 | 8.657 | 19.496 | 21.672 | 28.311 | 10.3 | 100.0% | 40 | | -> duration | 2.929 | 8.657 | 19.496 | 21.672 | 28.311 | 10.3 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 28.403334 Full duration: 39.309924 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "args": { "network_create_args": null, "subnet_create_args": null, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": null }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ed600e2e-83c2-427d-85bd-9d36880697d3 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.454 | 2.906 | 12.492 | 15.647 | 23.178 | 5.08 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.531 | 4.132 | 9.951 | 14.64 | 17.526 | 5.413 | 100.0% | 40 | | neutron.create_router (x2) | 0.351 | 0.903 | 4.598 | 5.019 | 11.395 | 1.825 | 100.0% | 40 | | neutron.add_interface_router (x2) | 7.042 | 12.917 | 28.659 | 30.539 | 34.9 | 15.784 | 100.0% | 40 | | neutron.list_routers | 0.236 | 0.565 | 1.831 | 2.082 | 2.275 | 0.852 | 100.0% | 40 | | total | 13.113 | 23.621 | 51.337 | 55.48 | 70.3 | 28.954 | 100.0% | 40 | | -> duration | 13.113 | 23.621 | 51.337 | 55.48 | 70.3 | 28.954 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 72.122384 Full duration: 150.925309 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {}, "router_update_args": { "admin_state_up": false } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ed600e2e-83c2-427d-85bd-9d36880697d3 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.462 | 2.693 | 17.191 | 19.92 | 30.42 | 5.672 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.222 | 5.837 | 10.535 | 11.681 | 17.937 | 6.257 | 100.0% | 40 | | neutron.create_router (x2) | 0.165 | 1.197 | 3.611 | 8.083 | 9.646 | 1.846 | 100.0% | 40 | | neutron.add_interface_router (x2) | 4.946 | 15.604 | 29.116 | 33.05 | 34.272 | 15.734 | 100.0% | 40 | | neutron.update_router (x2) | 1.161 | 3.964 | 10.266 | 10.334 | 10.626 | 4.903 | 100.0% | 40 | | total | 10.355 | 31.779 | 64.953 | 65.357 | 68.795 | 34.412 | 100.0% | 40 | | -> duration | 10.355 | 31.779 | 64.953 | 65.357 | 68.795 | 34.412 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 79.250638 Full duration: 156.437651 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {} }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ed600e2e-83c2-427d-85bd-9d36880697d3 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.54 | 1.833 | 11.368 | 13.053 | 22.099 | 3.911 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.359 | 3.796 | 8.986 | 10.158 | 13.376 | 4.858 | 100.0% | 40 | | neutron.create_router (x2) | 0.182 | 0.892 | 1.976 | 2.247 | 2.606 | 1.008 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.505 | 15.267 | 23.857 | 26.301 | 27.319 | 14.993 | 100.0% | 40 | | neutron.remove_interface_router (x2) | 4.272 | 12.936 | 25.899 | 27.471 | 30.133 | 13.888 | 100.0% | 40 | | neutron.delete_router (x2) | 0.733 | 2.771 | 4.475 | 5.332 | 5.835 | 2.893 | 100.0% | 40 | | total | 14.816 | 40.594 | 64.055 | 70.256 | 79.17 | 41.551 | 100.0% | 40 | | -> duration | 14.816 | 40.594 | 64.055 | 70.256 | 79.17 | 41.551 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 107.116909 Full duration: 134.435973 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 50 }, "runner": { "times": 8, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1, "port": 811 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ed600e2e-83c2-427d-85bd-9d36880697d3 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.378 | 0.781 | 2.192 | 2.331 | 2.469 | 1.098 | 100.0% | 8 | | neutron.create_port (x50) | 27.398 | 29.279 | 49.765 | 49.889 | 50.013 | 34.183 | 100.0% | 8 | | neutron.list_ports | 0.55 | 1.072 | 1.484 | 1.639 | 1.794 | 1.138 | 100.0% | 8 | | total | 29.247 | 30.938 | 53.351 | 53.643 | 53.935 | 36.427 | 100.0% | 8 | | -> duration | 29.247 | 30.938 | 53.351 | 53.643 | 53.935 | 36.427 | 100.0% | 8 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 84.739058 Full duration: 140.043864 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ed600e2e-83c2-427d-85bd-9d36880697d3 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.454 | 3.258 | 11.491 | 26.113 | 35.78 | 5.654 | 100.0% | 40 | | neutron.create_port (x5) | 2.282 | 6.477 | 10.623 | 10.886 | 12.556 | 6.693 | 100.0% | 40 | | neutron.update_port (x5) | 1.612 | 4.537 | 7.679 | 8.176 | 10.087 | 4.89 | 100.0% | 40 | | total | 5.135 | 15.249 | 29.18 | 37.751 | 41.787 | 17.296 | 100.0% | 40 | | -> duration | 5.135 | 15.249 | 29.18 | 37.751 | 41.787 | 17.296 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 41.915369 Full duration: 79.212445 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 2 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ed600e2e-83c2-427d-85bd-9d36880697d3 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.472 | 2.843 | 10.165 | 13.442 | 24.341 | 5.226 | 100.0% | 40 | | neutron.create_port (x5) | 2.328 | 7.442 | 14.144 | 14.543 | 15.423 | 8.375 | 100.0% | 40 | | neutron.delete_port (x5) | 2.21 | 6.242 | 10.665 | 11.11 | 11.92 | 6.668 | 100.0% | 40 | | total | 6.512 | 20.455 | 34.559 | 36.79 | 46.528 | 20.315 | 100.0% | 40 | | -> duration | 6.512 | 20.455 | 34.559 | 36.79 | 46.528 | 20.315 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 53.17965 Full duration: 65.229707 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 20, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ed600e2e-83c2-427d-85bd-9d36880697d3 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.257 | 0.363 | 0.467 | 0.501 | 0.527 | 0.367 | 100.0% | 40 | | total | 0.344 | 0.499 | 0.632 | 0.681 | 0.707 | 0.513 | 100.0% | 40 | | -> duration | 0.344 | 0.499 | 0.632 | 0.681 | 0.707 | 0.513 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.754259 Full duration: 22.19973 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunks args position 0 args values: { "args": { "subport_count": 125 }, "runner": { "times": 4, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ed600e2e-83c2-427d-85bd-9d36880697d3 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.677 | 1.284 | 2.409 | 2.618 | 2.827 | 1.518 | 100.0% | 4 | | neutron.create_port (x126) | 61.506 | 86.545 | 109.861 | 109.943 | 110.026 | 86.155 | 100.0% | 4 | | neutron.create_trunk | 9.215 | 12.252 | 15.296 | 15.333 | 15.371 | 12.273 | 100.0% | 4 | | neutron.update_port | 0.954 | 1.41 | 1.999 | 2.048 | 2.098 | 1.468 | 100.0% | 4 | | neutron.list_trunks | 0.039 | 0.059 | 0.124 | 0.136 | 0.148 | 0.076 | 100.0% | 4 | | neutron.list_subports_by_trunk | 0.054 | 0.078 | 0.116 | 0.12 | 0.124 | 0.083 | 100.0% | 4 | | neutron.list_ports_by_device_id | 0.098 | 0.107 | 0.217 | 0.239 | 0.262 | 0.143 | 100.0% | 4 | | total | 73.15 | 102.029 | 129.544 | 129.614 | 129.685 | 101.723 | 100.0% | 4 | | -> duration | 73.15 | 102.029 | 129.544 | 129.614 | 129.685 | 101.723 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 129.723129 Full duration: 198.697231 HINTS: * To plot HTML graphics with this data, run: rally task report ed600e2e-83c2-427d-85bd-9d36880697d3 --out output.html * To generate a JUnit report, run: rally task export ed600e2e-83c2-427d-85bd-9d36880697d3 --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report ed600e2e-83c2-427d-85bd-9d36880697d3 --json --out output.json 2021-06-02 02:01:08,850 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid ed600e2e-83c2-427d-85bd-9d36880697d3 --out /home/opnfv/functest/results/rally_jobs_cntt/neutron.json 2021-06-02 02:01:09,010 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2021-06-02 02:01:09,017 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 00:21:10 | 612 | 100.00% | | | | | | | TOTAL: | 00:21:10 | 612 | 100.00% | +-----------+------------+----------------+-----------+ 2021-06-02 02:01:09,018 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs_cntt' success_rate is 100.00% in 1/1 modules 2021-06-02 02:01:13,209 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.html 2021-06-02 02:01:17,128 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.xml 2021-06-02 02:01:17,129 - xtesting.ci.run_tests - INFO - Test result: +-------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------------+------------------+------------------+----------------+ | rally_jobs_cntt | functest | 22:12 | PASS | +-------------------------+------------------+------------------+----------------+