2021-08-16 22:27:02,584 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | false | | DEPLOY_SCENARIO | os-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 02QYZBF7GWDB | | NODE_NAME | lf-virtual6 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest/02QYZBF7GWDB/fun | | | ctest-opnfv-functest-benchmarking-cntt-wallaby- | | | rally_jobs_cntt-run-6 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest/02QYZBF7GWDB/f | | | unctest-opnfv-functest-benchmarking-cntt-wallaby- | | | rally_jobs_cntt-run-6 | +-------------------------+------------------------------------------------------------+ 2021-08-16 22:27:02,604 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs_cntt'... 2021-08-16 22:27:04,710 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs_cntt'... 2021-08-16 22:27:10,431 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2021-08-16 22:27:17,762 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 7598d618-74c8-4f26-8d43-17a89562f1a1 | 2021-08-16T22:27:17.547039 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 7598d618-74c8-4f26-8d43-17a89562f1a1 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2021-08-16 22:27:21,822 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | compute_legacy | Available | | __unknown__ | placement | Available | | barbican | key-manager | Available | | cinder | block-storage | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2021-08-16 22:27:23,721 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2021-08-16 22:40:17,572 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: bc067290-dfe6-4268-93bc-7ae40b6b19e5 2021-08-16 22:40:19,021 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid bc067290-dfe6-4268-93bc-7ae40b6b19e5 -------------------------------------------------------------------------------- Task bc067290-dfe6-4268-93bc-7ae40b6b19e5: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": {}, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": 119 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc067290-dfe6-4268-93bc-7ae40b6b19e5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.341 | 0.921 | 1.484 | 1.706 | 2.735 | 0.983 | 100.0% | 100 | | neutron.list_networks | 0.142 | 0.577 | 1.048 | 1.22 | 2.478 | 0.667 | 100.0% | 100 | | total | 0.648 | 1.57 | 2.278 | 3.313 | 3.854 | 1.65 | 100.0% | 100 | | -> duration | 0.648 | 1.57 | 2.278 | 3.313 | 3.854 | 1.65 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.725765 Full duration: 24.188528 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc067290-dfe6-4268-93bc-7ae40b6b19e5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.353 | 0.73 | 1.29 | 1.347 | 2.0 | 0.771 | 100.0% | 40 | | neutron.update_network | 0.183 | 0.391 | 0.711 | 0.844 | 0.887 | 0.423 | 100.0% | 40 | | total | 0.545 | 1.148 | 1.887 | 2.046 | 2.261 | 1.194 | 100.0% | 40 | | -> duration | 0.545 | 1.148 | 1.887 | 2.046 | 2.261 | 1.194 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.344865 Full duration: 11.306006 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "args": {}, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc067290-dfe6-4268-93bc-7ae40b6b19e5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.303 | 0.614 | 1.545 | 1.568 | 1.807 | 0.744 | 100.0% | 40 | | neutron.delete_network | 0.264 | 0.539 | 1.006 | 1.118 | 1.143 | 0.606 | 100.0% | 40 | | total | 0.567 | 1.341 | 2.092 | 2.114 | 2.241 | 1.35 | 100.0% | 40 | | -> duration | 0.567 | 1.341 | 2.092 | 2.114 | 2.241 | 1.35 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.873038 Full duration: 7.41053 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc067290-dfe6-4268-93bc-7ae40b6b19e5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.329 | 0.622 | 1.264 | 1.44 | 2.87 | 0.783 | 100.0% | 40 | | neutron.create_subnet (x2) | 0.706 | 1.353 | 4.436 | 4.628 | 4.818 | 1.75 | 100.0% | 40 | | neutron.list_subnets | 0.09 | 0.224 | 1.234 | 1.262 | 1.28 | 0.375 | 100.0% | 40 | | total | 1.242 | 2.397 | 7.101 | 7.134 | 7.945 | 2.908 | 100.0% | 40 | | -> duration | 1.242 | 2.397 | 7.101 | 7.134 | 7.945 | 2.908 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.048899 Full duration: 27.01547 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_update_args": { "enable_dhcp": true } }, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 5 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc067290-dfe6-4268-93bc-7ae40b6b19e5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.302 | 0.567 | 1.054 | 1.582 | 2.17 | 0.722 | 100.0% | 100 | | neutron.create_subnet (x2) | 0.666 | 1.493 | 2.916 | 3.395 | 3.74 | 1.679 | 100.0% | 100 | | neutron.update_subnet (x2) | 0.545 | 1.024 | 1.67 | 1.903 | 2.201 | 1.098 | 100.0% | 100 | | total | 1.712 | 3.057 | 5.477 | 6.571 | 7.573 | 3.499 | 100.0% | 100 | | -> duration | 1.712 | 3.057 | 5.477 | 6.571 | 7.573 | 3.499 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.800439 Full duration: 53.856931 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc067290-dfe6-4268-93bc-7ae40b6b19e5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.375 | 0.672 | 1.228 | 1.496 | 1.814 | 0.77 | 100.0% | 40 | | neutron.create_subnet (x2) | 0.721 | 1.609 | 2.454 | 2.539 | 2.581 | 1.673 | 100.0% | 40 | | neutron.delete_subnet (x2) | 0.59 | 1.249 | 1.697 | 1.749 | 1.975 | 1.271 | 100.0% | 40 | | total | 2.006 | 3.826 | 5.033 | 5.227 | 5.329 | 3.762 | 100.0% | 40 | | -> duration | 2.006 | 3.826 | 5.033 | 5.227 | 5.329 | 3.762 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.866904 Full duration: 18.446545 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "args": { "network_create_args": null, "subnet_create_args": null, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": null }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc067290-dfe6-4268-93bc-7ae40b6b19e5 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.353 | 0.672 | 1.679 | 2.081 | 2.205 | 0.875 | 100.0% | 40 | | neutron.create_router (x2) | 0.141 | 0.267 | 1.049 | 1.054 | 1.133 | 0.422 | 100.0% | 40 | | neutron.create_subnet (x2) | 4.783 | 9.156 | 27.124 | 27.864 | 28.897 | 11.898 | 100.0% | 40 | | -> neutron.add_interface_router (x2) | 4.012 | 7.43 | 21.636 | 22.919 | 24.182 | 9.723 | 100.0% | 40 | | neutron.list_routers | 0.177 | 0.369 | 1.153 | 1.732 | 1.821 | 0.582 | 100.0% | 40 | | total | 5.909 | 10.599 | 32.072 | 32.108 | 32.242 | 13.778 | 100.0% | 40 | | -> duration | 5.909 | 10.599 | 32.072 | 32.108 | 32.242 | 13.778 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 32.451661 Full duration: 79.561298 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {}, "router_update_args": { "admin_state_up": false } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc067290-dfe6-4268-93bc-7ae40b6b19e5 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.343 | 0.685 | 1.211 | 1.394 | 1.493 | 0.733 | 100.0% | 40 | | neutron.create_router (x2) | 0.116 | 0.292 | 0.593 | 0.683 | 0.867 | 0.327 | 100.0% | 40 | | neutron.create_subnet (x2) | 5.036 | 8.884 | 15.67 | 18.787 | 19.444 | 10.303 | 100.0% | 40 | | -> neutron.add_interface_router (x2) | 4.258 | 7.335 | 12.223 | 15.352 | 15.475 | 8.382 | 100.0% | 40 | | neutron.update_router (x2) | 1.391 | 2.273 | 4.424 | 4.592 | 5.314 | 2.703 | 100.0% | 40 | | total | 7.182 | 12.444 | 19.937 | 25.349 | 25.862 | 14.067 | 100.0% | 40 | | -> duration | 7.182 | 12.444 | 19.937 | 25.349 | 25.862 | 14.067 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 37.979345 Full duration: 84.297211 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {} }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc067290-dfe6-4268-93bc-7ae40b6b19e5 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.34 | 0.786 | 1.586 | 1.833 | 1.901 | 0.887 | 100.0% | 40 | | neutron.create_router (x2) | 0.122 | 0.231 | 0.547 | 0.613 | 0.835 | 0.318 | 100.0% | 40 | | neutron.create_subnet (x2) | 4.638 | 9.293 | 17.051 | 17.749 | 20.315 | 10.679 | 100.0% | 40 | | -> neutron.add_interface_router (x2) | 3.964 | 7.83 | 14.291 | 14.915 | 17.448 | 8.949 | 100.0% | 40 | | neutron.remove_interface_router (x2) | 3.63 | 6.839 | 13.424 | 14.523 | 15.039 | 7.931 | 100.0% | 40 | | neutron.delete_router (x2) | 0.663 | 1.467 | 2.049 | 2.226 | 2.462 | 1.45 | 100.0% | 40 | | total | 10.211 | 18.889 | 32.528 | 37.441 | 39.137 | 21.265 | 100.0% | 40 | | -> duration | 10.211 | 18.889 | 32.528 | 37.441 | 39.137 | 21.265 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 59.112186 Full duration: 77.063336 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 50 }, "runner": { "times": 8, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1, "port": 811 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc067290-dfe6-4268-93bc-7ae40b6b19e5 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.353 | 0.705 | 1.462 | 1.463 | 1.465 | 0.885 | 100.0% | 8 | | neutron.create_port (x50) | 19.387 | 24.7 | 59.197 | 59.305 | 59.413 | 36.57 | 100.0% | 8 | | neutron.list_ports | 0.415 | 1.862 | 2.396 | 2.589 | 2.783 | 1.718 | 100.0% | 8 | | total | 20.324 | 26.847 | 62.992 | 63.326 | 63.66 | 39.177 | 100.0% | 8 | | -> duration | 20.324 | 26.847 | 62.992 | 63.326 | 63.66 | 39.177 | 100.0% | 8 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 90.175351 Full duration: 136.448479 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc067290-dfe6-4268-93bc-7ae40b6b19e5 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.283 | 0.734 | 1.84 | 2.039 | 2.291 | 0.962 | 100.0% | 40 | | neutron.create_port (x5) | 1.921 | 3.829 | 12.488 | 12.718 | 13.314 | 5.17 | 100.0% | 40 | | neutron.update_port (x5) | 1.462 | 2.776 | 8.549 | 8.941 | 9.683 | 3.657 | 100.0% | 40 | | total | 3.933 | 7.547 | 23.467 | 23.661 | 23.856 | 9.846 | 100.0% | 40 | | -> duration | 3.933 | 7.547 | 23.467 | 23.661 | 23.856 | 9.846 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.875758 Full duration: 53.25664 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 2 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc067290-dfe6-4268-93bc-7ae40b6b19e5 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.315 | 0.709 | 1.3 | 2.354 | 2.454 | 0.815 | 100.0% | 40 | | neutron.create_port (x5) | 2.036 | 3.921 | 13.717 | 13.855 | 14.072 | 5.16 | 100.0% | 40 | | neutron.delete_port (x5) | 2.232 | 3.797 | 11.219 | 11.545 | 12.098 | 4.825 | 100.0% | 40 | | total | 4.79 | 8.638 | 26.594 | 27.418 | 27.453 | 10.848 | 100.0% | 40 | | -> duration | 4.79 | 8.638 | 26.594 | 27.418 | 27.453 | 10.848 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 27.471208 Full duration: 35.896101 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 20, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc067290-dfe6-4268-93bc-7ae40b6b19e5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.117 | 0.185 | 0.251 | 0.264 | 0.283 | 0.19 | 100.0% | 40 | | total | 0.202 | 0.339 | 0.42 | 0.451 | 0.456 | 0.338 | 100.0% | 40 | | -> duration | 0.202 | 0.339 | 0.42 | 0.451 | 0.456 | 0.338 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.529654 Full duration: 9.094612 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunks args position 0 args values: { "args": { "subport_count": 125 }, "runner": { "times": 4, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc067290-dfe6-4268-93bc-7ae40b6b19e5 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.541 | 1.089 | 1.096 | 1.096 | 1.096 | 0.954 | 100.0% | 4 | | neutron.create_port (x126) | 54.262 | 58.553 | 64.157 | 64.541 | 64.925 | 59.073 | 100.0% | 4 | | neutron.create_trunk | 8.226 | 8.496 | 10.232 | 10.577 | 10.922 | 9.035 | 100.0% | 4 | | neutron.update_port | 1.061 | 1.262 | 1.469 | 1.494 | 1.519 | 1.276 | 100.0% | 4 | | neutron.list_trunks | 0.036 | 0.052 | 0.063 | 0.064 | 0.065 | 0.051 | 100.0% | 4 | | neutron.list_subports_by_trunk | 0.04 | 0.043 | 0.045 | 0.046 | 0.046 | 0.043 | 100.0% | 4 | | neutron.list_ports | 0.074 | 0.093 | 0.102 | 0.104 | 0.105 | 0.091 | 100.0% | 4 | | total | 64.819 | 70.61 | 76.056 | 76.076 | 76.096 | 70.534 | 100.0% | 4 | | -> duration | 64.819 | 70.61 | 76.056 | 76.076 | 76.096 | 70.534 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 76.104857 Full duration: 132.581398 HINTS: * To plot HTML graphics with this data, run: rally task report bc067290-dfe6-4268-93bc-7ae40b6b19e5 --out output.html * To generate a JUnit report, run: rally task export bc067290-dfe6-4268-93bc-7ae40b6b19e5 --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report bc067290-dfe6-4268-93bc-7ae40b6b19e5 --json --out output.json 2021-08-16 22:40:22,795 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid bc067290-dfe6-4268-93bc-7ae40b6b19e5 --out /home/opnfv/functest/results/rally_jobs_cntt/neutron.json 2021-08-16 22:40:22,949 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2021-08-16 22:40:22,951 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 00:12:30 | 612 | 100.00% | | | | | | | TOTAL: | 00:12:30 | 612 | 100.00% | +-----------+------------+----------------+-----------+ 2021-08-16 22:40:22,951 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs_cntt' success_rate is 100.00% in 1/1 modules 2021-08-16 22:40:26,886 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.html 2021-08-16 22:40:30,582 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.xml 2021-08-16 22:40:30,583 - xtesting.ci.run_tests - INFO - Test result: +-------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------------+------------------+------------------+----------------+ | rally_jobs_cntt | functest | 13:25 | PASS | +-------------------------+------------------+------------------+----------------+