2020-12-14 07:06:23,817 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | os-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 0I16SBIIWHLB | | NODE_NAME | lf-virtual9 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest/0I16SBIIWHLB/fun | | | ctest-pi-ollivier-functest-benchmarking-cntt-arm- | | | latest-rally_jobs_cntt-run-2 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest/0I16SBIIWHLB/f | | | unctest-pi-ollivier-functest-benchmarking-cntt- | | | arm-latest-rally_jobs_cntt-run-2 | +-------------------------+------------------------------------------------------------+ 2020-12-14 07:06:24,022 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs_cntt'... 2020-12-14 07:06:34,237 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs_cntt'... 2020-12-14 07:06:45,978 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2020-12-14 07:07:56,090 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | e51a6b38-79c8-46f7-9691-01b4f89d6f01 | 2020-12-14T07:07:55.034772 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: e51a6b38-79c8-46f7-9691-01b4f89d6f01 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-12-14 07:08:32,996 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | compute_legacy | Available | | __unknown__ | event | Available | | __unknown__ | placement | Available | | barbican | key-manager | Available | | cinder | block-storage | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-12-14 07:08:48,725 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-12-14 07:42:09,957 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 91f69ecb-0467-4c8b-bb06-ea7d8b66755f 2020-12-14 07:42:24,128 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 91f69ecb-0467-4c8b-bb06-ea7d8b66755f -------------------------------------------------------------------------------- Task 91f69ecb-0467-4c8b-bb06-ea7d8b66755f: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": {}, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": 119 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 91f69ecb-0467-4c8b-bb06-ea7d8b66755f has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.771 | 4.34 | 5.416 | 6.317 | 9.913 | 4.529 | 100.0% | 100 | | neutron.list_networks | 0.493 | 1.29 | 1.836 | 1.938 | 5.567 | 1.324 | 100.0% | 100 | | total | 3.782 | 5.63 | 7.191 | 8.234 | 11.19 | 5.855 | 100.0% | 100 | | -> duration | 3.782 | 5.63 | 7.191 | 8.234 | 11.19 | 5.855 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 36.033852 Full duration: 73.768835 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 91f69ecb-0467-4c8b-bb06-ea7d8b66755f has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.173 | 3.93 | 10.409 | 12.077 | 14.151 | 4.87 | 100.0% | 40 | | neutron.update_network | 0.375 | 0.997 | 1.447 | 1.732 | 1.821 | 1.0 | 100.0% | 40 | | total | 3.078 | 4.93 | 11.112 | 13.072 | 14.829 | 5.875 | 100.0% | 40 | | -> duration | 3.078 | 4.93 | 11.112 | 13.072 | 14.829 | 5.875 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.613093 Full duration: 40.433939 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "args": {}, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 91f69ecb-0467-4c8b-bb06-ea7d8b66755f has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.351 | 5.44 | 14.073 | 15.735 | 19.926 | 7.213 | 100.0% | 40 | | neutron.delete_network | 0.659 | 1.354 | 4.935 | 6.051 | 6.248 | 1.943 | 100.0% | 40 | | total | 3.468 | 8.583 | 15.193 | 17.57 | 20.619 | 9.159 | 100.0% | 40 | | -> duration | 3.468 | 8.583 | 15.193 | 17.57 | 20.619 | 9.159 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.725382 Full duration: 33.355404 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 91f69ecb-0467-4c8b-bb06-ea7d8b66755f has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.781 | 4.589 | 10.066 | 11.075 | 17.221 | 5.404 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.961 | 4.889 | 7.968 | 11.135 | 11.576 | 5.348 | 100.0% | 40 | | neutron.list_subnets | 0.153 | 0.758 | 1.129 | 1.209 | 5.431 | 0.838 | 100.0% | 40 | | total | 6.273 | 11.19 | 16.316 | 16.728 | 29.373 | 11.594 | 100.0% | 40 | | -> duration | 6.273 | 11.19 | 16.316 | 16.728 | 29.373 | 11.594 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 31.959271 Full duration: 81.879235 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_update_args": { "enable_dhcp": true } }, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 5 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 91f69ecb-0467-4c8b-bb06-ea7d8b66755f has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.157 | 3.266 | 8.657 | 10.109 | 23.397 | 4.323 | 100.0% | 100 | | neutron.create_subnet (x2) | 1.829 | 5.216 | 10.625 | 12.385 | 13.757 | 5.978 | 100.0% | 100 | | neutron.update_subnet (x2) | 0.985 | 2.815 | 8.202 | 9.077 | 10.396 | 3.655 | 100.0% | 100 | | total | 5.416 | 14.034 | 20.597 | 23.528 | 27.555 | 13.963 | 100.0% | 100 | | -> duration | 5.416 | 14.034 | 20.597 | 23.528 | 27.555 | 13.963 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 82.867805 Full duration: 187.235761 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 91f69ecb-0467-4c8b-bb06-ea7d8b66755f has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.978 | 4.334 | 10.88 | 12.575 | 19.715 | 5.549 | 100.0% | 40 | | neutron.create_subnet (x2) | 2.382 | 5.854 | 12.397 | 13.938 | 14.449 | 6.726 | 100.0% | 40 | | neutron.delete_subnet (x2) | 1.21 | 2.873 | 7.299 | 10.493 | 11.058 | 3.831 | 100.0% | 40 | | total | 6.028 | 16.124 | 24.705 | 26.527 | 28.546 | 16.468 | 100.0% | 40 | | -> duration | 6.028 | 16.124 | 24.705 | 26.527 | 28.546 | 16.468 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 46.146576 Full duration: 70.778625 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "args": { "network_create_args": null, "subnet_create_args": null, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": null }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 91f69ecb-0467-4c8b-bb06-ea7d8b66755f has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.015 | 2.903 | 7.62 | 9.979 | 15.063 | 4.048 | 100.0% | 40 | | neutron.create_router (x2) | 0.775 | 1.618 | 2.354 | 2.972 | 9.256 | 1.958 | 100.0% | 40 | | neutron.create_subnet (x2) | 7.791 | 24.57 | 38.122 | 39.796 | 46.179 | 26.76 | 100.0% | 40 | | -> neutron.add_interface_router (x2) | 5.142 | 18.072 | 29.41 | 31.334 | 32.299 | 19.114 | 100.0% | 40 | | neutron.list_routers | 0.299 | 0.7 | 1.054 | 2.321 | 5.743 | 0.936 | 100.0% | 40 | | total | 10.333 | 32.399 | 45.606 | 47.072 | 57.993 | 33.708 | 100.0% | 40 | | -> duration | 10.333 | 32.399 | 45.606 | 47.072 | 57.993 | 33.708 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 90.529476 Full duration: 213.838064 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {}, "router_update_args": { "admin_state_up": false } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 91f69ecb-0467-4c8b-bb06-ea7d8b66755f has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.029 | 3.138 | 6.159 | 8.422 | 16.922 | 3.824 | 100.0% | 40 | | neutron.create_router (x2) | 0.673 | 1.62 | 2.883 | 5.389 | 7.098 | 2.026 | 100.0% | 40 | | neutron.create_subnet (x2) | 9.598 | 21.561 | 30.183 | 32.688 | 33.364 | 22.458 | 100.0% | 40 | | -> neutron.add_interface_router (x2) | 6.53 | 15.639 | 21.493 | 22.016 | 25.833 | 15.04 | 100.0% | 40 | | neutron.update_router (x2) | 1.277 | 3.565 | 11.007 | 12.309 | 12.505 | 5.256 | 100.0% | 40 | | total | 18.588 | 32.417 | 47.512 | 48.86 | 51.441 | 33.569 | 100.0% | 40 | | -> duration | 18.588 | 32.417 | 47.512 | 48.86 | 51.441 | 33.569 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 80.389236 Full duration: 191.980578 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {} }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 91f69ecb-0467-4c8b-bb06-ea7d8b66755f has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.831 | 2.817 | 7.314 | 8.949 | 15.929 | 3.822 | 100.0% | 40 | | neutron.create_router (x2) | 0.682 | 1.56 | 2.204 | 2.302 | 6.866 | 1.71 | 100.0% | 40 | | neutron.create_subnet (x2) | 6.829 | 24.678 | 37.272 | 37.468 | 42.156 | 25.516 | 100.0% | 40 | | -> neutron.add_interface_router (x2) | 4.654 | 16.921 | 28.733 | 29.028 | 29.39 | 17.74 | 100.0% | 40 | | neutron.remove_interface_router (x2) | 3.9 | 15.605 | 30.917 | 31.861 | 32.397 | 15.808 | 100.0% | 40 | | neutron.delete_router (x2) | 0.958 | 2.201 | 6.752 | 7.985 | 12.823 | 3.089 | 100.0% | 40 | | total | 13.986 | 53.365 | 78.358 | 78.825 | 86.54 | 49.956 | 100.0% | 40 | | -> duration | 13.986 | 53.365 | 78.358 | 78.825 | 86.54 | 49.956 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 133.604247 Full duration: 187.99946 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 50 }, "runner": { "times": 8, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1, "port": 811 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 91f69ecb-0467-4c8b-bb06-ea7d8b66755f has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.629 | 0.995 | 1.749 | 1.93 | 2.111 | 1.128 | 100.0% | 8 | | neutron.create_port (x50) | 41.692 | 48.645 | 83.096 | 83.225 | 83.353 | 55.059 | 100.0% | 8 | | neutron.list_ports | 0.691 | 1.349 | 1.526 | 1.552 | 1.577 | 1.224 | 100.0% | 8 | | total | 44.139 | 50.706 | 85.981 | 86.351 | 86.721 | 57.466 | 100.0% | 8 | | -> duration | 44.139 | 50.706 | 85.981 | 86.351 | 86.721 | 57.466 | 100.0% | 8 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 131.650245 Full duration: 245.52014 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 91f69ecb-0467-4c8b-bb06-ea7d8b66755f has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.215 | 3.116 | 6.929 | 9.198 | 13.853 | 3.99 | 100.0% | 40 | | neutron.create_port (x5) | 5.082 | 14.644 | 20.387 | 23.994 | 28.21 | 13.95 | 100.0% | 40 | | neutron.update_port (x5) | 3.071 | 7.862 | 14.002 | 16.379 | 21.883 | 9.011 | 100.0% | 40 | | total | 9.848 | 25.363 | 46.091 | 47.774 | 50.791 | 27.279 | 100.0% | 40 | | -> duration | 9.848 | 25.363 | 46.091 | 47.774 | 50.791 | 27.279 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 71.678269 Full duration: 149.398225 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 2 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 91f69ecb-0467-4c8b-bb06-ea7d8b66755f has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.176 | 3.744 | 8.571 | 9.248 | 11.085 | 4.679 | 100.0% | 40 | | neutron.create_port (x5) | 4.062 | 11.976 | 21.073 | 24.601 | 25.459 | 13.261 | 100.0% | 40 | | neutron.delete_port (x5) | 2.627 | 7.504 | 15.68 | 16.302 | 21.734 | 9.044 | 100.0% | 40 | | total | 11.656 | 24.882 | 41.828 | 43.548 | 48.173 | 27.321 | 100.0% | 40 | | -> duration | 11.656 | 24.882 | 41.828 | 43.548 | 48.173 | 27.321 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 73.1632 Full duration: 101.65702 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 20, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 91f69ecb-0467-4c8b-bb06-ea7d8b66755f has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.732 | 1.326 | 1.668 | 1.725 | 1.846 | 1.289 | 100.0% | 40 | | total | 2.753 | 3.712 | 4.845 | 5.188 | 5.529 | 3.888 | 100.0% | 40 | | -> duration | 2.753 | 3.712 | 4.845 | 5.188 | 5.529 | 3.888 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.965596 Full duration: 63.901109 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunks args position 0 args values: { "args": { "subport_count": 125 }, "runner": { "times": 4, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 91f69ecb-0467-4c8b-bb06-ea7d8b66755f has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.286 | 2.117 | 2.351 | 2.355 | 2.358 | 1.97 | 100.0% | 4 | | neutron.create_port (x126) | 110.202 | 115.977 | 117.405 | 117.656 | 117.907 | 115.016 | 100.0% | 4 | | neutron.create_trunk | 8.606 | 8.69 | 12.048 | 12.763 | 13.478 | 9.866 | 100.0% | 4 | | neutron.update_port | 1.167 | 1.337 | 1.418 | 1.434 | 1.45 | 1.323 | 100.0% | 4 | | neutron.list_trunks | 0.129 | 0.136 | 0.141 | 0.142 | 0.143 | 0.136 | 100.0% | 4 | | neutron.list_subports_by_trunk | 0.098 | 0.121 | 0.171 | 0.179 | 0.186 | 0.132 | 100.0% | 4 | | neutron.list_ports | 0.442 | 0.512 | 0.601 | 0.617 | 0.633 | 0.525 | 100.0% | 4 | | total | 128.079 | 128.972 | 129.81 | 129.912 | 130.013 | 129.009 | 100.0% | 4 | | -> duration | 128.079 | 128.972 | 129.81 | 129.912 | 130.013 | 129.009 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 130.047426 Full duration: 271.185637 HINTS: * To plot HTML graphics with this data, run: rally task report 91f69ecb-0467-4c8b-bb06-ea7d8b66755f --out output.html * To generate a JUnit report, run: rally task export 91f69ecb-0467-4c8b-bb06-ea7d8b66755f --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report 91f69ecb-0467-4c8b-bb06-ea7d8b66755f --json --out output.json 2020-12-14 07:43:04,563 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 91f69ecb-0467-4c8b-bb06-ea7d8b66755f --out /home/opnfv/functest/results/rally_jobs_cntt/neutron.json 2020-12-14 07:43:05,450 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2020-12-14 07:43:05,459 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 00:31:52 | 612 | 100.00% | | | | | | | TOTAL: | 00:31:52 | 612 | 100.00% | +-----------+------------+----------------+-----------+ 2020-12-14 07:43:05,460 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs_cntt' success_rate is 100.00% in 1/1 modules 2020-12-14 07:43:43,573 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.html 2020-12-14 07:44:21,024 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.xml 2020-12-14 07:44:21,027 - xtesting.ci.run_tests - INFO - Test result: +-------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------------+------------------+------------------+----------------+ | rally_jobs_cntt | functest | 37:46 | PASS | +-------------------------+------------------+------------------+----------------+