2021-02-04 14:39:38,967 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+-----------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+-----------------------------------------------------------+ | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_DST_URL | s3://artifacts.opnfv.org/functest/04NAWIQKGL0I | | | /functest-pi-ollivier-functest-benchmarking-arm64 | | | -hunter-rally_jobs-run-21 | | S3_ENDPOINT_URL | https://storage.googleapis.com | | DEPLOY_SCENARIO | os-nosdn-nofeature-noha | | BUILD_TAG | 04NAWIQKGL0I | | DEBUG | true | | INSTALLER_TYPE | unknown | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | HTTP_DST_URL | http://artifacts.opnfv.org/functest/04NAWIQKGL0I | | | /functest-pi-ollivier-functest-benchmarking-arm64 | | | -hunter-rally_jobs-run-21 | | NODE_NAME | lf-virtual6 | +-------------------------+-----------------------------------------------------------+ 2021-02-04 14:39:39,100 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs'... 2021-02-04 14:39:45,178 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs'... 2021-02-04 14:39:55,676 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2021-02-04 14:40:35,142 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 2652ddd7-6953-438d-b1ff-6fc256ec8fce | 2021-02-04T14:40:34.501028 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 2652ddd7-6953-438d-b1ff-6fc256ec8fce ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2021-02-04 14:40:56,597 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | compute_legacy | Available | | __unknown__ | placement | Available | | barbican | key-manager | Available | | cinder | block-storage | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2021-02-04 14:41:07,295 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2021-02-04 15:06:26,729 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 66288f24-8e1e-4fd3-a387-d1e87969c142 2021-02-04 15:06:35,681 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 66288f24-8e1e-4fd3-a387-d1e87969c142 -------------------------------------------------------------------------------- Task 66288f24-8e1e-4fd3-a387-d1e87969c142: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 20, "times": 100 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": 119 } } }, "args": {}, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 66288f24-8e1e-4fd3-a387-d1e87969c142 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.878 | 1.882 | 2.751 | 3.039 | 4.215 | 1.982 | 100.0% | 100 | | neutron.list_networks | 0.263 | 0.81 | 1.649 | 1.753 | 2.147 | 0.925 | 100.0% | 100 | | total | 1.143 | 2.864 | 3.843 | 4.288 | 5.19 | 2.909 | 100.0% | 100 | | -> duration | 1.143 | 2.864 | 3.843 | 4.288 | 5.19 | 2.909 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.983515 Full duration: 47.496998 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {}, "network_update_args": { "name": "_updated", "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 66288f24-8e1e-4fd3-a387-d1e87969c142 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.862 | 1.249 | 1.916 | 2.523 | 3.262 | 1.41 | 100.0% | 40 | | neutron.update_network | 0.372 | 0.695 | 2.157 | 2.597 | 2.799 | 1.013 | 100.0% | 40 | | total | 1.234 | 2.146 | 3.664 | 4.122 | 4.217 | 2.423 | 100.0% | 40 | | -> duration | 1.234 | 2.146 | 3.664 | 4.122 | 4.217 | 2.423 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.545797 Full duration: 28.138857 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 66288f24-8e1e-4fd3-a387-d1e87969c142 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.582 | 1.277 | 2.59 | 2.79 | 3.709 | 1.517 | 100.0% | 40 | | neutron.delete_network | 0.656 | 1.497 | 2.645 | 2.773 | 3.539 | 1.652 | 100.0% | 40 | | total | 1.432 | 3.071 | 4.407 | 4.748 | 6.12 | 3.171 | 100.0% | 40 | | -> duration | 1.432 | 3.071 | 4.407 | 4.748 | 6.12 | 3.171 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.260774 Full duration: 17.887974 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": { "subnets_per_network": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 66288f24-8e1e-4fd3-a387-d1e87969c142 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.536 | 1.032 | 2.315 | 2.37 | 2.395 | 1.31 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.64 | 3.954 | 5.678 | 7.018 | 7.932 | 3.863 | 100.0% | 40 | | neutron.list_subnets | 0.148 | 0.297 | 1.461 | 1.502 | 1.569 | 0.536 | 100.0% | 40 | | total | 3.333 | 5.234 | 8.321 | 9.222 | 10.131 | 5.71 | 100.0% | 40 | | -> duration | 3.333 | 5.234 | 8.321 | 9.222 | 10.131 | 5.71 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.397262 Full duration: 48.013827 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "runner": { "concurrency": 20, "times": 100 }, "contexts": { "users": { "users_per_tenant": 5, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_create_args": {}, "subnet_update_args": { "name": "_subnet_updated", "enable_dhcp": true } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 66288f24-8e1e-4fd3-a387-d1e87969c142 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.433 | 1.059 | 2.014 | 2.116 | 3.494 | 1.175 | 100.0% | 100 | | neutron.create_subnet (x2) | 1.645 | 3.939 | 6.318 | 6.825 | 14.108 | 4.319 | 100.0% | 100 | | neutron.update_subnet (x2) | 1.014 | 2.559 | 3.64 | 4.286 | 7.159 | 2.499 | 100.0% | 100 | | total | 4.282 | 7.611 | 10.487 | 12.091 | 19.794 | 7.993 | 100.0% | 100 | | -> duration | 4.282 | 7.611 | 10.487 | 12.091 | 19.794 | 7.993 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 44.117938 Full duration: 113.363068 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 66288f24-8e1e-4fd3-a387-d1e87969c142 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.483 | 0.956 | 2.082 | 2.144 | 3.399 | 1.211 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.682 | 4.345 | 6.669 | 7.107 | 7.704 | 4.382 | 100.0% | 40 | | neutron.delete_subnet (x2) | 1.269 | 2.852 | 4.251 | 5.479 | 6.597 | 2.906 | 100.0% | 40 | | total | 4.758 | 8.234 | 12.518 | 16.001 | 17.545 | 8.668 | 100.0% | 40 | | -> duration | 4.758 | 8.234 | 12.518 | 16.001 | 17.545 | 8.668 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.46237 Full duration: 40.230502 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": null, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": null, "router_create_args": null }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 66288f24-8e1e-4fd3-a387-d1e87969c142 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.402 | 0.924 | 1.48 | 1.615 | 2.617 | 1.006 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.766 | 4.352 | 8.161 | 9.328 | 9.919 | 4.925 | 100.0% | 40 | | neutron.create_router (x2) | 0.222 | 0.446 | 1.057 | 1.613 | 2.285 | 0.605 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.862 | 12.176 | 22.896 | 23.345 | 23.811 | 13.539 | 100.0% | 40 | | neutron.list_routers | 0.211 | 0.506 | 1.341 | 1.439 | 1.616 | 0.64 | 100.0% | 40 | | total | 9.625 | 18.325 | 32.514 | 35.074 | 35.602 | 20.717 | 100.0% | 40 | | -> duration | 9.625 | 18.325 | 32.514 | 35.074 | 35.602 | 20.717 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 57.017069 Full duration: 138.379969 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "subnets_per_network": 2, "subnet_cidr_start": "1.1.0.0/30", "network_create_args": {}, "subnet_create_args": {}, "router_update_args": { "name": "_router_updated", "admin_state_up": false }, "router_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 66288f24-8e1e-4fd3-a387-d1e87969c142 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.385 | 1.005 | 1.959 | 2.281 | 2.319 | 1.107 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.549 | 3.795 | 6.619 | 7.793 | 8.782 | 4.069 | 100.0% | 40 | | neutron.create_router (x2) | 0.193 | 0.412 | 1.221 | 1.467 | 1.716 | 0.566 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.065 | 10.224 | 19.16 | 26.863 | 26.89 | 11.811 | 100.0% | 40 | | neutron.update_router (x2) | 1.371 | 3.133 | 6.303 | 6.472 | 6.982 | 3.424 | 100.0% | 40 | | total | 11.306 | 18.467 | 32.637 | 43.494 | 44.425 | 20.98 | 100.0% | 40 | | -> duration | 11.306 | 18.467 | 32.637 | 43.494 | 44.425 | 20.98 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 56.828969 Full duration: 146.001247 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": {}, "router_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 66288f24-8e1e-4fd3-a387-d1e87969c142 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.44 | 1.116 | 2.008 | 2.214 | 2.858 | 1.2 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.449 | 3.92 | 6.208 | 6.34 | 6.876 | 3.941 | 100.0% | 40 | | neutron.create_router (x2) | 0.206 | 0.454 | 1.479 | 1.84 | 1.959 | 0.611 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.523 | 10.811 | 16.468 | 16.544 | 18.096 | 10.707 | 100.0% | 40 | | neutron.remove_interface_router (x2) | 3.865 | 9.252 | 14.875 | 16.116 | 17.363 | 9.65 | 100.0% | 40 | | neutron.delete_router (x2) | 0.846 | 1.922 | 3.76 | 3.825 | 4.298 | 2.073 | 100.0% | 40 | | total | 16.591 | 28.896 | 42.448 | 43.786 | 45.291 | 28.183 | 100.0% | 40 | | -> duration | 16.591 | 28.896 | 42.448 | 43.786 | 45.291 | 28.183 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 65.769612 Full duration: 109.67183 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 8 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "port": 811, "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": null, "ports_per_network": 50, "port_create_args": null }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 66288f24-8e1e-4fd3-a387-d1e87969c142 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.39 | 0.741 | 1.365 | 1.552 | 1.739 | 0.84 | 100.0% | 8 | | neutron.create_port (x50) | 45.996 | 49.796 | 61.528 | 63.262 | 64.997 | 52.604 | 100.0% | 8 | | neutron.list_ports | 0.57 | 0.835 | 1.295 | 1.399 | 1.503 | 0.908 | 100.0% | 8 | | total | 47.404 | 51.835 | 63.361 | 65.387 | 67.413 | 54.382 | 100.0% | 8 | | -> duration | 47.404 | 51.835 | 63.361 | 65.387 | 67.413 | 54.382 | 100.0% | 8 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 114.889581 Full duration: 189.167254 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "ports_per_network": 5, "port_create_args": {}, "port_update_args": { "device_owner": "dummy_owner", "device_id": "dummy_id", "name": "_port_updated", "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 66288f24-8e1e-4fd3-a387-d1e87969c142 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.481 | 1.235 | 2.11 | 2.238 | 2.438 | 1.314 | 100.0% | 40 | | neutron.create_port (x5) | 4.039 | 8.965 | 16.971 | 17.682 | 19.243 | 10.235 | 100.0% | 40 | | neutron.update_port (x5) | 2.456 | 4.87 | 9.179 | 10.306 | 12.158 | 5.761 | 100.0% | 40 | | total | 9.54 | 15.527 | 27.378 | 27.627 | 27.925 | 17.514 | 100.0% | 40 | | -> duration | 9.54 | 15.527 | 27.378 | 27.627 | 27.925 | 17.514 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 47.239008 Full duration: 103.369073 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "ports_per_network": 5, "port_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 66288f24-8e1e-4fd3-a387-d1e87969c142 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.54 | 0.997 | 2.044 | 2.094 | 2.303 | 1.147 | 100.0% | 40 | | neutron.create_port (x5) | 4.082 | 7.886 | 12.947 | 13.292 | 14.251 | 8.307 | 100.0% | 40 | | neutron.delete_port (x5) | 2.892 | 6.277 | 8.619 | 9.296 | 10.974 | 6.161 | 100.0% | 40 | | total | 8.113 | 15.939 | 23.161 | 23.874 | 24.115 | 15.772 | 100.0% | 40 | | -> duration | 8.113 | 15.939 | 23.161 | 23.874 | 24.115 | 15.772 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 40.146038 Full duration: 57.606543 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 20 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 66288f24-8e1e-4fd3-a387-d1e87969c142 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.212 | 0.7 | 1.162 | 1.463 | 1.787 | 0.777 | 100.0% | 40 | | total | 0.572 | 1.496 | 1.913 | 1.971 | 2.376 | 1.484 | 100.0% | 40 | | -> duration | 0.572 | 1.496 | 1.913 | 1.971 | 2.376 | 1.484 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.824777 Full duration: 54.589954 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunks args position 0 args values: { "runner": { "concurrency": 4, "times": 4 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "args": { "subport_count": 125 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 66288f24-8e1e-4fd3-a387-d1e87969c142 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.007 | 1.519 | 2.041 | 2.044 | 2.047 | 1.523 | 100.0% | 4 | | neutron.create_port (x126) | 129.708 | 193.307 | 234.413 | 234.434 | 234.455 | 187.694 | 100.0% | 4 | | neutron.create_trunk | 12.318 | 17.703 | 21.885 | 22.008 | 22.131 | 17.464 | 100.0% | 4 | | neutron.update_port | 2.333 | 3.091 | 3.676 | 3.734 | 3.791 | 3.077 | 100.0% | 4 | | neutron.list_trunks | 0.089 | 0.141 | 0.33 | 0.367 | 0.404 | 0.194 | 100.0% | 4 | | neutron.list_subports_by_trunk | 0.094 | 0.146 | 0.239 | 0.253 | 0.267 | 0.164 | 100.0% | 4 | | neutron.list_ports_by_device_id | 0.364 | 0.843 | 1.653 | 1.749 | 1.846 | 0.974 | 100.0% | 4 | | total | 145.936 | 216.905 | 264.16 | 264.435 | 264.71 | 211.114 | 100.0% | 4 | | -> duration | 145.936 | 216.905 | 264.16 | 264.435 | 264.71 | 211.114 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 264.74826 Full duration: 359.232753 HINTS: * To plot HTML graphics with this data, run: rally task report 66288f24-8e1e-4fd3-a387-d1e87969c142 --out output.html * To generate a JUnit report, run: rally task export 66288f24-8e1e-4fd3-a387-d1e87969c142 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 66288f24-8e1e-4fd3-a387-d1e87969c142 --json --out output.json 2021-02-04 15:06:55,932 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 66288f24-8e1e-4fd3-a387-d1e87969c142 --out /home/opnfv/functest/results/rally_jobs/neutron.json 2021-02-04 15:06:57,075 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2021-02-04 15:06:57,084 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 00:24:13 | 612 | 100.00% | | | | | | | TOTAL: | 00:24:13 | 612 | 100.00% | +-----------+------------+----------------+-----------+ 2021-02-04 15:06:57,085 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs' success_rate is 100.00% in 1/1 modules 2021-02-04 15:07:22,877 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.html 2021-02-04 15:07:44,207 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.xml 2021-02-04 15:07:44,210 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_jobs | functest | 27:59 | PASS | +--------------------+------------------+------------------+----------------+