2021-01-28 14:43:45,029 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+-----------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+-----------------------------------------------------------+ | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_DST_URL | s3://artifacts.opnfv.org/functest/0DPQB1CNUH2W | | | /functest-pi-ollivier-functest-benchmarking-arm64 | | | -hunter-rally_jobs-run-20 | | S3_ENDPOINT_URL | https://storage.googleapis.com | | DEPLOY_SCENARIO | os-nosdn-nofeature-noha | | BUILD_TAG | 0DPQB1CNUH2W | | DEBUG | true | | INSTALLER_TYPE | unknown | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | HTTP_DST_URL | http://artifacts.opnfv.org/functest/0DPQB1CNUH2W | | | /functest-pi-ollivier-functest-benchmarking-arm64 | | | -hunter-rally_jobs-run-20 | | NODE_NAME | lf-virtual6 | +-------------------------+-----------------------------------------------------------+ 2021-01-28 14:43:45,224 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs'... 2021-01-28 14:43:51,960 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs'... 2021-01-28 14:44:02,463 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2021-01-28 14:44:40,474 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 75d194cb-03a5-42b6-a113-9f08c2b1f2f4 | 2021-01-28T14:44:39.747626 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 75d194cb-03a5-42b6-a113-9f08c2b1f2f4 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2021-01-28 14:45:00,262 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | compute_legacy | Available | | __unknown__ | placement | Available | | barbican | key-manager | Available | | cinder | block-storage | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2021-01-28 14:45:09,562 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2021-01-28 15:08:55,201 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 0fb75521-d727-44f6-92b4-36236f58f7b0 2021-01-28 15:09:05,383 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 0fb75521-d727-44f6-92b4-36236f58f7b0 -------------------------------------------------------------------------------- Task 0fb75521-d727-44f6-92b4-36236f58f7b0: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 20, "times": 100 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": 119 } } }, "args": {}, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0fb75521-d727-44f6-92b4-36236f58f7b0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.998 | 2.26 | 4.532 | 5.396 | 6.469 | 2.682 | 100.0% | 100 | | neutron.list_networks | 0.258 | 0.853 | 2.099 | 2.333 | 3.05 | 1.059 | 100.0% | 100 | | total | 1.425 | 3.347 | 6.263 | 7.204 | 7.875 | 3.742 | 100.0% | 100 | | -> duration | 1.425 | 3.347 | 6.263 | 7.204 | 7.875 | 3.742 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.398965 Full duration: 54.079142 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {}, "network_update_args": { "name": "_updated", "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0fb75521-d727-44f6-92b4-36236f58f7b0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.653 | 1.405 | 2.258 | 2.423 | 2.849 | 1.571 | 100.0% | 40 | | neutron.update_network | 0.443 | 0.732 | 1.703 | 1.745 | 1.825 | 0.941 | 100.0% | 40 | | total | 1.661 | 2.503 | 3.211 | 3.373 | 3.511 | 2.512 | 100.0% | 40 | | -> duration | 1.661 | 2.503 | 3.211 | 3.373 | 3.511 | 2.512 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.10613 Full duration: 26.537317 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0fb75521-d727-44f6-92b4-36236f58f7b0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.551 | 1.223 | 1.999 | 2.174 | 2.551 | 1.353 | 100.0% | 40 | | neutron.delete_network | 0.741 | 1.541 | 2.235 | 2.278 | 2.524 | 1.586 | 100.0% | 40 | | total | 1.7 | 3.026 | 3.617 | 3.663 | 3.986 | 2.939 | 100.0% | 40 | | -> duration | 1.7 | 3.026 | 3.617 | 3.663 | 3.986 | 2.939 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.582471 Full duration: 16.517314 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": { "subnets_per_network": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0fb75521-d727-44f6-92b4-36236f58f7b0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.656 | 1.159 | 1.732 | 1.888 | 2.237 | 1.219 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.984 | 3.601 | 5.385 | 5.548 | 6.272 | 3.787 | 100.0% | 40 | | neutron.list_subnets | 0.157 | 0.329 | 0.558 | 1.041 | 1.254 | 0.402 | 100.0% | 40 | | total | 3.958 | 5.544 | 6.784 | 7.404 | 7.805 | 5.41 | 100.0% | 40 | | -> duration | 3.958 | 5.544 | 6.784 | 7.404 | 7.805 | 5.41 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.929759 Full duration: 46.94154 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "runner": { "concurrency": 20, "times": 100 }, "contexts": { "users": { "users_per_tenant": 5, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_create_args": {}, "subnet_update_args": { "name": "_subnet_updated", "enable_dhcp": true } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0fb75521-d727-44f6-92b4-36236f58f7b0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.457 | 1.043 | 1.967 | 2.069 | 2.502 | 1.176 | 100.0% | 100 | | neutron.create_subnet (x2) | 1.582 | 3.686 | 5.635 | 6.167 | 7.793 | 3.846 | 100.0% | 100 | | neutron.update_subnet (x2) | 1.001 | 2.439 | 3.156 | 3.731 | 5.504 | 2.35 | 100.0% | 100 | | total | 4.136 | 7.239 | 9.778 | 11.487 | 13.025 | 7.373 | 100.0% | 100 | | -> duration | 4.136 | 7.239 | 9.778 | 11.487 | 13.025 | 7.373 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 42.806703 Full duration: 108.241702 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0fb75521-d727-44f6-92b4-36236f58f7b0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.405 | 0.941 | 1.828 | 2.273 | 2.747 | 1.059 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.421 | 4.736 | 7.375 | 7.871 | 8.43 | 4.891 | 100.0% | 40 | | neutron.delete_subnet (x2) | 1.047 | 2.729 | 4.243 | 4.712 | 5.037 | 2.815 | 100.0% | 40 | | total | 3.896 | 8.392 | 12.889 | 14.49 | 14.571 | 8.945 | 100.0% | 40 | | -> duration | 3.896 | 8.392 | 12.889 | 14.49 | 14.571 | 8.945 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.756072 Full duration: 39.119286 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": null, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": null, "router_create_args": null }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0fb75521-d727-44f6-92b4-36236f58f7b0 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.337 | 0.92 | 1.492 | 1.687 | 1.923 | 0.958 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.625 | 4.485 | 6.817 | 7.46 | 9.242 | 4.528 | 100.0% | 40 | | neutron.create_router (x2) | 0.223 | 0.404 | 1.167 | 1.508 | 1.859 | 0.643 | 100.0% | 40 | | neutron.add_interface_router (x2) | 6.232 | 11.672 | 16.047 | 17.751 | 19.859 | 11.652 | 100.0% | 40 | | neutron.list_routers | 0.201 | 0.433 | 1.26 | 1.271 | 1.329 | 0.627 | 100.0% | 40 | | total | 9.993 | 18.319 | 23.272 | 29.798 | 31.941 | 18.41 | 100.0% | 40 | | -> duration | 9.993 | 18.319 | 23.272 | 29.798 | 31.941 | 18.41 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 46.096747 Full duration: 130.807352 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "subnets_per_network": 2, "subnet_cidr_start": "1.1.0.0/30", "network_create_args": {}, "subnet_create_args": {}, "router_update_args": { "name": "_router_updated", "admin_state_up": false }, "router_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0fb75521-d727-44f6-92b4-36236f58f7b0 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.455 | 1.227 | 2.255 | 2.334 | 2.712 | 1.296 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.556 | 3.867 | 5.469 | 5.719 | 5.747 | 3.857 | 100.0% | 40 | | neutron.create_router (x2) | 0.179 | 0.348 | 1.32 | 1.731 | 2.276 | 0.56 | 100.0% | 40 | | neutron.add_interface_router (x2) | 6.141 | 10.812 | 16.605 | 16.706 | 17.651 | 10.771 | 100.0% | 40 | | neutron.update_router (x2) | 1.333 | 3.304 | 5.564 | 5.635 | 5.91 | 3.425 | 100.0% | 40 | | total | 10.878 | 20.346 | 30.475 | 30.745 | 31.05 | 19.912 | 100.0% | 40 | | -> duration | 10.878 | 20.346 | 30.475 | 30.745 | 31.05 | 19.912 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 51.344768 Full duration: 135.352886 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": {}, "router_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0fb75521-d727-44f6-92b4-36236f58f7b0 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.501 | 1.432 | 2.047 | 2.697 | 3.045 | 1.364 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.446 | 3.832 | 5.864 | 6.125 | 6.941 | 4.005 | 100.0% | 40 | | neutron.create_router (x2) | 0.184 | 0.427 | 0.823 | 1.335 | 1.78 | 0.535 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.971 | 10.753 | 16.157 | 16.339 | 17.107 | 11.03 | 100.0% | 40 | | neutron.remove_interface_router (x2) | 4.585 | 9.78 | 14.635 | 15.244 | 15.43 | 9.71 | 100.0% | 40 | | neutron.delete_router (x2) | 0.801 | 2.151 | 2.969 | 3.363 | 4.792 | 2.182 | 100.0% | 40 | | total | 15.711 | 27.414 | 42.179 | 42.901 | 43.925 | 28.828 | 100.0% | 40 | | -> duration | 15.711 | 27.414 | 42.179 | 42.901 | 43.925 | 28.828 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 71.97068 Full duration: 111.140624 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 8 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "port": 811, "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": null, "ports_per_network": 50, "port_create_args": null }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0fb75521-d727-44f6-92b4-36236f58f7b0 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.472 | 0.841 | 1.251 | 1.423 | 1.595 | 0.861 | 100.0% | 8 | | neutron.create_port (x50) | 43.199 | 45.043 | 48.06 | 49.699 | 51.338 | 45.684 | 100.0% | 8 | | neutron.list_ports | 0.48 | 1.076 | 1.645 | 1.69 | 1.736 | 1.09 | 100.0% | 8 | | total | 45.423 | 46.843 | 50.531 | 52.612 | 54.694 | 47.66 | 100.0% | 8 | | -> duration | 45.423 | 46.843 | 50.531 | 52.612 | 54.694 | 47.66 | 100.0% | 8 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 101.478592 Full duration: 173.570026 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "ports_per_network": 5, "port_create_args": {}, "port_update_args": { "device_owner": "dummy_owner", "device_id": "dummy_id", "name": "_port_updated", "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0fb75521-d727-44f6-92b4-36236f58f7b0 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.402 | 1.189 | 2.025 | 2.259 | 2.382 | 1.3 | 100.0% | 40 | | neutron.create_port (x5) | 4.803 | 8.736 | 13.421 | 17.978 | 20.596 | 9.663 | 100.0% | 40 | | neutron.update_port (x5) | 2.702 | 5.661 | 10.962 | 13.163 | 13.878 | 6.652 | 100.0% | 40 | | total | 9.627 | 16.045 | 22.638 | 33.823 | 34.743 | 17.793 | 100.0% | 40 | | -> duration | 9.627 | 16.045 | 22.638 | 33.823 | 34.743 | 17.793 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 51.051793 Full duration: 108.310549 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "ports_per_network": 5, "port_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0fb75521-d727-44f6-92b4-36236f58f7b0 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.409 | 1.076 | 2.12 | 2.281 | 2.361 | 1.131 | 100.0% | 40 | | neutron.create_port (x5) | 4.298 | 7.333 | 12.938 | 15.078 | 17.524 | 8.279 | 100.0% | 40 | | neutron.delete_port (x5) | 2.975 | 5.81 | 9.562 | 11.043 | 12.882 | 6.374 | 100.0% | 40 | | total | 8.41 | 14.054 | 23.744 | 29.191 | 29.668 | 15.966 | 100.0% | 40 | | -> duration | 8.41 | 14.054 | 23.744 | 29.191 | 29.668 | 15.966 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 39.241905 Full duration: 57.875858 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 20 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0fb75521-d727-44f6-92b4-36236f58f7b0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.213 | 0.479 | 0.802 | 0.814 | 0.951 | 0.507 | 100.0% | 40 | | total | 0.524 | 1.038 | 1.522 | 1.593 | 1.781 | 1.079 | 100.0% | 40 | | -> duration | 0.524 | 1.038 | 1.522 | 1.593 | 1.781 | 1.079 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.098589 Full duration: 48.261503 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunks args position 0 args values: { "runner": { "concurrency": 4, "times": 4 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "args": { "subport_count": 125 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0fb75521-d727-44f6-92b4-36236f58f7b0 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.09 | 1.255 | 1.31 | 1.321 | 1.332 | 1.233 | 100.0% | 4 | | neutron.create_port (x126) | 113.005 | 151.027 | 185.523 | 185.562 | 185.601 | 150.165 | 100.0% | 4 | | neutron.create_trunk | 10.394 | 15.607 | 19.402 | 19.451 | 19.5 | 15.277 | 100.0% | 4 | | neutron.update_port | 1.445 | 2.17 | 2.645 | 2.679 | 2.712 | 2.124 | 100.0% | 4 | | neutron.list_trunks | 0.074 | 0.145 | 0.275 | 0.294 | 0.313 | 0.169 | 100.0% | 4 | | neutron.list_subports_by_trunk | 0.077 | 0.145 | 0.613 | 0.705 | 0.797 | 0.291 | 100.0% | 4 | | neutron.list_ports_by_device_id | 0.353 | 0.827 | 4.028 | 4.682 | 5.336 | 1.836 | 100.0% | 4 | | total | 128.765 | 170.798 | 213.131 | 213.623 | 214.116 | 171.119 | 100.0% | 4 | | -> duration | 128.765 | 170.798 | 213.131 | 213.623 | 214.116 | 171.119 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 214.229847 Full duration: 307.56833 HINTS: * To plot HTML graphics with this data, run: rally task report 0fb75521-d727-44f6-92b4-36236f58f7b0 --out output.html * To generate a JUnit report, run: rally task export 0fb75521-d727-44f6-92b4-36236f58f7b0 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 0fb75521-d727-44f6-92b4-36236f58f7b0 --json --out output.json 2021-01-28 15:09:27,621 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 0fb75521-d727-44f6-92b4-36236f58f7b0 --out /home/opnfv/functest/results/rally_jobs/neutron.json 2021-01-28 15:09:28,621 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2021-01-28 15:09:28,629 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 00:22:44 | 612 | 100.00% | | | | | | | TOTAL: | 00:22:44 | 612 | 100.00% | +-----------+------------+----------------+-----------+ 2021-01-28 15:09:28,630 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs' success_rate is 100.00% in 1/1 modules 2021-01-28 15:09:53,796 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.html 2021-01-28 15:10:15,754 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.xml 2021-01-28 15:10:15,756 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_jobs | functest | 26:23 | PASS | +--------------------+------------------+------------------+----------------+