2020-12-14 04:13:25,188 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | os-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 0I16SBIIWHLB | | NODE_NAME | lf-virtual9 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest/0I16SBIIWHLB/fun | | | ctest-pi-ollivier-functest-benchmarking-arm- | | | latest-rally_jobs-run-2 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest/0I16SBIIWHLB/f | | | unctest-pi-ollivier-functest-benchmarking-arm- | | | latest-rally_jobs-run-2 | +-------------------------+------------------------------------------------------------+ 2020-12-14 04:13:25,424 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs'... 2020-12-14 04:13:35,464 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs'... 2020-12-14 04:13:44,128 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2020-12-14 04:15:01,638 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 0eb825d5-49cc-41fc-a764-fdd86179ed98 | 2020-12-14T04:15:00.440864 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 0eb825d5-49cc-41fc-a764-fdd86179ed98 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-12-14 04:15:42,372 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | compute_legacy | Available | | __unknown__ | event | Available | | __unknown__ | placement | Available | | barbican | key-manager | Available | | cinder | block-storage | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-12-14 04:16:00,220 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-12-14 05:04:57,332 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 2020-12-14 05:05:16,131 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": {}, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": 119 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.462 | 5.037 | 8.462 | 9.408 | 13.932 | 5.537 | 100.0% | 100 | | neutron.list_networks | 0.484 | 1.394 | 2.404 | 4.09 | 5.902 | 1.576 | 100.0% | 100 | | total | 4.235 | 6.412 | 10.32 | 11.004 | 15.245 | 7.119 | 100.0% | 100 | | -> duration | 4.235 | 6.412 | 10.32 | 11.004 | 15.245 | 7.119 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 44.316876 Full duration: 84.644476 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.731 | 3.919 | 5.652 | 7.202 | 10.22 | 4.348 | 100.0% | 40 | | neutron.update_network | 0.381 | 1.016 | 1.685 | 1.901 | 5.976 | 1.257 | 100.0% | 40 | | total | 3.177 | 4.972 | 8.402 | 9.465 | 11.473 | 5.608 | 100.0% | 40 | | -> duration | 3.177 | 4.972 | 8.402 | 9.465 | 11.473 | 5.608 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.963215 Full duration: 39.197322 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "args": {}, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.21 | 4.339 | 5.908 | 8.408 | 9.503 | 4.663 | 100.0% | 40 | | neutron.delete_network | 0.746 | 1.395 | 5.767 | 6.9 | 7.389 | 2.182 | 100.0% | 40 | | total | 4.257 | 6.068 | 10.585 | 11.08 | 11.312 | 6.848 | 100.0% | 40 | | -> duration | 4.257 | 6.068 | 10.585 | 11.08 | 11.312 | 6.848 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.267425 Full duration: 29.601906 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.16 | 3.612 | 6.434 | 7.982 | 9.883 | 4.149 | 100.0% | 40 | | neutron.create_subnet (x2) | 2.213 | 4.561 | 9.331 | 10.929 | 11.199 | 5.221 | 100.0% | 40 | | neutron.list_subnets | 0.297 | 0.742 | 1.093 | 1.175 | 1.535 | 0.716 | 100.0% | 40 | | total | 5.992 | 8.751 | 15.926 | 18.101 | 20.124 | 10.092 | 100.0% | 40 | | -> duration | 5.992 | 8.751 | 15.926 | 18.101 | 20.124 | 10.092 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.635913 Full duration: 76.97184 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_update_args": { "enable_dhcp": true } }, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 5 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.115 | 3.191 | 8.171 | 9.486 | 20.901 | 4.306 | 100.0% | 100 | | neutron.create_subnet (x2) | 2.578 | 5.364 | 11.102 | 11.54 | 12.43 | 6.312 | 100.0% | 100 | | neutron.update_subnet (x2) | 0.987 | 3.054 | 8.78 | 9.695 | 10.034 | 4.054 | 100.0% | 100 | | total | 6.577 | 14.321 | 21.332 | 22.262 | 27.578 | 14.68 | 100.0% | 100 | | -> duration | 6.577 | 14.321 | 21.332 | 22.262 | 27.578 | 14.68 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 85.122435 Full duration: 193.634176 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.899 | 3.047 | 7.541 | 10.946 | 12.683 | 4.173 | 100.0% | 40 | | neutron.create_subnet (x2) | 3.372 | 7.803 | 11.346 | 12.408 | 13.799 | 7.748 | 100.0% | 40 | | neutron.delete_subnet (x2) | 1.203 | 4.883 | 9.748 | 10.059 | 11.374 | 5.378 | 100.0% | 40 | | total | 7.641 | 17.256 | 23.536 | 24.568 | 30.0 | 17.807 | 100.0% | 40 | | -> duration | 7.641 | 17.256 | 23.536 | 24.568 | 30.0 | 17.807 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 46.434884 Full duration: 70.214237 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "args": { "network_create_args": null, "subnet_create_args": null, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": null }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.073 | 3.317 | 7.97 | 9.749 | 11.693 | 4.064 | 100.0% | 40 | | neutron.create_router (x2) | 0.703 | 2.045 | 3.57 | 7.109 | 8.187 | 2.523 | 100.0% | 40 | | neutron.create_subnet (x2) | 7.065 | 23.858 | 36.243 | 40.22 | 42.887 | 25.583 | 100.0% | 40 | | -> neutron.add_interface_router (x2) | 4.815 | 17.932 | 26.28 | 29.278 | 33.592 | 17.812 | 100.0% | 40 | | neutron.list_routers | 0.318 | 0.677 | 2.001 | 5.635 | 6.513 | 1.259 | 100.0% | 40 | | total | 9.787 | 32.999 | 43.858 | 49.529 | 50.053 | 33.439 | 100.0% | 40 | | -> duration | 9.787 | 32.999 | 43.858 | 49.529 | 50.053 | 33.439 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 82.036339 Full duration: 204.931266 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {}, "router_update_args": { "admin_state_up": false } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.236 | 3.163 | 17.469 | 19.828 | 27.484 | 6.085 | 100.0% | 40 | | neutron.create_router (x2) | 0.999 | 1.515 | 2.494 | 2.93 | 6.817 | 1.882 | 100.0% | 40 | | neutron.create_subnet (x2) | 8.37 | 22.288 | 33.969 | 35.615 | 37.429 | 23.192 | 100.0% | 40 | | -> neutron.add_interface_router (x2) | 6.314 | 16.15 | 27.235 | 27.541 | 29.362 | 16.617 | 100.0% | 40 | | neutron.update_router (x2) | 1.441 | 4.519 | 8.062 | 9.734 | 11.657 | 4.859 | 100.0% | 40 | | total | 17.726 | 35.42 | 49.085 | 56.721 | 62.351 | 36.028 | 100.0% | 40 | | -> duration | 17.726 | 35.42 | 49.085 | 56.721 | 62.351 | 36.028 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 90.989444 Full duration: 213.345474 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {} }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.935 | 2.529 | 7.859 | 14.72 | 27.874 | 4.387 | 100.0% | 40 | | neutron.create_router (x2) | 0.687 | 1.844 | 3.489 | 4.424 | 8.255 | 2.18 | 100.0% | 40 | | neutron.create_subnet (x2) | 7.442 | 21.562 | 45.81 | 49.992 | 52.38 | 25.286 | 100.0% | 40 | | -> neutron.add_interface_router (x2) | 5.045 | 15.966 | 33.729 | 35.436 | 36.002 | 17.913 | 100.0% | 40 | | neutron.remove_interface_router (x2) | 3.626 | 14.605 | 32.003 | 33.09 | 33.171 | 16.547 | 100.0% | 40 | | neutron.delete_router (x2) | 0.876 | 2.115 | 8.89 | 10.257 | 10.419 | 3.4 | 100.0% | 40 | | total | 16.947 | 42.305 | 93.664 | 104.075 | 104.48 | 51.809 | 100.0% | 40 | | -> duration | 16.947 | 42.305 | 93.664 | 104.075 | 104.48 | 51.809 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +---------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 126.273017 Full duration: 183.673241 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 50 }, "runner": { "times": 8, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1, "port": 811 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.685 | 1.141 | 2.359 | 2.692 | 3.024 | 1.391 | 100.0% | 8 | | neutron.create_port (x50) | 40.778 | 52.24 | 117.446 | 117.763 | 118.079 | 73.616 | 100.0% | 8 | | neutron.list_ports | 0.501 | 1.393 | 1.635 | 1.656 | 1.678 | 1.302 | 100.0% | 8 | | total | 42.688 | 54.445 | 121.212 | 121.828 | 122.444 | 76.355 | 100.0% | 8 | | -> duration | 42.688 | 54.445 | 121.212 | 121.828 | 122.444 | 76.355 | 100.0% | 8 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 168.737302 Full duration: 286.406587 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.899 | 3.37 | 8.316 | 11.005 | 21.39 | 4.338 | 100.0% | 40 | | neutron.create_port (x5) | 5.25 | 10.966 | 21.635 | 23.316 | 26.849 | 13.495 | 100.0% | 40 | | neutron.update_port (x5) | 2.823 | 9.153 | 17.169 | 17.696 | 18.013 | 9.623 | 100.0% | 40 | | total | 10.113 | 24.608 | 46.036 | 49.131 | 53.286 | 27.801 | 100.0% | 40 | | -> duration | 10.113 | 24.608 | 46.036 | 49.131 | 53.286 | 27.801 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 64.746092 Full duration: 147.823231 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_bind_ports args position 2 args values: { "args": { "ports_per_network": 5 }, "runner": { "times": 3, "concurrency": 2 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1 } }, "network": {}, "networking_agents": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet (x2) | 2.013 | 2.07 | 2.451 | 2.499 | 2.546 | 2.21 | 100.0% | 3 | | neutron.create_port (x5) | 5.425 | 5.478 | 6.222 | 6.315 | 6.407 | 5.77 | 100.0% | 3 | | neutron.update_port (x5) | 5.501 | 6.175 | 11.705 | 12.397 | 13.088 | 8.254 | 100.0% | 3 | | total | 12.945 | 14.206 | 20.105 | 20.843 | 21.58 | 16.244 | 100.0% | 3 | | -> duration | 12.945 | 14.206 | 20.105 | 20.843 | 21.58 | 16.244 | 100.0% | 3 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 3 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 27.260647 Full duration: 77.235583 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 3 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.154 | 3.109 | 6.549 | 8.13 | 11.36 | 3.577 | 100.0% | 40 | | neutron.create_port (x5) | 5.482 | 10.404 | 20.018 | 22.673 | 29.974 | 12.541 | 100.0% | 40 | | neutron.delete_port (x5) | 3.767 | 9.309 | 17.289 | 24.058 | 25.057 | 10.315 | 100.0% | 40 | | total | 15.341 | 22.548 | 49.746 | 51.149 | 56.895 | 26.835 | 100.0% | 40 | | -> duration | 15.341 | 22.548 | 49.746 | 51.149 | 56.895 | 26.835 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 63.364014 Full duration: 88.675093 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 20, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.49 | 1.204 | 1.638 | 1.747 | 2.044 | 1.206 | 100.0% | 40 | | total | 2.389 | 3.436 | 4.464 | 4.631 | 4.936 | 3.574 | 100.0% | 40 | | -> duration | 2.389 | 3.436 | 4.464 | 4.631 | 4.936 | 3.574 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.533491 Full duration: 63.454139 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunks args position 0 args values: { "args": { "subport_count": 125 }, "runner": { "times": 4, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.536 | 2.366 | 2.94 | 3.06 | 3.179 | 2.362 | 100.0% | 4 | | neutron.create_port (x126) | 105.64 | 156.75 | 199.424 | 199.484 | 199.545 | 154.671 | 100.0% | 4 | | neutron.create_trunk | 7.49 | 11.567 | 14.853 | 14.968 | 15.082 | 11.426 | 100.0% | 4 | | neutron.update_port | 1.74 | 5.3 | 5.669 | 5.713 | 5.757 | 4.524 | 100.0% | 4 | | neutron.list_trunks | 0.079 | 0.112 | 0.173 | 0.182 | 0.192 | 0.124 | 100.0% | 4 | | neutron.list_subports_by_trunk | 0.095 | 0.118 | 0.156 | 0.161 | 0.166 | 0.124 | 100.0% | 4 | | neutron.list_ports | 0.27 | 0.577 | 3.511 | 4.098 | 4.686 | 1.527 | 100.0% | 4 | | total | 121.163 | 177.157 | 223.742 | 223.806 | 223.87 | 174.837 | 100.0% | 4 | | -> duration | 121.163 | 177.157 | 223.742 | 223.806 | 223.87 | 174.837 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 223.996372 Full duration: 370.686746 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_floating_ips args position 0 args values: { "args": { "floating_network": "public", "floating_ip_args": {} }, "runner": { "times": 10, "concurrency": 5 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "floatingip": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_floating_ip | 2.005 | 3.739 | 5.697 | 6.791 | 7.884 | 3.941 | 100.0% | 10 | | -> neutron.list_networks | 0.576 | 1.012 | 1.529 | 1.53 | 1.531 | 1.059 | 100.0% | 10 | | neutron.delete_floating_ip | 0.619 | 0.83 | 1.549 | 3.281 | 5.013 | 1.258 | 100.0% | 10 | | total | 2.71 | 5.564 | 8.188 | 8.382 | 8.577 | 5.199 | 100.0% | 10 | | -> duration | 2.71 | 5.564 | 8.188 | 8.382 | 8.577 | 5.199 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.356824 Full duration: 37.997155 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_floating_ips args position 1 args values: { "args": { "floating_network": "public", "floating_ip_args": {} }, "runner": { "times": 10, "concurrency": 5 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "floatingip": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_floating_ip | 2.118 | 2.591 | 4.053 | 4.247 | 4.44 | 2.922 | 100.0% | 10 | | -> neutron.list_networks | 0.524 | 0.848 | 1.29 | 1.342 | 1.394 | 0.915 | 100.0% | 10 | | neutron.list_floating_ips | 0.107 | 0.13 | 0.177 | 0.177 | 0.178 | 0.136 | 100.0% | 10 | | total | 2.226 | 2.725 | 4.23 | 4.424 | 4.618 | 3.059 | 100.0% | 10 | | -> duration | 2.226 | 2.725 | 4.23 | 4.424 | 4.618 | 3.059 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.073429 Full duration: 34.530095 -------------------------------------------------------------------------------- test scenario NeutronNetworks.associate_and_dissociate_floating_ips args position 2 args values: { "args": { "floating_network": "public" }, "runner": { "times": 10, "concurrency": 5 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "floatingip": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.list_networks | 0.524 | 0.85 | 1.289 | 1.325 | 1.361 | 0.886 | 100.0% | 10 | | neutron.create_floating_ip | 1.44 | 1.838 | 2.699 | 2.947 | 3.195 | 1.997 | 100.0% | 10 | | neutron.create_network | 0.352 | 0.499 | 0.601 | 0.751 | 0.901 | 0.511 | 100.0% | 10 | | neutron.create_subnet | 0.753 | 0.97 | 2.372 | 4.119 | 5.866 | 1.606 | 100.0% | 10 | | neutron.create_port | 1.062 | 1.205 | 1.721 | 1.735 | 1.75 | 1.296 | 100.0% | 10 | | neutron.create_router | 0.264 | 0.309 | 0.435 | 0.444 | 0.454 | 0.337 | 100.0% | 10 | | neutron.add_gateway_router | 1.573 | 1.77 | 3.114 | 3.258 | 3.402 | 2.077 | 100.0% | 10 | | neutron.add_interface_router | 2.416 | 2.582 | 4.616 | 5.987 | 7.358 | 3.361 | 100.0% | 10 | | neutron.associate_floating_ip | 1.16 | 1.292 | 7.019 | 7.055 | 7.09 | 2.425 | 100.0% | 10 | | -> neutron.update_floating_ip | 1.16 | 1.292 | 7.018 | 7.054 | 7.09 | 2.425 | 100.0% | 10 | | neutron.dissociate_floating_ip | 0.789 | 0.82 | 1.175 | 1.3 | 1.425 | 0.923 | 100.0% | 10 | | -> neutron.update_floating_ip | 0.789 | 0.82 | 1.174 | 1.3 | 1.425 | 0.923 | 100.0% | 10 | | total | 10.731 | 12.253 | 24.673 | 24.821 | 24.969 | 15.424 | 100.0% | 10 | | -> duration | 10.731 | 12.253 | 24.673 | 24.821 | 24.969 | 15.424 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 36.938187 Full duration: 106.25466 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.147 | 2.151 | 3.032 | 3.493 | 3.607 | 2.252 | 100.0% | 50 | | neutron.create_security_group_rule | 0.304 | 0.7 | 1.0 | 1.098 | 5.817 | 0.83 | 100.0% | 50 | | neutron.delete_security_group_rule | 0.13 | 0.425 | 0.669 | 0.699 | 0.895 | 0.424 | 100.0% | 50 | | neutron.delete_security_group | 0.164 | 0.495 | 0.721 | 0.844 | 1.021 | 0.508 | 100.0% | 50 | | total | 2.257 | 3.853 | 5.285 | 5.496 | 9.719 | 4.022 | 100.0% | 50 | | -> duration | 2.257 | 3.853 | 5.285 | 5.496 | 9.719 | 4.022 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.804035 Full duration: 42.178893 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 1 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.399 | 2.305 | 2.947 | 3.234 | 3.457 | 2.36 | 100.0% | 50 | | neutron.delete_security_group | 0.23 | 0.545 | 0.91 | 1.242 | 5.543 | 0.776 | 100.0% | 50 | | total | 1.71 | 2.881 | 3.841 | 4.043 | 8.395 | 3.144 | 100.0% | 50 | | -> duration | 1.71 | 2.881 | 3.841 | 4.043 | 8.395 | 3.144 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.899067 Full duration: 46.494372 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 2 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {}, "security_group_rules_count": 20 }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.926 | 1.712 | 2.941 | 6.82 | 8.633 | 2.268 | 100.0% | 50 | | neutron.create_security_group_rule (x20) | 8.625 | 15.003 | 21.576 | 25.176 | 26.713 | 15.789 | 100.0% | 50 | | neutron.list_security_group_rules | 0.356 | 0.986 | 1.589 | 1.617 | 5.346 | 1.057 | 100.0% | 50 | | total | 11.159 | 18.3 | 28.801 | 30.56 | 31.499 | 19.364 | 100.0% | 50 | | -> duration | 11.159 | 18.3 | 28.801 | 30.56 | 31.499 | 19.364 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 102.542451 Full duration: 138.885347 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_groups args position 3 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.569 | 2.317 | 3.263 | 5.264 | 8.088 | 2.664 | 100.0% | 50 | | neutron.list_security_groups | 0.157 | 0.646 | 0.773 | 0.892 | 1.11 | 0.605 | 100.0% | 50 | | total | 2.08 | 3.041 | 4.039 | 5.692 | 8.374 | 3.277 | 100.0% | 50 | | -> duration | 2.08 | 3.041 | 4.039 | 5.692 | 8.374 | 3.277 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.194113 Full duration: 55.566836 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group_rule args position 4 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.413 | 2.291 | 2.742 | 2.867 | 3.207 | 2.257 | 100.0% | 50 | | neutron.create_security_group_rule | 0.266 | 0.734 | 1.113 | 1.203 | 1.423 | 0.761 | 100.0% | 50 | | neutron.show_security_group_rule | 0.063 | 0.355 | 0.528 | 0.636 | 0.895 | 0.357 | 100.0% | 50 | | total | 1.793 | 3.408 | 4.097 | 4.353 | 4.902 | 3.387 | 100.0% | 50 | | -> duration | 1.793 | 3.408 | 4.097 | 4.353 | 4.902 | 3.387 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.590377 Full duration: 53.927788 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 5 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.632 | 2.254 | 2.817 | 2.951 | 3.27 | 2.319 | 100.0% | 50 | | neutron.show_security_group | 0.105 | 0.407 | 0.579 | 0.611 | 0.882 | 0.397 | 100.0% | 50 | | total | 2.079 | 2.678 | 3.339 | 3.452 | 3.817 | 2.731 | 100.0% | 50 | | -> duration | 2.079 | 2.678 | 3.339 | 3.452 | 3.817 | 2.731 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.087459 Full duration: 48.509242 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_update_security_groups args position 6 args values: { "args": { "security_group_create_args": {}, "security_group_update_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.75 | 2.439 | 4.798 | 5.706 | 6.21 | 2.688 | 100.0% | 50 | | neutron.update_security_group | 0.128 | 0.487 | 0.656 | 0.68 | 0.939 | 0.461 | 100.0% | 50 | | total | 0.955 | 2.836 | 5.351 | 6.243 | 6.537 | 3.157 | 100.0% | 50 | | -> duration | 0.955 | 2.836 | 5.351 | 6.243 | 6.537 | 3.157 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.88107 Full duration: 50.677514 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "args": { "flavor": { "name": "rally_jobs-flavor_e6e45596-ba9a-44ae-bec6-a5017cb4f039" }, "image": { "name": "rally_jobs-img_e6e45596-ba9a-44ae-bec6-a5017cb4f039" }, "auto_assign_nic": true }, "runner": { "times": 2, "concurrency": 2 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 2 }, "network": {} }, "sla": { "failure_rate": { "max": 100 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 15.285 | 16.081 | 16.717 | 16.797 | 16.877 | 16.081 | 100.0% | 2 | | nova.delete_server | 2.604 | 2.646 | 2.68 | 2.684 | 2.688 | 2.646 | 100.0% | 2 | | total | 17.975 | 18.729 | 19.332 | 19.407 | 19.483 | 18.729 | 100.0% | 2 | | -> duration | 16.975 | 17.729 | 18.332 | 18.407 | 18.483 | 17.729 | 100.0% | 2 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 2 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.506615 Full duration: 62.601799 HINTS: * To plot HTML graphics with this data, run: rally task report 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 --out output.html * To generate a JUnit report, run: rally task export 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 --json --out output.json 2020-12-14 05:06:02,428 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 7614ac04-ddf3-4ef6-ac87-0410f6a8c191 --out /home/opnfv/functest/results/rally_jobs/neutron.json 2020-12-14 05:06:03,516 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2020-12-14 05:06:03,526 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 00:46:48 | 997 | 100.00% | | | | | | | TOTAL: | 00:46:48 | 997 | 100.00% | +-----------+------------+----------------+-----------+ 2020-12-14 05:06:03,527 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs' success_rate is 100.00% in 1/1 modules 2020-12-14 05:06:46,615 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.html 2020-12-14 05:07:30,722 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.xml 2020-12-14 05:07:30,725 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_jobs | functest | 53:55 | PASS | +--------------------+------------------+------------------+----------------+