2020-12-09 13:52:46,233 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | os-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 0MFB3UXXHQ3X | | NODE_NAME | lf-pod4-3 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest/0MFB3UXXHQ3X/fun | | | ctest-opnfv-functest-benchmarking-kali-rally_jobs- | | | run-134 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest/0MFB3UXXHQ3X/f | | | unctest-opnfv-functest-benchmarking-kali- | | | rally_jobs-run-134 | +-------------------------+------------------------------------------------------------+ 2020-12-09 13:52:46,252 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs'... 2020-12-09 13:52:48,876 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs'... 2020-12-09 13:52:57,037 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2020-12-09 13:53:04,422 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | b9a7153e-bd55-4ea5-8a1d-2681f37f9c4a | 2020-12-09T13:53:04.001592 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: b9a7153e-bd55-4ea5-8a1d-2681f37f9c4a ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-12-09 13:53:08,819 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | accelerator | Available | | __unknown__ | alarming | Available | | __unknown__ | compute_legacy | Available | | __unknown__ | event | Available | | __unknown__ | placement | Available | | barbican | key-manager | Available | | cinder | block-storage | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-12-09 13:53:11,044 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-12-09 14:24:31,072 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 8ed3858a-c334-4c60-a87d-399de043c3da 2020-12-09 14:24:33,030 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 8ed3858a-c334-4c60-a87d-399de043c3da -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": {}, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": 119 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.33 | 1.882 | 7.034 | 12.947 | 27.639 | 3.305 | 100.0% | 100 | | neutron.list_networks | 0.125 | 0.357 | 0.924 | 1.116 | 1.908 | 0.472 | 100.0% | 100 | | total | 0.565 | 2.288 | 7.338 | 14.051 | 28.13 | 3.777 | 100.0% | 100 | | -> duration | 0.565 | 2.288 | 7.338 | 14.051 | 28.13 | 3.777 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 28.130196 Full duration: 53.955198 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.324 | 3.203 | 7.467 | 9.47 | 13.249 | 3.994 | 100.0% | 40 | | neutron.update_network | 0.427 | 0.564 | 1.191 | 1.439 | 1.68 | 0.713 | 100.0% | 40 | | total | 0.882 | 3.903 | 8.324 | 10.101 | 13.706 | 4.707 | 100.0% | 40 | | -> duration | 0.882 | 3.903 | 8.324 | 10.101 | 13.706 | 4.707 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.762293 Full duration: 27.7218 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "args": {}, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.36 | 2.578 | 7.09 | 10.15 | 12.744 | 3.246 | 100.0% | 40 | | neutron.delete_network | 0.614 | 0.848 | 1.701 | 1.844 | 1.976 | 1.05 | 100.0% | 40 | | total | 1.121 | 3.403 | 8.379 | 10.842 | 13.359 | 4.296 | 100.0% | 40 | | -> duration | 1.121 | 3.403 | 8.379 | 10.842 | 13.359 | 4.296 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.756001 Full duration: 19.169285 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.327 | 4.115 | 9.635 | 10.418 | 16.896 | 4.866 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.316 | 4.22 | 7.054 | 7.085 | 8.235 | 4.227 | 100.0% | 40 | | neutron.list_subnets | 0.099 | 0.243 | 0.437 | 1.015 | 1.172 | 0.319 | 100.0% | 40 | | total | 1.966 | 8.635 | 15.772 | 16.274 | 22.307 | 9.412 | 100.0% | 40 | | -> duration | 1.966 | 8.635 | 15.772 | 16.274 | 22.307 | 9.412 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.582574 Full duration: 52.362641 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_update_args": { "enable_dhcp": true } }, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 5 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.288 | 1.545 | 4.529 | 6.818 | 22.932 | 2.529 | 100.0% | 100 | | neutron.create_subnet (x2) | 1.489 | 5.484 | 9.424 | 10.05 | 11.061 | 5.565 | 100.0% | 100 | | neutron.update_subnet (x2) | 0.896 | 3.037 | 5.714 | 6.293 | 8.215 | 3.236 | 100.0% | 100 | | total | 4.101 | 10.435 | 18.521 | 19.52 | 28.361 | 11.33 | 100.0% | 100 | | -> duration | 4.101 | 10.435 | 18.521 | 19.52 | 28.361 | 11.33 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 63.245344 Full duration: 121.466385 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.423 | 2.111 | 7.273 | 9.988 | 20.452 | 3.583 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.389 | 3.872 | 8.331 | 9.629 | 10.035 | 4.833 | 100.0% | 40 | | neutron.delete_subnet (x2) | 1.034 | 3.099 | 5.403 | 6.65 | 7.699 | 3.34 | 100.0% | 40 | | total | 4.23 | 10.534 | 19.143 | 19.918 | 28.452 | 11.825 | 100.0% | 40 | | -> duration | 4.23 | 10.534 | 19.143 | 19.918 | 28.452 | 11.825 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 34.110509 Full duration: 50.236042 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "args": { "network_create_args": null, "subnet_create_args": null, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": null }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.492 | 2.696 | 8.522 | 9.363 | 17.082 | 3.966 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.506 | 5.083 | 8.441 | 9.63 | 12.484 | 5.35 | 100.0% | 40 | | neutron.create_router (x2) | 0.172 | 0.795 | 1.954 | 2.402 | 2.852 | 1.059 | 100.0% | 40 | | neutron.add_interface_router (x2) | 6.244 | 13.485 | 25.643 | 26.616 | 27.586 | 15.675 | 100.0% | 40 | | neutron.list_routers | 0.161 | 0.49 | 1.531 | 1.65 | 1.947 | 0.72 | 100.0% | 40 | | total | 9.528 | 23.587 | 43.177 | 45.62 | 48.904 | 26.772 | 100.0% | 40 | | -> duration | 9.528 | 23.587 | 43.177 | 45.62 | 48.904 | 26.772 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 63.557065 Full duration: 143.103101 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {}, "router_update_args": { "admin_state_up": false } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.29 | 1.94 | 6.091 | 7.553 | 17.579 | 2.769 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.378 | 6.301 | 9.5 | 11.824 | 13.126 | 6.136 | 100.0% | 40 | | neutron.create_router (x2) | 0.149 | 1.279 | 2.631 | 2.747 | 4.173 | 1.386 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.1 | 20.082 | 28.985 | 29.194 | 30.527 | 19.356 | 100.0% | 40 | | neutron.update_router (x2) | 1.252 | 6.158 | 9.786 | 11.049 | 12.426 | 5.983 | 100.0% | 40 | | total | 9.782 | 37.593 | 52.468 | 54.288 | 56.703 | 35.63 | 100.0% | 40 | | -> duration | 9.782 | 37.593 | 52.468 | 54.288 | 56.703 | 35.63 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 99.0491 Full duration: 176.149404 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {} }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.34 | 1.899 | 4.705 | 5.719 | 12.927 | 2.452 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.437 | 5.293 | 10.878 | 12.286 | 13.009 | 5.849 | 100.0% | 40 | | neutron.create_router (x2) | 0.177 | 0.85 | 1.528 | 1.822 | 3.176 | 0.95 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.891 | 15.785 | 22.914 | 24.18 | 24.636 | 15.928 | 100.0% | 40 | | neutron.remove_interface_router (x2) | 3.932 | 14.09 | 22.725 | 24.114 | 24.412 | 14.815 | 100.0% | 40 | | neutron.delete_router (x2) | 1.0 | 3.105 | 4.53 | 4.814 | 5.339 | 2.855 | 100.0% | 40 | | total | 14.482 | 42.592 | 59.178 | 63.276 | 69.034 | 42.85 | 100.0% | 40 | | -> duration | 14.482 | 42.592 | 59.178 | 63.276 | 69.034 | 42.85 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 106.291886 Full duration: 138.244241 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 50 }, "runner": { "times": 8, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1, "port": 811 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.4 | 0.503 | 1.899 | 2.528 | 3.156 | 0.931 | 100.0% | 8 | | neutron.create_port (x50) | 33.584 | 40.84 | 112.047 | 112.144 | 112.24 | 64.855 | 100.0% | 8 | | neutron.list_ports | 0.381 | 1.354 | 2.312 | 2.36 | 2.408 | 1.405 | 100.0% | 8 | | total | 35.263 | 42.254 | 115.554 | 116.686 | 117.817 | 67.2 | 100.0% | 8 | | -> duration | 35.263 | 42.254 | 115.554 | 116.686 | 117.817 | 67.2 | 100.0% | 8 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 150.066063 Full duration: 211.476272 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.412 | 2.0 | 8.23 | 12.763 | 29.539 | 3.899 | 100.0% | 40 | | neutron.create_port (x5) | 4.669 | 8.946 | 13.988 | 14.505 | 14.84 | 9.873 | 100.0% | 40 | | neutron.update_port (x5) | 3.544 | 6.471 | 10.049 | 10.49 | 11.259 | 6.849 | 100.0% | 40 | | total | 10.433 | 17.409 | 31.434 | 36.578 | 41.81 | 20.669 | 100.0% | 40 | | -> duration | 10.433 | 17.409 | 31.434 | 36.578 | 41.81 | 20.669 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 49.217263 Full duration: 89.240254 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_bind_ports args position 2 args values: { "args": { "ports_per_network": 5 }, "runner": { "times": 3, "concurrency": 2 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1 } }, "network": {}, "networking_agents": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet (x2) | 1.196 | 1.204 | 1.822 | 1.899 | 1.977 | 1.459 | 100.0% | 3 | | neutron.create_port (x5) | 3.42 | 4.5 | 4.569 | 4.577 | 4.586 | 4.169 | 100.0% | 3 | | neutron.update_port (x5) | 5.532 | 6.558 | 6.575 | 6.577 | 6.579 | 6.223 | 100.0% | 3 | | total | 11.196 | 12.009 | 12.28 | 12.314 | 12.348 | 11.851 | 100.0% | 3 | | -> duration | 11.196 | 12.009 | 12.28 | 12.314 | 12.348 | 11.851 | 100.0% | 3 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 3 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.211537 Full duration: 51.173347 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 3 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.339 | 1.3 | 8.915 | 12.163 | 22.476 | 3.438 | 100.0% | 40 | | neutron.create_port (x5) | 3.644 | 11.277 | 19.773 | 20.416 | 22.509 | 11.445 | 100.0% | 40 | | neutron.delete_port (x5) | 2.303 | 8.171 | 14.139 | 15.685 | 16.438 | 8.319 | 100.0% | 40 | | total | 6.533 | 22.616 | 39.987 | 45.424 | 48.341 | 23.242 | 100.0% | 40 | | -> duration | 6.533 | 22.616 | 39.987 | 45.424 | 48.341 | 23.242 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 53.789913 Full duration: 67.964607 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 20, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.212 | 0.346 | 0.928 | 1.114 | 1.161 | 0.45 | 100.0% | 40 | | total | 0.372 | 0.51 | 1.048 | 1.218 | 1.336 | 0.609 | 100.0% | 40 | | -> duration | 0.372 | 0.51 | 1.048 | 1.218 | 1.336 | 0.609 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.264358 Full duration: 22.944199 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunks args position 0 args values: { "args": { "subport_count": 125 }, "runner": { "times": 4, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.522 | 1.613 | 2.583 | 2.686 | 2.789 | 1.634 | 100.0% | 4 | | neutron.create_port (x126) | 90.432 | 126.47 | 163.336 | 163.61 | 163.884 | 126.814 | 100.0% | 4 | | neutron.create_trunk | 8.832 | 15.215 | 22.42 | 22.694 | 22.967 | 15.557 | 100.0% | 4 | | neutron.update_port | 1.177 | 1.754 | 2.42 | 2.513 | 2.607 | 1.823 | 100.0% | 4 | | neutron.list_trunks | 0.039 | 0.051 | 0.076 | 0.08 | 0.083 | 0.056 | 100.0% | 4 | | neutron.list_subports_by_trunk | 0.049 | 0.051 | 0.089 | 0.097 | 0.105 | 0.064 | 100.0% | 4 | | neutron.list_ports_by_device_id | 0.198 | 0.496 | 1.276 | 1.407 | 1.538 | 0.682 | 100.0% | 4 | | total | 102.165 | 146.591 | 190.957 | 191.081 | 191.204 | 146.638 | 100.0% | 4 | | -> duration | 102.165 | 146.591 | 190.957 | 191.081 | 191.204 | 146.638 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 191.203938 Full duration: 268.083698 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_floating_ips args position 0 args values: { "args": { "floating_network": "public", "floating_ip_args": {} }, "runner": { "times": 10, "concurrency": 5 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "floatingip": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_floating_ip | 1.813 | 2.935 | 3.761 | 3.822 | 3.883 | 2.972 | 100.0% | 10 | | -> neutron.list_networks | 0.322 | 0.398 | 1.078 | 1.086 | 1.093 | 0.543 | 100.0% | 10 | | neutron.delete_floating_ip | 0.643 | 0.982 | 1.81 | 1.841 | 1.871 | 1.1 | 100.0% | 10 | | total | 2.537 | 4.461 | 5.155 | 5.209 | 5.263 | 4.072 | 100.0% | 10 | | -> duration | 2.537 | 4.461 | 5.155 | 5.209 | 5.263 | 4.072 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.830455 Full duration: 18.221082 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_floating_ips args position 1 args values: { "args": { "floating_network": "public", "floating_ip_args": {} }, "runner": { "times": 10, "concurrency": 5 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "floatingip": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_floating_ip | 1.753 | 2.533 | 4.959 | 5.062 | 5.166 | 3.009 | 100.0% | 10 | | -> neutron.list_networks | 0.224 | 0.391 | 0.689 | 0.865 | 1.042 | 0.478 | 100.0% | 10 | | neutron.list_floating_ips | 0.06 | 0.08 | 0.173 | 0.2 | 0.228 | 0.099 | 100.0% | 10 | | total | 1.852 | 2.605 | 5.115 | 5.171 | 5.227 | 3.108 | 100.0% | 10 | | -> duration | 1.852 | 2.605 | 5.115 | 5.171 | 5.227 | 3.108 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.732654 Full duration: 19.900095 -------------------------------------------------------------------------------- test scenario NeutronNetworks.associate_and_dissociate_floating_ips args position 2 args values: { "args": { "floating_network": "public" }, "runner": { "times": 10, "concurrency": 5 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "floatingip": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_floating_ip | 2.485 | 4.328 | 5.206 | 5.525 | 5.845 | 4.115 | 100.0% | 10 | | -> neutron.list_networks | 0.234 | 0.494 | 0.757 | 0.984 | 1.212 | 0.565 | 100.0% | 10 | | neutron.create_network | 0.21 | 0.354 | 0.781 | 1.238 | 1.695 | 0.525 | 100.0% | 10 | | neutron.create_subnet | 0.741 | 1.57 | 2.893 | 2.946 | 2.998 | 1.648 | 100.0% | 10 | | neutron.create_port | 0.733 | 1.345 | 2.619 | 2.759 | 2.9 | 1.606 | 100.0% | 10 | | neutron.create_router | 0.1 | 0.137 | 0.593 | 0.841 | 1.089 | 0.295 | 100.0% | 10 | | neutron.list_networks | 0.156 | 0.189 | 0.307 | 0.328 | 0.349 | 0.219 | 100.0% | 10 | | neutron.add_gateway_router | 1.547 | 2.386 | 5.845 | 5.967 | 6.089 | 3.128 | 100.0% | 10 | | neutron.add_interface_router | 3.035 | 3.988 | 8.853 | 9.153 | 9.452 | 5.364 | 100.0% | 10 | | neutron.associate_floating_ip | 1.245 | 2.237 | 4.064 | 4.097 | 4.129 | 2.505 | 100.0% | 10 | | neutron.dissociate_floating_ip | 0.787 | 1.947 | 2.467 | 2.621 | 2.774 | 1.82 | 100.0% | 10 | | total | 12.374 | 17.696 | 33.139 | 33.253 | 33.367 | 21.226 | 100.0% | 10 | | -> duration | 12.374 | 17.696 | 33.139 | 33.253 | 33.367 | 21.226 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 49.343749 Full duration: 101.159591 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.296 | 0.496 | 1.639 | 1.897 | 2.283 | 0.735 | 100.0% | 50 | | neutron.create_security_group_rule | 0.133 | 0.358 | 0.542 | 0.709 | 0.921 | 0.367 | 100.0% | 50 | | neutron.delete_security_group_rule | 0.084 | 0.157 | 0.262 | 0.284 | 0.822 | 0.186 | 100.0% | 50 | | neutron.delete_security_group | 0.117 | 0.236 | 0.322 | 0.373 | 0.453 | 0.243 | 100.0% | 50 | | total | 0.674 | 1.459 | 2.666 | 2.952 | 3.143 | 1.532 | 100.0% | 50 | | -> duration | 0.674 | 1.459 | 2.666 | 2.952 | 3.143 | 1.532 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.355958 Full duration: 15.922148 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 1 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.286 | 0.566 | 1.524 | 1.559 | 1.582 | 0.738 | 100.0% | 50 | | neutron.delete_security_group | 0.129 | 0.254 | 0.43 | 0.455 | 0.718 | 0.282 | 100.0% | 50 | | total | 0.423 | 0.837 | 1.882 | 1.94 | 1.975 | 1.02 | 100.0% | 50 | | -> duration | 0.423 | 0.837 | 1.882 | 1.94 | 1.975 | 1.02 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.721472 Full duration: 14.484914 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 2 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {}, "security_group_rules_count": 20 }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.323 | 0.494 | 1.239 | 1.336 | 1.887 | 0.606 | 100.0% | 50 | | neutron.create_security_group_rule (x20) | 3.685 | 5.449 | 7.081 | 8.998 | 11.122 | 5.785 | 100.0% | 50 | | neutron.list_security_group_rules | 0.138 | 0.44 | 0.917 | 1.049 | 1.197 | 0.482 | 100.0% | 50 | | total | 4.433 | 6.5 | 8.843 | 10.39 | 12.076 | 6.88 | 100.0% | 50 | | -> duration | 4.433 | 6.5 | 8.843 | 10.39 | 12.076 | 6.88 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 36.889642 Full duration: 50.102292 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_groups args position 3 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.275 | 0.448 | 1.211 | 1.364 | 1.514 | 0.586 | 100.0% | 50 | | neutron.list_security_groups | 0.064 | 0.28 | 0.483 | 0.626 | 0.834 | 0.318 | 100.0% | 50 | | total | 0.454 | 0.793 | 1.326 | 1.651 | 1.865 | 0.904 | 100.0% | 50 | | -> duration | 0.454 | 0.793 | 1.326 | 1.651 | 1.865 | 0.904 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.084699 Full duration: 19.975016 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group_rule args position 4 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.284 | 0.493 | 0.869 | 1.095 | 1.266 | 0.569 | 100.0% | 50 | | neutron.create_security_group_rule | 0.132 | 0.244 | 0.528 | 0.572 | 1.074 | 0.3 | 100.0% | 50 | | neutron.show_security_group_rule | 0.022 | 0.034 | 0.059 | 0.068 | 0.083 | 0.039 | 100.0% | 50 | | total | 0.455 | 0.795 | 1.454 | 1.489 | 1.543 | 0.908 | 100.0% | 50 | | -> duration | 0.455 | 0.795 | 1.454 | 1.489 | 1.543 | 0.908 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.389899 Full duration: 19.480099 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 5 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.309 | 0.559 | 1.299 | 2.297 | 2.412 | 0.795 | 100.0% | 50 | | neutron.show_security_group | 0.039 | 0.081 | 0.168 | 0.179 | 0.197 | 0.091 | 100.0% | 50 | | total | 0.395 | 0.645 | 1.376 | 2.47 | 2.609 | 0.886 | 100.0% | 50 | | -> duration | 0.395 | 0.645 | 1.376 | 2.47 | 2.609 | 0.886 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.79931 Full duration: 18.256223 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_update_security_groups args position 6 args values: { "args": { "security_group_create_args": {}, "security_group_update_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.306 | 0.444 | 1.2 | 1.283 | 1.428 | 0.595 | 100.0% | 50 | | neutron.update_security_group | 0.076 | 0.155 | 0.35 | 0.776 | 0.803 | 0.229 | 100.0% | 50 | | total | 0.434 | 0.628 | 1.552 | 1.817 | 2.002 | 0.824 | 100.0% | 50 | | -> duration | 0.434 | 0.628 | 1.552 | 1.817 | 2.002 | 0.824 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.756321 Full duration: 18.973082 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_delete_server args position 0 args values: { "args": { "flavor": { "name": "rally_jobs-flavor_69512c20-c385-4dd5-8f8a-95b561ec1444" }, "image": { "name": "rally_jobs-img_69512c20-c385-4dd5-8f8a-95b561ec1444" }, "auto_assign_nic": true }, "runner": { "times": 2, "concurrency": 2 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 2 }, "network": {} }, "sla": { "failure_rate": { "max": 100 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8ed3858a-c334-4c60-a87d-399de043c3da has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 11.874 | 12.811 | 13.561 | 13.655 | 13.749 | 12.811 | 100.0% | 2 | | nova.delete_server | 2.562 | 2.873 | 3.121 | 3.152 | 3.183 | 2.873 | 100.0% | 2 | | total | 14.436 | 15.684 | 16.683 | 16.807 | 16.932 | 15.684 | 100.0% | 2 | | -> duration | 13.436 | 14.684 | 15.683 | 15.807 | 15.932 | 14.684 | 100.0% | 2 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 2 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.940583 Full duration: 47.257333 HINTS: * To plot HTML graphics with this data, run: rally task report 8ed3858a-c334-4c60-a87d-399de043c3da --out output.html * To generate a JUnit report, run: rally task export 8ed3858a-c334-4c60-a87d-399de043c3da --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report 8ed3858a-c334-4c60-a87d-399de043c3da --json --out output.json 2020-12-09 14:24:37,448 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 8ed3858a-c334-4c60-a87d-399de043c3da --out /home/opnfv/functest/results/rally_jobs/neutron.json 2020-12-09 14:24:37,651 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2020-12-09 14:24:37,653 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 00:30:37 | 997 | 100.00% | | | | | | | TOTAL: | 00:30:37 | 997 | 100.00% | +-----------+------------+----------------+-----------+ 2020-12-09 14:24:37,653 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs' success_rate is 100.00% in 1/1 modules 2020-12-09 14:24:41,743 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.html 2020-12-09 14:24:45,569 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.xml 2020-12-09 14:24:45,570 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_jobs | functest | 31:56 | PASS | +--------------------+------------------+------------------+----------------+