2019-12-27 21:26:26,914 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | os-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 1JRRW1L5MK9Z | | NODE_NAME | lf-virtual4 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest/1JRRW1L5MK9Z/functest-opnfv-functest-benchmarking-iruya-rally_jobs-run-228 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest/1JRRW1L5MK9Z/functest-opnfv-functest-benchmarking-iruya-rally_jobs-run-228 | +-------------------------+------------------------------------------------------------------------------------------------------------------------+ 2019-12-27 21:26:26,920 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file export OS_AUTH_URL=http://172.30.13.89/identity/v3 export OS_PROJECT_NAME="demo" export OS_USER_DOMAIN_NAME="Default" export OS_PROJECT_DOMAIN_NAME="Default" export OS_USERNAME="admin" export OS_PASSWORD="secret" export OS_REGION_NAME="RegionOne" export OS_INTERFACE=public export OS_IDENTITY_API_VERSION=3 2019-12-27 21:26:26,920 - xtesting.ci.run_tests - DEBUG - Test args: rally_jobs 2019-12-27 21:26:26,935 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs'... 2019-12-27 21:26:27,976 - functest.core.tenantnetwork - DEBUG - password: }Z)wKfinished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 67ac3208-f95e-4bfe-bee7-2ac458e77637 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2019-12-27 21:26:48,849 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | compute_legacy | Available | | __unknown__ | placement | Available | | barbican | key-manager | Available | | cinder | block-storage | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2019-12-27 21:26:50,214 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests... 2019-12-27 21:26:51,359 - functest.core.singlevm - DEBUG - flavor: Munch({'location': Munch({'cloud': 'envvars', 'region_name': 'RegionOne', 'zone': None, 'project': Munch({'id': '945ec2f3decd4533ac4bc6c64168cf87', 'name': 'demo', 'domain_id': None, 'domain_name': 'Default'})}), 'id': '4f9b2354-668c-4910-9d61-faa5274b0981', 'name': 'rally_jobs-flavor_alt_3096354d-dc5b-47f6-a4a7-ad5ad9ee7436', 'is_public': True, 'is_disabled': False, 'ram': 1024, 'vcpus': 1, 'disk': 1, 'ephemeral': 0, 'swap': 0, 'rxtx_factor': 1.0, 'properties': Munch({'OS-FLV-DISABLED:disabled': False, 'os-flavor-access:is_public': True, 'OS-FLV-EXT-DATA:ephemeral': 0}), 'extra_specs': Munch({}), 'OS-FLV-DISABLED:disabled': False, 'os-flavor-access:is_public': True, 'OS-FLV-EXT-DATA:ephemeral': 0}) 2019-12-27 21:26:51,528 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'location': Munch({'cloud': 'envvars', 'region_name': 'RegionOne', 'zone': None, 'project': Munch({'id': '945ec2f3decd4533ac4bc6c64168cf87', 'name': 'demo', 'domain_id': None, 'domain_name': 'Default'})}), 'id': '4f9b2354-668c-4910-9d61-faa5274b0981', 'name': 'rally_jobs-flavor_alt_3096354d-dc5b-47f6-a4a7-ad5ad9ee7436', 'is_public': True, 'is_disabled': False, 'ram': 1024, 'vcpus': 1, 'disk': 1, 'ephemeral': 0, 'swap': 0, 'rxtx_factor': 1.0, 'properties': Munch({'OS-FLV-DISABLED:disabled': False, 'os-flavor-access:is_public': True, 'OS-FLV-EXT-DATA:ephemeral': 0}), 'extra_specs': Munch({}), 'OS-FLV-DISABLED:disabled': False, 'os-flavor-access:is_public': True, 'OS-FLV-EXT-DATA:ephemeral': 0}) 2019-12-27 21:26:51,533 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /home/opnfv/functest/data/rally/neutron/rally-jobs/task-neutron.yaml 2019-12-27 21:26:51,533 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2019-12-27 21:26:51,552 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2019-12-27 21:26:52,018 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2019-12-27 21:26:52,018 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'neutron', '--task', '/home/opnfv/functest/data/rally/task/var/task-neutron.yaml', '--task-args', "{'floating_network': 'public', 'image_name': 'rally_jobs-img_3096354d-dc5b-47f6-a4a7-ad5ad9ee7436', 'flavor_name': 'rally_jobs-flavor_3096354d-dc5b-47f6-a4a7-ad5ad9ee7436'}"] 2019-12-27 21:48:05,568 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: f527893f-5cff-43db-b69f-849e9c95c15e 2019-12-27 21:48:05,569 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : f527893f-5cff-43db-b69f-849e9c95c15e 2019-12-27 21:48:05,570 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', 'f527893f-5cff-43db-b69f-849e9c95c15e'] 2019-12-27 21:48:07,266 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid f527893f-5cff-43db-b69f-849e9c95c15e -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": {}, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": 119 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.284 | 0.65 | 1.39 | 1.566 | 2.46 | 0.794 | 100.0% | 100 | | neutron.list_networks | 0.137 | 0.411 | 0.825 | 0.923 | 1.006 | 0.466 | 100.0% | 100 | | total | 0.554 | 1.161 | 1.862 | 1.998 | 2.729 | 1.26 | 100.0% | 100 | | -> duration | 0.554 | 1.161 | 1.862 | 1.998 | 2.729 | 1.26 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.241407 Full duration: 25.858577 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false, "name": "_updated" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.318 | 0.793 | 1.423 | 1.449 | 1.891 | 0.84 | 100.0% | 40 | | neutron.update_network | 0.405 | 0.779 | 1.212 | 1.23 | 1.403 | 0.762 | 100.0% | 40 | | total | 0.812 | 1.608 | 2.467 | 2.533 | 2.899 | 1.602 | 100.0% | 40 | | -> duration | 0.812 | 1.608 | 2.467 | 2.533 | 2.899 | 1.602 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.827711 Full duration: 16.212839 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "args": {}, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.302 | 0.868 | 1.386 | 1.746 | 2.661 | 0.911 | 100.0% | 40 | | neutron.delete_network | 0.671 | 1.231 | 1.853 | 1.996 | 2.137 | 1.303 | 100.0% | 40 | | total | 1.088 | 2.193 | 2.855 | 2.959 | 3.827 | 2.214 | 100.0% | 40 | | -> duration | 1.088 | 2.193 | 2.855 | 2.959 | 3.827 | 2.214 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.744093 Full duration: 10.085175 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.288 | 0.83 | 1.42 | 1.475 | 1.573 | 0.827 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.532 | 2.785 | 3.591 | 4.583 | 4.905 | 2.714 | 100.0% | 40 | | neutron.list_subnets | 0.105 | 0.201 | 0.325 | 0.335 | 0.642 | 0.217 | 100.0% | 40 | | total | 2.152 | 3.793 | 5.05 | 6.088 | 6.469 | 3.758 | 100.0% | 40 | | -> duration | 2.152 | 3.793 | 5.05 | 6.088 | 6.469 | 3.758 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.183769 Full duration: 30.506052 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_update_args": { "enable_dhcp": true, "name": "_subnet_updated" } }, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 5 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.289 | 0.533 | 1.267 | 1.411 | 2.294 | 0.672 | 100.0% | 100 | | neutron.create_subnet (x2) | 1.379 | 2.676 | 4.616 | 5.282 | 6.43 | 2.774 | 100.0% | 100 | | neutron.update_subnet (x2) | 0.909 | 1.709 | 3.162 | 3.249 | 4.635 | 1.834 | 100.0% | 100 | | total | 2.921 | 4.71 | 8.469 | 9.964 | 12.557 | 5.281 | 100.0% | 100 | | -> duration | 2.921 | 4.71 | 8.469 | 9.964 | 12.557 | 5.281 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 28.296654 Full duration: 68.926678 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.275 | 0.905 | 1.525 | 1.543 | 2.018 | 0.88 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.497 | 2.053 | 3.273 | 3.31 | 3.53 | 2.366 | 100.0% | 40 | | neutron.delete_subnet (x2) | 0.968 | 1.466 | 2.005 | 2.029 | 2.184 | 1.551 | 100.0% | 40 | | total | 3.106 | 4.432 | 6.569 | 6.648 | 6.705 | 4.798 | 100.0% | 40 | | -> duration | 3.106 | 4.432 | 6.569 | 6.648 | 6.705 | 4.798 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.407631 Full duration: 23.989451 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "args": { "network_create_args": null, "subnet_create_args": null, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": null }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.319 | 0.808 | 1.203 | 1.257 | 2.11 | 0.85 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.41 | 2.067 | 3.267 | 3.345 | 3.383 | 2.404 | 100.0% | 40 | | neutron.create_router (x2) | 0.122 | 0.188 | 0.429 | 0.51 | 0.79 | 0.243 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.306 | 6.219 | 10.176 | 10.275 | 10.79 | 7.34 | 100.0% | 40 | | neutron.list_routers | 0.186 | 0.305 | 0.649 | 0.715 | 0.741 | 0.372 | 100.0% | 40 | | total | 7.916 | 9.777 | 14.941 | 15.411 | 16.167 | 11.21 | 100.0% | 40 | | -> duration | 7.916 | 9.777 | 14.941 | 15.411 | 16.167 | 11.21 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 25.377034 Full duration: 81.007425 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {}, "router_update_args": { "admin_state_up": false, "name": "_router_updated" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.31 | 0.92 | 1.446 | 1.504 | 1.865 | 0.897 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.531 | 2.072 | 3.458 | 3.671 | 5.342 | 2.537 | 100.0% | 40 | | neutron.create_router (x2) | 0.125 | 0.177 | 0.742 | 0.914 | 1.433 | 0.315 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.146 | 6.067 | 11.123 | 13.811 | 14.227 | 7.957 | 100.0% | 40 | | neutron.update_router (x2) | 1.487 | 2.041 | 3.159 | 3.257 | 5.171 | 2.322 | 100.0% | 40 | | total | 9.366 | 11.067 | 19.135 | 22.377 | 24.054 | 14.028 | 100.0% | 40 | | -> duration | 9.366 | 11.067 | 19.135 | 22.377 | 24.054 | 14.028 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 36.428194 Full duration: 92.865036 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {} }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.285 | 0.819 | 1.579 | 1.786 | 2.642 | 0.927 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.416 | 1.946 | 3.572 | 3.735 | 3.888 | 2.408 | 100.0% | 40 | | neutron.create_router (x2) | 0.125 | 0.165 | 0.467 | 0.755 | 1.082 | 0.263 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.032 | 6.215 | 10.838 | 11.085 | 11.907 | 7.646 | 100.0% | 40 | | neutron.remove_interface_router (x2) | 4.199 | 5.251 | 10.087 | 10.198 | 10.433 | 6.691 | 100.0% | 40 | | neutron.delete_router (x2) | 0.755 | 1.392 | 2.248 | 2.531 | 3.04 | 1.5 | 100.0% | 40 | | total | 12.929 | 15.49 | 29.041 | 29.348 | 29.68 | 19.437 | 100.0% | 40 | | -> duration | 12.929 | 15.49 | 29.041 | 29.348 | 29.68 | 19.437 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 49.830087 Full duration: 72.799978 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": null, "port_create_args": null, "ports_per_network": 50 }, "runner": { "times": 8, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1, "port": 811 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.277 | 0.73 | 1.97 | 1.974 | 1.978 | 0.995 | 100.0% | 8 | | neutron.create_port (x50) | 36.044 | 38.665 | 106.68 | 106.713 | 106.747 | 63.345 | 100.0% | 8 | | neutron.list_ports | 0.332 | 0.918 | 1.257 | 1.526 | 1.796 | 0.926 | 100.0% | 8 | | total | 37.983 | 39.809 | 109.804 | 110.164 | 110.524 | 65.269 | 100.0% | 8 | | -> duration | 37.983 | 39.809 | 109.804 | 110.164 | 110.524 | 65.269 | 100.0% | 8 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 148.695738 Full duration: 200.518832 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner", "name": "_port_updated" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.317 | 0.986 | 1.81 | 1.849 | 1.854 | 1.05 | 100.0% | 40 | | neutron.create_port (x5) | 3.787 | 4.402 | 8.925 | 9.273 | 10.376 | 5.587 | 100.0% | 40 | | neutron.update_port (x5) | 1.768 | 2.441 | 5.398 | 6.295 | 6.459 | 3.175 | 100.0% | 40 | | total | 6.136 | 7.925 | 16.105 | 16.467 | 17.075 | 9.812 | 100.0% | 40 | | -> duration | 6.136 | 7.925 | 16.105 | 16.467 | 17.075 | 9.812 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 30.848836 Full duration: 65.342821 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 2 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.301 | 0.905 | 1.559 | 1.765 | 2.129 | 0.938 | 100.0% | 40 | | neutron.create_port (x5) | 3.405 | 4.037 | 7.61 | 8.314 | 8.816 | 5.023 | 100.0% | 40 | | neutron.delete_port (x5) | 2.388 | 3.033 | 5.732 | 5.775 | 6.149 | 3.675 | 100.0% | 40 | | total | 6.791 | 8.23 | 13.964 | 14.097 | 16.386 | 9.636 | 100.0% | 40 | | -> duration | 6.791 | 8.23 | 13.964 | 14.097 | 16.386 | 9.636 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.448051 Full duration: 33.71576 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 20, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.236 | 0.308 | 0.393 | 0.564 | 0.573 | 0.325 | 100.0% | 40 | | total | 0.293 | 0.379 | 0.459 | 0.63 | 0.639 | 0.392 | 100.0% | 40 | | -> duration | 0.293 | 0.379 | 0.459 | 0.63 | 0.639 | 0.392 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.049282 Full duration: 19.226889 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunks args position 0 args values: { "args": { "subport_count": 125 }, "runner": { "times": 4, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.531 | 0.644 | 0.973 | 1.029 | 1.085 | 0.726 | 100.0% | 4 | | neutron.create_port (x126) | 94.105 | 135.869 | 177.429 | 177.434 | 177.439 | 135.821 | 100.0% | 4 | | neutron.create_trunk | 10.202 | 13.853 | 17.259 | 17.267 | 17.275 | 13.796 | 100.0% | 4 | | neutron.update_port | 1.642 | 2.27 | 2.941 | 2.951 | 2.961 | 2.286 | 100.0% | 4 | | neutron.list_trunks | 0.096 | 0.101 | 0.116 | 0.119 | 0.122 | 0.105 | 100.0% | 4 | | neutron.list_subports_by_trunk | 0.06 | 0.093 | 0.143 | 0.147 | 0.152 | 0.099 | 100.0% | 4 | | neutron.list_ports_by_device_id | 0.343 | 0.925 | 1.289 | 1.289 | 1.289 | 0.871 | 100.0% | 4 | | total | 107.206 | 153.91 | 199.797 | 199.807 | 199.817 | 153.711 | 100.0% | 4 | | -> duration | 107.206 | 153.91 | 199.797 | 199.807 | 199.817 | 153.711 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 199.818496 Full duration: 263.331914 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_floating_ips args position 0 args values: { "args": { "floating_network": "public", "floating_ip_args": {} }, "runner": { "times": 10, "concurrency": 5 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "floatingip": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_floating_ip | 1.637 | 2.094 | 4.149 | 4.155 | 4.161 | 2.446 | 100.0% | 10 | | -> neutron.list_networks | 0.254 | 0.496 | 0.883 | 0.891 | 0.898 | 0.556 | 100.0% | 10 | | neutron.delete_floating_ip | 0.681 | 0.98 | 1.714 | 1.716 | 1.718 | 1.058 | 100.0% | 10 | | total | 2.602 | 3.011 | 5.867 | 5.871 | 5.875 | 3.504 | 100.0% | 10 | | -> duration | 2.602 | 3.011 | 5.867 | 5.871 | 5.875 | 3.504 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.611691 Full duration: 16.862944 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_floating_ips args position 1 args values: { "args": { "floating_network": "public", "floating_ip_args": {} }, "runner": { "times": 10, "concurrency": 5 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "floatingip": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_floating_ip | 1.917 | 2.914 | 5.746 | 5.822 | 5.899 | 3.476 | 100.0% | 10 | | -> neutron.list_networks | 0.237 | 0.693 | 0.9 | 0.901 | 0.901 | 0.613 | 100.0% | 10 | | neutron.list_floating_ips | 0.059 | 0.067 | 0.157 | 0.168 | 0.18 | 0.094 | 100.0% | 10 | | total | 1.986 | 3.012 | 5.891 | 5.924 | 5.958 | 3.57 | 100.0% | 10 | | -> duration | 1.986 | 3.012 | 5.891 | 5.924 | 5.958 | 3.57 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.958315 Full duration: 18.861155 -------------------------------------------------------------------------------- test scenario NeutronNetworks.associate_and_dissociate_floating_ips args position 2 args values: { "args": { "floating_network": "public" }, "runner": { "times": 10, "concurrency": 5 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "floatingip": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_floating_ip | 1.723 | 2.033 | 2.188 | 2.197 | 2.206 | 2.027 | 100.0% | 10 | | -> neutron.list_networks | 0.287 | 0.445 | 0.81 | 0.814 | 0.819 | 0.499 | 100.0% | 10 | | neutron.create_network | 0.165 | 0.213 | 0.71 | 0.906 | 1.103 | 0.366 | 100.0% | 10 | | neutron.create_subnet | 0.711 | 0.804 | 1.096 | 1.176 | 1.256 | 0.886 | 100.0% | 10 | | neutron.create_port | 0.892 | 1.218 | 1.285 | 1.285 | 1.286 | 1.141 | 100.0% | 10 | | neutron.create_router | 0.077 | 0.091 | 0.105 | 0.106 | 0.108 | 0.092 | 100.0% | 10 | | neutron.list_networks | 0.126 | 0.15 | 0.215 | 0.416 | 0.617 | 0.193 | 100.0% | 10 | | neutron.add_gateway_router | 1.961 | 2.137 | 2.381 | 2.427 | 2.473 | 2.169 | 100.0% | 10 | | neutron.add_interface_router | 2.634 | 3.018 | 3.282 | 3.394 | 3.506 | 3.044 | 100.0% | 10 | | neutron.associate_floating_ip | 1.164 | 1.445 | 1.498 | 1.5 | 1.502 | 1.419 | 100.0% | 10 | | neutron.dissociate_floating_ip | 0.702 | 1.072 | 1.117 | 1.193 | 1.269 | 0.974 | 100.0% | 10 | | total | 12.015 | 12.238 | 12.649 | 12.764 | 12.879 | 12.312 | 100.0% | 10 | | -> duration | 12.015 | 12.238 | 12.649 | 12.764 | 12.879 | 12.312 | 100.0% | 10 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 | +--------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.932628 Full duration: 60.723041 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.227 | 0.306 | 1.036 | 1.185 | 1.345 | 0.459 | 100.0% | 50 | | neutron.create_security_group_rule | 0.11 | 0.152 | 0.268 | 0.691 | 0.803 | 0.211 | 100.0% | 50 | | neutron.delete_security_group_rule | 0.068 | 0.096 | 0.167 | 0.323 | 0.676 | 0.132 | 100.0% | 50 | | neutron.delete_security_group | 0.107 | 0.164 | 0.368 | 0.455 | 0.543 | 0.202 | 100.0% | 50 | | total | 0.564 | 0.784 | 1.655 | 2.308 | 2.59 | 1.003 | 100.0% | 50 | | -> duration | 0.564 | 0.784 | 1.655 | 2.308 | 2.59 | 1.003 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.282645 Full duration: 12.345766 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 1 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.233 | 0.345 | 1.187 | 1.357 | 1.523 | 0.518 | 100.0% | 50 | | neutron.delete_security_group | 0.112 | 0.19 | 0.497 | 0.529 | 0.664 | 0.235 | 100.0% | 50 | | total | 0.345 | 0.562 | 1.703 | 1.781 | 1.84 | 0.753 | 100.0% | 50 | | -> duration | 0.345 | 0.562 | 1.703 | 1.781 | 1.84 | 0.753 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.924912 Full duration: 10.933828 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 2 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {}, "security_group_rules_count": 20 }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.255 | 0.299 | 1.127 | 1.148 | 1.18 | 0.458 | 100.0% | 50 | | neutron.create_security_group_rule (x20) | 2.753 | 3.627 | 4.832 | 4.951 | 5.245 | 3.897 | 100.0% | 50 | | neutron.list_security_group_rules | 0.077 | 0.277 | 0.438 | 0.468 | 0.765 | 0.295 | 100.0% | 50 | | total | 3.383 | 4.462 | 5.829 | 6.07 | 6.383 | 4.657 | 100.0% | 50 | | -> duration | 3.383 | 4.462 | 5.829 | 6.07 | 6.383 | 4.657 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.408611 Full duration: 38.372952 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_groups args position 3 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.23 | 0.314 | 1.042 | 1.147 | 1.291 | 0.438 | 100.0% | 50 | | neutron.list_security_groups | 0.068 | 0.257 | 0.482 | 0.544 | 0.627 | 0.287 | 100.0% | 50 | | total | 0.371 | 0.639 | 1.169 | 1.388 | 1.595 | 0.725 | 100.0% | 50 | | -> duration | 0.371 | 0.639 | 1.169 | 1.388 | 1.595 | 0.725 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.896793 Full duration: 16.455774 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group_rule args position 4 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.239 | 0.325 | 0.86 | 1.098 | 1.148 | 0.44 | 100.0% | 50 | | neutron.create_security_group_rule | 0.107 | 0.162 | 0.267 | 0.353 | 0.51 | 0.183 | 100.0% | 50 | | neutron.show_security_group_rule | 0.015 | 0.022 | 0.038 | 0.043 | 0.312 | 0.036 | 100.0% | 50 | | total | 0.377 | 0.553 | 1.083 | 1.27 | 1.468 | 0.659 | 100.0% | 50 | | -> duration | 0.377 | 0.553 | 1.083 | 1.27 | 1.468 | 0.659 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.504243 Full duration: 16.392195 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 5 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.23 | 0.352 | 1.042 | 1.156 | 1.26 | 0.464 | 100.0% | 50 | | neutron.show_security_group | 0.034 | 0.054 | 0.106 | 0.115 | 0.125 | 0.061 | 100.0% | 50 | | total | 0.272 | 0.439 | 1.097 | 1.247 | 1.354 | 0.525 | 100.0% | 50 | | -> duration | 0.272 | 0.439 | 1.097 | 1.247 | 1.354 | 0.525 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.789538 Full duration: 15.039196 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_update_security_groups args position 6 args values: { "args": { "security_group_create_args": {}, "security_group_update_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f527893f-5cff-43db-b69f-849e9c95c15e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.229 | 0.299 | 1.077 | 1.161 | 1.545 | 0.479 | 100.0% | 50 | | neutron.update_security_group | 0.073 | 0.107 | 0.209 | 0.231 | 0.509 | 0.139 | 100.0% | 50 | | total | 0.319 | 0.416 | 1.203 | 1.317 | 1.713 | 0.618 | 100.0% | 50 | | -> duration | 0.319 | 0.416 | 1.203 | 1.317 | 1.713 | 0.618 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.566449 Full duration: 16.030699 HINTS: * To plot HTML graphics with this data, run: rally task report f527893f-5cff-43db-b69f-849e9c95c15e --out output.html * To generate a JUnit report, run: rally task export f527893f-5cff-43db-b69f-849e9c95c15e --type junit --to output.xml * To get raw JSON output of task results, run: rally task report f527893f-5cff-43db-b69f-849e9c95c15e --json --out output.json 2019-12-27 21:48:07,267 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', 'f527893f-5cff-43db-b69f-849e9c95c15e', '--out', '/home/opnfv/functest/results/rally_jobs/neutron.json'] 2019-12-27 21:48:11,261 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid f527893f-5cff-43db-b69f-849e9c95c15e --out /home/opnfv/functest/results/rally_jobs/neutron.json 2019-12-27 21:48:11,402 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2019-12-27 21:48:11,405 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 00:20:26 | 992 | 100.00% | | | | | | | TOTAL: | 00:20:26 | 992 | 100.00% | +-----------+------------+----------------+-----------+ 2019-12-27 21:48:11,406 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs' success_rate is 100.00% in 1/1 modules 2019-12-27 21:48:11,406 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.html'] 2019-12-27 21:48:15,567 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.html 2019-12-27 21:48:15,568 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.xml'] 2019-12-27 21:48:19,461 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.xml 2019-12-27 21:48:19,462 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_jobs | functest | 21:50 | PASS | +--------------------+------------------+------------------+----------------+ 2019-12-27 21:48:32,125 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)