2020-04-13 02:35:08,140 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+--------------------------------------------------------------------------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+--------------------------------------------------------------------------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | os-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 0FLC7ZSQ1U3P | | NODE_NAME | lf-pod4 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest/0FLC7ZSQ1U3P/functest-opnfv-functest-benchmarking-cntt-jerma-rally_jobs_cntt-run-7 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest/0FLC7ZSQ1U3P/functest-opnfv-functest-benchmarking-cntt-jerma-rally_jobs_cntt-run-7 | +-------------------------+--------------------------------------------------------------------------------------------------------------------------------+ 2020-04-13 02:35:08,145 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file export OS_AUTH_URL=http://172.30.12.83/identity/v3 export OS_PROJECT_NAME="demo" export OS_USER_DOMAIN_NAME="Default" export OS_PROJECT_DOMAIN_NAME="Default" export OS_USERNAME="admin" export OS_PASSWORD="secret" export OS_REGION_NAME="RegionOne" export OS_INTERFACE=public export OS_IDENTITY_API_VERSION=3 2020-04-13 02:35:08,145 - xtesting.ci.run_tests - DEBUG - Test args: rally_jobs_cntt 2020-04-13 02:35:08,158 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs_cntt'... 2020-04-13 02:35:09,027 - functest.core.tenantnetwork - DEBUG - password: pL_y[=qMB_[+*^XwC=hxQL~puc1finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 59652a79-091d-45a8-a901-f17e0a697279 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-04-13 02:35:28,337 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | compute_legacy | Available | | __unknown__ | placement | Available | | barbican | key-manager | Available | | cinder | block-storage | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-04-13 02:35:29,683 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests... 2020-04-13 02:35:29,851 - functest.core.singlevm - DEBUG - flavor: Munch({'location': Munch({'cloud': 'envvars', 'region_name': 'RegionOne', 'zone': None, 'project': Munch({'id': 'd5571fad9d124116ae0de9e710ef632d', 'name': 'demo', 'domain_id': None, 'domain_name': 'Default'})}), 'id': '24390e1f-b147-44fe-9852-66900c08b22f', 'name': 'rally_jobs_cntt-flavor_alt_04e319cb-96bb-4f2e-88b5-5272b4aad43c', 'is_public': True, 'is_disabled': False, 'ram': 1024, 'vcpus': 1, 'disk': 1, 'ephemeral': 0, 'swap': 0, 'rxtx_factor': 1.0, 'properties': Munch({'OS-FLV-EXT-DATA:ephemeral': 0, 'OS-FLV-DISABLED:disabled': False, 'os-flavor-access:is_public': True}), 'extra_specs': Munch({}), 'OS-FLV-EXT-DATA:ephemeral': 0, 'OS-FLV-DISABLED:disabled': False, 'os-flavor-access:is_public': True}) 2020-04-13 02:35:29,971 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'location': Munch({'cloud': 'envvars', 'region_name': 'RegionOne', 'zone': None, 'project': Munch({'id': 'd5571fad9d124116ae0de9e710ef632d', 'name': 'demo', 'domain_id': None, 'domain_name': 'Default'})}), 'id': '24390e1f-b147-44fe-9852-66900c08b22f', 'name': 'rally_jobs_cntt-flavor_alt_04e319cb-96bb-4f2e-88b5-5272b4aad43c', 'is_public': True, 'is_disabled': False, 'ram': 1024, 'vcpus': 1, 'disk': 1, 'ephemeral': 0, 'swap': 0, 'rxtx_factor': 1.0, 'properties': Munch({'OS-FLV-EXT-DATA:ephemeral': 0, 'OS-FLV-DISABLED:disabled': False, 'os-flavor-access:is_public': True}), 'extra_specs': Munch({}), 'OS-FLV-EXT-DATA:ephemeral': 0, 'OS-FLV-DISABLED:disabled': False, 'os-flavor-access:is_public': True}) 2020-04-13 02:35:29,976 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /home/opnfv/functest/data/rally/neutron/rally-jobs/task-neutron.yaml 2020-04-13 02:35:29,976 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-04-13 02:35:30,003 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: ['NeutronNetworks.create_and_bind_ports', 'NeutronSecurityGroup.create_and_delete_security_group_rule', 'NeutronSecurityGroup.create_and_list_security_groups', 'NeutronNetworks.create_and_delete_floating_ips', 'NeutronSecurityGroup.create_and_show_security_group', 'NeutronNetworks.associate_and_dissociate_floating_ips', 'NovaServers.boot_and_delete_server', 'NeutronSecurityGroup.create_and_delete_security_groups', 'NeutronSecurityGroup.create_and_update_security_groups', 'NeutronSecurityGroup.create_and_list_security_group_rules', 'NeutronNetworks.create_and_list_floating_ips', 'NeutronSecurityGroup.create_and_show_security_group_rule'] 2020-04-13 02:35:30,404 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-04-13 02:35:30,404 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'neutron', '--task', '/home/opnfv/functest/data/rally/task/var/task-neutron.yaml', '--task-args', "{'floating_network': 'public', 'image_name': 'rally_jobs_cntt-img_04e319cb-96bb-4f2e-88b5-5272b4aad43c', 'flavor_name': 'rally_jobs_cntt-flavor_04e319cb-96bb-4f2e-88b5-5272b4aad43c'}"] 2020-04-13 02:52:47,617 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 640f1903-d0ca-4e8d-b9bd-e28c0d6f5474 2020-04-13 02:52:47,618 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 640f1903-d0ca-4e8d-b9bd-e28c0d6f5474 2020-04-13 02:52:47,619 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', '640f1903-d0ca-4e8d-b9bd-e28c0d6f5474'] 2020-04-13 02:52:49,078 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 640f1903-d0ca-4e8d-b9bd-e28c0d6f5474 -------------------------------------------------------------------------------- Task 640f1903-d0ca-4e8d-b9bd-e28c0d6f5474: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": {}, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": 119 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 640f1903-d0ca-4e8d-b9bd-e28c0d6f5474 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.304 | 1.732 | 6.128 | 15.257 | 23.684 | 3.153 | 100.0% | 100 | | neutron.list_networks | 0.154 | 0.366 | 0.701 | 0.783 | 0.903 | 0.392 | 100.0% | 100 | | total | 0.539 | 2.2 | 6.467 | 15.636 | 24.098 | 3.545 | 100.0% | 100 | | -> duration | 0.539 | 2.2 | 6.467 | 15.636 | 24.098 | 3.545 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 27.335187 Full duration: 47.186172 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false, "name": "_updated" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 640f1903-d0ca-4e8d-b9bd-e28c0d6f5474 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.266 | 1.511 | 7.313 | 8.698 | 12.753 | 2.955 | 100.0% | 40 | | neutron.update_network | 0.4 | 0.63 | 1.029 | 1.135 | 1.37 | 0.708 | 100.0% | 40 | | total | 0.8 | 2.301 | 7.925 | 9.133 | 13.202 | 3.664 | 100.0% | 40 | | -> duration | 0.8 | 2.301 | 7.925 | 9.133 | 13.202 | 3.664 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.240771 Full duration: 25.441997 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "args": {}, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 640f1903-d0ca-4e8d-b9bd-e28c0d6f5474 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.263 | 2.217 | 4.52 | 5.876 | 9.79 | 2.606 | 100.0% | 40 | | neutron.delete_network | 0.606 | 1.01 | 1.53 | 1.657 | 1.751 | 1.045 | 100.0% | 40 | | total | 0.996 | 3.303 | 5.566 | 7.479 | 10.9 | 3.652 | 100.0% | 40 | | -> duration | 0.996 | 3.303 | 5.566 | 7.479 | 10.9 | 3.652 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.948371 Full duration: 16.052623 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 640f1903-d0ca-4e8d-b9bd-e28c0d6f5474 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.248 | 1.822 | 5.359 | 10.635 | 16.226 | 2.851 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.312 | 2.254 | 4.872 | 6.002 | 6.673 | 2.883 | 100.0% | 40 | | neutron.list_subnets | 0.085 | 0.217 | 0.718 | 0.884 | 0.945 | 0.289 | 100.0% | 40 | | total | 1.883 | 4.927 | 9.869 | 13.122 | 21.463 | 6.023 | 100.0% | 40 | | -> duration | 1.883 | 4.927 | 9.869 | 13.122 | 21.463 | 6.023 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.502128 Full duration: 52.046457 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_update_args": { "enable_dhcp": true, "name": "_subnet_updated" } }, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 5 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 640f1903-d0ca-4e8d-b9bd-e28c0d6f5474 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.268 | 1.041 | 5.238 | 9.489 | 23.766 | 2.365 | 100.0% | 100 | | neutron.create_subnet (x2) | 1.365 | 2.709 | 4.455 | 4.995 | 6.061 | 2.908 | 100.0% | 100 | | neutron.update_subnet (x2) | 0.772 | 1.85 | 2.882 | 3.173 | 4.677 | 1.882 | 100.0% | 100 | | total | 2.941 | 6.145 | 10.69 | 13.805 | 27.62 | 7.156 | 100.0% | 100 | | -> duration | 2.941 | 6.145 | 10.69 | 13.805 | 27.62 | 7.156 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 40.576903 Full duration: 95.88559 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 640f1903-d0ca-4e8d-b9bd-e28c0d6f5474 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.277 | 1.661 | 6.79 | 8.316 | 12.999 | 2.694 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.261 | 3.248 | 5.685 | 6.165 | 6.743 | 3.462 | 100.0% | 40 | | neutron.delete_subnet (x2) | 0.957 | 3.116 | 5.773 | 7.208 | 7.945 | 3.243 | 100.0% | 40 | | total | 3.253 | 9.135 | 14.651 | 16.39 | 17.757 | 9.399 | 100.0% | 40 | | -> duration | 3.253 | 9.135 | 14.651 | 16.39 | 17.757 | 9.399 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 24.749656 Full duration: 37.734884 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "args": { "network_create_args": null, "subnet_create_args": null, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": null }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 640f1903-d0ca-4e8d-b9bd-e28c0d6f5474 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.276 | 1.588 | 5.986 | 6.98 | 11.693 | 2.519 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.3 | 2.955 | 7.748 | 8.369 | 12.331 | 3.799 | 100.0% | 40 | | neutron.create_router (x2) | 0.131 | 0.361 | 1.672 | 1.807 | 2.498 | 0.598 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.281 | 8.466 | 28.033 | 29.828 | 30.204 | 11.537 | 100.0% | 40 | | neutron.list_routers | 0.176 | 0.328 | 1.089 | 1.205 | 1.516 | 0.484 | 100.0% | 40 | | total | 8.166 | 15.594 | 42.042 | 42.619 | 44.23 | 18.938 | 100.0% | 40 | | -> duration | 8.166 | 15.594 | 42.042 | 42.619 | 44.23 | 18.938 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 44.244848 Full duration: 113.055624 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {}, "router_update_args": { "admin_state_up": false, "name": "_router_updated" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 640f1903-d0ca-4e8d-b9bd-e28c0d6f5474 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.28 | 1.44 | 4.792 | 6.348 | 10.27 | 2.264 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.309 | 2.783 | 4.686 | 4.921 | 5.364 | 2.916 | 100.0% | 40 | | neutron.create_router (x2) | 0.123 | 0.397 | 0.993 | 1.273 | 1.971 | 0.562 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.313 | 9.775 | 14.857 | 22.044 | 24.212 | 10.528 | 100.0% | 40 | | neutron.update_router (x2) | 1.226 | 2.783 | 5.915 | 7.054 | 9.85 | 3.31 | 100.0% | 40 | | total | 9.497 | 18.293 | 29.824 | 38.414 | 41.701 | 19.581 | 100.0% | 40 | | -> duration | 9.497 | 18.293 | 29.824 | 38.414 | 41.701 | 19.581 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 46.849378 Full duration: 113.194384 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {} }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 640f1903-d0ca-4e8d-b9bd-e28c0d6f5474 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.255 | 1.59 | 6.16 | 8.66 | 10.966 | 2.503 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.304 | 2.969 | 5.215 | 5.683 | 5.87 | 2.961 | 100.0% | 40 | | neutron.create_router (x2) | 0.128 | 0.402 | 1.092 | 1.22 | 1.387 | 0.519 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.066 | 9.832 | 15.436 | 15.751 | 17.696 | 9.999 | 100.0% | 40 | | neutron.remove_interface_router (x2) | 4.355 | 8.792 | 14.069 | 14.522 | 15.241 | 8.73 | 100.0% | 40 | | neutron.delete_router (x2) | 0.784 | 1.432 | 2.712 | 2.923 | 2.99 | 1.658 | 100.0% | 40 | | total | 13.24 | 23.894 | 40.15 | 41.112 | 43.723 | 26.37 | 100.0% | 40 | | -> duration | 13.24 | 23.894 | 40.15 | 41.112 | 43.723 | 26.37 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 65.267408 Full duration: 97.35603 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": null, "port_create_args": null, "ports_per_network": 50 }, "runner": { "times": 8, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1, "port": 811 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 640f1903-d0ca-4e8d-b9bd-e28c0d6f5474 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.389 | 0.953 | 1.577 | 1.617 | 1.657 | 0.955 | 100.0% | 8 | | neutron.create_port (x50) | 31.396 | 32.633 | 33.545 | 33.581 | 33.616 | 32.602 | 100.0% | 8 | | neutron.list_ports | 0.713 | 1.277 | 1.482 | 1.644 | 1.805 | 1.165 | 100.0% | 8 | | total | 33.128 | 34.84 | 35.761 | 35.787 | 35.814 | 34.725 | 100.0% | 8 | | -> duration | 33.128 | 34.84 | 35.761 | 35.787 | 35.814 | 34.725 | 100.0% | 8 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 70.197147 Full duration: 122.217026 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner", "name": "_port_updated" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 640f1903-d0ca-4e8d-b9bd-e28c0d6f5474 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.256 | 0.964 | 5.678 | 10.209 | 24.011 | 2.82 | 100.0% | 40 | | neutron.create_port (x5) | 3.227 | 6.345 | 8.212 | 8.652 | 9.883 | 6.074 | 100.0% | 40 | | neutron.update_port (x5) | 2.083 | 4.195 | 6.516 | 6.553 | 6.993 | 4.362 | 100.0% | 40 | | total | 6.137 | 13.072 | 18.808 | 22.51 | 33.027 | 13.257 | 100.0% | 40 | | -> duration | 6.137 | 13.072 | 18.808 | 22.51 | 33.027 | 13.257 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 33.075035 Full duration: 67.599915 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 2 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 640f1903-d0ca-4e8d-b9bd-e28c0d6f5474 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.266 | 1.792 | 5.881 | 9.098 | 18.829 | 2.991 | 100.0% | 40 | | neutron.create_port (x5) | 2.662 | 6.343 | 9.432 | 10.837 | 11.368 | 6.283 | 100.0% | 40 | | neutron.delete_port (x5) | 2.333 | 5.213 | 7.499 | 7.932 | 8.205 | 5.008 | 100.0% | 40 | | total | 6.44 | 14.162 | 24.475 | 25.192 | 33.087 | 14.283 | 100.0% | 40 | | -> duration | 6.44 | 14.162 | 24.475 | 25.192 | 33.087 | 14.283 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 33.382732 Full duration: 45.952912 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 20, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 640f1903-d0ca-4e8d-b9bd-e28c0d6f5474 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.22 | 0.352 | 0.452 | 0.474 | 0.927 | 0.376 | 100.0% | 40 | | total | 0.275 | 0.407 | 0.504 | 0.53 | 0.979 | 0.428 | 100.0% | 40 | | -> duration | 0.275 | 0.407 | 0.504 | 0.53 | 0.979 | 0.428 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.25605 Full duration: 22.239895 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunks args position 0 args values: { "args": { "subport_count": 125 }, "runner": { "times": 4, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 640f1903-d0ca-4e8d-b9bd-e28c0d6f5474 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.542 | 1.404 | 1.969 | 2.021 | 2.074 | 1.356 | 100.0% | 4 | | neutron.create_port (x126) | 78.018 | 82.067 | 83.524 | 83.636 | 83.748 | 81.475 | 100.0% | 4 | | neutron.create_trunk | 8.036 | 8.359 | 8.728 | 8.749 | 8.77 | 8.381 | 100.0% | 4 | | neutron.update_port | 1.295 | 1.464 | 1.591 | 1.603 | 1.615 | 1.46 | 100.0% | 4 | | neutron.list_trunks | 0.034 | 0.051 | 0.064 | 0.064 | 0.065 | 0.05 | 100.0% | 4 | | neutron.list_subports_by_trunk | 0.045 | 0.048 | 0.053 | 0.054 | 0.055 | 0.049 | 100.0% | 4 | | neutron.list_ports_by_device_id | 0.184 | 0.336 | 0.838 | 0.934 | 1.031 | 0.472 | 100.0% | 4 | | total | 89.994 | 93.591 | 95.429 | 95.625 | 95.821 | 93.249 | 100.0% | 4 | | -> duration | 89.994 | 93.591 | 95.429 | 95.625 | 95.821 | 93.249 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 95.828353 Full duration: 159.803108 HINTS: * To plot HTML graphics with this data, run: rally task report 640f1903-d0ca-4e8d-b9bd-e28c0d6f5474 --out output.html * To generate a JUnit report, run: rally task export 640f1903-d0ca-4e8d-b9bd-e28c0d6f5474 --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report 640f1903-d0ca-4e8d-b9bd-e28c0d6f5474 --json --out output.json 2020-04-13 02:52:49,079 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', '640f1903-d0ca-4e8d-b9bd-e28c0d6f5474', '--out', '/home/opnfv/functest/results/rally_jobs_cntt/neutron.json'] 2020-04-13 02:52:52,901 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 640f1903-d0ca-4e8d-b9bd-e28c0d6f5474 --out /home/opnfv/functest/results/rally_jobs_cntt/neutron.json 2020-04-13 02:52:52,990 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2020-04-13 02:52:52,991 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 00:16:55 | 612 | 100.00% | | | | | | | TOTAL: | 00:16:55 | 612 | 100.00% | +-----------+------------+----------------+-----------+ 2020-04-13 02:52:52,992 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs_cntt' success_rate is 100.00% in 1/1 modules 2020-04-13 02:52:52,992 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.html'] 2020-04-13 02:52:56,688 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.html 2020-04-13 02:52:56,689 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.xml'] 2020-04-13 02:53:00,294 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.xml 2020-04-13 02:53:00,295 - xtesting.ci.run_tests - INFO - Test result: +-------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------------+------------------+------------------+----------------+ | rally_jobs_cntt | functest | 17:50 | PASS | +-------------------------+------------------+------------------+----------------+ 2020-04-13 02:53:11,944 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)