2020-08-22 03:19:11,367 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+---------------------------------------------------------------------------------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+---------------------------------------------------------------------------------------------------------------------------------------+ | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_DST_URL | s3://artifacts.opnfv.org/functest/0PHRSB3NZGOR/functest-opnfv-functest-benchmarking-cntt-arm64-hunter-rally_jobs_cntt-run-3 | | S3_ENDPOINT_URL | https://storage.googleapis.com | | DEPLOY_SCENARIO | os-nosdn-nofeature-noha | | BUILD_TAG | 0PHRSB3NZGOR | | DEBUG | true | | INSTALLER_TYPE | unknown | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | HTTP_DST_URL | http://artifacts.opnfv.org/functest/0PHRSB3NZGOR/functest-opnfv-functest-benchmarking-cntt-arm64-hunter-rally_jobs_cntt-run-3 | | NODE_NAME | lf-virtual6 | +-------------------------+---------------------------------------------------------------------------------------------------------------------------------------+ 2020-08-22 03:19:11,424 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file export OS_AUTH_URL=http://172.30.13.91/identity/v3 export OS_PROJECT_NAME="demo" export OS_USER_DOMAIN_NAME="Default" export OS_PROJECT_DOMAIN_NAME="Default" export OS_USERNAME="admin" export OS_PASSWORD="secret" export OS_REGION_NAME="RegionOne" export OS_INTERFACE=public export OS_IDENTITY_API_VERSION=3 export EXTERNAL_NETWORK=public 2020-08-22 03:19:11,425 - xtesting.ci.run_tests - DEBUG - Test args: rally_jobs_cntt 2020-08-22 03:19:11,595 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs_cntt'... 2020-08-22 03:19:17,265 - functest.core.tenantnetwork - DEBUG - password: }nJT8[v0finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 9433ff7d-bb1e-4155-9919-d3641c961515 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-08-22 03:20:43,971 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | compute_legacy | Available | | __unknown__ | placement | Available | | barbican | key-manager | Available | | cinder | block-storage | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-08-22 03:20:49,567 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests... 2020-08-22 03:20:50,086 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_jobs_cntt-flavor_alt_660d00f0-a72a-44d4-8992-56e4e5ecde7f', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'68736c2e334441e7b35d13d8a6e94595', 'name': 'demo', 'domain_name': 'Default'}), 'zone': None, 'region_name': 'RegionOne', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'010897d1-8856-43df-83f4-3b2afb1706fe', 'swap': 0}) 2020-08-22 03:20:50,320 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'name': u'rally_jobs_cntt-flavor_alt_660d00f0-a72a-44d4-8992-56e4e5ecde7f', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'68736c2e334441e7b35d13d8a6e94595', 'name': 'demo', 'domain_name': 'Default'}), 'zone': None, 'region_name': 'RegionOne', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'010897d1-8856-43df-83f4-3b2afb1706fe', 'swap': 0}) 2020-08-22 03:20:50,331 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /home/opnfv/functest/data/rally/neutron/rally-jobs/task-neutron.yaml 2020-08-22 03:20:50,333 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-08-22 03:20:50,432 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-08-22 03:20:52,502 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-08-22 03:20:52,502 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'neutron', '--task', u'/home/opnfv/functest/data/rally/task/var/task-neutron.yaml'] 2020-08-22 03:51:54,799 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: a5739431-32b6-41a1-9fa0-5d3df30ea5e2 2020-08-22 03:51:54,801 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : a5739431-32b6-41a1-9fa0-5d3df30ea5e2 2020-08-22 03:51:54,802 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'a5739431-32b6-41a1-9fa0-5d3df30ea5e2'] 2020-08-22 03:52:03,364 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a5739431-32b6-41a1-9fa0-5d3df30ea5e2 -------------------------------------------------------------------------------- Task a5739431-32b6-41a1-9fa0-5d3df30ea5e2: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 20, "times": 100 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": 119 } } }, "args": {}, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a5739431-32b6-41a1-9fa0-5d3df30ea5e2 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.047 | 2.063 | 4.081 | 4.482 | 5.409 | 2.396 | 100.0% | 100 | | neutron.list_networks | 0.229 | 0.791 | 1.387 | 3.185 | 3.853 | 1.014 | 100.0% | 100 | | total | 1.672 | 3.063 | 5.143 | 5.969 | 7.853 | 3.411 | 100.0% | 100 | | -> duration | 1.672 | 3.063 | 5.143 | 5.969 | 7.853 | 3.411 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.659992 Full duration: 55.282567 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {}, "network_update_args": { "name": "_updated", "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a5739431-32b6-41a1-9fa0-5d3df30ea5e2 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.605 | 1.521 | 3.401 | 4.402 | 5.714 | 1.898 | 100.0% | 40 | | neutron.update_network | 0.47 | 1.226 | 5.067 | 5.173 | 5.228 | 2.068 | 100.0% | 40 | | total | 1.129 | 3.114 | 7.641 | 7.942 | 8.527 | 3.967 | 100.0% | 40 | | -> duration | 1.129 | 3.114 | 7.641 | 7.942 | 8.527 | 3.967 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.544085 Full duration: 31.264262 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a5739431-32b6-41a1-9fa0-5d3df30ea5e2 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.565 | 2.039 | 4.067 | 4.163 | 5.113 | 2.396 | 100.0% | 40 | | neutron.delete_network | 0.706 | 1.684 | 7.262 | 7.328 | 7.549 | 2.478 | 100.0% | 40 | | total | 1.645 | 4.488 | 9.366 | 11.33 | 12.662 | 4.874 | 100.0% | 40 | | -> duration | 1.645 | 4.488 | 9.366 | 11.33 | 12.662 | 4.874 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.151176 Full duration: 21.609802 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": { "subnets_per_network": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a5739431-32b6-41a1-9fa0-5d3df30ea5e2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.617 | 1.502 | 2.385 | 4.015 | 4.386 | 1.662 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.829 | 6.87 | 11.012 | 11.151 | 11.43 | 7.096 | 100.0% | 40 | | neutron.list_subnets | 0.182 | 0.368 | 0.578 | 0.811 | 4.09 | 0.55 | 100.0% | 40 | | total | 3.237 | 9.702 | 13.052 | 13.517 | 13.915 | 9.309 | 100.0% | 40 | | -> duration | 3.237 | 9.702 | 13.052 | 13.517 | 13.915 | 9.309 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 27.704493 Full duration: 73.023639 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "runner": { "concurrency": 20, "times": 100 }, "contexts": { "users": { "users_per_tenant": 5, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_create_args": {}, "subnet_update_args": { "name": "_subnet_updated", "enable_dhcp": true } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a5739431-32b6-41a1-9fa0-5d3df30ea5e2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.589 | 1.29 | 2.642 | 3.928 | 4.913 | 1.517 | 100.0% | 100 | | neutron.create_subnet (x2) | 2.256 | 7.996 | 11.014 | 12.037 | 14.358 | 7.625 | 100.0% | 100 | | neutron.update_subnet (x2) | 1.305 | 4.34 | 6.913 | 7.286 | 9.299 | 4.463 | 100.0% | 100 | | total | 4.974 | 13.458 | 18.715 | 19.182 | 20.09 | 13.606 | 100.0% | 100 | | -> duration | 4.974 | 13.458 | 18.715 | 19.182 | 20.09 | 13.606 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 74.185032 Full duration: 168.38169 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a5739431-32b6-41a1-9fa0-5d3df30ea5e2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.64 | 1.242 | 2.87 | 4.01 | 5.041 | 1.656 | 100.0% | 40 | | neutron.create_subnet (x2) | 2.081 | 7.979 | 17.263 | 17.38 | 17.538 | 9.507 | 100.0% | 40 | | neutron.delete_subnet (x2) | 1.319 | 4.61 | 9.894 | 10.082 | 15.42 | 5.86 | 100.0% | 40 | | total | 4.34 | 14.927 | 29.764 | 30.105 | 34.736 | 17.233 | 100.0% | 40 | | -> duration | 4.34 | 14.927 | 29.764 | 30.105 | 34.736 | 17.233 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 43.488496 Full duration: 63.421064 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": null, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": null, "router_create_args": null }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a5739431-32b6-41a1-9fa0-5d3df30ea5e2 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.691 | 1.433 | 3.687 | 4.489 | 4.771 | 1.786 | 100.0% | 40 | | neutron.create_subnet (x2) | 2.943 | 8.167 | 13.52 | 14.071 | 14.29 | 8.392 | 100.0% | 40 | | neutron.create_router (x2) | 0.492 | 1.228 | 4.054 | 4.112 | 4.712 | 1.588 | 100.0% | 40 | | neutron.add_interface_router (x2) | 9.059 | 23.673 | 30.75 | 31.699 | 32.226 | 21.528 | 100.0% | 40 | | neutron.list_routers | 0.275 | 0.508 | 3.035 | 3.121 | 3.407 | 0.873 | 100.0% | 40 | | total | 18.494 | 36.155 | 46.498 | 47.257 | 47.722 | 34.17 | 100.0% | 40 | | -> duration | 18.494 | 36.155 | 46.498 | 47.257 | 47.722 | 34.17 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 83.480658 Full duration: 193.098428 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "subnets_per_network": 2, "subnet_cidr_start": "1.1.0.0/30", "network_create_args": {}, "subnet_create_args": {}, "router_update_args": { "name": "_router_updated", "admin_state_up": false }, "router_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a5739431-32b6-41a1-9fa0-5d3df30ea5e2 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.563 | 1.859 | 5.241 | 6.698 | 7.791 | 2.582 | 100.0% | 40 | | neutron.create_subnet (x2) | 2.006 | 9.488 | 15.634 | 16.144 | 16.206 | 8.703 | 100.0% | 40 | | neutron.create_router (x2) | 0.343 | 1.386 | 3.545 | 4.285 | 4.486 | 1.696 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.587 | 25.804 | 40.59 | 40.99 | 41.386 | 23.019 | 100.0% | 40 | | neutron.update_router (x2) | 1.587 | 7.156 | 13.118 | 13.244 | 13.484 | 7.673 | 100.0% | 40 | | total | 12.988 | 47.614 | 75.147 | 75.697 | 76.169 | 43.675 | 100.0% | 40 | | -> duration | 12.988 | 47.614 | 75.147 | 75.697 | 76.169 | 43.675 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 114.798318 Full duration: 222.879949 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": {}, "router_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a5739431-32b6-41a1-9fa0-5d3df30ea5e2 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.622 | 1.45 | 3.865 | 4.269 | 4.733 | 1.698 | 100.0% | 40 | | neutron.create_subnet (x2) | 2.186 | 7.932 | 9.866 | 11.267 | 15.789 | 7.803 | 100.0% | 40 | | neutron.create_router (x2) | 0.34 | 1.057 | 1.682 | 3.79 | 4.683 | 1.282 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.242 | 22.549 | 30.197 | 31.208 | 32.066 | 21.581 | 100.0% | 40 | | neutron.remove_interface_router (x2) | 5.475 | 20.429 | 26.011 | 28.338 | 31.643 | 19.164 | 100.0% | 40 | | neutron.delete_router (x2) | 0.933 | 2.385 | 5.619 | 5.974 | 6.092 | 3.038 | 100.0% | 40 | | total | 20.919 | 59.477 | 69.812 | 76.711 | 77.842 | 54.569 | 100.0% | 40 | | -> duration | 20.919 | 59.477 | 69.812 | 76.711 | 77.842 | 54.569 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 138.064369 Full duration: 197.527027 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 8 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "port": 811, "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": null, "ports_per_network": 50, "port_create_args": null }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a5739431-32b6-41a1-9fa0-5d3df30ea5e2 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.583 | 0.911 | 3.466 | 3.637 | 3.808 | 1.524 | 100.0% | 8 | | neutron.create_port (x50) | 49.88 | 55.685 | 87.175 | 87.192 | 87.208 | 62.899 | 100.0% | 8 | | neutron.list_ports | 0.412 | 1.119 | 3.257 | 3.274 | 3.291 | 1.547 | 100.0% | 8 | | total | 53.101 | 57.939 | 89.308 | 89.378 | 89.449 | 66.006 | 100.0% | 8 | | -> duration | 53.101 | 57.939 | 89.308 | 89.378 | 89.449 | 66.006 | 100.0% | 8 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 145.993019 Full duration: 243.556094 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "ports_per_network": 5, "port_create_args": {}, "port_update_args": { "device_owner": "dummy_owner", "device_id": "dummy_id", "name": "_port_updated", "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a5739431-32b6-41a1-9fa0-5d3df30ea5e2 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.526 | 1.246 | 3.825 | 4.033 | 5.763 | 1.856 | 100.0% | 40 | | neutron.create_port (x5) | 4.397 | 15.931 | 29.389 | 31.339 | 32.249 | 16.413 | 100.0% | 40 | | neutron.update_port (x5) | 2.582 | 8.393 | 14.315 | 15.058 | 23.446 | 9.268 | 100.0% | 40 | | total | 7.858 | 24.193 | 46.542 | 49.597 | 49.8 | 27.731 | 100.0% | 40 | | -> duration | 7.858 | 24.193 | 46.542 | 49.597 | 49.8 | 27.731 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 65.826274 Full duration: 126.827267 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "ports_per_network": 5, "port_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a5739431-32b6-41a1-9fa0-5d3df30ea5e2 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.628 | 1.318 | 3.765 | 3.966 | 4.375 | 1.673 | 100.0% | 40 | | neutron.create_port (x5) | 4.367 | 14.111 | 31.613 | 31.915 | 32.155 | 15.547 | 100.0% | 40 | | neutron.delete_port (x5) | 3.02 | 9.192 | 15.856 | 18.642 | 21.584 | 10.074 | 100.0% | 40 | | total | 11.233 | 24.734 | 47.667 | 47.996 | 48.34 | 27.524 | 100.0% | 40 | | -> duration | 11.233 | 24.734 | 47.667 | 47.996 | 48.34 | 27.524 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 63.969661 Full duration: 83.868426 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 20 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a5739431-32b6-41a1-9fa0-5d3df30ea5e2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.327 | 0.6 | 0.8 | 0.838 | 0.891 | 0.606 | 100.0% | 40 | | total | 0.783 | 1.252 | 1.553 | 1.605 | 1.705 | 1.241 | 100.0% | 40 | | -> duration | 0.783 | 1.252 | 1.553 | 1.605 | 1.705 | 1.241 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.280246 Full duration: 55.803672 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunks args position 0 args values: { "runner": { "concurrency": 4, "times": 4 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "args": { "subport_count": 125 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a5739431-32b6-41a1-9fa0-5d3df30ea5e2 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.922 | 0.975 | 1.185 | 1.225 | 1.266 | 1.035 | 100.0% | 4 | | neutron.create_port (x126) | 127.693 | 143.678 | 144.501 | 144.64 | 144.779 | 139.957 | 100.0% | 4 | | neutron.create_trunk | 11.062 | 12.936 | 14.728 | 14.804 | 14.88 | 12.953 | 100.0% | 4 | | neutron.update_port | 1.594 | 2.909 | 4.131 | 4.132 | 4.134 | 2.886 | 100.0% | 4 | | neutron.list_trunks | 0.095 | 0.137 | 0.154 | 0.156 | 0.158 | 0.132 | 100.0% | 4 | | neutron.list_subports_by_trunk | 0.095 | 0.102 | 0.115 | 0.117 | 0.118 | 0.104 | 100.0% | 4 | | neutron.list_ports_by_device_id | 0.277 | 0.767 | 0.783 | 0.783 | 0.783 | 0.648 | 100.0% | 4 | | total | 145.171 | 161.128 | 162.834 | 163.185 | 163.536 | 157.741 | 100.0% | 4 | | -> duration | 145.171 | 161.128 | 162.834 | 163.185 | 163.536 | 157.741 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 163.589575 Full duration: 267.090532 HINTS: * To plot HTML graphics with this data, run: rally task report a5739431-32b6-41a1-9fa0-5d3df30ea5e2 --out output.html * To generate a JUnit report, run: rally task export a5739431-32b6-41a1-9fa0-5d3df30ea5e2 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report a5739431-32b6-41a1-9fa0-5d3df30ea5e2 --json --out output.json 2020-08-22 03:52:03,369 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'a5739431-32b6-41a1-9fa0-5d3df30ea5e2', '--out', u'/home/opnfv/functest/results/rally_jobs_cntt/neutron.json'] 2020-08-22 03:52:23,565 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a5739431-32b6-41a1-9fa0-5d3df30ea5e2 --out /home/opnfv/functest/results/rally_jobs_cntt/neutron.json 2020-08-22 03:52:24,522 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2020-08-22 03:52:24,529 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 00:30:03 | 612 | 100.00% | | | | | | | TOTAL: | 00:30:03 | 612 | 100.00% | +-----------+------------+----------------+-----------+ 2020-08-22 03:52:24,530 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs_cntt' success_rate is 100.00% in 1/1 modules 2020-08-22 03:52:24,530 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.html'] 2020-08-22 03:52:44,410 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.html 2020-08-22 03:52:44,411 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.xml'] 2020-08-22 03:53:01,601 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.xml 2020-08-22 03:53:01,603 - xtesting.ci.run_tests - INFO - Test result: +-------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------------+------------------+------------------+----------------+ | rally_jobs_cntt | functest | 33:32 | PASS | +-------------------------+------------------+------------------+----------------+ 2020-08-22 03:53:18,418 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)