2020-03-20 00:17:41,549 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+----------------------------------------------------------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+----------------------------------------------------------------------------------------------------------------+ | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_DST_URL | s3://artifacts.opnfv.org/cntt/DKY0B7RLM02H/cntt-opnfv-functest-benchmarking-latest-rally_jobs-run-31 | | S3_ENDPOINT_URL | https://storage.googleapis.com | | DEPLOY_SCENARIO | os-nosdn-nofeature-ha | | BUILD_TAG | DKY0B7RLM02H | | DEBUG | false | | INSTALLER_TYPE | cntt | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | HTTP_DST_URL | http://artifacts.opnfv.org/cntt/DKY0B7RLM02H/cntt-opnfv-functest-benchmarking-latest-rally_jobs-run-31 | | NODE_NAME | intel-pod15 | +-------------------------+----------------------------------------------------------------------------------------------------------------+ 2020-03-20 00:17:41,554 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file export OS_AUTH_URL=http://identity-airship.intel-pod15.opnfv.org/v3 export OS_USER_DOMAIN_NAME=default export OS_PROJECT_DOMAIN_NAME=default export OS_USERNAME=admin export OS_PROJECT_NAME=admin export OS_PASSWORD=password123 export OS_IDENTITY_API_VERSION=3 export OS_INTERFACE=public export OS_REGION_NAME=intel-pod15 2020-03-20 00:17:41,554 - xtesting.ci.run_tests - DEBUG - Test args: rally_jobs 2020-03-20 00:17:41,568 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs'... 2020-03-20 00:17:42,626 - functest.core.tenantnetwork - DEBUG - password: .s>WWQ)1VmU1T3Dr[]Y>qtGz.7WWQ)1VmU1T3Dr[]Y>qtGz.7WWQ)1VmU1T3Dr[]Y>qtGz.7finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 184774b2-03e1-4048-8ea2-a8b9ebeb17a4 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-03-20 00:18:05,161 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-03-20 00:18:06,119 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests... 2020-03-20 00:18:06,453 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_alt_85d3eefe-a115-4cb3-9b0d-abee5ffee4c0', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'ed787faed6934ba080bf15645db1ce23', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'bf953fda-578f-4dc6-8a01-f566cc11dd89', 'swap': 0}) 2020-03-20 00:18:06,540 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_alt_85d3eefe-a115-4cb3-9b0d-abee5ffee4c0', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'ed787faed6934ba080bf15645db1ce23', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod15', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'bf953fda-578f-4dc6-8a01-f566cc11dd89', 'swap': 0}) 2020-03-20 00:18:06,545 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /home/opnfv/functest/data/rally/neutron/rally-jobs/task-neutron.yaml 2020-03-20 00:18:06,545 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-03-20 00:18:06,567 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario exclusion not applied. 2020-03-20 00:18:06,937 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-03-20 00:18:06,937 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'neutron', '--task', u'/home/opnfv/functest/data/rally/task/var/task-neutron.yaml'] 2020-03-20 01:02:21,560 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 6dd1b05b-317d-41c1-8b75-a985824e8cec 2020-03-20 01:02:21,560 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 6dd1b05b-317d-41c1-8b75-a985824e8cec 2020-03-20 01:02:21,560 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'6dd1b05b-317d-41c1-8b75-a985824e8cec'] 2020-03-20 01:02:22,791 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 6dd1b05b-317d-41c1-8b75-a985824e8cec -------------------------------------------------------------------------------- Task 6dd1b05b-317d-41c1-8b75-a985824e8cec: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 20, "times": 100 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": 119 } } }, "args": {}, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6dd1b05b-317d-41c1-8b75-a985824e8cec has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.859 | 3.22 | 4.481 | 4.788 | 5.193 | 3.178 | 100.0% | 100 | | neutron.list_networks | 0.177 | 0.828 | 2.184 | 2.406 | 2.563 | 0.987 | 100.0% | 100 | | total | 1.304 | 4.231 | 5.808 | 7.188 | 7.345 | 4.166 | 100.0% | 100 | | -> duration | 1.304 | 4.231 | 5.808 | 7.188 | 7.345 | 4.166 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.073798 Full duration: 96.694944 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {}, "network_update_args": { "name": "_updated", "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6dd1b05b-317d-41c1-8b75-a985824e8cec has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.827 | 4.23 | 5.716 | 6.14 | 7.168 | 4.212 | 100.0% | 40 | | neutron.update_network | 0.591 | 2.168 | 3.595 | 3.801 | 3.948 | 2.202 | 100.0% | 40 | | total | 2.767 | 6.514 | 7.73 | 7.948 | 8.602 | 6.415 | 100.0% | 40 | | -> duration | 2.767 | 6.514 | 7.73 | 7.948 | 8.602 | 6.415 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.453806 Full duration: 87.499843 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6dd1b05b-317d-41c1-8b75-a985824e8cec has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.157 | 3.41 | 4.231 | 4.365 | 7.367 | 3.297 | 100.0% | 40 | | neutron.delete_network | 0.77 | 1.877 | 2.959 | 3.027 | 3.158 | 1.895 | 100.0% | 40 | | total | 2.616 | 4.936 | 7.174 | 7.211 | 9.016 | 5.191 | 100.0% | 40 | | -> duration | 2.616 | 4.936 | 7.174 | 7.211 | 9.016 | 5.191 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.379235 Full duration: 17.480721 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": { "subnets_per_network": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6dd1b05b-317d-41c1-8b75-a985824e8cec has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.728 | 4.527 | 6.363 | 8.514 | 10.951 | 4.5 | 100.0% | 40 | | neutron.create_subnet (x2) | 5.299 | 13.003 | 19.683 | 20.064 | 22.526 | 14.16 | 100.0% | 40 | | neutron.list_subnets | 0.199 | 1.256 | 5.193 | 5.894 | 6.241 | 2.043 | 100.0% | 40 | | total | 6.268 | 18.993 | 28.124 | 28.143 | 28.171 | 20.704 | 100.0% | 40 | | -> duration | 6.268 | 18.993 | 28.124 | 28.143 | 28.171 | 20.704 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 44.741568 Full duration: 139.768264 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "runner": { "concurrency": 20, "times": 100 }, "contexts": { "users": { "users_per_tenant": 5, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_create_args": {}, "subnet_update_args": { "name": "_subnet_updated", "enable_dhcp": true } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6dd1b05b-317d-41c1-8b75-a985824e8cec has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.611 | 3.03 | 5.979 | 6.563 | 7.462 | 3.168 | 100.0% | 100 | | neutron.create_subnet (x2) | 2.135 | 10.755 | 17.405 | 18.435 | 19.14 | 10.813 | 100.0% | 100 | | neutron.update_subnet (x2) | 1.441 | 3.443 | 5.131 | 5.687 | 7.357 | 3.62 | 100.0% | 100 | | total | 5.055 | 16.713 | 27.138 | 27.515 | 30.933 | 17.601 | 100.0% | 100 | | -> duration | 5.055 | 16.713 | 27.138 | 27.515 | 30.933 | 17.601 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 91.231244 Full duration: 226.726445 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6dd1b05b-317d-41c1-8b75-a985824e8cec has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.456 | 3.928 | 4.962 | 5.832 | 6.273 | 3.976 | 100.0% | 40 | | neutron.create_subnet (x2) | 8.053 | 12.393 | 13.421 | 13.873 | 15.135 | 11.871 | 100.0% | 40 | | neutron.delete_subnet (x2) | 1.765 | 4.072 | 7.623 | 8.132 | 8.805 | 4.55 | 100.0% | 40 | | total | 15.954 | 20.501 | 22.97 | 25.477 | 25.548 | 20.398 | 100.0% | 40 | | -> duration | 15.954 | 20.501 | 22.97 | 25.477 | 25.548 | 20.398 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 43.706304 Full duration: 83.177273 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": null, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": null, "router_create_args": null }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6dd1b05b-317d-41c1-8b75-a985824e8cec has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.224 | 5.117 | 8.625 | 10.561 | 20.517 | 5.604 | 100.0% | 40 | | neutron.create_subnet (x2) | 5.971 | 11.922 | 20.122 | 20.393 | 20.527 | 13.285 | 100.0% | 40 | | neutron.create_router (x2) | 25.949 | 38.501 | 48.717 | 55.604 | 65.066 | 39.84 | 100.0% | 40 | | neutron.add_interface_router (x2) | 7.077 | 12.861 | 16.471 | 16.773 | 18.319 | 12.404 | 100.0% | 40 | | neutron.list_routers | 0.174 | 0.325 | 1.82 | 2.058 | 2.678 | 0.575 | 100.0% | 40 | | total | 56.055 | 72.025 | 78.797 | 85.971 | 91.112 | 71.709 | 100.0% | 40 | | -> duration | 56.055 | 72.025 | 78.797 | 85.971 | 91.112 | 71.709 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 156.221493 Full duration: 298.217147 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "subnets_per_network": 2, "subnet_cidr_start": "1.1.0.0/30", "network_create_args": {}, "subnet_create_args": {}, "router_update_args": { "name": "_router_updated", "admin_state_up": false }, "router_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6dd1b05b-317d-41c1-8b75-a985824e8cec has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.844 | 5.908 | 11.072 | 24.693 | 34.151 | 6.781 | 100.0% | 40 | | neutron.create_subnet (x2) | 6.346 | 12.3 | 14.814 | 15.553 | 15.761 | 12.04 | 100.0% | 40 | | neutron.create_router (x2) | 17.315 | 33.285 | 44.055 | 49.67 | 54.262 | 34.194 | 100.0% | 40 | | neutron.add_interface_router (x2) | 4.574 | 11.814 | 14.828 | 15.663 | 18.88 | 11.367 | 100.0% | 40 | | neutron.update_router (x2) | 0.858 | 4.244 | 5.954 | 6.235 | 7.228 | 3.989 | 100.0% | 40 | | total | 39.056 | 70.434 | 77.853 | 79.621 | 86.583 | 68.372 | 100.0% | 40 | | -> duration | 39.056 | 70.434 | 77.853 | 79.621 | 86.583 | 68.372 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 169.415563 Full duration: 329.285157 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": {}, "router_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6dd1b05b-317d-41c1-8b75-a985824e8cec has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.565 | 2.962 | 6.258 | 7.432 | 12.256 | 3.528 | 100.0% | 40 | | neutron.create_subnet (x2) | 3.87 | 12.644 | 15.922 | 17.052 | 18.454 | 12.392 | 100.0% | 40 | | neutron.create_router (x2) | 31.506 | 47.074 | 51.99 | 53.815 | 55.613 | 45.397 | 100.0% | 40 | | neutron.add_interface_router (x2) | 7.575 | 13.552 | 17.301 | 18.026 | 18.973 | 13.415 | 100.0% | 40 | | neutron.remove_interface_router (x2) | 3.35 | 7.982 | 11.094 | 11.866 | 13.577 | 7.87 | 100.0% | 40 | | neutron.delete_router (x2) | 5.08 | 13.521 | 20.261 | 21.013 | 23.624 | 13.762 | 100.0% | 40 | | total | 68.259 | 99.611 | 109.413 | 112.255 | 119.215 | 96.364 | 100.0% | 40 | | -> duration | 68.259 | 99.611 | 109.413 | 112.255 | 119.215 | 96.364 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 209.28373 Full duration: 245.504431 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 8 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "port": 811, "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": null, "ports_per_network": 50, "port_create_args": null }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6dd1b05b-317d-41c1-8b75-a985824e8cec has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.447 | 1.939 | 3.276 | 3.61 | 3.944 | 1.909 | 100.0% | 8 | | neutron.create_port (x50) | 67.427 | 77.364 | 84.082 | 88.309 | 92.535 | 77.528 | 100.0% | 8 | | neutron.list_ports | 0.512 | 0.953 | 1.859 | 2.563 | 3.268 | 1.161 | 100.0% | 8 | | total | 71.378 | 80.215 | 87.391 | 91.555 | 95.719 | 80.601 | 100.0% | 8 | | -> duration | 71.378 | 80.215 | 87.391 | 91.555 | 95.719 | 80.601 | 100.0% | 8 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 176.47642 Full duration: 408.061747 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "ports_per_network": 5, "port_create_args": {}, "port_update_args": { "device_owner": "dummy_owner", "device_id": "dummy_id", "name": "_port_updated", "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6dd1b05b-317d-41c1-8b75-a985824e8cec has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.898 | 4.693 | 13.733 | 18.469 | 21.553 | 5.708 | 100.0% | 40 | | neutron.create_port (x5) | 5.57 | 19.866 | 28.07 | 28.791 | 29.526 | 19.768 | 100.0% | 40 | | neutron.update_port (x5) | 2.82 | 8.439 | 10.491 | 11.112 | 12.573 | 7.964 | 100.0% | 40 | | total | 22.229 | 31.864 | 43.127 | 44.597 | 45.896 | 33.441 | 100.0% | 40 | | -> duration | 22.229 | 31.864 | 43.127 | 44.597 | 45.896 | 33.441 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 76.282871 Full duration: 170.75893 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "ports_per_network": 5, "port_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6dd1b05b-317d-41c1-8b75-a985824e8cec has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.259 | 4.307 | 5.191 | 5.326 | 5.344 | 3.734 | 100.0% | 40 | | neutron.create_port (x5) | 11.187 | 16.102 | 20.492 | 20.904 | 22.176 | 16.641 | 100.0% | 40 | | neutron.delete_port (x5) | 4.487 | 6.863 | 10.695 | 10.995 | 11.388 | 7.668 | 100.0% | 40 | | total | 18.561 | 28.034 | 33.088 | 34.84 | 37.887 | 28.045 | 100.0% | 40 | | -> duration | 18.561 | 28.034 | 33.088 | 34.84 | 37.887 | 28.045 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 59.546655 Full duration: 73.568634 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 20 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6dd1b05b-317d-41c1-8b75-a985824e8cec has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.055 | 4.902 | 5.761 | 5.784 | 5.927 | 4.665 | 100.0% | 40 | | total | 1.175 | 5.243 | 5.872 | 5.953 | 6.051 | 4.939 | 100.0% | 40 | | -> duration | 1.175 | 5.243 | 5.872 | 5.953 | 6.051 | 4.939 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.113961 Full duration: 39.716715 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunk_subports args position 0 args values: { "runner": { "concurrency": 4, "times": 4 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "args": { "subport_count": 125 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6dd1b05b-317d-41c1-8b75-a985824e8cec has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.872 | 1.067 | 1.258 | 1.262 | 1.265 | 1.068 | 100.0% | 4 | | neutron.create_subnet | 0.878 | 1.525 | 1.96 | 1.969 | 1.978 | 1.477 | 100.0% | 4 | | neutron.create_port (x125) | 253.419 | 256.855 | 265.105 | 266.156 | 267.206 | 258.584 | 100.0% | 4 | | neutron.create_trunk | 35.386 | 43.08 | 51.737 | 52.031 | 52.325 | 43.468 | 100.0% | 4 | | neutron.update_port | 1.54 | 1.796 | 1.961 | 1.982 | 2.003 | 1.784 | 100.0% | 4 | | neutron.list_trunks | 0.055 | 0.056 | 0.091 | 0.099 | 0.106 | 0.068 | 100.0% | 4 | | neutron.list_ports_by_device_id | 0.263 | 0.333 | 0.441 | 0.455 | 0.469 | 0.349 | 100.0% | 4 | | neutron.delete_trunk | 0.318 | 0.429 | 0.478 | 0.487 | 0.496 | 0.418 | 100.0% | 4 | | total | 295.264 | 309.203 | 314.159 | 314.69 | 315.221 | 307.223 | 100.0% | 4 | | -> duration | 295.264 | 309.203 | 314.159 | 314.69 | 315.221 | 307.223 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 315.227705 Full duration: 410.149339 HINTS: * To plot HTML graphics with this data, run: rally task report 6dd1b05b-317d-41c1-8b75-a985824e8cec --out output.html * To generate a JUnit report, run: rally task export 6dd1b05b-317d-41c1-8b75-a985824e8cec --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 6dd1b05b-317d-41c1-8b75-a985824e8cec --json --out output.json 2020-03-20 01:02:22,792 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'6dd1b05b-317d-41c1-8b75-a985824e8cec', '--out', u'/home/opnfv/functest/results/rally_jobs/neutron.json'] 2020-03-20 01:02:25,598 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 6dd1b05b-317d-41c1-8b75-a985824e8cec --out /home/opnfv/functest/results/rally_jobs/neutron.json 2020-03-20 01:02:25,750 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2020-03-20 01:02:25,752 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 00:43:46 | 612 | 100.00% | | | | | | | TOTAL: | 00:43:46 | 612 | 100.00% | +-----------+------------+----------------+-----------+ 2020-03-20 01:02:25,752 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs' success_rate is 100.00% in 1/1 modules 2020-03-20 01:02:25,752 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.html'] 2020-03-20 01:02:28,226 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.html 2020-03-20 01:02:28,226 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.xml'] 2020-03-20 01:02:30,884 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.xml 2020-03-20 01:02:30,885 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_jobs | functest | 44:47 | PASS | +--------------------+------------------+------------------+----------------+ 2020-03-20 01:02:45,921 - functest.core.singlevm - DEBUG - Cleaning security group 27fcc92e-4824-4fa8-ad09-fdb5074978b7 2020-03-20 01:02:46,271 - functest.core.singlevm - DEBUG - Cleaning security group 690f65e4-6bf3-4950-aac7-f60a3c5a4c4f 2020-03-20 01:02:46,840 - functest.core.singlevm - DEBUG - Cleaning security group f8f9ed90-b335-4ff4-8ef8-252c7601e593 2020-03-20 01:02:49,591 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)