2020-12-08 15:21:45,351 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | WR7HM1BV0NA2 | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airs | | | hip-opnfv-functest-benchmarking-latest-rally_jobs- | | | run-184 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/ai | | | rship-opnfv-functest-benchmarking-latest- | | | rally_jobs-run-184 | +-------------------------+------------------------------------------------------------+ 2020-12-08 15:21:45,368 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs'... 2020-12-08 15:21:48,484 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs'... 2020-12-08 15:21:53,503 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2020-12-08 15:21:59,871 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | f550587d-6faf-4b65-ae95-946f264448c8 | 2020-12-08T15:21:59.657175 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: f550587d-6faf-4b65-ae95-946f264448c8 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-12-08 15:22:04,740 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-12-08 15:22:06,724 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-12-08 16:37:12,266 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 6f93330c-95ea-4d32-9194-c5afce1ef718 2020-12-08 16:37:13,674 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 6f93330c-95ea-4d32-9194-c5afce1ef718 -------------------------------------------------------------------------------- Task 6f93330c-95ea-4d32-9194-c5afce1ef718: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": {}, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": 119 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f93330c-95ea-4d32-9194-c5afce1ef718 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 3.21 | 11.417 | 16.477 | 18.23 | 26.346 | 11.472 | 100.0% | 100 | | neutron.list_networks | 0.263 | 5.997 | 10.781 | 11.378 | 12.256 | 5.41 | 100.0% | 100 | | total | 6.483 | 17.005 | 21.828 | 24.377 | 38.328 | 16.882 | 100.0% | 100 | | -> duration | 6.483 | 17.005 | 21.828 | 24.377 | 38.328 | 16.882 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 87.82655 Full duration: 137.224831 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false, "name": "_updated" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f93330c-95ea-4d32-9194-c5afce1ef718 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.933 | 10.992 | 13.532 | 13.735 | 16.58 | 10.378 | 100.0% | 40 | | neutron.update_network | 2.247 | 4.042 | 4.735 | 4.976 | 5.661 | 4.008 | 100.0% | 40 | | total | 5.74 | 15.275 | 17.241 | 18.602 | 18.832 | 14.387 | 100.0% | 40 | | -> duration | 5.74 | 15.275 | 17.241 | 18.602 | 18.832 | 14.387 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 32.432413 Full duration: 64.631835 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "args": {}, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f93330c-95ea-4d32-9194-c5afce1ef718 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 6.682 | 14.027 | 17.852 | 18.184 | 18.648 | 13.292 | 100.0% | 40 | | neutron.delete_network | 2.896 | 4.394 | 5.759 | 5.924 | 6.051 | 4.662 | 100.0% | 40 | | total | 10.834 | 19.117 | 22.874 | 23.685 | 23.924 | 17.954 | 100.0% | 40 | | -> duration | 10.834 | 19.117 | 22.874 | 23.685 | 23.924 | 17.954 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 38.398221 Full duration: 57.922311 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f93330c-95ea-4d32-9194-c5afce1ef718 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 5.82 | 13.722 | 23.865 | 24.195 | 31.658 | 13.897 | 100.0% | 40 | | neutron.create_subnet (x2) | 24.364 | 37.972 | 54.856 | 56.087 | 57.529 | 42.305 | 100.0% | 40 | | neutron.list_subnets | 0.202 | 0.744 | 5.098 | 6.23 | 6.602 | 2.016 | 100.0% | 40 | | total | 45.575 | 56.255 | 64.885 | 64.975 | 65.064 | 58.219 | 100.0% | 40 | | -> duration | 45.575 | 56.255 | 64.885 | 64.975 | 65.064 | 58.219 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 120.936631 Full duration: 187.053362 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_update_args": { "enable_dhcp": true, "name": "_subnet_updated" } }, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 5 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f93330c-95ea-4d32-9194-c5afce1ef718 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 5.006 | 12.925 | 19.747 | 22.755 | 25.055 | 12.936 | 100.0% | 100 | | neutron.create_subnet (x2) | 22.049 | 34.518 | 43.353 | 46.054 | 54.384 | 35.023 | 100.0% | 100 | | neutron.update_subnet (x2) | 6.32 | 11.299 | 15.82 | 16.762 | 17.279 | 11.49 | 100.0% | 100 | | total | 45.321 | 59.858 | 69.124 | 72.614 | 74.697 | 59.449 | 100.0% | 100 | | -> duration | 45.321 | 59.858 | 69.124 | 72.614 | 74.697 | 59.449 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 307.44206 Full duration: 427.114247 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f93330c-95ea-4d32-9194-c5afce1ef718 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 4.463 | 11.267 | 18.295 | 21.445 | 26.369 | 12.141 | 100.0% | 40 | | neutron.create_subnet (x2) | 17.239 | 25.375 | 33.569 | 35.526 | 36.729 | 25.558 | 100.0% | 40 | | neutron.delete_subnet (x2) | 5.665 | 12.054 | 13.335 | 13.383 | 13.559 | 11.179 | 100.0% | 40 | | total | 30.984 | 50.109 | 62.828 | 64.866 | 67.261 | 48.9 | 100.0% | 40 | | -> duration | 30.984 | 50.109 | 62.828 | 64.866 | 67.261 | 48.9 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 101.775543 Full duration: 134.433591 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 0 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {}, "router_update_args": { "admin_state_up": false, "name": "_router_updated" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f93330c-95ea-4d32-9194-c5afce1ef718 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 8.970537 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": null, "port_create_args": null, "ports_per_network": 50 }, "runner": { "times": 8, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1, "port": 811 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f93330c-95ea-4d32-9194-c5afce1ef718 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 10.247028 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner", "name": "_port_updated" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f93330c-95ea-4d32-9194-c5afce1ef718 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 5.45 | 17.318 | 22.96 | 25.073 | 26.716 | 16.446 | 100.0% | 40 | | neutron.create_port (x5) | 73.871 | 86.271 | 97.677 | 98.852 | 101.348 | 87.51 | 100.0% | 40 | | neutron.update_port (x5) | 22.141 | 30.271 | 36.404 | 37.857 | 39.709 | 30.304 | 100.0% | 40 | | total | 118.593 | 132.345 | 144.652 | 152.549 | 156.26 | 134.298 | 100.0% | 40 | | -> duration | 118.593 | 132.345 | 144.652 | 152.549 | 156.26 | 134.298 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 282.01805 Full duration: 377.829832 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 2 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f93330c-95ea-4d32-9194-c5afce1ef718 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 3.816 | 19.583 | 23.974 | 24.376 | 29.028 | 16.102 | 100.0% | 40 | | neutron.create_port (x5) | 97.164 | 115.396 | 124.573 | 126.195 | 129.473 | 113.892 | 100.0% | 40 | | neutron.delete_port (x5) | 22.683 | 35.013 | 40.474 | 41.744 | 45.454 | 34.676 | 100.0% | 40 | | total | 144.398 | 171.914 | 182.01 | 182.902 | 186.867 | 164.71 | 100.0% | 40 | | -> duration | 144.398 | 171.914 | 182.01 | 182.902 | 186.867 | 164.71 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 343.947906 Full duration: 384.698712 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunks args position 0 args values: { "args": { "subport_count": 125 }, "runner": { "times": 4, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f93330c-95ea-4d32-9194-c5afce1ef718 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 3.51 | 5.66 | 5.872 | 5.873 | 5.874 | 5.176 | 100.0% | 4 | | neutron.create_port (x126) | 466.686 | 484.921 | 510.377 | 512.64 | 514.903 | 487.858 | 100.0% | 4 | | neutron.create_trunk | 16.082 | 16.54 | 19.075 | 19.564 | 20.053 | 17.304 | 100.0% | 4 | | neutron.update_port | 2.208 | 2.463 | 2.559 | 2.566 | 2.572 | 2.426 | 100.0% | 4 | | neutron.list_trunks | 0.095 | 0.109 | 0.387 | 0.444 | 0.502 | 0.204 | 100.0% | 4 | | neutron.list_subports_by_trunk | 0.1 | 0.118 | 0.248 | 0.275 | 0.302 | 0.16 | 100.0% | 4 | | neutron.list_ports_by_device_id | 0.569 | 1.259 | 1.369 | 1.369 | 1.37 | 1.114 | 100.0% | 4 | | total | 494.826 | 510.799 | 536.151 | 538.36 | 540.57 | 514.248 | 100.0% | 4 | | -> duration | 494.826 | 510.799 | 536.151 | 538.36 | 540.57 | 514.248 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 540.585944 Full duration: 767.237448 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f93330c-95ea-4d32-9194-c5afce1ef718 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 2.043 | 9.804 | 14.191 | 16.825 | 18.56 | 9.803 | 100.0% | 50 | | neutron.create_security_group_rule | 3.413 | 9.883 | 17.124 | 18.78 | 19.178 | 10.857 | 100.0% | 50 | | neutron.delete_security_group_rule | 1.166 | 2.701 | 6.35 | 6.823 | 9.182 | 3.501 | 100.0% | 50 | | neutron.delete_security_group | 1.1 | 2.993 | 4.548 | 5.019 | 10.416 | 3.37 | 100.0% | 50 | | total | 10.162 | 29.363 | 32.761 | 33.485 | 34.838 | 27.531 | 100.0% | 50 | | -> duration | 10.162 | 29.363 | 32.761 | 33.485 | 34.838 | 27.531 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 151.29777 Full duration: 191.9224 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 1 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f93330c-95ea-4d32-9194-c5afce1ef718 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.332 | 7.74 | 12.535 | 13.46 | 14.949 | 7.961 | 100.0% | 50 | | neutron.delete_security_group | 0.288 | 1.95 | 3.56 | 3.865 | 4.585 | 2.161 | 100.0% | 50 | | total | 2.205 | 10.128 | 15.446 | 16.108 | 17.143 | 10.122 | 100.0% | 50 | | -> duration | 2.205 | 10.128 | 15.446 | 16.108 | 17.143 | 10.122 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 52.01142 Full duration: 90.975893 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 2 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {}, "security_group_rules_count": 20 }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f93330c-95ea-4d32-9194-c5afce1ef718 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 3.503 | 10.297 | 16.706 | 17.836 | 20.481 | 10.639 | 100.0% | 50 | | neutron.create_security_group_rule (x20) | 159.617 | 205.632 | 244.522 | 248.331 | 252.982 | 208.795 | 100.0% | 50 | | neutron.list_security_group_rules | 0.334 | 3.853 | 6.742 | 7.775 | 10.771 | 3.967 | 100.0% | 50 | | total | 172.558 | 221.247 | 263.692 | 265.134 | 270.833 | 223.409 | 100.0% | 50 | | -> duration | 172.558 | 221.247 | 263.692 | 265.134 | 270.833 | 223.409 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1128.638236 Full duration: 1208.17281 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_groups args position 3 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f93330c-95ea-4d32-9194-c5afce1ef718 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.258 | 4.37 | 8.234 | 9.131 | 9.519 | 4.675 | 100.0% | 50 | | neutron.list_security_groups | 0.139 | 1.023 | 2.472 | 2.927 | 4.098 | 1.234 | 100.0% | 50 | | total | 1.725 | 5.516 | 9.906 | 10.551 | 12.353 | 5.909 | 100.0% | 50 | | -> duration | 1.725 | 5.516 | 9.906 | 10.551 | 12.353 | 5.909 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 34.370704 Full duration: 80.291984 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group_rule args position 4 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f93330c-95ea-4d32-9194-c5afce1ef718 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.907 | 8.347 | 14.571 | 15.289 | 21.513 | 9.179 | 100.0% | 50 | | neutron.create_security_group_rule | 2.408 | 6.986 | 9.534 | 11.277 | 14.408 | 7.148 | 100.0% | 50 | | neutron.show_security_group_rule | 0.034 | 0.051 | 0.067 | 0.082 | 0.458 | 0.066 | 100.0% | 50 | | total | 4.715 | 16.254 | 21.25 | 22.866 | 23.973 | 16.393 | 100.0% | 50 | | -> duration | 4.715 | 16.254 | 21.25 | 22.866 | 23.973 | 16.393 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 84.886735 Full duration: 137.153128 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 5 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f93330c-95ea-4d32-9194-c5afce1ef718 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.062 | 5.479 | 7.63 | 7.883 | 9.263 | 5.49 | 100.0% | 50 | | neutron.show_security_group | 0.057 | 0.104 | 0.168 | 0.294 | 0.472 | 0.127 | 100.0% | 50 | | total | 1.187 | 5.594 | 7.767 | 7.972 | 9.346 | 5.617 | 100.0% | 50 | | -> duration | 1.187 | 5.594 | 7.767 | 7.972 | 9.346 | 5.617 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 29.823637 Full duration: 78.805481 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_update_security_groups args position 6 args values: { "args": { "security_group_create_args": {}, "security_group_update_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6f93330c-95ea-4d32-9194-c5afce1ef718 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.275 | 8.475 | 17.701 | 18.503 | 18.933 | 8.937 | 100.0% | 50 | | neutron.update_security_group | 0.175 | 2.261 | 9.296 | 10.122 | 10.662 | 3.264 | 100.0% | 50 | | total | 1.451 | 10.092 | 20.92 | 21.085 | 21.444 | 12.201 | 100.0% | 50 | | -> duration | 1.451 | 10.092 | 20.92 | 21.085 | 21.444 | 12.201 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 70.146212 Full duration: 118.053245 HINTS: * To plot HTML graphics with this data, run: rally task report 6f93330c-95ea-4d32-9194-c5afce1ef718 --out output.html * To generate a JUnit report, run: rally task export 6f93330c-95ea-4d32-9194-c5afce1ef718 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 6f93330c-95ea-4d32-9194-c5afce1ef718 --json --out output.json At least one workload did not pass SLA criteria. 2020-12-08 16:37:17,061 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 6f93330c-95ea-4d32-9194-c5afce1ef718 --out /home/opnfv/functest/results/rally_jobs/neutron.json 2020-12-08 16:37:17,155 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed. 2020-12-08 16:37:17,157 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 01:14:22 | 794 | 100.00% | | | | | | | TOTAL: | 01:14:22 | 794 | 100.00% | +-----------+------------+----------------+-----------+ 2020-12-08 16:37:17,157 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs' success_rate is 100.00% in 0/1 modules 2020-12-08 16:37:20,494 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.html 2020-12-08 16:37:23,570 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.xml 2020-12-08 16:37:23,571 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_jobs | functest | 75:35 | FAIL | +--------------------+------------------+------------------+----------------+