2020-12-09 20:02:08,640 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | E4QQGUBM31BK | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/E4QQGUBM31BK/airs | | | hip-opnfv-functest-benchmarking-latest-rally_jobs- | | | run-185 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/E4QQGUBM31BK/ai | | | rship-opnfv-functest-benchmarking-latest- | | | rally_jobs-run-185 | +-------------------------+------------------------------------------------------------+ 2020-12-09 20:02:08,658 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs'... 2020-12-09 20:02:12,280 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs'... 2020-12-09 20:02:17,570 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2020-12-09 20:02:24,019 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | ef8a0289-6d6b-44e5-b831-97eb0a1ced7d | 2020-12-09T20:02:23.730996 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: ef8a0289-6d6b-44e5-b831-97eb0a1ced7d ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-12-09 20:02:28,856 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-12-09 20:02:30,945 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-12-09 21:28:41,248 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 70c2a996-d9fd-4422-a91b-1a691c31a10d 2020-12-09 21:28:42,578 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 70c2a996-d9fd-4422-a91b-1a691c31a10d -------------------------------------------------------------------------------- Task 70c2a996-d9fd-4422-a91b-1a691c31a10d: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": {}, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": 119 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 70c2a996-d9fd-4422-a91b-1a691c31a10d has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 4.604 | 17.888 | 31.795 | 32.997 | 56.23 | 19.823 | 100.0% | 100 | | neutron.list_networks | 0.258 | 7.464 | 15.811 | 19.387 | 22.115 | 7.714 | 100.0% | 100 | | total | 8.632 | 26.774 | 39.408 | 42.96 | 56.695 | 27.538 | 100.0% | 100 | | -> duration | 8.632 | 26.774 | 39.408 | 42.96 | 56.695 | 27.538 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 144.333763 Full duration: 199.24313 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false, "name": "_updated" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 70c2a996-d9fd-4422-a91b-1a691c31a10d has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 4.639 | 13.016 | 18.532 | 19.229 | 20.03 | 13.531 | 100.0% | 40 | | neutron.update_network | 2.451 | 4.534 | 7.573 | 7.808 | 8.076 | 4.831 | 100.0% | 40 | | total | 9.217 | 19.043 | 22.3 | 23.016 | 24.155 | 18.363 | 100.0% | 40 | | -> duration | 9.217 | 19.043 | 22.3 | 23.016 | 24.155 | 18.363 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 43.034416 Full duration: 80.331812 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "args": {}, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 70c2a996-d9fd-4422-a91b-1a691c31a10d has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 8.602 | 14.24 | 16.944 | 17.2 | 20.581 | 13.735 | 100.0% | 40 | | neutron.delete_network | 3.039 | 5.661 | 7.902 | 8.793 | 9.123 | 6.057 | 100.0% | 40 | | total | 14.115 | 20.085 | 22.341 | 22.442 | 26.069 | 19.791 | 100.0% | 40 | | -> duration | 14.115 | 20.085 | 22.341 | 22.442 | 26.069 | 19.791 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 43.985138 Full duration: 61.601522 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 70c2a996-d9fd-4422-a91b-1a691c31a10d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 8.112 | 13.255 | 19.993 | 20.158 | 20.416 | 14.539 | 100.0% | 40 | | neutron.create_subnet (x2) | 33.111 | 46.373 | 58.175 | 60.302 | 61.672 | 46.783 | 100.0% | 40 | | neutron.list_subnets | 0.201 | 4.168 | 7.247 | 7.872 | 9.936 | 3.815 | 100.0% | 40 | | total | 46.138 | 66.939 | 76.549 | 76.616 | 76.72 | 65.137 | 100.0% | 40 | | -> duration | 46.138 | 66.939 | 76.549 | 76.616 | 76.72 | 65.137 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 134.808626 Full duration: 200.297263 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_update_args": { "enable_dhcp": true, "name": "_subnet_updated" } }, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 5 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 70c2a996-d9fd-4422-a91b-1a691c31a10d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 5.068 | 19.577 | 29.564 | 30.61 | 37.439 | 18.04 | 100.0% | 100 | | neutron.create_subnet (x2) | 16.766 | 32.44 | 45.208 | 48.024 | 60.092 | 32.736 | 100.0% | 100 | | neutron.update_subnet (x2) | 5.908 | 12.773 | 19.361 | 20.823 | 24.032 | 13.211 | 100.0% | 100 | | total | 33.539 | 65.394 | 85.367 | 88.371 | 93.427 | 63.988 | 100.0% | 100 | | -> duration | 33.539 | 65.394 | 85.367 | 88.371 | 93.427 | 63.988 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 329.586122 Full duration: 506.553479 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 70c2a996-d9fd-4422-a91b-1a691c31a10d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 10.733 | 18.513 | 24.003 | 24.576 | 25.109 | 17.798 | 100.0% | 40 | | neutron.create_subnet (x2) | 35.708 | 42.008 | 45.993 | 46.377 | 48.591 | 42.047 | 100.0% | 40 | | neutron.delete_subnet (x2) | 12.655 | 19.889 | 26.943 | 27.167 | 28.507 | 19.994 | 100.0% | 40 | | total | 75.126 | 79.721 | 83.952 | 84.333 | 85.39 | 79.868 | 100.0% | 40 | | -> duration | 75.126 | 79.721 | 83.952 | 84.333 | 85.39 | 79.868 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 163.046969 Full duration: 204.317519 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": null, "port_create_args": null, "ports_per_network": 50 }, "runner": { "times": 8, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1, "port": 811 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 70c2a996-d9fd-4422-a91b-1a691c31a10d has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 10.947782 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner", "name": "_port_updated" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 70c2a996-d9fd-4422-a91b-1a691c31a10d has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 6.394 | 19.44 | 25.076 | 25.309 | 25.704 | 18.623 | 100.0% | 40 | | neutron.create_port (x5) | 63.793 | 89.388 | 108.734 | 109.388 | 111.184 | 88.287 | 100.0% | 40 | | neutron.update_port (x5) | 23.681 | 31.671 | 38.373 | 38.895 | 42.235 | 32.352 | 100.0% | 40 | | total | 112.173 | 139.687 | 158.356 | 159.001 | 163.958 | 139.303 | 100.0% | 40 | | -> duration | 112.173 | 139.687 | 158.356 | 159.001 | 163.958 | 139.303 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 285.514027 Full duration: 383.721959 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 2 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 70c2a996-d9fd-4422-a91b-1a691c31a10d has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 4.054 | 11.611 | 16.933 | 19.353 | 22.863 | 11.638 | 100.0% | 40 | | neutron.create_port (x5) | 79.917 | 107.324 | 120.005 | 120.928 | 123.098 | 102.355 | 100.0% | 40 | | neutron.delete_port (x5) | 21.444 | 34.222 | 40.574 | 41.752 | 43.901 | 33.864 | 100.0% | 40 | | total | 115.301 | 152.71 | 165.182 | 165.242 | 165.27 | 147.892 | 100.0% | 40 | | -> duration | 115.301 | 152.71 | 165.182 | 165.242 | 165.27 | 147.892 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 308.630094 Full duration: 343.556958 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunks args position 0 args values: { "args": { "subport_count": 125 }, "runner": { "times": 4, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 70c2a996-d9fd-4422-a91b-1a691c31a10d has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 5.377 | 6.984 | 7.584 | 7.671 | 7.759 | 6.776 | 100.0% | 4 | | neutron.create_port (x126) | 641.085 | 674.343 | 689.315 | 689.904 | 690.493 | 670.066 | 100.0% | 4 | | neutron.create_trunk | 18.632 | 25.231 | 26.549 | 26.745 | 26.94 | 24.009 | 100.0% | 4 | | neutron.update_port | 2.481 | 3.333 | 4.139 | 4.275 | 4.41 | 3.389 | 100.0% | 4 | | neutron.list_trunks | 0.061 | 0.119 | 0.145 | 0.147 | 0.148 | 0.112 | 100.0% | 4 | | neutron.list_subports_by_trunk | 0.11 | 0.128 | 0.167 | 0.175 | 0.183 | 0.137 | 100.0% | 4 | | neutron.list_ports_by_device_id | 0.614 | 0.851 | 1.025 | 1.043 | 1.06 | 0.844 | 100.0% | 4 | | total | 677.52 | 708.517 | 723.857 | 725.334 | 726.811 | 705.341 | 100.0% | 4 | | -> duration | 677.52 | 708.517 | 723.857 | 725.334 | 726.811 | 705.341 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 726.841545 Full duration: 982.247671 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 70c2a996-d9fd-4422-a91b-1a691c31a10d has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 3.986 | 13.601 | 28.414 | 29.457 | 31.018 | 14.724 | 100.0% | 50 | | neutron.create_security_group_rule | 6.488 | 15.059 | 22.939 | 23.322 | 25.663 | 15.628 | 100.0% | 50 | | neutron.delete_security_group_rule | 2.847 | 4.873 | 8.741 | 9.462 | 10.918 | 5.376 | 100.0% | 50 | | neutron.delete_security_group | 1.427 | 6.116 | 8.292 | 9.447 | 11.754 | 5.57 | 100.0% | 50 | | total | 20.435 | 41.634 | 57.437 | 59.375 | 61.856 | 41.298 | 100.0% | 50 | | -> duration | 20.435 | 41.634 | 57.437 | 59.375 | 61.856 | 41.298 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 207.157891 Full duration: 246.696953 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 1 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 70c2a996-d9fd-4422-a91b-1a691c31a10d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.057 | 8.607 | 17.215 | 17.659 | 18.045 | 9.04 | 100.0% | 50 | | neutron.delete_security_group | 0.318 | 2.154 | 3.728 | 4.437 | 8.244 | 2.253 | 100.0% | 50 | | total | 3.035 | 11.903 | 18.831 | 19.002 | 19.684 | 11.293 | 100.0% | 50 | | -> duration | 3.035 | 11.903 | 18.831 | 19.002 | 19.684 | 11.293 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 60.406464 Full duration: 100.950203 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_group_rules args position 2 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {}, "security_group_rules_count": 20 }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 70c2a996-d9fd-4422-a91b-1a691c31a10d has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 4.319 | 8.856 | 12.806 | 13.958 | 14.387 | 9.061 | 100.0% | 50 | | neutron.create_security_group_rule (x20) | 153.949 | 221.386 | 247.475 | 249.519 | 255.906 | 206.829 | 100.0% | 50 | | neutron.list_security_group_rules | 0.315 | 2.253 | 4.818 | 5.127 | 5.958 | 2.518 | 100.0% | 50 | | total | 165.351 | 230.791 | 260.835 | 261.532 | 267.526 | 218.417 | 100.0% | 50 | | -> duration | 165.351 | 230.791 | 260.835 | 261.532 | 267.526 | 218.417 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1096.317731 Full duration: 1171.605895 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_list_security_groups args position 3 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 70c2a996-d9fd-4422-a91b-1a691c31a10d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 4.938 | 10.935 | 21.963 | 24.914 | 28.359 | 12.588 | 100.0% | 50 | | neutron.list_security_groups | 0.271 | 3.688 | 8.292 | 10.038 | 11.741 | 3.891 | 100.0% | 50 | | total | 5.98 | 14.964 | 28.597 | 29.512 | 29.722 | 16.479 | 100.0% | 50 | | -> duration | 5.98 | 14.964 | 28.597 | 29.512 | 29.722 | 16.479 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 86.294552 Full duration: 151.074262 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group_rule args position 4 args values: { "args": { "security_group_args": {}, "security_group_rule_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1, "security_group_rule": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 70c2a996-d9fd-4422-a91b-1a691c31a10d has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 5.396 | 12.491 | 17.412 | 18.176 | 19.592 | 12.789 | 100.0% | 50 | | neutron.create_security_group_rule | 7.561 | 12.023 | 18.192 | 20.346 | 23.192 | 12.896 | 100.0% | 50 | | neutron.show_security_group_rule | 0.038 | 0.051 | 0.07 | 0.073 | 0.376 | 0.059 | 100.0% | 50 | | total | 16.283 | 26.188 | 31.04 | 32.027 | 35.474 | 25.748 | 100.0% | 50 | | -> duration | 16.283 | 26.188 | 31.04 | 32.027 | 35.474 | 25.748 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 131.281085 Full duration: 195.451733 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_show_security_group args position 5 args values: { "args": { "security_group_create_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 70c2a996-d9fd-4422-a91b-1a691c31a10d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 7.403 | 10.8 | 14.761 | 16.598 | 18.66 | 11.181 | 100.0% | 50 | | neutron.show_security_group | 0.066 | 0.088 | 0.119 | 0.27 | 0.414 | 0.108 | 100.0% | 50 | | total | 7.473 | 10.891 | 14.856 | 16.687 | 18.757 | 11.289 | 100.0% | 50 | | -> duration | 7.473 | 10.891 | 14.856 | 16.687 | 18.757 | 11.289 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 62.211746 Full duration: 132.15878 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_update_security_groups args position 6 args values: { "args": { "security_group_create_args": {}, "security_group_update_args": {} }, "runner": { "times": 50, "concurrency": 10 }, "contexts": { "users": { "tenants": 2, "users_per_tenant": 3 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 70c2a996-d9fd-4422-a91b-1a691c31a10d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 6.864 | 10.923 | 17.324 | 17.509 | 19.422 | 11.979 | 100.0% | 50 | | neutron.update_security_group | 0.819 | 4.147 | 9.261 | 9.418 | 9.64 | 4.687 | 100.0% | 50 | | total | 12.061 | 17.127 | 20.671 | 21.118 | 22.07 | 16.667 | 100.0% | 50 | | -> duration | 12.061 | 17.127 | 20.671 | 21.118 | 22.07 | 16.667 | 100.0% | 50 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 50 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 84.338738 Full duration: 154.284312 HINTS: * To plot HTML graphics with this data, run: rally task report 70c2a996-d9fd-4422-a91b-1a691c31a10d --out output.html * To generate a JUnit report, run: rally task export 70c2a996-d9fd-4422-a91b-1a691c31a10d --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 70c2a996-d9fd-4422-a91b-1a691c31a10d --json --out output.json At least one workload did not pass SLA criteria. 2020-12-09 21:28:45,853 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 70c2a996-d9fd-4422-a91b-1a691c31a10d --out /home/opnfv/functest/results/rally_jobs/neutron.json 2020-12-09 21:28:45,948 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed. 2020-12-09 21:28:45,949 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 01:25:25 | 794 | 100.00% | | | | | | | TOTAL: | 01:25:25 | 794 | 100.00% | +-----------+------------+----------------+-----------+ 2020-12-09 21:28:45,950 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs' success_rate is 100.00% in 0/1 modules 2020-12-09 21:28:49,287 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.html 2020-12-09 21:28:52,463 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.xml 2020-12-09 21:28:52,464 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_jobs | functest | 86:40 | FAIL | +--------------------+------------------+------------------+----------------+