2020-09-29 12:25:53,392 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | os-nosdn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 07XMXVGY9BT8 | | NODE_NAME | lf-pod4 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest/07XMXVGY9BT8/fun | | | ctest-pi-ollivier-functest-benchmarking-cntt- | | | jerma-rally_jobs_cntt-run-4 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest/07XMXVGY9BT8/f | | | unctest-pi-ollivier-functest-benchmarking-cntt- | | | jerma-rally_jobs_cntt-run-4 | +-------------------------+------------------------------------------------------------+ 2020-09-29 12:25:53,414 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs_cntt'... 2020-09-29 12:25:55,949 - xtesting.ci.run_tests - INFO - Running test case 'rally_jobs_cntt'... 2020-09-29 12:26:01,984 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2020-09-29 12:26:09,603 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 4fd7a7d2-888c-4eac-b09b-0c26b005dd7b | 2020-09-29T12:26:09.335383 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 4fd7a7d2-888c-4eac-b09b-0c26b005dd7b ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-09-29 12:26:13,386 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | compute_legacy | Available | | __unknown__ | event | Available | | __unknown__ | placement | Available | | barbican | key-manager | Available | | cinder | block-storage | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | octavia | load-balancer | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-09-29 12:26:15,243 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-09-29 12:53:55,547 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: bc408f49-46a7-4e1b-b48c-9a516dbeda0c 2020-09-29 12:53:57,085 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid bc408f49-46a7-4e1b-b48c-9a516dbeda0c -------------------------------------------------------------------------------- Task bc408f49-46a7-4e1b-b48c-9a516dbeda0c: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": {}, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": 119 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc408f49-46a7-4e1b-b48c-9a516dbeda0c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.456 | 2.393 | 11.371 | 31.122 | 47.32 | 6.091 | 100.0% | 100 | | neutron.list_networks | 0.156 | 0.393 | 0.548 | 0.594 | 5.734 | 0.535 | 100.0% | 100 | | total | 0.784 | 2.874 | 11.77 | 31.594 | 47.738 | 6.626 | 100.0% | 100 | | -> duration | 0.784 | 2.874 | 11.77 | 31.594 | 47.738 | 6.626 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 49.500225 Full duration: 76.846601 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc408f49-46a7-4e1b-b48c-9a516dbeda0c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.444 | 2.984 | 7.375 | 10.441 | 11.09 | 3.602 | 100.0% | 40 | | neutron.update_network | 0.427 | 0.56 | 0.833 | 0.861 | 1.0 | 0.615 | 100.0% | 40 | | total | 1.019 | 3.457 | 7.832 | 11.058 | 11.556 | 4.217 | 100.0% | 40 | | -> duration | 1.019 | 3.457 | 7.832 | 11.058 | 11.556 | 4.217 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.040897 Full duration: 25.79474 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "args": {}, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc408f49-46a7-4e1b-b48c-9a516dbeda0c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.414 | 2.073 | 15.038 | 16.543 | 17.412 | 5.856 | 100.0% | 40 | | neutron.delete_network | 0.656 | 0.79 | 4.157 | 6.248 | 6.659 | 1.536 | 100.0% | 40 | | total | 1.179 | 4.144 | 16.102 | 17.46 | 18.487 | 7.392 | 100.0% | 40 | | -> duration | 1.179 | 4.144 | 16.102 | 17.46 | 18.487 | 7.392 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.616209 Full duration: 24.375772 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc408f49-46a7-4e1b-b48c-9a516dbeda0c has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.603 | 2.318 | 8.025 | 13.536 | 18.463 | 3.794 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.852 | 5.008 | 17.699 | 18.083 | 18.396 | 6.998 | 100.0% | 40 | | neutron.list_subnets | 0.122 | 0.304 | 0.636 | 0.766 | 5.959 | 0.478 | 100.0% | 40 | | total | 3.072 | 8.783 | 23.202 | 24.33 | 26.307 | 11.271 | 100.0% | 40 | | -> duration | 3.072 | 8.783 | 23.202 | 24.33 | 26.307 | 11.271 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 29.681759 Full duration: 71.698482 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_update_args": { "enable_dhcp": true } }, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 5 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc408f49-46a7-4e1b-b48c-9a516dbeda0c has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.443 | 2.322 | 14.468 | 26.704 | 54.094 | 6.162 | 100.0% | 100 | | neutron.create_subnet (x2) | 1.695 | 5.012 | 12.871 | 13.722 | 16.198 | 6.219 | 100.0% | 100 | | neutron.update_subnet (x2) | 0.919 | 2.324 | 8.038 | 9.475 | 11.803 | 3.287 | 100.0% | 100 | | total | 3.13 | 13.303 | 25.399 | 33.997 | 62.315 | 15.668 | 100.0% | 100 | | -> duration | 3.13 | 13.303 | 25.399 | 33.997 | 62.315 | 15.668 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 88.40386 Full duration: 170.880207 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc408f49-46a7-4e1b-b48c-9a516dbeda0c has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.457 | 1.507 | 8.395 | 9.77 | 11.284 | 2.967 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.686 | 6.572 | 15.358 | 16.279 | 17.438 | 7.244 | 100.0% | 40 | | neutron.delete_subnet (x2) | 1.019 | 3.449 | 17.754 | 19.518 | 25.564 | 7.181 | 100.0% | 40 | | total | 3.268 | 14.348 | 37.031 | 38.56 | 38.904 | 17.443 | 100.0% | 40 | | -> duration | 3.268 | 14.348 | 37.031 | 38.56 | 38.904 | 17.443 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 43.238911 Full duration: 60.233146 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "args": { "network_create_args": null, "subnet_create_args": null, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": null }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc408f49-46a7-4e1b-b48c-9a516dbeda0c has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.458 | 1.396 | 11.248 | 14.021 | 24.058 | 3.704 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.681 | 7.446 | 12.788 | 14.03 | 15.223 | 7.833 | 100.0% | 40 | | neutron.create_router (x2) | 0.486 | 1.101 | 1.819 | 2.467 | 7.268 | 1.43 | 100.0% | 40 | | neutron.add_interface_router (x2) | 4.511 | 16.848 | 25.693 | 29.833 | 31.259 | 16.164 | 100.0% | 40 | | neutron.list_routers | 0.153 | 0.475 | 0.774 | 1.018 | 6.324 | 0.642 | 100.0% | 40 | | total | 8.652 | 25.281 | 52.19 | 53.312 | 55.467 | 29.775 | 100.0% | 40 | | -> duration | 8.652 | 25.281 | 52.19 | 53.312 | 55.467 | 29.775 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 71.747296 Full duration: 171.484723 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {}, "router_update_args": { "admin_state_up": false } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc408f49-46a7-4e1b-b48c-9a516dbeda0c has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.472 | 2.062 | 8.609 | 8.843 | 11.361 | 3.612 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.594 | 5.463 | 11.673 | 12.85 | 16.04 | 6.638 | 100.0% | 40 | | neutron.create_router (x2) | 0.455 | 1.158 | 1.922 | 2.751 | 7.938 | 1.509 | 100.0% | 40 | | neutron.add_interface_router (x2) | 4.427 | 17.491 | 21.307 | 32.586 | 33.695 | 17.428 | 100.0% | 40 | | neutron.update_router (x2) | 1.173 | 3.404 | 12.602 | 13.453 | 16.144 | 5.067 | 100.0% | 40 | | total | 8.641 | 33.415 | 44.148 | 56.83 | 60.889 | 34.254 | 100.0% | 40 | | -> duration | 8.641 | 33.415 | 44.148 | 56.83 | 60.889 | 34.254 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 78.042325 Full duration: 185.182935 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {} }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc408f49-46a7-4e1b-b48c-9a516dbeda0c has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.452 | 1.273 | 7.341 | 14.1 | 23.982 | 3.398 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.577 | 5.156 | 11.889 | 12.606 | 16.723 | 6.481 | 100.0% | 40 | | neutron.create_router (x2) | 0.393 | 1.258 | 2.792 | 6.843 | 7.186 | 1.782 | 100.0% | 40 | | neutron.add_interface_router (x2) | 4.178 | 17.617 | 36.204 | 36.317 | 41.273 | 18.383 | 100.0% | 40 | | neutron.remove_interface_router (x2) | 3.622 | 17.143 | 34.463 | 34.975 | 38.392 | 16.638 | 100.0% | 40 | | neutron.delete_router (x2) | 0.744 | 2.227 | 7.356 | 7.898 | 10.235 | 2.951 | 100.0% | 40 | | total | 11.738 | 47.207 | 92.56 | 102.234 | 105.806 | 49.633 | 100.0% | 40 | | -> duration | 11.738 | 47.207 | 92.56 | 102.234 | 105.806 | 49.633 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 115.144421 Full duration: 156.446417 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 50 }, "runner": { "times": 8, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1, "port": 811 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc408f49-46a7-4e1b-b48c-9a516dbeda0c has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.394 | 0.663 | 1.997 | 2.136 | 2.275 | 1.013 | 100.0% | 8 | | neutron.create_port (x50) | 41.02 | 46.174 | 47.555 | 47.778 | 48.001 | 45.29 | 100.0% | 8 | | neutron.list_ports | 0.726 | 1.022 | 1.361 | 1.379 | 1.398 | 1.043 | 100.0% | 8 | | total | 42.762 | 47.997 | 50.193 | 50.31 | 50.428 | 47.352 | 100.0% | 8 | | -> duration | 42.762 | 47.997 | 50.193 | 50.31 | 50.428 | 47.352 | 100.0% | 8 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 98.039109 Full duration: 162.111519 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc408f49-46a7-4e1b-b48c-9a516dbeda0c has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.624 | 2.129 | 7.126 | 8.829 | 9.931 | 3.018 | 100.0% | 40 | | neutron.create_port (x5) | 5.335 | 14.014 | 18.532 | 25.783 | 28.644 | 14.193 | 100.0% | 40 | | neutron.update_port (x5) | 2.427 | 8.56 | 14.034 | 14.397 | 14.703 | 8.589 | 100.0% | 40 | | total | 11.866 | 26.275 | 35.833 | 38.546 | 39.685 | 25.859 | 100.0% | 40 | | -> duration | 11.866 | 26.275 | 35.833 | 38.546 | 39.685 | 25.859 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 68.046249 Full duration: 115.849462 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 2 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc408f49-46a7-4e1b-b48c-9a516dbeda0c has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.39 | 7.366 | 24.65 | 31.887 | 42.419 | 9.436 | 100.0% | 40 | | neutron.create_port (x5) | 3.471 | 8.636 | 30.264 | 34.335 | 35.723 | 12.869 | 100.0% | 40 | | neutron.delete_port (x5) | 2.181 | 6.623 | 23.917 | 26.191 | 28.7 | 9.808 | 100.0% | 40 | | total | 6.228 | 22.894 | 69.964 | 71.105 | 71.43 | 32.174 | 100.0% | 40 | | -> duration | 6.228 | 22.894 | 69.964 | 71.105 | 71.43 | 32.174 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 71.666897 Full duration: 89.43611 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 20, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc408f49-46a7-4e1b-b48c-9a516dbeda0c has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.37 | 0.782 | 1.07 | 1.135 | 1.462 | 0.79 | 100.0% | 40 | | total | 0.476 | 0.909 | 1.204 | 1.358 | 1.652 | 0.938 | 100.0% | 40 | | -> duration | 0.476 | 0.909 | 1.204 | 1.358 | 1.652 | 0.938 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.678078 Full duration: 24.12733 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunks args position 0 args values: { "args": { "subport_count": 125 }, "runner": { "times": 4, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bc408f49-46a7-4e1b-b48c-9a516dbeda0c has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.807 | 1.942 | 5.3 | 5.933 | 6.567 | 2.815 | 100.0% | 4 | | neutron.create_port (x126) | 104.95 | 156.731 | 205.763 | 206.35 | 206.937 | 156.337 | 100.0% | 4 | | neutron.create_trunk | 8.45 | 14.07 | 17.039 | 17.622 | 18.205 | 13.699 | 100.0% | 4 | | neutron.update_port | 1.196 | 1.313 | 4.974 | 5.738 | 6.502 | 2.581 | 100.0% | 4 | | neutron.list_trunks | 0.034 | 0.071 | 0.109 | 0.115 | 0.121 | 0.074 | 100.0% | 4 | | neutron.list_subports_by_trunk | 0.054 | 0.062 | 0.071 | 0.072 | 0.074 | 0.063 | 100.0% | 4 | | neutron.list_ports_by_device_id | 0.231 | 0.482 | 0.702 | 0.726 | 0.749 | 0.486 | 100.0% | 4 | | total | 121.494 | 176.961 | 228.317 | 228.57 | 228.822 | 176.06 | 100.0% | 4 | | -> duration | 121.494 | 176.961 | 228.317 | 228.57 | 228.822 | 176.06 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 228.822171 Full duration: 303.052085 HINTS: * To plot HTML graphics with this data, run: rally task report bc408f49-46a7-4e1b-b48c-9a516dbeda0c --out output.html * To generate a JUnit report, run: rally task export bc408f49-46a7-4e1b-b48c-9a516dbeda0c --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report bc408f49-46a7-4e1b-b48c-9a516dbeda0c --json --out output.json 2020-09-29 12:54:00,672 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid bc408f49-46a7-4e1b-b48c-9a516dbeda0c --out /home/opnfv/functest/results/rally_jobs_cntt/neutron.json 2020-09-29 12:54:00,790 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2020-09-29 12:54:00,791 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 00:27:17 | 612 | 100.00% | | | | | | | TOTAL: | 00:27:17 | 612 | 100.00% | +-----------+------------+----------------+-----------+ 2020-09-29 12:54:00,791 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs_cntt' success_rate is 100.00% in 1/1 modules 2020-09-29 12:54:04,552 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.html 2020-09-29 12:54:07,971 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.xml 2020-09-29 12:54:07,972 - xtesting.ci.run_tests - INFO - Test result: +-------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------------+------------------+------------------+----------------+ | rally_jobs_cntt | functest | 28:12 | PASS | +-------------------------+------------------+------------------+----------------+