2020-12-08 08:54:24,332 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | WR7HM1BV0NA2 | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/WR7HM1BV0NA2/airs | | | hip-opnfv-functest-smoke-latest-rally_sanity- | | | run-191 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/WR7HM1BV0NA2/ai | | | rship-opnfv-functest-smoke-latest-rally_sanity- | | | run-191 | +-------------------------+------------------------------------------------------------+ 2020-12-08 08:54:24,400 - xtesting.ci.run_tests - INFO - Loading test case 'rally_sanity'... 2020-12-08 08:54:27,668 - xtesting.ci.run_tests - INFO - Running test case 'rally_sanity'... 2020-12-08 08:54:32,518 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2020-12-08 08:54:39,291 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 4d4f33f1-173e-4aeb-b589-657a30716740 | 2020-12-08T08:54:39.019560 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 4d4f33f1-173e-4aeb-b589-657a30716740 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-12-08 08:54:44,451 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-12-08 08:54:46,188 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-08 08:54:46,342 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2020-12-08 08:56:07,944 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: 7f55bbda-ead6-44bc-9caf-496d3095068c 2020-12-08 08:56:09,295 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 7f55bbda-ead6-44bc-9caf-496d3095068c -------------------------------------------------------------------------------- Task 7f55bbda-ead6-44bc-9caf-496d3095068c: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7f55bbda-ead6-44bc-9caf-496d3095068c has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 1.085 | 1.085 | 1.085 | 1.085 | 1.085 | 1.085 | 100.0% | 1 | | total | 1.085 | 1.085 | 1.085 | 1.085 | 1.085 | 1.085 | 100.0% | 1 | | -> duration | 1.085 | 1.085 | 1.085 | 1.085 | 1.085 | 1.085 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.084981 Full duration: 8.706043 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7f55bbda-ead6-44bc-9caf-496d3095068c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.28 | 0.28 | 0.28 | 0.28 | 0.28 | 0.28 | 100.0% | 1 | | total | 0.887 | 0.887 | 0.887 | 0.887 | 0.887 | 0.887 | 100.0% | 1 | | -> duration | 0.887 | 0.887 | 0.887 | 0.887 | 0.887 | 0.887 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.887459 Full duration: 8.844121 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7f55bbda-ead6-44bc-9caf-496d3095068c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.334 | 0.334 | 0.334 | 0.334 | 0.334 | 0.334 | 100.0% | 1 | | total | 0.943 | 0.943 | 0.943 | 0.943 | 0.943 | 0.943 | 100.0% | 1 | | -> duration | 0.943 | 0.943 | 0.943 | 0.943 | 0.943 | 0.943 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.943183 Full duration: 9.242875 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7f55bbda-ead6-44bc-9caf-496d3095068c has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.296 | 0.296 | 0.296 | 0.296 | 0.296 | 0.296 | 100.0% | 1 | | total | 0.881 | 0.881 | 0.881 | 0.881 | 0.881 | 0.881 | 100.0% | 1 | | -> duration | 0.881 | 0.881 | 0.881 | 0.881 | 0.881 | 0.881 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.881011 Full duration: 10.135622 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7f55bbda-ead6-44bc-9caf-496d3095068c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.461 | 0.461 | 0.461 | 0.461 | 0.461 | 0.461 | 100.0% | 1 | | total | 1.102 | 1.102 | 1.102 | 1.102 | 1.102 | 1.102 | 100.0% | 1 | | -> duration | 1.102 | 1.102 | 1.102 | 1.102 | 1.102 | 1.102 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.102447 Full duration: 10.234283 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7f55bbda-ead6-44bc-9caf-496d3095068c has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.299 | 0.299 | 0.299 | 0.299 | 0.299 | 0.299 | 100.0% | 1 | | total | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 100.0% | 1 | | -> duration | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.959579 Full duration: 10.12811 HINTS: * To plot HTML graphics with this data, run: rally task report 7f55bbda-ead6-44bc-9caf-496d3095068c --out output.html * To generate a JUnit report, run: rally task export 7f55bbda-ead6-44bc-9caf-496d3095068c --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 7f55bbda-ead6-44bc-9caf-496d3095068c --json --out output.json 2020-12-08 08:56:12,512 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 7f55bbda-ead6-44bc-9caf-496d3095068c --out /home/opnfv/functest/results/rally_sanity/authenticate.json 2020-12-08 08:56:12,518 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2020-12-08 08:56:12,546 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-08 08:56:12,712 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2020-12-08 08:58:25,431 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: 6c51abd1-d781-4383-a0dd-14adee8567d5 2020-12-08 08:58:26,806 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 6c51abd1-d781-4383-a0dd-14adee8567d5 -------------------------------------------------------------------------------- Task 6c51abd1-d781-4383-a0dd-14adee8567d5: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6c51abd1-d781-4383-a0dd-14adee8567d5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 6.607 | 6.607 | 6.607 | 6.607 | 6.607 | 6.607 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.098 | 0.098 | 0.098 | 0.098 | 0.098 | 0.098 | 100.0% | 1 | | -> glance_v2.upload_data | 2.942 | 2.942 | 2.942 | 2.942 | 2.942 | 2.942 | 100.0% | 1 | | glance_v2.delete_image | 4.538 | 4.538 | 4.538 | 4.538 | 4.538 | 4.538 | 100.0% | 1 | | total | 11.145 | 11.145 | 11.145 | 11.145 | 11.145 | 11.145 | 100.0% | 1 | | -> duration | 11.145 | 11.145 | 11.145 | 11.145 | 11.145 | 11.145 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.14549 Full duration: 22.668277 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6c51abd1-d781-4383-a0dd-14adee8567d5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 6.152 | 6.152 | 6.152 | 6.152 | 6.152 | 6.152 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.104 | 0.104 | 0.104 | 0.104 | 0.104 | 0.104 | 100.0% | 1 | | -> glance_v2.upload_data | 3.7 | 3.7 | 3.7 | 3.7 | 3.7 | 3.7 | 100.0% | 1 | | glance_v2.list_images | 0.056 | 0.056 | 0.056 | 0.056 | 0.056 | 0.056 | 100.0% | 1 | | total | 6.208 | 6.208 | 6.208 | 6.208 | 6.208 | 6.208 | 100.0% | 1 | | -> duration | 6.208 | 6.208 | 6.208 | 6.208 | 6.208 | 6.208 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.208136 Full duration: 19.635007 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6c51abd1-d781-4383-a0dd-14adee8567d5 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.22 | 0.22 | 0.22 | 0.22 | 0.22 | 0.22 | 100.0% | 1 | | total | 0.22 | 0.22 | 0.22 | 0.22 | 0.22 | 0.22 | 100.0% | 1 | | -> duration | 0.22 | 0.22 | 0.22 | 0.22 | 0.22 | 0.22 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.219928 Full duration: 10.132303 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_sanity-flavor_9b8ad7f6-e1bb-4e99-a373-110c124beb35" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "03af5d5d-b042-405b-bfd2-56322aa0f0ff" } ] } }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6c51abd1-d781-4383-a0dd-14adee8567d5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.038 | 5.038 | 5.038 | 5.038 | 5.038 | 5.038 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.099 | 0.099 | 0.099 | 0.099 | 0.099 | 0.099 | 100.0% | 1 | | -> glance_v2.upload_data | 2.539 | 2.539 | 2.539 | 2.539 | 2.539 | 2.539 | 100.0% | 1 | | nova.boot_servers | 24.154 | 24.154 | 24.154 | 24.154 | 24.154 | 24.154 | 100.0% | 1 | | total | 29.193 | 29.193 | 29.193 | 29.193 | 29.193 | 29.193 | 100.0% | 1 | | -> duration | 28.193 | 28.193 | 28.193 | 28.193 | 28.193 | 28.193 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 28.192923 Full duration: 57.260425 HINTS: * To plot HTML graphics with this data, run: rally task report 6c51abd1-d781-4383-a0dd-14adee8567d5 --out output.html * To generate a JUnit report, run: rally task export 6c51abd1-d781-4383-a0dd-14adee8567d5 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 6c51abd1-d781-4383-a0dd-14adee8567d5 --json --out output.json 2020-12-08 08:58:30,073 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 6c51abd1-d781-4383-a0dd-14adee8567d5 --out /home/opnfv/functest/results/rally_sanity/glance.json 2020-12-08 08:58:30,078 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2020-12-08 08:58:30,109 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-08 08:58:30,279 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2020-12-08 09:02:34,388 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: 5e841aba-9186-437f-96a7-bee60ab8db39 2020-12-08 09:02:35,750 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 5e841aba-9186-437f-96a7-bee60ab8db39 -------------------------------------------------------------------------------- Task 5e841aba-9186-437f-96a7-bee60ab8db39: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5e841aba-9186-437f-96a7-bee60ab8db39 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 3.414 | 3.414 | 3.414 | 3.414 | 3.414 | 3.414 | 100.0% | 1 | | cinder_v3.delete_snapshot | 2.55 | 2.55 | 2.55 | 2.55 | 2.55 | 2.55 | 100.0% | 1 | | total | 5.964 | 5.964 | 5.964 | 5.964 | 5.964 | 5.964 | 100.0% | 1 | | -> duration | 5.964 | 5.964 | 5.964 | 5.964 | 5.964 | 5.964 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.96446 Full duration: 27.056115 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5e841aba-9186-437f-96a7-bee60ab8db39 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.281 | 3.281 | 3.281 | 3.281 | 3.281 | 3.281 | 100.0% | 1 | | cinder_v3.delete_volume | 3.272 | 3.272 | 3.272 | 3.272 | 3.272 | 3.272 | 100.0% | 1 | | total | 6.553 | 6.553 | 6.553 | 6.553 | 6.553 | 6.553 | 100.0% | 1 | | -> duration | 6.553 | 6.553 | 6.553 | 6.553 | 6.553 | 6.553 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.553266 Full duration: 18.808855 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_sanity-img_9b8ad7f6-e1bb-4e99-a373-110c124beb35" }, "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5e841aba-9186-437f-96a7-bee60ab8db39 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 13.86 | 13.86 | 13.86 | 13.86 | 13.86 | 13.86 | 100.0% | 1 | | cinder_v3.delete_volume | 2.518 | 2.518 | 2.518 | 2.518 | 2.518 | 2.518 | 100.0% | 1 | | total | 16.379 | 16.379 | 16.379 | 16.379 | 16.379 | 16.379 | 100.0% | 1 | | -> duration | 16.379 | 16.379 | 16.379 | 16.379 | 16.379 | 16.379 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.37861 Full duration: 35.419309 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5e841aba-9186-437f-96a7-bee60ab8db39 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.47 | 3.47 | 3.47 | 3.47 | 3.47 | 3.47 | 100.0% | 1 | | cinder_v3.delete_volume | 2.742 | 2.742 | 2.742 | 2.742 | 2.742 | 2.742 | 100.0% | 1 | | total | 6.212 | 6.212 | 6.212 | 6.212 | 6.212 | 6.212 | 100.0% | 1 | | -> duration | 6.212 | 6.212 | 6.212 | 6.212 | 6.212 | 6.212 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.211932 Full duration: 20.818077 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5e841aba-9186-437f-96a7-bee60ab8db39 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.93 | 3.93 | 3.93 | 3.93 | 3.93 | 3.93 | 100.0% | 1 | | cinder_v3.extend_volume | 2.358 | 2.358 | 2.358 | 2.358 | 2.358 | 2.358 | 100.0% | 1 | | cinder_v3.delete_volume | 2.262 | 2.262 | 2.262 | 2.262 | 2.262 | 2.262 | 100.0% | 1 | | total | 8.55 | 8.55 | 8.55 | 8.55 | 8.55 | 8.55 | 100.0% | 1 | | -> duration | 8.55 | 8.55 | 8.55 | 8.55 | 8.55 | 8.55 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.550124 Full duration: 23.335645 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5e841aba-9186-437f-96a7-bee60ab8db39 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.526 | 3.526 | 3.526 | 3.526 | 3.526 | 3.526 | 100.0% | 1 | | cinder_v3.delete_volume | 2.528 | 2.528 | 2.528 | 2.528 | 2.528 | 2.528 | 100.0% | 1 | | total | 6.054 | 6.054 | 6.054 | 6.054 | 6.054 | 6.054 | 100.0% | 1 | | -> duration | 6.054 | 6.054 | 6.054 | 6.054 | 6.054 | 6.054 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.0539 Full duration: 27.790689 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5e841aba-9186-437f-96a7-bee60ab8db39 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.871 | 0.871 | 0.871 | 0.871 | 0.871 | 0.871 | 100.0% | 1 | | cinder_v3.list_qos | 0.049 | 0.049 | 0.049 | 0.049 | 0.049 | 0.049 | 100.0% | 1 | | total | 0.92 | 0.92 | 0.92 | 0.92 | 0.92 | 0.92 | 100.0% | 1 | | -> duration | 0.92 | 0.92 | 0.92 | 0.92 | 0.92 | 0.92 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.920475 Full duration: 14.86166 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5e841aba-9186-437f-96a7-bee60ab8db39 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.656 | 0.656 | 0.656 | 0.656 | 0.656 | 0.656 | 100.0% | 1 | | cinder_v3.set_qos | 0.109 | 0.109 | 0.109 | 0.109 | 0.109 | 0.109 | 100.0% | 1 | | total | 0.766 | 0.766 | 0.766 | 0.766 | 0.766 | 0.766 | 100.0% | 1 | | -> duration | 0.766 | 0.766 | 0.766 | 0.766 | 0.766 | 0.766 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.765786 Full duration: 14.507771 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5e841aba-9186-437f-96a7-bee60ab8db39 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.904 | 0.904 | 0.904 | 0.904 | 0.904 | 0.904 | 100.0% | 1 | | cinder_v3.list_types | 0.037 | 0.037 | 0.037 | 0.037 | 0.037 | 0.037 | 100.0% | 1 | | total | 0.941 | 0.941 | 0.941 | 0.941 | 0.941 | 0.941 | 100.0% | 1 | | -> duration | 0.941 | 0.941 | 0.941 | 0.941 | 0.941 | 0.941 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.941186 Full duration: 14.806164 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5e841aba-9186-437f-96a7-bee60ab8db39 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.769 | 0.769 | 0.769 | 0.769 | 0.769 | 0.769 | 100.0% | 1 | | cinder_v3.create_encryption_type | 0.812 | 0.812 | 0.812 | 0.812 | 0.812 | 0.812 | 100.0% | 1 | | total | 1.582 | 1.582 | 1.582 | 1.582 | 1.582 | 1.582 | 100.0% | 1 | | -> duration | 1.582 | 1.582 | 1.582 | 1.582 | 1.582 | 1.582 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.581768 Full duration: 15.030729 HINTS: * To plot HTML graphics with this data, run: rally task report 5e841aba-9186-437f-96a7-bee60ab8db39 --out output.html * To generate a JUnit report, run: rally task export 5e841aba-9186-437f-96a7-bee60ab8db39 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 5e841aba-9186-437f-96a7-bee60ab8db39 --json --out output.json 2020-12-08 09:02:38,969 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 5e841aba-9186-437f-96a7-bee60ab8db39 --out /home/opnfv/functest/results/rally_sanity/cinder.json 2020-12-08 09:02:38,982 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2020-12-08 09:02:39,007 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-08 09:02:39,337 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2020-12-08 09:05:45,761 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: c1e5b56c-e6f9-455b-9453-5f9dfc5c9e47 2020-12-08 09:05:47,110 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid c1e5b56c-e6f9-455b-9453-5f9dfc5c9e47 -------------------------------------------------------------------------------- Task c1e5b56c-e6f9-455b-9453-5f9dfc5c9e47: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c1e5b56c-e6f9-455b-9453-5f9dfc5c9e47 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 16.596 | 16.596 | 16.596 | 16.596 | 16.596 | 16.596 | 100.0% | 1 | | heat.update_stack | 7.794 | 7.794 | 7.794 | 7.794 | 7.794 | 7.794 | 100.0% | 1 | | heat.delete_stack | 12.437 | 12.437 | 12.437 | 12.437 | 12.437 | 12.437 | 100.0% | 1 | | total | 36.827 | 36.827 | 36.827 | 36.827 | 36.827 | 36.827 | 100.0% | 1 | | -> duration | 32.827 | 32.827 | 32.827 | 32.827 | 32.827 | 32.827 | 100.0% | 1 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 32.827194 Full duration: 59.975639 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c1e5b56c-e6f9-455b-9453-5f9dfc5c9e47 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 8.906 | 8.906 | 8.906 | 8.906 | 8.906 | 8.906 | 100.0% | 1 | | heat.check_stack | 2.843 | 2.843 | 2.843 | 2.843 | 2.843 | 2.843 | 100.0% | 1 | | heat.delete_stack | 6.227 | 6.227 | 6.227 | 6.227 | 6.227 | 6.227 | 100.0% | 1 | | total | 17.976 | 17.976 | 17.976 | 17.976 | 17.976 | 17.976 | 100.0% | 1 | | -> duration | 15.976 | 15.976 | 15.976 | 15.976 | 15.976 | 15.976 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.975673 Full duration: 38.127886 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c1e5b56c-e6f9-455b-9453-5f9dfc5c9e47 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 7.27 | 7.27 | 7.27 | 7.27 | 7.27 | 7.27 | 100.0% | 1 | | heat.suspend_stack | 3.01 | 3.01 | 3.01 | 3.01 | 3.01 | 3.01 | 100.0% | 1 | | heat.resume_stack | 2.562 | 2.562 | 2.562 | 2.562 | 2.562 | 2.562 | 100.0% | 1 | | heat.delete_stack | 4.773 | 4.773 | 4.773 | 4.773 | 4.773 | 4.773 | 100.0% | 1 | | total | 17.616 | 17.616 | 17.616 | 17.616 | 17.616 | 17.616 | 100.0% | 1 | | -> duration | 15.616 | 15.616 | 15.616 | 15.616 | 15.616 | 15.616 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.616451 Full duration: 33.795139 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c1e5b56c-e6f9-455b-9453-5f9dfc5c9e47 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.84 | 0.84 | 0.84 | 0.84 | 0.84 | 0.84 | 100.0% | 1 | | total | 0.84 | 0.84 | 0.84 | 0.84 | 0.84 | 0.84 | 100.0% | 1 | | -> duration | 0.84 | 0.84 | 0.84 | 0.84 | 0.84 | 0.84 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.840456 Full duration: 17.40217 HINTS: * To plot HTML graphics with this data, run: rally task report c1e5b56c-e6f9-455b-9453-5f9dfc5c9e47 --out output.html * To generate a JUnit report, run: rally task export c1e5b56c-e6f9-455b-9453-5f9dfc5c9e47 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report c1e5b56c-e6f9-455b-9453-5f9dfc5c9e47 --json --out output.json 2020-12-08 09:05:50,296 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid c1e5b56c-e6f9-455b-9453-5f9dfc5c9e47 --out /home/opnfv/functest/results/rally_sanity/heat.json 2020-12-08 09:05:50,301 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2020-12-08 09:05:50,331 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-08 09:05:50,500 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2020-12-08 09:10:27,991 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: 2e39825f-d3f0-4eca-88aa-2ad804ba9523 2020-12-08 09:10:29,408 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 2e39825f-d3f0-4eca-88aa-2ad804ba9523 -------------------------------------------------------------------------------- Task 2e39825f-d3f0-4eca-88aa-2ad804ba9523: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e39825f-d3f0-4eca-88aa-2ad804ba9523 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.16 | 0.16 | 0.16 | 0.16 | 0.16 | 0.16 | 100.0% | 1 | | keystone_v3.add_role | 0.387 | 0.387 | 0.387 | 0.387 | 0.387 | 0.387 | 100.0% | 1 | | keystone_v3.revoke_role | 0.219 | 0.219 | 0.219 | 0.219 | 0.219 | 0.219 | 100.0% | 1 | | total | 0.767 | 0.767 | 0.767 | 0.767 | 0.767 | 0.767 | 100.0% | 1 | | -> duration | 0.767 | 0.767 | 0.767 | 0.767 | 0.767 | 0.767 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.767137 Full duration: 22.686104 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e39825f-d3f0-4eca-88aa-2ad804ba9523 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.463 | 0.463 | 0.463 | 0.463 | 0.463 | 0.463 | 100.0% | 1 | | keystone_v3.add_role | 0.089 | 0.089 | 0.089 | 0.089 | 0.089 | 0.089 | 100.0% | 1 | | keystone_v3.list_roles | 0.122 | 0.122 | 0.122 | 0.122 | 0.122 | 0.122 | 100.0% | 1 | | total | 0.674 | 0.674 | 0.674 | 0.674 | 0.674 | 0.674 | 100.0% | 1 | | -> duration | 0.674 | 0.674 | 0.674 | 0.674 | 0.674 | 0.674 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.673888 Full duration: 18.883767 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e39825f-d3f0-4eca-88aa-2ad804ba9523 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.499 | 0.499 | 0.499 | 0.499 | 0.499 | 0.499 | 100.0% | 1 | | keystone_v3.list_projects | 0.134 | 0.134 | 0.134 | 0.134 | 0.134 | 0.134 | 100.0% | 1 | | total | 0.634 | 0.634 | 0.634 | 0.634 | 0.634 | 0.634 | 100.0% | 1 | | -> duration | 0.634 | 0.634 | 0.634 | 0.634 | 0.634 | 0.634 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.634279 Full duration: 20.276796 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e39825f-d3f0-4eca-88aa-2ad804ba9523 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.138 | 0.138 | 0.138 | 0.138 | 0.138 | 0.138 | 100.0% | 1 | | keystone_v3.delete_role | 0.093 | 0.093 | 0.093 | 0.093 | 0.093 | 0.093 | 100.0% | 1 | | total | 0.232 | 0.232 | 0.232 | 0.232 | 0.232 | 0.232 | 100.0% | 1 | | -> duration | 0.232 | 0.232 | 0.232 | 0.232 | 0.232 | 0.232 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.231915 Full duration: 16.232661 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e39825f-d3f0-4eca-88aa-2ad804ba9523 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.343 | 0.343 | 0.343 | 0.343 | 0.343 | 0.343 | 100.0% | 1 | | keystone_v3.delete_service | 0.361 | 0.361 | 0.361 | 0.361 | 0.361 | 0.361 | 100.0% | 1 | | total | 0.703 | 0.703 | 0.703 | 0.703 | 0.703 | 0.703 | 100.0% | 1 | | -> duration | 0.703 | 0.703 | 0.703 | 0.703 | 0.703 | 0.703 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.70324 Full duration: 16.551215 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e39825f-d3f0-4eca-88aa-2ad804ba9523 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.236 | 0.236 | 0.236 | 0.236 | 0.236 | 0.236 | 100.0% | 1 | | keystone_v3.create_user | 0.575 | 0.575 | 0.575 | 0.575 | 0.575 | 0.575 | 100.0% | 1 | | -> keystone_v3.list_roles | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 0.05 | 100.0% | 1 | | -> keystone_v3.add_role | 0.249 | 0.249 | 0.249 | 0.249 | 0.249 | 0.249 | 100.0% | 1 | | keystone_v3.create_role | 0.732 | 0.732 | 0.732 | 0.732 | 0.732 | 0.732 | 100.0% | 1 | | keystone_v3.get_project | 0.042 | 0.042 | 0.042 | 0.042 | 0.042 | 0.042 | 100.0% | 1 | | keystone_v3.get_user | 0.037 | 0.037 | 0.037 | 0.037 | 0.037 | 0.037 | 100.0% | 1 | | keystone_v3.get_role | 0.034 | 0.034 | 0.034 | 0.034 | 0.034 | 0.034 | 100.0% | 1 | | keystone_v3.list_services | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 100.0% | 1 | | keystone_v3.get_services | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 100.0% | 1 | | total | 1.856 | 1.856 | 1.856 | 1.856 | 1.856 | 1.856 | 100.0% | 1 | | -> duration | 1.856 | 1.856 | 1.856 | 1.856 | 1.856 | 1.856 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.855528 Full duration: 27.232762 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e39825f-d3f0-4eca-88aa-2ad804ba9523 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.277 | 0.277 | 0.277 | 0.277 | 0.277 | 0.277 | 100.0% | 1 | | keystone_v3.update_project | 0.607 | 0.607 | 0.607 | 0.607 | 0.607 | 0.607 | 100.0% | 1 | | keystone_v3.delete_project | 0.772 | 0.772 | 0.772 | 0.772 | 0.772 | 0.772 | 100.0% | 1 | | total | 1.657 | 1.657 | 1.657 | 1.657 | 1.657 | 1.657 | 100.0% | 1 | | -> duration | 1.657 | 1.657 | 1.657 | 1.657 | 1.657 | 1.657 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.657096 Full duration: 17.513762 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e39825f-d3f0-4eca-88aa-2ad804ba9523 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.231 | 0.231 | 0.231 | 0.231 | 0.231 | 0.231 | 100.0% | 1 | | total | 0.307 | 0.307 | 0.307 | 0.307 | 0.307 | 0.307 | 100.0% | 1 | | -> duration | 0.307 | 0.307 | 0.307 | 0.307 | 0.307 | 0.307 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.306802 Full duration: 19.487695 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e39825f-d3f0-4eca-88aa-2ad804ba9523 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.394 | 0.394 | 0.394 | 0.394 | 0.394 | 0.394 | 100.0% | 1 | | total | 0.394 | 0.394 | 0.394 | 0.394 | 0.394 | 0.394 | 100.0% | 1 | | -> duration | 0.394 | 0.394 | 0.394 | 0.394 | 0.394 | 0.394 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.394116 Full duration: 23.022083 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e39825f-d3f0-4eca-88aa-2ad804ba9523 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 1.117 | 1.117 | 1.117 | 1.117 | 1.117 | 1.117 | 100.0% | 1 | | keystone_v3.list_users | 0.066 | 0.066 | 0.066 | 0.066 | 0.066 | 0.066 | 100.0% | 1 | | total | 1.262 | 1.262 | 1.262 | 1.262 | 1.262 | 1.262 | 100.0% | 1 | | -> duration | 1.262 | 1.262 | 1.262 | 1.262 | 1.262 | 1.262 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.262022 Full duration: 21.258979 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e39825f-d3f0-4eca-88aa-2ad804ba9523 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.352 | 0.352 | 0.352 | 0.352 | 0.352 | 0.352 | 100.0% | 1 | | keystone_v3.create_users | 12.036 | 12.036 | 12.036 | 12.036 | 12.036 | 12.036 | 100.0% | 1 | | -> keystone_v3.create_user (x10) | 12.035 | 12.035 | 12.035 | 12.035 | 12.035 | 12.035 | 100.0% | 1 | | --> keystone_v3.list_roles (x10) | 0.556 | 0.556 | 0.556 | 0.556 | 0.556 | 0.556 | 100.0% | 1 | | --> keystone_v3.add_role (x10) | 3.895 | 3.895 | 3.895 | 3.895 | 3.895 | 3.895 | 100.0% | 1 | | total | 12.85 | 12.85 | 12.85 | 12.85 | 12.85 | 12.85 | 100.0% | 1 | | -> duration | 12.85 | 12.85 | 12.85 | 12.85 | 12.85 | 12.85 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.85034 Full duration: 42.828259 HINTS: * To plot HTML graphics with this data, run: rally task report 2e39825f-d3f0-4eca-88aa-2ad804ba9523 --out output.html * To generate a JUnit report, run: rally task export 2e39825f-d3f0-4eca-88aa-2ad804ba9523 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 2e39825f-d3f0-4eca-88aa-2ad804ba9523 --json --out output.json 2020-12-08 09:10:32,672 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 2e39825f-d3f0-4eca-88aa-2ad804ba9523 --out /home/opnfv/functest/results/rally_sanity/keystone.json 2020-12-08 09:10:32,680 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2020-12-08 09:10:32,707 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-08 09:10:33,127 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-12-08 09:14:31,848 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: e8cb7f07-fdc6-4375-8e60-abcd324efee9 2020-12-08 09:14:33,318 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid e8cb7f07-fdc6-4375-8e60-abcd324efee9 -------------------------------------------------------------------------------- Task e8cb7f07-fdc6-4375-8e60-abcd324efee9: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e8cb7f07-fdc6-4375-8e60-abcd324efee9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 3.346 | 3.346 | 3.346 | 3.346 | 3.346 | 3.346 | 100.0% | 1 | | neutron.delete_network | 0.898 | 0.898 | 0.898 | 0.898 | 0.898 | 0.898 | 100.0% | 1 | | total | 4.244 | 4.244 | 4.244 | 4.244 | 4.244 | 4.244 | 100.0% | 1 | | -> duration | 4.244 | 4.244 | 4.244 | 4.244 | 4.244 | 4.244 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.244181 Full duration: 23.058934 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e8cb7f07-fdc6-4375-8e60-abcd324efee9 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 4.014 | 4.014 | 4.014 | 4.014 | 4.014 | 4.014 | 100.0% | 1 | | neutron.delete_port | 1.164 | 1.164 | 1.164 | 1.164 | 1.164 | 1.164 | 100.0% | 1 | | total | 5.179 | 5.179 | 5.179 | 5.179 | 5.179 | 5.179 | 100.0% | 1 | | -> duration | 5.179 | 5.179 | 5.179 | 5.179 | 5.179 | 5.179 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.178805 Full duration: 35.627453 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e8cb7f07-fdc6-4375-8e60-abcd324efee9 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 3.176 | 3.176 | 3.176 | 3.176 | 3.176 | 3.176 | 100.0% | 1 | | neutron.delete_subnet | 0.805 | 0.805 | 0.805 | 0.805 | 0.805 | 0.805 | 100.0% | 1 | | total | 3.981 | 3.981 | 3.981 | 3.981 | 3.981 | 3.981 | 100.0% | 1 | | -> duration | 3.981 | 3.981 | 3.981 | 3.981 | 3.981 | 3.981 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.980839 Full duration: 31.076526 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e8cb7f07-fdc6-4375-8e60-abcd324efee9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.204 | 2.204 | 2.204 | 2.204 | 2.204 | 2.204 | 100.0% | 1 | | neutron.list_networks | 0.159 | 0.159 | 0.159 | 0.159 | 0.159 | 0.159 | 100.0% | 1 | | total | 2.363 | 2.363 | 2.363 | 2.363 | 2.363 | 2.363 | 100.0% | 1 | | -> duration | 2.363 | 2.363 | 2.363 | 2.363 | 2.363 | 2.363 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.363043 Full duration: 24.353552 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e8cb7f07-fdc6-4375-8e60-abcd324efee9 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 3.655 | 3.655 | 3.655 | 3.655 | 3.655 | 3.655 | 100.0% | 1 | | neutron.list_ports | 0.116 | 0.116 | 0.116 | 0.116 | 0.116 | 0.116 | 100.0% | 1 | | total | 3.771 | 3.771 | 3.771 | 3.771 | 3.771 | 3.771 | 100.0% | 1 | | -> duration | 3.771 | 3.771 | 3.771 | 3.771 | 3.771 | 3.771 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.771103 Full duration: 31.481226 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e8cb7f07-fdc6-4375-8e60-abcd324efee9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.444 | 2.444 | 2.444 | 2.444 | 2.444 | 2.444 | 100.0% | 1 | | neutron.create_subnet | 1.721 | 1.721 | 1.721 | 1.721 | 1.721 | 1.721 | 100.0% | 1 | | neutron.list_subnets | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 100.0% | 1 | | total | 4.25 | 4.25 | 4.25 | 4.25 | 4.25 | 4.25 | 100.0% | 1 | | -> duration | 4.25 | 4.25 | 4.25 | 4.25 | 4.25 | 4.25 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.250189 Full duration: 27.969881 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e8cb7f07-fdc6-4375-8e60-abcd324efee9 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 3.71 | 3.71 | 3.71 | 3.71 | 3.71 | 3.71 | 100.0% | 1 | | neutron.delete_security_group | 0.538 | 0.538 | 0.538 | 0.538 | 0.538 | 0.538 | 100.0% | 1 | | total | 4.248 | 4.248 | 4.248 | 4.248 | 4.248 | 4.248 | 100.0% | 1 | | -> duration | 4.248 | 4.248 | 4.248 | 4.248 | 4.248 | 4.248 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.247991 Full duration: 19.140215 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e8cb7f07-fdc6-4375-8e60-abcd324efee9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.528 | 1.528 | 1.528 | 1.528 | 1.528 | 1.528 | 100.0% | 1 | | neutron.create_security_group_rule | 1.087 | 1.087 | 1.087 | 1.087 | 1.087 | 1.087 | 100.0% | 1 | | neutron.delete_security_group_rule | 0.135 | 0.135 | 0.135 | 0.135 | 0.135 | 0.135 | 100.0% | 1 | | neutron.delete_security_group | 0.28 | 0.28 | 0.28 | 0.28 | 0.28 | 0.28 | 100.0% | 1 | | total | 3.03 | 3.03 | 3.03 | 3.03 | 3.03 | 3.03 | 100.0% | 1 | | -> duration | 3.03 | 3.03 | 3.03 | 3.03 | 3.03 | 3.03 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.030455 Full duration: 18.591201 HINTS: * To plot HTML graphics with this data, run: rally task report e8cb7f07-fdc6-4375-8e60-abcd324efee9 --out output.html * To generate a JUnit report, run: rally task export e8cb7f07-fdc6-4375-8e60-abcd324efee9 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report e8cb7f07-fdc6-4375-8e60-abcd324efee9 --json --out output.json 2020-12-08 09:14:36,558 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid e8cb7f07-fdc6-4375-8e60-abcd324efee9 --out /home/opnfv/functest/results/rally_sanity/neutron.json 2020-12-08 09:14:36,567 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2020-12-08 09:14:36,596 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-08 09:14:36,738 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2020-12-08 09:16:01,965 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: 799c1716-c4fa-4b2c-9216-cec4456c386a 2020-12-08 09:16:03,376 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 799c1716-c4fa-4b2c-9216-cec4456c386a -------------------------------------------------------------------------------- Task 799c1716-c4fa-4b2c-9216-cec4456c386a: aborted -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_live_migrate_server args position 0 args values: { "args": { "flavor": { "name": "rally_sanity-flavor_9b8ad7f6-e1bb-4e99-a373-110c124beb35" }, "image": { "name": "rally_sanity-img_9b8ad7f6-e1bb-4e99-a373-110c124beb35" }, "block_migration": false, "nics": [ { "net-id": "03af5d5d-b042-405b-bfd2-56322aa0f0ff" } ] }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 799c1716-c4fa-4b2c-9216-cec4456c386a has 1 error(s) -------------------------------------------------------------------------------- BadRequest: Migration pre-check error: Instance has an associated NUMA topology. Instance NUMA topologies, including related attributes such as CPU pinning, huge page and emulator thread pinning information, are not currently recalculated on live migration. See bug #1289064 for more information. (HTTP 400) (Request-ID: req-6b650903-b047-45b2-8507-0f729618f27f) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 720, in run self._live_migrate(server, block_migration, disk_over_commit) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 798, in _live_migrate disk_over_commit=disk_over_commit) File "/usr/lib/python3.6/site-packages/novaclient/api_versions.py", line 393, in substitution return methods[-1].func(obj, *args, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 438, in live_migrate disk_over_commit) File "/usr/lib/python3.6/site-packages/novaclient/api_versions.py", line 393, in substitution return methods[-1].func(obj, *args, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1742, in live_migrate force=None) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1726, in _live_migrate return self._action('os-migrateLive', server, body) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: Migration pre-check error: Instance has an associated NUMA topology. Instance NUMA topologies, including related attributes such as CPU pinning, huge page and emulator thread pinning information, are not currently recalculated on live migration. See bug #1289064 for more information. (HTTP 400) (Request-ID: req-6b650903-b047-45b2-8507-0f729618f27f) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 21.062 | 21.062 | 21.062 | 21.062 | 21.062 | 21.062 | 100.0% | 1 | | nova.live_migrate | 6.857 | 6.857 | 6.857 | 6.857 | 6.857 | 6.857 | 0.0% | 1 | | -> nova.list_hypervisors | 0.612 | 0.612 | 0.612 | 0.612 | 0.612 | 0.612 | 100.0% | 1 | | total | 27.92 | 27.92 | 27.92 | 27.92 | 27.92 | 27.92 | 0.0% | 1 | | -> duration | 26.92 | 26.92 | 26.92 | 26.92 | 26.92 | 26.92 | 0.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 26.919946 Full duration: 46.90889 HINTS: * To plot HTML graphics with this data, run: rally task report 799c1716-c4fa-4b2c-9216-cec4456c386a --out output.html * To generate a JUnit report, run: rally task export 799c1716-c4fa-4b2c-9216-cec4456c386a --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 799c1716-c4fa-4b2c-9216-cec4456c386a --json --out output.json At least one workload did not pass SLA criteria. 2020-12-08 09:16:06,555 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 799c1716-c4fa-4b2c-9216-cec4456c386a --out /home/opnfv/functest/results/rally_sanity/nova.json 2020-12-08 09:16:06,557 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2020-12-08 09:16:06,585 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-08 09:16:07,003 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2020-12-08 09:17:05,160 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: a78f4820-5f0d-4a6b-a990-d5a51f125660 2020-12-08 09:17:06,572 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a78f4820-5f0d-4a6b-a990-d5a51f125660 -------------------------------------------------------------------------------- Task a78f4820-5f0d-4a6b-a990-d5a51f125660: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a78f4820-5f0d-4a6b-a990-d5a51f125660 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.908 | 0.908 | 0.908 | 0.908 | 0.908 | 0.908 | 100.0% | 1 | | quotas.delete_quotas | 0.376 | 0.376 | 0.376 | 0.376 | 0.376 | 0.376 | 100.0% | 1 | | total | 1.284 | 1.284 | 1.284 | 1.284 | 1.284 | 1.284 | 100.0% | 1 | | -> duration | 1.284 | 1.284 | 1.284 | 1.284 | 1.284 | 1.284 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.283906 Full duration: 11.215461 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a78f4820-5f0d-4a6b-a990-d5a51f125660 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.805 | 0.805 | 0.805 | 0.805 | 0.805 | 0.805 | 100.0% | 1 | | total | 0.805 | 0.805 | 0.805 | 0.805 | 0.805 | 0.805 | 100.0% | 1 | | -> duration | 0.805 | 0.805 | 0.805 | 0.805 | 0.805 | 0.805 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.805496 Full duration: 14.379804 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a78f4820-5f0d-4a6b-a990-d5a51f125660 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 2.949 | 2.949 | 2.949 | 2.949 | 2.949 | 2.949 | 100.0% | 1 | | total | 2.949 | 2.949 | 2.949 | 2.949 | 2.949 | 2.949 | 100.0% | 1 | | -> duration | 2.949 | 2.949 | 2.949 | 2.949 | 2.949 | 2.949 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.948599 Full duration: 12.356936 HINTS: * To plot HTML graphics with this data, run: rally task report a78f4820-5f0d-4a6b-a990-d5a51f125660 --out output.html * To generate a JUnit report, run: rally task export a78f4820-5f0d-4a6b-a990-d5a51f125660 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report a78f4820-5f0d-4a6b-a990-d5a51f125660 --json --out output.json 2020-12-08 09:17:09,869 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a78f4820-5f0d-4a6b-a990-d5a51f125660 --out /home/opnfv/functest/results/rally_sanity/quotas.json 2020-12-08 09:17:09,873 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2020-12-08 09:17:09,902 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-08 09:17:10,055 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2020-12-08 09:19:36,665 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: 8f9dbee4-9dde-4841-9f34-1c32022d68c5 2020-12-08 09:19:38,017 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 8f9dbee4-9dde-4841-9f34-1c32022d68c5 -------------------------------------------------------------------------------- Task 8f9dbee4-9dde-4841-9f34-1c32022d68c5: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8f9dbee4-9dde-4841-9f34-1c32022d68c5 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.335 | 1.335 | 1.335 | 1.335 | 1.335 | 1.335 | 100.0% | 1 | | swift.upload_object (x2) | 1.079 | 1.079 | 1.079 | 1.079 | 1.079 | 1.079 | 100.0% | 1 | | swift.list_objects | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 0.96 | 100.0% | 1 | | total | 3.374 | 3.374 | 3.374 | 3.374 | 3.374 | 3.374 | 100.0% | 1 | | -> duration | 3.374 | 3.374 | 3.374 | 3.374 | 3.374 | 3.374 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.374234 Full duration: 25.130767 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8f9dbee4-9dde-4841-9f34-1c32022d68c5 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.23 | 1.23 | 1.23 | 1.23 | 1.23 | 1.23 | 100.0% | 1 | | swift.list_objects | 0.866 | 0.866 | 0.866 | 0.866 | 0.866 | 0.866 | 100.0% | 1 | | total | 2.095 | 2.095 | 2.095 | 2.095 | 2.095 | 2.095 | 100.0% | 1 | | -> duration | 2.095 | 2.095 | 2.095 | 2.095 | 2.095 | 2.095 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.095419 Full duration: 22.131366 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8f9dbee4-9dde-4841-9f34-1c32022d68c5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.33 | 1.33 | 1.33 | 1.33 | 1.33 | 1.33 | 100.0% | 1 | | swift.upload_object (x5) | 2.711 | 2.711 | 2.711 | 2.711 | 2.711 | 2.711 | 100.0% | 1 | | swift.download_object (x5) | 2.499 | 2.499 | 2.499 | 2.499 | 2.499 | 2.499 | 100.0% | 1 | | total | 6.541 | 6.541 | 6.541 | 6.541 | 6.541 | 6.541 | 100.0% | 1 | | -> duration | 6.541 | 6.541 | 6.541 | 6.541 | 6.541 | 6.541 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.540992 Full duration: 30.012736 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8f9dbee4-9dde-4841-9f34-1c32022d68c5 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.32 | 1.32 | 1.32 | 1.32 | 1.32 | 1.32 | 100.0% | 1 | | swift.upload_object (x5) | 2.868 | 2.868 | 2.868 | 2.868 | 2.868 | 2.868 | 100.0% | 1 | | swift.delete_object (x5) | 2.623 | 2.623 | 2.623 | 2.623 | 2.623 | 2.623 | 100.0% | 1 | | swift.delete_container | 0.615 | 0.615 | 0.615 | 0.615 | 0.615 | 0.615 | 100.0% | 1 | | total | 7.427 | 7.427 | 7.427 | 7.427 | 7.427 | 7.427 | 100.0% | 1 | | -> duration | 7.427 | 7.427 | 7.427 | 7.427 | 7.427 | 7.427 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.426716 Full duration: 21.538684 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8f9dbee4-9dde-4841-9f34-1c32022d68c5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.511 | 1.511 | 1.511 | 1.511 | 1.511 | 1.511 | 100.0% | 1 | | swift.list_objects | 1.013 | 1.013 | 1.013 | 1.013 | 1.013 | 1.013 | 100.0% | 1 | | swift.download_object (x5) | 2.589 | 2.589 | 2.589 | 2.589 | 2.589 | 2.589 | 100.0% | 1 | | total | 5.113 | 5.113 | 5.113 | 5.113 | 5.113 | 5.113 | 100.0% | 1 | | -> duration | 5.113 | 5.113 | 5.113 | 5.113 | 5.113 | 5.113 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.11341 Full duration: 24.445543 HINTS: * To plot HTML graphics with this data, run: rally task report 8f9dbee4-9dde-4841-9f34-1c32022d68c5 --out output.html * To generate a JUnit report, run: rally task export 8f9dbee4-9dde-4841-9f34-1c32022d68c5 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 8f9dbee4-9dde-4841-9f34-1c32022d68c5 --json --out output.json 2020-12-08 09:19:41,293 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 8f9dbee4-9dde-4841-9f34-1c32022d68c5 --out /home/opnfv/functest/results/rally_sanity/swift.json 2020-12-08 09:19:41,300 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2020-12-08 09:19:41,306 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:00:57 | 6 | 100.00% | | glance | 00:01:49 | 4 | 100.00% | | cinder | 00:03:32 | 10 | 100.00% | | heat | 00:02:29 | 4 | 100.00% | | keystone | 00:04:05 | 11 | 100.00% | | neutron | 00:03:31 | 8 | 100.00% | | nova | 00:00:46 | 1 | 0.00% | | quotas | 00:00:37 | 3 | 100.00% | | swift | 00:02:03 | 5 | 100.00% | | | | | | | TOTAL: | 00:19:54 | 52 | 98.08% | +----------------+------------+----------------+-----------+ 2020-12-08 09:19:41,306 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_sanity' success_rate is 98.08% in 8/9 modules 2020-12-08 09:19:44,861 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_sanity/rally_sanity.html 2020-12-08 09:19:48,448 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_sanity/rally_sanity.xml 2020-12-08 09:19:48,449 - xtesting.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | rally_sanity | functest | 25:20 | FAIL | +----------------------+------------------+------------------+----------------+