2021-03-20 13:08:09,071 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | 1NB8LDRXOM6L | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/1NB8LDRXOM6L/airs | | | hip-opnfv-functest-smoke-latest-rally_sanity- | | | run-211 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/1NB8LDRXOM6L/ai | | | rship-opnfv-functest-smoke-latest-rally_sanity- | | | run-211 | +-------------------------+------------------------------------------------------------+ 2021-03-20 13:08:09,142 - xtesting.ci.run_tests - INFO - Loading test case 'rally_sanity'... 2021-03-20 13:08:13,545 - xtesting.ci.run_tests - INFO - Running test case 'rally_sanity'... 2021-03-20 13:08:17,811 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2021-03-20 13:08:24,620 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 94bce433-bf63-4885-ad43-53960f379189 | 2021-03-20T13:08:24.325437 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 94bce433-bf63-4885-ad43-53960f379189 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2021-03-20 13:08:29,906 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2021-03-20 13:08:31,798 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-20 13:08:31,991 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2021-03-20 13:09:53,475 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: 868a1381-154f-4a40-9f58-6ca8f8c362ec 2021-03-20 13:09:54,842 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 868a1381-154f-4a40-9f58-6ca8f8c362ec -------------------------------------------------------------------------------- Task 868a1381-154f-4a40-9f58-6ca8f8c362ec: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 868a1381-154f-4a40-9f58-6ca8f8c362ec has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 1.06 | 1.06 | 1.06 | 1.06 | 1.06 | 1.06 | 100.0% | 1 | | total | 1.06 | 1.06 | 1.06 | 1.06 | 1.06 | 1.06 | 100.0% | 1 | | -> duration | 1.06 | 1.06 | 1.06 | 1.06 | 1.06 | 1.06 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.059917 Full duration: 9.418314 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 868a1381-154f-4a40-9f58-6ca8f8c362ec has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.303 | 0.303 | 0.303 | 0.303 | 0.303 | 0.303 | 100.0% | 1 | | total | 0.905 | 0.905 | 0.905 | 0.905 | 0.905 | 0.905 | 100.0% | 1 | | -> duration | 0.905 | 0.905 | 0.905 | 0.905 | 0.905 | 0.905 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.904854 Full duration: 9.583454 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 868a1381-154f-4a40-9f58-6ca8f8c362ec has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.397 | 0.397 | 0.397 | 0.397 | 0.397 | 0.397 | 100.0% | 1 | | total | 1.016 | 1.016 | 1.016 | 1.016 | 1.016 | 1.016 | 100.0% | 1 | | -> duration | 1.016 | 1.016 | 1.016 | 1.016 | 1.016 | 1.016 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.016258 Full duration: 9.694751 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 868a1381-154f-4a40-9f58-6ca8f8c362ec has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.36 | 0.36 | 0.36 | 0.36 | 0.36 | 0.36 | 100.0% | 1 | | total | 1.065 | 1.065 | 1.065 | 1.065 | 1.065 | 1.065 | 100.0% | 1 | | -> duration | 1.065 | 1.065 | 1.065 | 1.065 | 1.065 | 1.065 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.064749 Full duration: 10.416098 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 868a1381-154f-4a40-9f58-6ca8f8c362ec has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.484 | 0.484 | 0.484 | 0.484 | 0.484 | 0.484 | 100.0% | 1 | | total | 1.063 | 1.063 | 1.063 | 1.063 | 1.063 | 1.063 | 100.0% | 1 | | -> duration | 1.063 | 1.063 | 1.063 | 1.063 | 1.063 | 1.063 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.062542 Full duration: 13.366123 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 868a1381-154f-4a40-9f58-6ca8f8c362ec has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.269 | 0.269 | 0.269 | 0.269 | 0.269 | 0.269 | 100.0% | 1 | | total | 0.91 | 0.91 | 0.91 | 0.91 | 0.91 | 0.91 | 100.0% | 1 | | -> duration | 0.91 | 0.91 | 0.91 | 0.91 | 0.91 | 0.91 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.909978 Full duration: 9.080057 HINTS: * To plot HTML graphics with this data, run: rally task report 868a1381-154f-4a40-9f58-6ca8f8c362ec --out output.html * To generate a JUnit report, run: rally task export 868a1381-154f-4a40-9f58-6ca8f8c362ec --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 868a1381-154f-4a40-9f58-6ca8f8c362ec --json --out output.json 2021-03-20 13:09:58,178 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 868a1381-154f-4a40-9f58-6ca8f8c362ec --out /home/opnfv/functest/results/rally_sanity/authenticate.json 2021-03-20 13:09:58,184 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2021-03-20 13:09:58,214 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-20 13:09:58,388 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2021-03-20 13:12:06,145 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: 8b5e86da-284c-481d-8ef1-ef157bcfb041 2021-03-20 13:12:07,506 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 8b5e86da-284c-481d-8ef1-ef157bcfb041 -------------------------------------------------------------------------------- Task 8b5e86da-284c-481d-8ef1-ef157bcfb041: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8b5e86da-284c-481d-8ef1-ef157bcfb041 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.761 | 4.761 | 4.761 | 4.761 | 4.761 | 4.761 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.121 | 0.121 | 0.121 | 0.121 | 0.121 | 0.121 | 100.0% | 1 | | -> glance_v2.upload_data | 2.261 | 2.261 | 2.261 | 2.261 | 2.261 | 2.261 | 100.0% | 1 | | glance_v2.delete_image | 2.073 | 2.073 | 2.073 | 2.073 | 2.073 | 2.073 | 100.0% | 1 | | total | 6.835 | 6.835 | 6.835 | 6.835 | 6.835 | 6.835 | 100.0% | 1 | | -> duration | 6.835 | 6.835 | 6.835 | 6.835 | 6.835 | 6.835 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.834749 Full duration: 18.061777 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8b5e86da-284c-481d-8ef1-ef157bcfb041 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.04 | 5.04 | 5.04 | 5.04 | 5.04 | 5.04 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.101 | 0.101 | 0.101 | 0.101 | 0.101 | 0.101 | 100.0% | 1 | | -> glance_v2.upload_data | 2.46 | 2.46 | 2.46 | 2.46 | 2.46 | 2.46 | 100.0% | 1 | | glance_v2.list_images | 0.061 | 0.061 | 0.061 | 0.061 | 0.061 | 0.061 | 100.0% | 1 | | total | 5.102 | 5.102 | 5.102 | 5.102 | 5.102 | 5.102 | 100.0% | 1 | | -> duration | 5.102 | 5.102 | 5.102 | 5.102 | 5.102 | 5.102 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.101995 Full duration: 19.564883 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8b5e86da-284c-481d-8ef1-ef157bcfb041 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.261 | 0.261 | 0.261 | 0.261 | 0.261 | 0.261 | 100.0% | 1 | | total | 0.261 | 0.261 | 0.261 | 0.261 | 0.261 | 0.261 | 100.0% | 1 | | -> duration | 0.261 | 0.261 | 0.261 | 0.261 | 0.261 | 0.261 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.260962 Full duration: 9.373688 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_sanity-flavor_c8e76c9a-2f1d-4134-a629-f9aa95817cdf" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "64e89b92-7c6c-478c-925c-c398ad7bc489" } ] } }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8b5e86da-284c-481d-8ef1-ef157bcfb041 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.003 | 5.003 | 5.003 | 5.003 | 5.003 | 5.003 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.094 | 0.094 | 0.094 | 0.094 | 0.094 | 0.094 | 100.0% | 1 | | -> glance_v2.upload_data | 2.609 | 2.609 | 2.609 | 2.609 | 2.609 | 2.609 | 100.0% | 1 | | nova.boot_servers | 26.889 | 26.889 | 26.889 | 26.889 | 26.889 | 26.889 | 100.0% | 1 | | total | 31.893 | 31.893 | 31.893 | 31.893 | 31.893 | 31.893 | 100.0% | 1 | | -> duration | 30.893 | 30.893 | 30.893 | 30.893 | 30.893 | 30.893 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 30.892543 Full duration: 59.348735 HINTS: * To plot HTML graphics with this data, run: rally task report 8b5e86da-284c-481d-8ef1-ef157bcfb041 --out output.html * To generate a JUnit report, run: rally task export 8b5e86da-284c-481d-8ef1-ef157bcfb041 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 8b5e86da-284c-481d-8ef1-ef157bcfb041 --json --out output.json 2021-03-20 13:12:10,847 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 8b5e86da-284c-481d-8ef1-ef157bcfb041 --out /home/opnfv/functest/results/rally_sanity/glance.json 2021-03-20 13:12:10,852 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2021-03-20 13:12:10,892 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-20 13:12:11,301 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2021-03-20 13:16:20,114 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: 32793591-cae4-4652-b066-a1080b3b7d54 2021-03-20 13:16:21,602 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 32793591-cae4-4652-b066-a1080b3b7d54 -------------------------------------------------------------------------------- Task 32793591-cae4-4652-b066-a1080b3b7d54: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 32793591-cae4-4652-b066-a1080b3b7d54 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 4.789 | 4.789 | 4.789 | 4.789 | 4.789 | 4.789 | 100.0% | 1 | | cinder_v3.delete_snapshot | 2.418 | 2.418 | 2.418 | 2.418 | 2.418 | 2.418 | 100.0% | 1 | | total | 7.208 | 7.208 | 7.208 | 7.208 | 7.208 | 7.208 | 100.0% | 1 | | -> duration | 7.208 | 7.208 | 7.208 | 7.208 | 7.208 | 7.208 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.207516 Full duration: 29.023045 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 32793591-cae4-4652-b066-a1080b3b7d54 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.47 | 3.47 | 3.47 | 3.47 | 3.47 | 3.47 | 100.0% | 1 | | cinder_v3.delete_volume | 2.298 | 2.298 | 2.298 | 2.298 | 2.298 | 2.298 | 100.0% | 1 | | total | 5.768 | 5.768 | 5.768 | 5.768 | 5.768 | 5.768 | 100.0% | 1 | | -> duration | 5.768 | 5.768 | 5.768 | 5.768 | 5.768 | 5.768 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.768019 Full duration: 20.257081 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_sanity-img_c8e76c9a-2f1d-4134-a629-f9aa95817cdf" }, "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 32793591-cae4-4652-b066-a1080b3b7d54 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 12.843 | 12.843 | 12.843 | 12.843 | 12.843 | 12.843 | 100.0% | 1 | | cinder_v3.delete_volume | 3.471 | 3.471 | 3.471 | 3.471 | 3.471 | 3.471 | 100.0% | 1 | | total | 16.315 | 16.315 | 16.315 | 16.315 | 16.315 | 16.315 | 100.0% | 1 | | -> duration | 16.315 | 16.315 | 16.315 | 16.315 | 16.315 | 16.315 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.314717 Full duration: 29.753476 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 32793591-cae4-4652-b066-a1080b3b7d54 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.679 | 3.679 | 3.679 | 3.679 | 3.679 | 3.679 | 100.0% | 1 | | cinder_v3.delete_volume | 2.597 | 2.597 | 2.597 | 2.597 | 2.597 | 2.597 | 100.0% | 1 | | total | 6.275 | 6.275 | 6.275 | 6.275 | 6.275 | 6.275 | 100.0% | 1 | | -> duration | 6.275 | 6.275 | 6.275 | 6.275 | 6.275 | 6.275 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.275434 Full duration: 19.161256 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 32793591-cae4-4652-b066-a1080b3b7d54 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.264 | 3.264 | 3.264 | 3.264 | 3.264 | 3.264 | 100.0% | 1 | | cinder_v3.extend_volume | 2.571 | 2.571 | 2.571 | 2.571 | 2.571 | 2.571 | 100.0% | 1 | | cinder_v3.delete_volume | 3.068 | 3.068 | 3.068 | 3.068 | 3.068 | 3.068 | 100.0% | 1 | | total | 8.903 | 8.903 | 8.903 | 8.903 | 8.903 | 8.903 | 100.0% | 1 | | -> duration | 8.903 | 8.903 | 8.903 | 8.903 | 8.903 | 8.903 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.903478 Full duration: 21.992316 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 32793591-cae4-4652-b066-a1080b3b7d54 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.55 | 4.55 | 4.55 | 4.55 | 4.55 | 4.55 | 100.0% | 1 | | cinder_v3.delete_volume | 2.495 | 2.495 | 2.495 | 2.495 | 2.495 | 2.495 | 100.0% | 1 | | total | 7.046 | 7.046 | 7.046 | 7.046 | 7.046 | 7.046 | 100.0% | 1 | | -> duration | 7.046 | 7.046 | 7.046 | 7.046 | 7.046 | 7.046 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.046152 Full duration: 32.121154 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 32793591-cae4-4652-b066-a1080b3b7d54 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.907 | 0.907 | 0.907 | 0.907 | 0.907 | 0.907 | 100.0% | 1 | | cinder_v3.list_qos | 0.045 | 0.045 | 0.045 | 0.045 | 0.045 | 0.045 | 100.0% | 1 | | total | 0.952 | 0.952 | 0.952 | 0.952 | 0.952 | 0.952 | 100.0% | 1 | | -> duration | 0.952 | 0.952 | 0.952 | 0.952 | 0.952 | 0.952 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.952281 Full duration: 17.506926 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 32793591-cae4-4652-b066-a1080b3b7d54 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.708 | 0.708 | 0.708 | 0.708 | 0.708 | 0.708 | 100.0% | 1 | | cinder_v3.set_qos | 0.086 | 0.086 | 0.086 | 0.086 | 0.086 | 0.086 | 100.0% | 1 | | total | 0.794 | 0.794 | 0.794 | 0.794 | 0.794 | 0.794 | 100.0% | 1 | | -> duration | 0.794 | 0.794 | 0.794 | 0.794 | 0.794 | 0.794 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.793748 Full duration: 16.332595 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 32793591-cae4-4652-b066-a1080b3b7d54 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 1.176 | 1.176 | 1.176 | 1.176 | 1.176 | 1.176 | 100.0% | 1 | | cinder_v3.list_types | 0.035 | 0.035 | 0.035 | 0.035 | 0.035 | 0.035 | 100.0% | 1 | | total | 1.211 | 1.211 | 1.211 | 1.211 | 1.211 | 1.211 | 100.0% | 1 | | -> duration | 1.211 | 1.211 | 1.211 | 1.211 | 1.211 | 1.211 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.210596 Full duration: 16.33917 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 32793591-cae4-4652-b066-a1080b3b7d54 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.797 | 0.797 | 0.797 | 0.797 | 0.797 | 0.797 | 100.0% | 1 | | cinder_v3.create_encryption_type | 0.217 | 0.217 | 0.217 | 0.217 | 0.217 | 0.217 | 100.0% | 1 | | total | 1.014 | 1.014 | 1.014 | 1.014 | 1.014 | 1.014 | 100.0% | 1 | | -> duration | 1.014 | 1.014 | 1.014 | 1.014 | 1.014 | 1.014 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.014321 Full duration: 14.663724 HINTS: * To plot HTML graphics with this data, run: rally task report 32793591-cae4-4652-b066-a1080b3b7d54 --out output.html * To generate a JUnit report, run: rally task export 32793591-cae4-4652-b066-a1080b3b7d54 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 32793591-cae4-4652-b066-a1080b3b7d54 --json --out output.json 2021-03-20 13:16:25,055 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 32793591-cae4-4652-b066-a1080b3b7d54 --out /home/opnfv/functest/results/rally_sanity/cinder.json 2021-03-20 13:16:25,071 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2021-03-20 13:16:25,101 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-20 13:16:25,521 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2021-03-20 13:19:05,056 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: 2e170e59-2a9a-4fee-9600-32b4fa4f3fa2 2021-03-20 13:19:06,377 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 2e170e59-2a9a-4fee-9600-32b4fa4f3fa2 -------------------------------------------------------------------------------- Task 2e170e59-2a9a-4fee-9600-32b4fa4f3fa2: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e170e59-2a9a-4fee-9600-32b4fa4f3fa2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 10.334 | 10.334 | 10.334 | 10.334 | 10.334 | 10.334 | 100.0% | 1 | | heat.update_stack | 7.432 | 7.432 | 7.432 | 7.432 | 7.432 | 7.432 | 100.0% | 1 | | heat.delete_stack | 9.634 | 9.634 | 9.634 | 9.634 | 9.634 | 9.634 | 100.0% | 1 | | total | 27.4 | 27.4 | 27.4 | 27.4 | 27.4 | 27.4 | 100.0% | 1 | | -> duration | 23.4 | 23.4 | 23.4 | 23.4 | 23.4 | 23.4 | 100.0% | 1 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.400352 Full duration: 42.252186 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e170e59-2a9a-4fee-9600-32b4fa4f3fa2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 7.505 | 7.505 | 7.505 | 7.505 | 7.505 | 7.505 | 100.0% | 1 | | heat.check_stack | 2.61 | 2.61 | 2.61 | 2.61 | 2.61 | 2.61 | 100.0% | 1 | | heat.delete_stack | 4.499 | 4.499 | 4.499 | 4.499 | 4.499 | 4.499 | 100.0% | 1 | | total | 14.615 | 14.615 | 14.615 | 14.615 | 14.615 | 14.615 | 100.0% | 1 | | -> duration | 12.615 | 12.615 | 12.615 | 12.615 | 12.615 | 12.615 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.614836 Full duration: 30.337557 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e170e59-2a9a-4fee-9600-32b4fa4f3fa2 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 7.74 | 7.74 | 7.74 | 7.74 | 7.74 | 7.74 | 100.0% | 1 | | heat.suspend_stack | 3.49 | 3.49 | 3.49 | 3.49 | 3.49 | 3.49 | 100.0% | 1 | | heat.resume_stack | 2.672 | 2.672 | 2.672 | 2.672 | 2.672 | 2.672 | 100.0% | 1 | | heat.delete_stack | 3.972 | 3.972 | 3.972 | 3.972 | 3.972 | 3.972 | 100.0% | 1 | | total | 17.874 | 17.874 | 17.874 | 17.874 | 17.874 | 17.874 | 100.0% | 1 | | -> duration | 15.874 | 15.874 | 15.874 | 15.874 | 15.874 | 15.874 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.873942 Full duration: 34.68869 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e170e59-2a9a-4fee-9600-32b4fa4f3fa2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.77 | 0.77 | 0.77 | 0.77 | 0.77 | 0.77 | 100.0% | 1 | | total | 0.77 | 0.77 | 0.77 | 0.77 | 0.77 | 0.77 | 100.0% | 1 | | -> duration | 0.77 | 0.77 | 0.77 | 0.77 | 0.77 | 0.77 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.770087 Full duration: 14.183305 HINTS: * To plot HTML graphics with this data, run: rally task report 2e170e59-2a9a-4fee-9600-32b4fa4f3fa2 --out output.html * To generate a JUnit report, run: rally task export 2e170e59-2a9a-4fee-9600-32b4fa4f3fa2 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 2e170e59-2a9a-4fee-9600-32b4fa4f3fa2 --json --out output.json 2021-03-20 13:19:09,777 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 2e170e59-2a9a-4fee-9600-32b4fa4f3fa2 --out /home/opnfv/functest/results/rally_sanity/heat.json 2021-03-20 13:19:09,782 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2021-03-20 13:19:09,807 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-20 13:19:09,973 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2021-03-20 13:23:22,155 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: c9b1d9fa-f8d1-4c54-b402-6fc495fdfdb6 2021-03-20 13:23:23,558 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid c9b1d9fa-f8d1-4c54-b402-6fc495fdfdb6 -------------------------------------------------------------------------------- Task c9b1d9fa-f8d1-4c54-b402-6fc495fdfdb6: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c9b1d9fa-f8d1-4c54-b402-6fc495fdfdb6 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.264 | 0.264 | 0.264 | 0.264 | 0.264 | 0.264 | 100.0% | 1 | | keystone_v3.add_role | 0.083 | 0.083 | 0.083 | 0.083 | 0.083 | 0.083 | 100.0% | 1 | | keystone_v3.revoke_role | 0.223 | 0.223 | 0.223 | 0.223 | 0.223 | 0.223 | 100.0% | 1 | | total | 0.57 | 0.57 | 0.57 | 0.57 | 0.57 | 0.57 | 100.0% | 1 | | -> duration | 0.57 | 0.57 | 0.57 | 0.57 | 0.57 | 0.57 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.570405 Full duration: 18.066538 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c9b1d9fa-f8d1-4c54-b402-6fc495fdfdb6 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.131 | 0.131 | 0.131 | 0.131 | 0.131 | 0.131 | 100.0% | 1 | | keystone_v3.add_role | 0.134 | 0.134 | 0.134 | 0.134 | 0.134 | 0.134 | 100.0% | 1 | | keystone_v3.list_roles | 0.115 | 0.115 | 0.115 | 0.115 | 0.115 | 0.115 | 100.0% | 1 | | total | 0.38 | 0.38 | 0.38 | 0.38 | 0.38 | 0.38 | 100.0% | 1 | | -> duration | 0.38 | 0.38 | 0.38 | 0.38 | 0.38 | 0.38 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.380261 Full duration: 17.442389 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c9b1d9fa-f8d1-4c54-b402-6fc495fdfdb6 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.379 | 0.379 | 0.379 | 0.379 | 0.379 | 0.379 | 100.0% | 1 | | keystone_v3.list_projects | 0.136 | 0.136 | 0.136 | 0.136 | 0.136 | 0.136 | 100.0% | 1 | | total | 0.515 | 0.515 | 0.515 | 0.515 | 0.515 | 0.515 | 100.0% | 1 | | -> duration | 0.515 | 0.515 | 0.515 | 0.515 | 0.515 | 0.515 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.514668 Full duration: 19.155644 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c9b1d9fa-f8d1-4c54-b402-6fc495fdfdb6 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.22 | 0.22 | 0.22 | 0.22 | 0.22 | 0.22 | 100.0% | 1 | | keystone_v3.delete_role | 0.262 | 0.262 | 0.262 | 0.262 | 0.262 | 0.262 | 100.0% | 1 | | total | 0.482 | 0.482 | 0.482 | 0.482 | 0.482 | 0.482 | 100.0% | 1 | | -> duration | 0.482 | 0.482 | 0.482 | 0.482 | 0.482 | 0.482 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.481935 Full duration: 16.524196 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c9b1d9fa-f8d1-4c54-b402-6fc495fdfdb6 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.426 | 0.426 | 0.426 | 0.426 | 0.426 | 0.426 | 100.0% | 1 | | keystone_v3.delete_service | 0.127 | 0.127 | 0.127 | 0.127 | 0.127 | 0.127 | 100.0% | 1 | | total | 0.553 | 0.553 | 0.553 | 0.553 | 0.553 | 0.553 | 100.0% | 1 | | -> duration | 0.553 | 0.553 | 0.553 | 0.553 | 0.553 | 0.553 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.552975 Full duration: 15.426095 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c9b1d9fa-f8d1-4c54-b402-6fc495fdfdb6 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.503 | 0.503 | 0.503 | 0.503 | 0.503 | 0.503 | 100.0% | 1 | | keystone_v3.create_user | 0.733 | 0.733 | 0.733 | 0.733 | 0.733 | 0.733 | 100.0% | 1 | | -> keystone_v3.list_roles | 0.059 | 0.059 | 0.059 | 0.059 | 0.059 | 0.059 | 100.0% | 1 | | -> keystone_v3.add_role | 0.372 | 0.372 | 0.372 | 0.372 | 0.372 | 0.372 | 100.0% | 1 | | keystone_v3.create_role | 0.097 | 0.097 | 0.097 | 0.097 | 0.097 | 0.097 | 100.0% | 1 | | keystone_v3.get_project | 0.042 | 0.042 | 0.042 | 0.042 | 0.042 | 0.042 | 100.0% | 1 | | keystone_v3.get_user | 0.038 | 0.038 | 0.038 | 0.038 | 0.038 | 0.038 | 100.0% | 1 | | keystone_v3.get_role | 0.04 | 0.04 | 0.04 | 0.04 | 0.04 | 0.04 | 100.0% | 1 | | keystone_v3.list_services | 0.043 | 0.043 | 0.043 | 0.043 | 0.043 | 0.043 | 100.0% | 1 | | keystone_v3.get_services | 0.047 | 0.047 | 0.047 | 0.047 | 0.047 | 0.047 | 100.0% | 1 | | total | 1.664 | 1.664 | 1.664 | 1.664 | 1.664 | 1.664 | 100.0% | 1 | | -> duration | 1.664 | 1.664 | 1.664 | 1.664 | 1.664 | 1.664 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.663787 Full duration: 24.942613 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c9b1d9fa-f8d1-4c54-b402-6fc495fdfdb6 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.496 | 0.496 | 0.496 | 0.496 | 0.496 | 0.496 | 100.0% | 1 | | keystone_v3.update_project | 0.381 | 0.381 | 0.381 | 0.381 | 0.381 | 0.381 | 100.0% | 1 | | keystone_v3.delete_project | 0.484 | 0.484 | 0.484 | 0.484 | 0.484 | 0.484 | 100.0% | 1 | | total | 1.361 | 1.361 | 1.361 | 1.361 | 1.361 | 1.361 | 100.0% | 1 | | -> duration | 1.361 | 1.361 | 1.361 | 1.361 | 1.361 | 1.361 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.361306 Full duration: 16.077816 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c9b1d9fa-f8d1-4c54-b402-6fc495fdfdb6 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.306 | 0.306 | 0.306 | 0.306 | 0.306 | 0.306 | 100.0% | 1 | | total | 0.382 | 0.382 | 0.382 | 0.382 | 0.382 | 0.382 | 100.0% | 1 | | -> duration | 0.382 | 0.382 | 0.382 | 0.382 | 0.382 | 0.382 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.381707 Full duration: 18.756554 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c9b1d9fa-f8d1-4c54-b402-6fc495fdfdb6 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.231 | 0.231 | 0.231 | 0.231 | 0.231 | 0.231 | 100.0% | 1 | | total | 0.231 | 0.231 | 0.231 | 0.231 | 0.231 | 0.231 | 100.0% | 1 | | -> duration | 0.231 | 0.231 | 0.231 | 0.231 | 0.231 | 0.231 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.231107 Full duration: 17.949062 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c9b1d9fa-f8d1-4c54-b402-6fc495fdfdb6 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.233 | 0.233 | 0.233 | 0.233 | 0.233 | 0.233 | 100.0% | 1 | | keystone_v3.list_users | 0.078 | 0.078 | 0.078 | 0.078 | 0.078 | 0.078 | 100.0% | 1 | | total | 0.393 | 0.393 | 0.393 | 0.393 | 0.393 | 0.393 | 100.0% | 1 | | -> duration | 0.393 | 0.393 | 0.393 | 0.393 | 0.393 | 0.393 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.393488 Full duration: 18.636147 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c9b1d9fa-f8d1-4c54-b402-6fc495fdfdb6 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.371 | 0.371 | 0.371 | 0.371 | 0.371 | 0.371 | 100.0% | 1 | | keystone_v3.create_users | 10.899 | 10.899 | 10.899 | 10.899 | 10.899 | 10.899 | 100.0% | 1 | | -> keystone_v3.create_user (x10) | 10.899 | 10.899 | 10.899 | 10.899 | 10.899 | 10.899 | 100.0% | 1 | | --> keystone_v3.list_roles (x10) | 0.534 | 0.534 | 0.534 | 0.534 | 0.534 | 0.534 | 100.0% | 1 | | --> keystone_v3.add_role (x10) | 4.457 | 4.457 | 4.457 | 4.457 | 4.457 | 4.457 | 100.0% | 1 | | total | 11.724 | 11.724 | 11.724 | 11.724 | 11.724 | 11.724 | 100.0% | 1 | | -> duration | 11.724 | 11.724 | 11.724 | 11.724 | 11.724 | 11.724 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.723642 Full duration: 42.889661 HINTS: * To plot HTML graphics with this data, run: rally task report c9b1d9fa-f8d1-4c54-b402-6fc495fdfdb6 --out output.html * To generate a JUnit report, run: rally task export c9b1d9fa-f8d1-4c54-b402-6fc495fdfdb6 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report c9b1d9fa-f8d1-4c54-b402-6fc495fdfdb6 --json --out output.json 2021-03-20 13:23:26,922 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid c9b1d9fa-f8d1-4c54-b402-6fc495fdfdb6 --out /home/opnfv/functest/results/rally_sanity/keystone.json 2021-03-20 13:23:26,933 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2021-03-20 13:23:26,965 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-20 13:23:27,339 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2021-03-20 13:26:57,541 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 8741f7fe-64e8-4017-a2c4-da9903d7d682 2021-03-20 13:26:58,911 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 8741f7fe-64e8-4017-a2c4-da9903d7d682 -------------------------------------------------------------------------------- Task 8741f7fe-64e8-4017-a2c4-da9903d7d682: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8741f7fe-64e8-4017-a2c4-da9903d7d682 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.141 | 2.141 | 2.141 | 2.141 | 2.141 | 2.141 | 100.0% | 1 | | neutron.delete_network | 1.604 | 1.604 | 1.604 | 1.604 | 1.604 | 1.604 | 100.0% | 1 | | total | 3.745 | 3.745 | 3.745 | 3.745 | 3.745 | 3.745 | 100.0% | 1 | | -> duration | 3.745 | 3.745 | 3.745 | 3.745 | 3.745 | 3.745 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.74488 Full duration: 19.345192 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8741f7fe-64e8-4017-a2c4-da9903d7d682 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.679 | 2.679 | 2.679 | 2.679 | 2.679 | 2.679 | 100.0% | 1 | | neutron.delete_port | 0.885 | 0.885 | 0.885 | 0.885 | 0.885 | 0.885 | 100.0% | 1 | | total | 3.565 | 3.565 | 3.565 | 3.565 | 3.565 | 3.565 | 100.0% | 1 | | -> duration | 3.565 | 3.565 | 3.565 | 3.565 | 3.565 | 3.565 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.564794 Full duration: 25.839549 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8741f7fe-64e8-4017-a2c4-da9903d7d682 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 2.952 | 2.952 | 2.952 | 2.952 | 2.952 | 2.952 | 100.0% | 1 | | neutron.delete_subnet | 1.304 | 1.304 | 1.304 | 1.304 | 1.304 | 1.304 | 100.0% | 1 | | total | 4.256 | 4.256 | 4.256 | 4.256 | 4.256 | 4.256 | 100.0% | 1 | | -> duration | 4.256 | 4.256 | 4.256 | 4.256 | 4.256 | 4.256 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.256343 Full duration: 28.52485 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8741f7fe-64e8-4017-a2c4-da9903d7d682 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.621 | 1.621 | 1.621 | 1.621 | 1.621 | 1.621 | 100.0% | 1 | | neutron.list_networks | 0.148 | 0.148 | 0.148 | 0.148 | 0.148 | 0.148 | 100.0% | 1 | | total | 1.77 | 1.77 | 1.77 | 1.77 | 1.77 | 1.77 | 100.0% | 1 | | -> duration | 1.77 | 1.77 | 1.77 | 1.77 | 1.77 | 1.77 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.769723 Full duration: 20.570151 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8741f7fe-64e8-4017-a2c4-da9903d7d682 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.183 | 2.183 | 2.183 | 2.183 | 2.183 | 2.183 | 100.0% | 1 | | neutron.list_ports | 0.108 | 0.108 | 0.108 | 0.108 | 0.108 | 0.108 | 100.0% | 1 | | total | 2.291 | 2.291 | 2.291 | 2.291 | 2.291 | 2.291 | 100.0% | 1 | | -> duration | 2.291 | 2.291 | 2.291 | 2.291 | 2.291 | 2.291 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.290971 Full duration: 28.55191 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8741f7fe-64e8-4017-a2c4-da9903d7d682 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.042 | 2.042 | 2.042 | 2.042 | 2.042 | 2.042 | 100.0% | 1 | | neutron.create_subnet | 1.612 | 1.612 | 1.612 | 1.612 | 1.612 | 1.612 | 100.0% | 1 | | neutron.list_subnets | 0.092 | 0.092 | 0.092 | 0.092 | 0.092 | 0.092 | 100.0% | 1 | | total | 3.747 | 3.747 | 3.747 | 3.747 | 3.747 | 3.747 | 100.0% | 1 | | -> duration | 3.747 | 3.747 | 3.747 | 3.747 | 3.747 | 3.747 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.746831 Full duration: 24.709552 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8741f7fe-64e8-4017-a2c4-da9903d7d682 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.404 | 1.404 | 1.404 | 1.404 | 1.404 | 1.404 | 100.0% | 1 | | neutron.delete_security_group | 0.294 | 0.294 | 0.294 | 0.294 | 0.294 | 0.294 | 100.0% | 1 | | total | 1.698 | 1.698 | 1.698 | 1.698 | 1.698 | 1.698 | 100.0% | 1 | | -> duration | 1.698 | 1.698 | 1.698 | 1.698 | 1.698 | 1.698 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.697924 Full duration: 16.90905 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8741f7fe-64e8-4017-a2c4-da9903d7d682 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.146 | 1.146 | 1.146 | 1.146 | 1.146 | 1.146 | 100.0% | 1 | | neutron.create_security_group_rule | 0.39 | 0.39 | 0.39 | 0.39 | 0.39 | 0.39 | 100.0% | 1 | | neutron.delete_security_group_rule | 0.387 | 0.387 | 0.387 | 0.387 | 0.387 | 0.387 | 100.0% | 1 | | neutron.delete_security_group | 0.727 | 0.727 | 0.727 | 0.727 | 0.727 | 0.727 | 100.0% | 1 | | total | 2.649 | 2.649 | 2.649 | 2.649 | 2.649 | 2.649 | 100.0% | 1 | | -> duration | 2.649 | 2.649 | 2.649 | 2.649 | 2.649 | 2.649 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.649496 Full duration: 17.939345 HINTS: * To plot HTML graphics with this data, run: rally task report 8741f7fe-64e8-4017-a2c4-da9903d7d682 --out output.html * To generate a JUnit report, run: rally task export 8741f7fe-64e8-4017-a2c4-da9903d7d682 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 8741f7fe-64e8-4017-a2c4-da9903d7d682 --json --out output.json 2021-03-20 13:27:02,300 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 8741f7fe-64e8-4017-a2c4-da9903d7d682 --out /home/opnfv/functest/results/rally_sanity/neutron.json 2021-03-20 13:27:02,309 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2021-03-20 13:27:02,339 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-20 13:27:02,494 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2021-03-20 13:30:09,016 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: 36f0fd2e-9368-49ea-8fb4-1908df7cd202 2021-03-20 13:30:10,371 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 36f0fd2e-9368-49ea-8fb4-1908df7cd202 -------------------------------------------------------------------------------- Task 36f0fd2e-9368-49ea-8fb4-1908df7cd202: finished -------------------------------------------------------------------------------- test scenario NovaKeypair.boot_and_delete_server_with_keypair args position 0 args values: { "args": { "flavor": { "name": "rally_sanity-flavor_c8e76c9a-2f1d-4134-a629-f9aa95817cdf" }, "image": { "name": "rally_sanity-img_c8e76c9a-2f1d-4134-a629-f9aa95817cdf" }, "boot_server_kwargs": { "nics": [ { "net-id": "64e89b92-7c6c-478c-925c-c398ad7bc489" } ] } }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 36f0fd2e-9368-49ea-8fb4-1908df7cd202 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 1.195 | 1.195 | 1.195 | 1.195 | 1.195 | 1.195 | 100.0% | 1 | | nova.boot_server | 21.107 | 21.107 | 21.107 | 21.107 | 21.107 | 21.107 | 100.0% | 1 | | nova.delete_server | 5.555 | 5.555 | 5.555 | 5.555 | 5.555 | 5.555 | 100.0% | 1 | | nova.delete_keypair | 0.365 | 0.365 | 0.365 | 0.365 | 0.365 | 0.365 | 100.0% | 1 | | total | 28.222 | 28.222 | 28.222 | 28.222 | 28.222 | 28.222 | 100.0% | 1 | | -> duration | 27.222 | 27.222 | 27.222 | 27.222 | 27.222 | 27.222 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 27.222373 Full duration: 43.397007 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume_and_delete args position 0 args values: { "args": { "flavor": { "name": "rally_sanity-flavor_c8e76c9a-2f1d-4134-a629-f9aa95817cdf" }, "image": { "name": "rally_sanity-img_c8e76c9a-2f1d-4134-a629-f9aa95817cdf" }, "volume_size": 1, "nics": [ { "net-id": "64e89b92-7c6c-478c-925c-c398ad7bc489" } ] }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 }, "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 36f0fd2e-9368-49ea-8fb4-1908df7cd202 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 14.17 | 14.17 | 14.17 | 14.17 | 14.17 | 14.17 | 100.0% | 1 | | nova.boot_server | 20.432 | 20.432 | 20.432 | 20.432 | 20.432 | 20.432 | 100.0% | 1 | | nova.delete_server | 6.341 | 6.341 | 6.341 | 6.341 | 6.341 | 6.341 | 100.0% | 1 | | total | 40.944 | 40.944 | 40.944 | 40.944 | 40.944 | 40.944 | 100.0% | 1 | | -> duration | 39.944 | 39.944 | 39.944 | 39.944 | 39.944 | 39.944 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 39.943817 Full duration: 63.367254 -------------------------------------------------------------------------------- test scenario NovaServers.pause_and_unpause_server args position 0 args values: { "args": { "flavor": { "name": "rally_sanity-flavor_c8e76c9a-2f1d-4134-a629-f9aa95817cdf" }, "image": { "name": "rally_sanity-img_c8e76c9a-2f1d-4134-a629-f9aa95817cdf" }, "force_delete": false, "nics": [ { "net-id": "64e89b92-7c6c-478c-925c-c398ad7bc489" } ] }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 36f0fd2e-9368-49ea-8fb4-1908df7cd202 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 17.25 | 17.25 | 17.25 | 17.25 | 17.25 | 17.25 | 100.0% | 1 | | nova.pause_server | 2.998 | 2.998 | 2.998 | 2.998 | 2.998 | 2.998 | 100.0% | 1 | | nova.unpause_server | 2.709 | 2.709 | 2.709 | 2.709 | 2.709 | 2.709 | 100.0% | 1 | | nova.delete_server | 5.791 | 5.791 | 5.791 | 5.791 | 5.791 | 5.791 | 100.0% | 1 | | total | 28.748 | 28.748 | 28.748 | 28.748 | 28.748 | 28.748 | 100.0% | 1 | | -> duration | 23.748 | 23.748 | 23.748 | 23.748 | 23.748 | 23.748 | 100.0% | 1 | | -> idle_duration | 5.0 | 5.0 | 5.0 | 5.0 | 5.0 | 5.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.748487 Full duration: 41.419396 -------------------------------------------------------------------------------- test scenario NovaServerGroups.create_and_delete_server_group args position 0 args values: { "args": { "policies": [ "affinity" ] }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 36f0fd2e-9368-49ea-8fb4-1908df7cd202 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_server_group | 0.865 | 0.865 | 0.865 | 0.865 | 0.865 | 0.865 | 100.0% | 1 | | nova.delete_server_group | 0.315 | 0.315 | 0.315 | 0.315 | 0.315 | 0.315 | 100.0% | 1 | | total | 1.18 | 1.18 | 1.18 | 1.18 | 1.18 | 1.18 | 100.0% | 1 | | -> duration | 1.18 | 1.18 | 1.18 | 1.18 | 1.18 | 1.18 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.180206 Full duration: 11.748411 HINTS: * To plot HTML graphics with this data, run: rally task report 36f0fd2e-9368-49ea-8fb4-1908df7cd202 --out output.html * To generate a JUnit report, run: rally task export 36f0fd2e-9368-49ea-8fb4-1908df7cd202 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 36f0fd2e-9368-49ea-8fb4-1908df7cd202 --json --out output.json 2021-03-20 13:30:13,598 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 36f0fd2e-9368-49ea-8fb4-1908df7cd202 --out /home/opnfv/functest/results/rally_sanity/nova.json 2021-03-20 13:30:13,605 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" OK. 2021-03-20 13:30:13,636 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-20 13:30:14,018 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2021-03-20 13:31:10,903 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: e5719ceb-b847-462c-88b1-419995f5ac89 2021-03-20 13:31:12,334 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid e5719ceb-b847-462c-88b1-419995f5ac89 -------------------------------------------------------------------------------- Task e5719ceb-b847-462c-88b1-419995f5ac89: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e5719ceb-b847-462c-88b1-419995f5ac89 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.667 | 1.667 | 1.667 | 1.667 | 1.667 | 1.667 | 100.0% | 1 | | quotas.delete_quotas | 0.348 | 0.348 | 0.348 | 0.348 | 0.348 | 0.348 | 100.0% | 1 | | total | 2.015 | 2.015 | 2.015 | 2.015 | 2.015 | 2.015 | 100.0% | 1 | | -> duration | 2.015 | 2.015 | 2.015 | 2.015 | 2.015 | 2.015 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.014801 Full duration: 12.47466 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e5719ceb-b847-462c-88b1-419995f5ac89 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.835 | 1.835 | 1.835 | 1.835 | 1.835 | 1.835 | 100.0% | 1 | | total | 1.835 | 1.835 | 1.835 | 1.835 | 1.835 | 1.835 | 100.0% | 1 | | -> duration | 1.835 | 1.835 | 1.835 | 1.835 | 1.835 | 1.835 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.834632 Full duration: 13.82391 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e5719ceb-b847-462c-88b1-419995f5ac89 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.989 | 0.989 | 0.989 | 0.989 | 0.989 | 0.989 | 100.0% | 1 | | total | 0.989 | 0.989 | 0.989 | 0.989 | 0.989 | 0.989 | 100.0% | 1 | | -> duration | 0.989 | 0.989 | 0.989 | 0.989 | 0.989 | 0.989 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.988996 Full duration: 10.934379 HINTS: * To plot HTML graphics with this data, run: rally task report e5719ceb-b847-462c-88b1-419995f5ac89 --out output.html * To generate a JUnit report, run: rally task export e5719ceb-b847-462c-88b1-419995f5ac89 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report e5719ceb-b847-462c-88b1-419995f5ac89 --json --out output.json 2021-03-20 13:31:15,584 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid e5719ceb-b847-462c-88b1-419995f5ac89 --out /home/opnfv/functest/results/rally_sanity/quotas.json 2021-03-20 13:31:15,588 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2021-03-20 13:31:15,620 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-03-20 13:31:15,776 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2021-03-20 13:33:42,843 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: 91d203c5-f181-4b6c-82c5-28d98d67975a 2021-03-20 13:33:44,200 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 91d203c5-f181-4b6c-82c5-28d98d67975a -------------------------------------------------------------------------------- Task 91d203c5-f181-4b6c-82c5-28d98d67975a: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 91d203c5-f181-4b6c-82c5-28d98d67975a has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.241 | 1.241 | 1.241 | 1.241 | 1.241 | 1.241 | 100.0% | 1 | | swift.upload_object (x2) | 1.133 | 1.133 | 1.133 | 1.133 | 1.133 | 1.133 | 100.0% | 1 | | swift.list_objects | 0.952 | 0.952 | 0.952 | 0.952 | 0.952 | 0.952 | 100.0% | 1 | | total | 3.327 | 3.327 | 3.327 | 3.327 | 3.327 | 3.327 | 100.0% | 1 | | -> duration | 3.327 | 3.327 | 3.327 | 3.327 | 3.327 | 3.327 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.32708 Full duration: 25.257586 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 91d203c5-f181-4b6c-82c5-28d98d67975a has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.2 | 1.2 | 1.2 | 1.2 | 1.2 | 1.2 | 100.0% | 1 | | swift.list_objects | 0.872 | 0.872 | 0.872 | 0.872 | 0.872 | 0.872 | 100.0% | 1 | | total | 2.071 | 2.071 | 2.071 | 2.071 | 2.071 | 2.071 | 100.0% | 1 | | -> duration | 2.071 | 2.071 | 2.071 | 2.071 | 2.071 | 2.071 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.071463 Full duration: 23.840897 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 91d203c5-f181-4b6c-82c5-28d98d67975a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.406 | 1.406 | 1.406 | 1.406 | 1.406 | 1.406 | 100.0% | 1 | | swift.upload_object (x5) | 2.584 | 2.584 | 2.584 | 2.584 | 2.584 | 2.584 | 100.0% | 1 | | swift.download_object (x5) | 2.37 | 2.37 | 2.37 | 2.37 | 2.37 | 2.37 | 100.0% | 1 | | total | 6.362 | 6.362 | 6.362 | 6.362 | 6.362 | 6.362 | 100.0% | 1 | | -> duration | 6.362 | 6.362 | 6.362 | 6.362 | 6.362 | 6.362 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.361813 Full duration: 28.321154 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 91d203c5-f181-4b6c-82c5-28d98d67975a has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.286 | 1.286 | 1.286 | 1.286 | 1.286 | 1.286 | 100.0% | 1 | | swift.upload_object (x5) | 2.801 | 2.801 | 2.801 | 2.801 | 2.801 | 2.801 | 100.0% | 1 | | swift.delete_object (x5) | 2.632 | 2.632 | 2.632 | 2.632 | 2.632 | 2.632 | 100.0% | 1 | | swift.delete_container | 0.665 | 0.665 | 0.665 | 0.665 | 0.665 | 0.665 | 100.0% | 1 | | total | 7.386 | 7.386 | 7.386 | 7.386 | 7.386 | 7.386 | 100.0% | 1 | | -> duration | 7.386 | 7.386 | 7.386 | 7.386 | 7.386 | 7.386 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.385555 Full duration: 23.229134 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 91d203c5-f181-4b6c-82c5-28d98d67975a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.358 | 1.358 | 1.358 | 1.358 | 1.358 | 1.358 | 100.0% | 1 | | swift.list_objects | 1.02 | 1.02 | 1.02 | 1.02 | 1.02 | 1.02 | 100.0% | 1 | | swift.download_object (x5) | 2.301 | 2.301 | 2.301 | 2.301 | 2.301 | 2.301 | 100.0% | 1 | | total | 4.679 | 4.679 | 4.679 | 4.679 | 4.679 | 4.679 | 100.0% | 1 | | -> duration | 4.679 | 4.679 | 4.679 | 4.679 | 4.679 | 4.679 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.679237 Full duration: 23.406231 HINTS: * To plot HTML graphics with this data, run: rally task report 91d203c5-f181-4b6c-82c5-28d98d67975a --out output.html * To generate a JUnit report, run: rally task export 91d203c5-f181-4b6c-82c5-28d98d67975a --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 91d203c5-f181-4b6c-82c5-28d98d67975a --json --out output.json 2021-03-20 13:33:47,546 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 91d203c5-f181-4b6c-82c5-28d98d67975a --out /home/opnfv/functest/results/rally_sanity/swift.json 2021-03-20 13:33:47,554 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2021-03-20 13:33:47,560 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:01:01 | 6 | 100.00% | | glance | 00:01:46 | 4 | 100.00% | | cinder | 00:03:37 | 10 | 100.00% | | heat | 00:02:01 | 4 | 100.00% | | keystone | 00:03:45 | 11 | 100.00% | | neutron | 00:03:02 | 8 | 100.00% | | nova | 00:02:39 | 4 | 100.00% | | quotas | 00:00:37 | 3 | 100.00% | | swift | 00:02:04 | 5 | 100.00% | | | | | | | TOTAL: | 00:20:35 | 55 | 100.00% | +----------------+------------+----------------+-----------+ 2021-03-20 13:33:47,561 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_sanity' success_rate is 100.00% in 9/9 modules 2021-03-20 13:33:51,136 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_sanity/rally_sanity.html 2021-03-20 13:33:54,705 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_sanity/rally_sanity.xml 2021-03-20 13:33:54,706 - xtesting.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | rally_sanity | functest | 25:41 | PASS | +----------------------+------------------+------------------+----------------+