2020-12-19 08:43:26,674 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | AIO7OOR9BIZ5 | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/AIO7OOR9BIZ5/airs | | | hip-opnfv-functest-smoke-latest-rally_sanity- | | | run-195 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/AIO7OOR9BIZ5/ai | | | rship-opnfv-functest-smoke-latest-rally_sanity- | | | run-195 | +-------------------------+------------------------------------------------------------+ 2020-12-19 08:43:26,739 - xtesting.ci.run_tests - INFO - Loading test case 'rally_sanity'... 2020-12-19 08:43:30,625 - xtesting.ci.run_tests - INFO - Running test case 'rally_sanity'... 2020-12-19 08:43:35,076 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2020-12-19 08:43:41,763 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | d0828151-d9d2-4b97-a45b-dbb4740b1a50 | 2020-12-19T08:43:41.477716 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: d0828151-d9d2-4b97-a45b-dbb4740b1a50 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-12-19 08:43:46,790 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-12-19 08:43:50,191 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-19 08:43:50,343 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2020-12-19 08:45:21,320 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: 650b051b-768e-4f07-9c5a-48774673ca0b 2020-12-19 08:45:22,712 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 650b051b-768e-4f07-9c5a-48774673ca0b -------------------------------------------------------------------------------- Task 650b051b-768e-4f07-9c5a-48774673ca0b: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 650b051b-768e-4f07-9c5a-48774673ca0b has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 1.095 | 1.095 | 1.095 | 1.095 | 1.095 | 1.095 | 100.0% | 1 | | total | 1.095 | 1.095 | 1.095 | 1.095 | 1.095 | 1.095 | 100.0% | 1 | | -> duration | 1.095 | 1.095 | 1.095 | 1.095 | 1.095 | 1.095 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.095293 Full duration: 10.068863 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 650b051b-768e-4f07-9c5a-48774673ca0b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.36 | 0.36 | 0.36 | 0.36 | 0.36 | 0.36 | 100.0% | 1 | | total | 0.974 | 0.974 | 0.974 | 0.974 | 0.974 | 0.974 | 100.0% | 1 | | -> duration | 0.974 | 0.974 | 0.974 | 0.974 | 0.974 | 0.974 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.974247 Full duration: 12.850181 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 650b051b-768e-4f07-9c5a-48774673ca0b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.302 | 0.302 | 0.302 | 0.302 | 0.302 | 0.302 | 100.0% | 1 | | total | 0.895 | 0.895 | 0.895 | 0.895 | 0.895 | 0.895 | 100.0% | 1 | | -> duration | 0.895 | 0.895 | 0.895 | 0.895 | 0.895 | 0.895 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.894672 Full duration: 10.60045 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 650b051b-768e-4f07-9c5a-48774673ca0b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.406 | 0.406 | 0.406 | 0.406 | 0.406 | 0.406 | 100.0% | 1 | | total | 1.033 | 1.033 | 1.033 | 1.033 | 1.033 | 1.033 | 100.0% | 1 | | -> duration | 1.033 | 1.033 | 1.033 | 1.033 | 1.033 | 1.033 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.032764 Full duration: 10.665933 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 650b051b-768e-4f07-9c5a-48774673ca0b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.559 | 0.559 | 0.559 | 0.559 | 0.559 | 0.559 | 100.0% | 1 | | total | 1.121 | 1.121 | 1.121 | 1.121 | 1.121 | 1.121 | 100.0% | 1 | | -> duration | 1.121 | 1.121 | 1.121 | 1.121 | 1.121 | 1.121 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.12098 Full duration: 11.617082 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 650b051b-768e-4f07-9c5a-48774673ca0b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.286 | 0.286 | 0.286 | 0.286 | 0.286 | 0.286 | 100.0% | 1 | | total | 0.938 | 0.938 | 0.938 | 0.938 | 0.938 | 0.938 | 100.0% | 1 | | -> duration | 0.938 | 0.938 | 0.938 | 0.938 | 0.938 | 0.938 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.938202 Full duration: 10.263964 HINTS: * To plot HTML graphics with this data, run: rally task report 650b051b-768e-4f07-9c5a-48774673ca0b --out output.html * To generate a JUnit report, run: rally task export 650b051b-768e-4f07-9c5a-48774673ca0b --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 650b051b-768e-4f07-9c5a-48774673ca0b --json --out output.json 2020-12-19 08:45:26,031 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 650b051b-768e-4f07-9c5a-48774673ca0b --out /home/opnfv/functest/results/rally_sanity/authenticate.json 2020-12-19 08:45:26,037 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2020-12-19 08:45:26,066 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-19 08:45:26,235 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2020-12-19 08:47:38,378 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: ac29b9c9-7f7d-4d46-b612-29276a6ea308 2020-12-19 08:47:39,758 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid ac29b9c9-7f7d-4d46-b612-29276a6ea308 -------------------------------------------------------------------------------- Task ac29b9c9-7f7d-4d46-b612-29276a6ea308: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ac29b9c9-7f7d-4d46-b612-29276a6ea308 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 6.634 | 6.634 | 6.634 | 6.634 | 6.634 | 6.634 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.099 | 0.099 | 0.099 | 0.099 | 0.099 | 0.099 | 100.0% | 1 | | -> glance_v2.upload_data | 3.914 | 3.914 | 3.914 | 3.914 | 3.914 | 3.914 | 100.0% | 1 | | glance_v2.delete_image | 1.989 | 1.989 | 1.989 | 1.989 | 1.989 | 1.989 | 100.0% | 1 | | total | 8.623 | 8.623 | 8.623 | 8.623 | 8.623 | 8.623 | 100.0% | 1 | | -> duration | 8.623 | 8.623 | 8.623 | 8.623 | 8.623 | 8.623 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.623179 Full duration: 19.358238 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ac29b9c9-7f7d-4d46-b612-29276a6ea308 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.803 | 5.803 | 5.803 | 5.803 | 5.803 | 5.803 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.107 | 0.107 | 0.107 | 0.107 | 0.107 | 0.107 | 100.0% | 1 | | -> glance_v2.upload_data | 3.333 | 3.333 | 3.333 | 3.333 | 3.333 | 3.333 | 100.0% | 1 | | glance_v2.list_images | 0.143 | 0.143 | 0.143 | 0.143 | 0.143 | 0.143 | 100.0% | 1 | | total | 5.946 | 5.946 | 5.946 | 5.946 | 5.946 | 5.946 | 100.0% | 1 | | -> duration | 5.946 | 5.946 | 5.946 | 5.946 | 5.946 | 5.946 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.946403 Full duration: 22.838097 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ac29b9c9-7f7d-4d46-b612-29276a6ea308 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.306 | 0.306 | 0.306 | 0.306 | 0.306 | 0.306 | 100.0% | 1 | | total | 0.306 | 0.306 | 0.306 | 0.306 | 0.306 | 0.306 | 100.0% | 1 | | -> duration | 0.306 | 0.306 | 0.306 | 0.306 | 0.306 | 0.306 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.306052 Full duration: 9.75377 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_sanity-flavor_27750471-d131-4fdd-a179-b8bcd9427160" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "c407c003-1bc2-4be9-a7f6-f4074855a758" } ] } }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ac29b9c9-7f7d-4d46-b612-29276a6ea308 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.299 | 5.299 | 5.299 | 5.299 | 5.299 | 5.299 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.118 | 0.118 | 0.118 | 0.118 | 0.118 | 0.118 | 100.0% | 1 | | -> glance_v2.upload_data | 2.799 | 2.799 | 2.799 | 2.799 | 2.799 | 2.799 | 100.0% | 1 | | nova.boot_servers | 24.801 | 24.801 | 24.801 | 24.801 | 24.801 | 24.801 | 100.0% | 1 | | total | 30.1 | 30.1 | 30.1 | 30.1 | 30.1 | 30.1 | 100.0% | 1 | | -> duration | 29.1 | 29.1 | 29.1 | 29.1 | 29.1 | 29.1 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 29.100139 Full duration: 56.769073 HINTS: * To plot HTML graphics with this data, run: rally task report ac29b9c9-7f7d-4d46-b612-29276a6ea308 --out output.html * To generate a JUnit report, run: rally task export ac29b9c9-7f7d-4d46-b612-29276a6ea308 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report ac29b9c9-7f7d-4d46-b612-29276a6ea308 --json --out output.json 2020-12-19 08:47:42,983 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid ac29b9c9-7f7d-4d46-b612-29276a6ea308 --out /home/opnfv/functest/results/rally_sanity/glance.json 2020-12-19 08:47:42,988 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2020-12-19 08:47:43,023 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-19 08:47:43,234 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2020-12-19 08:52:18,431 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: 594da977-6177-40c2-8cd1-79eb12c458f2 2020-12-19 08:52:19,828 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 594da977-6177-40c2-8cd1-79eb12c458f2 -------------------------------------------------------------------------------- Task 594da977-6177-40c2-8cd1-79eb12c458f2: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 594da977-6177-40c2-8cd1-79eb12c458f2 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 3.894 | 3.894 | 3.894 | 3.894 | 3.894 | 3.894 | 100.0% | 1 | | cinder_v3.delete_snapshot | 2.484 | 2.484 | 2.484 | 2.484 | 2.484 | 2.484 | 100.0% | 1 | | total | 6.378 | 6.378 | 6.378 | 6.378 | 6.378 | 6.378 | 100.0% | 1 | | -> duration | 6.378 | 6.378 | 6.378 | 6.378 | 6.378 | 6.378 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.377819 Full duration: 34.136702 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 594da977-6177-40c2-8cd1-79eb12c458f2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.178 | 4.178 | 4.178 | 4.178 | 4.178 | 4.178 | 100.0% | 1 | | cinder_v3.delete_volume | 2.662 | 2.662 | 2.662 | 2.662 | 2.662 | 2.662 | 100.0% | 1 | | total | 6.841 | 6.841 | 6.841 | 6.841 | 6.841 | 6.841 | 100.0% | 1 | | -> duration | 6.841 | 6.841 | 6.841 | 6.841 | 6.841 | 6.841 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.840846 Full duration: 22.453589 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_sanity-img_27750471-d131-4fdd-a179-b8bcd9427160" }, "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 594da977-6177-40c2-8cd1-79eb12c458f2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 14.737 | 14.737 | 14.737 | 14.737 | 14.737 | 14.737 | 100.0% | 1 | | cinder_v3.delete_volume | 2.442 | 2.442 | 2.442 | 2.442 | 2.442 | 2.442 | 100.0% | 1 | | total | 17.18 | 17.18 | 17.18 | 17.18 | 17.18 | 17.18 | 100.0% | 1 | | -> duration | 17.18 | 17.18 | 17.18 | 17.18 | 17.18 | 17.18 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.180022 Full duration: 31.134228 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 594da977-6177-40c2-8cd1-79eb12c458f2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.514 | 6.514 | 6.514 | 6.514 | 6.514 | 6.514 | 100.0% | 1 | | cinder_v3.delete_volume | 2.309 | 2.309 | 2.309 | 2.309 | 2.309 | 2.309 | 100.0% | 1 | | total | 8.822 | 8.822 | 8.822 | 8.822 | 8.822 | 8.822 | 100.0% | 1 | | -> duration | 8.822 | 8.822 | 8.822 | 8.822 | 8.822 | 8.822 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.82243 Full duration: 25.378063 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 594da977-6177-40c2-8cd1-79eb12c458f2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.265 | 4.265 | 4.265 | 4.265 | 4.265 | 4.265 | 100.0% | 1 | | cinder_v3.extend_volume | 3.149 | 3.149 | 3.149 | 3.149 | 3.149 | 3.149 | 100.0% | 1 | | cinder_v3.delete_volume | 2.274 | 2.274 | 2.274 | 2.274 | 2.274 | 2.274 | 100.0% | 1 | | total | 9.688 | 9.688 | 9.688 | 9.688 | 9.688 | 9.688 | 100.0% | 1 | | -> duration | 9.688 | 9.688 | 9.688 | 9.688 | 9.688 | 9.688 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.688044 Full duration: 24.423288 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 594da977-6177-40c2-8cd1-79eb12c458f2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.737 | 6.737 | 6.737 | 6.737 | 6.737 | 6.737 | 100.0% | 1 | | cinder_v3.delete_volume | 4.366 | 4.366 | 4.366 | 4.366 | 4.366 | 4.366 | 100.0% | 1 | | total | 11.104 | 11.104 | 11.104 | 11.104 | 11.104 | 11.104 | 100.0% | 1 | | -> duration | 11.104 | 11.104 | 11.104 | 11.104 | 11.104 | 11.104 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.103558 Full duration: 37.183322 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 594da977-6177-40c2-8cd1-79eb12c458f2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 1.426 | 1.426 | 1.426 | 1.426 | 1.426 | 1.426 | 100.0% | 1 | | cinder_v3.list_qos | 0.038 | 0.038 | 0.038 | 0.038 | 0.038 | 0.038 | 100.0% | 1 | | total | 1.465 | 1.465 | 1.465 | 1.465 | 1.465 | 1.465 | 100.0% | 1 | | -> duration | 1.465 | 1.465 | 1.465 | 1.465 | 1.465 | 1.465 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.464758 Full duration: 16.270484 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 594da977-6177-40c2-8cd1-79eb12c458f2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 1.389 | 1.389 | 1.389 | 1.389 | 1.389 | 1.389 | 100.0% | 1 | | cinder_v3.set_qos | 0.43 | 0.43 | 0.43 | 0.43 | 0.43 | 0.43 | 100.0% | 1 | | total | 1.819 | 1.819 | 1.819 | 1.819 | 1.819 | 1.819 | 100.0% | 1 | | -> duration | 1.819 | 1.819 | 1.819 | 1.819 | 1.819 | 1.819 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.818949 Full duration: 20.754611 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 594da977-6177-40c2-8cd1-79eb12c458f2 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 1.037 | 1.037 | 1.037 | 1.037 | 1.037 | 1.037 | 100.0% | 1 | | cinder_v3.list_types | 0.043 | 0.043 | 0.043 | 0.043 | 0.043 | 0.043 | 100.0% | 1 | | total | 1.081 | 1.081 | 1.081 | 1.081 | 1.081 | 1.081 | 100.0% | 1 | | -> duration | 1.081 | 1.081 | 1.081 | 1.081 | 1.081 | 1.081 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.080823 Full duration: 14.685177 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 594da977-6177-40c2-8cd1-79eb12c458f2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.815 | 0.815 | 0.815 | 0.815 | 0.815 | 0.815 | 100.0% | 1 | | cinder_v3.create_encryption_type | 0.079 | 0.079 | 0.079 | 0.079 | 0.079 | 0.079 | 100.0% | 1 | | total | 0.895 | 0.895 | 0.895 | 0.895 | 0.895 | 0.895 | 100.0% | 1 | | -> duration | 0.895 | 0.895 | 0.895 | 0.895 | 0.895 | 0.895 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.894997 Full duration: 14.275394 HINTS: * To plot HTML graphics with this data, run: rally task report 594da977-6177-40c2-8cd1-79eb12c458f2 --out output.html * To generate a JUnit report, run: rally task export 594da977-6177-40c2-8cd1-79eb12c458f2 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 594da977-6177-40c2-8cd1-79eb12c458f2 --json --out output.json 2020-12-19 08:52:23,059 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 594da977-6177-40c2-8cd1-79eb12c458f2 --out /home/opnfv/functest/results/rally_sanity/cinder.json 2020-12-19 08:52:23,071 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2020-12-19 08:52:23,098 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-19 08:52:23,787 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2020-12-19 08:55:35,531 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: 5e6e69ad-71be-4945-b77c-8ddf188c404a 2020-12-19 08:55:36,906 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 5e6e69ad-71be-4945-b77c-8ddf188c404a -------------------------------------------------------------------------------- Task 5e6e69ad-71be-4945-b77c-8ddf188c404a: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5e6e69ad-71be-4945-b77c-8ddf188c404a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 14.469 | 14.469 | 14.469 | 14.469 | 14.469 | 14.469 | 100.0% | 1 | | heat.update_stack | 15.311 | 15.311 | 15.311 | 15.311 | 15.311 | 15.311 | 100.0% | 1 | | heat.delete_stack | 9.293 | 9.293 | 9.293 | 9.293 | 9.293 | 9.293 | 100.0% | 1 | | total | 39.074 | 39.074 | 39.074 | 39.074 | 39.074 | 39.074 | 100.0% | 1 | | -> duration | 35.074 | 35.074 | 35.074 | 35.074 | 35.074 | 35.074 | 100.0% | 1 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 35.073518 Full duration: 58.116509 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5e6e69ad-71be-4945-b77c-8ddf188c404a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 12.69 | 12.69 | 12.69 | 12.69 | 12.69 | 12.69 | 100.0% | 1 | | heat.check_stack | 3.685 | 3.685 | 3.685 | 3.685 | 3.685 | 3.685 | 100.0% | 1 | | heat.delete_stack | 4.088 | 4.088 | 4.088 | 4.088 | 4.088 | 4.088 | 100.0% | 1 | | total | 20.464 | 20.464 | 20.464 | 20.464 | 20.464 | 20.464 | 100.0% | 1 | | -> duration | 18.464 | 18.464 | 18.464 | 18.464 | 18.464 | 18.464 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.464114 Full duration: 38.849182 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5e6e69ad-71be-4945-b77c-8ddf188c404a has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 10.999 | 10.999 | 10.999 | 10.999 | 10.999 | 10.999 | 100.0% | 1 | | heat.suspend_stack | 2.94 | 2.94 | 2.94 | 2.94 | 2.94 | 2.94 | 100.0% | 1 | | heat.resume_stack | 4.227 | 4.227 | 4.227 | 4.227 | 4.227 | 4.227 | 100.0% | 1 | | heat.delete_stack | 5.977 | 5.977 | 5.977 | 5.977 | 5.977 | 5.977 | 100.0% | 1 | | total | 24.144 | 24.144 | 24.144 | 24.144 | 24.144 | 24.144 | 100.0% | 1 | | -> duration | 22.144 | 22.144 | 22.144 | 22.144 | 22.144 | 22.144 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.143547 Full duration: 44.000404 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5e6e69ad-71be-4945-b77c-8ddf188c404a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.791 | 0.791 | 0.791 | 0.791 | 0.791 | 0.791 | 100.0% | 1 | | total | 0.791 | 0.791 | 0.791 | 0.791 | 0.791 | 0.791 | 100.0% | 1 | | -> duration | 0.791 | 0.791 | 0.791 | 0.791 | 0.791 | 0.791 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.791335 Full duration: 14.493924 HINTS: * To plot HTML graphics with this data, run: rally task report 5e6e69ad-71be-4945-b77c-8ddf188c404a --out output.html * To generate a JUnit report, run: rally task export 5e6e69ad-71be-4945-b77c-8ddf188c404a --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 5e6e69ad-71be-4945-b77c-8ddf188c404a --json --out output.json 2020-12-19 08:55:40,203 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 5e6e69ad-71be-4945-b77c-8ddf188c404a --out /home/opnfv/functest/results/rally_sanity/heat.json 2020-12-19 08:55:40,208 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2020-12-19 08:55:40,240 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-19 08:55:40,434 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2020-12-19 09:00:00,205 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: 67f9cc61-032e-4b1d-a6fb-8f16359c047d 2020-12-19 09:00:01,599 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 67f9cc61-032e-4b1d-a6fb-8f16359c047d -------------------------------------------------------------------------------- Task 67f9cc61-032e-4b1d-a6fb-8f16359c047d: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 67f9cc61-032e-4b1d-a6fb-8f16359c047d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.498 | 0.498 | 0.498 | 0.498 | 0.498 | 0.498 | 100.0% | 1 | | keystone_v3.add_role | 0.362 | 0.362 | 0.362 | 0.362 | 0.362 | 0.362 | 100.0% | 1 | | keystone_v3.revoke_role | 0.36 | 0.36 | 0.36 | 0.36 | 0.36 | 0.36 | 100.0% | 1 | | total | 1.22 | 1.22 | 1.22 | 1.22 | 1.22 | 1.22 | 100.0% | 1 | | -> duration | 1.22 | 1.22 | 1.22 | 1.22 | 1.22 | 1.22 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.220216 Full duration: 19.145817 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 67f9cc61-032e-4b1d-a6fb-8f16359c047d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.307 | 0.307 | 0.307 | 0.307 | 0.307 | 0.307 | 100.0% | 1 | | keystone_v3.add_role | 0.295 | 0.295 | 0.295 | 0.295 | 0.295 | 0.295 | 100.0% | 1 | | keystone_v3.list_roles | 0.126 | 0.126 | 0.126 | 0.126 | 0.126 | 0.126 | 100.0% | 1 | | total | 0.728 | 0.728 | 0.728 | 0.728 | 0.728 | 0.728 | 100.0% | 1 | | -> duration | 0.728 | 0.728 | 0.728 | 0.728 | 0.728 | 0.728 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.72787 Full duration: 19.49688 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 67f9cc61-032e-4b1d-a6fb-8f16359c047d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.423 | 0.423 | 0.423 | 0.423 | 0.423 | 0.423 | 100.0% | 1 | | keystone_v3.list_projects | 0.125 | 0.125 | 0.125 | 0.125 | 0.125 | 0.125 | 100.0% | 1 | | total | 0.549 | 0.549 | 0.549 | 0.549 | 0.549 | 0.549 | 100.0% | 1 | | -> duration | 0.549 | 0.549 | 0.549 | 0.549 | 0.549 | 0.549 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.548701 Full duration: 18.369224 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 67f9cc61-032e-4b1d-a6fb-8f16359c047d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.132 | 0.132 | 0.132 | 0.132 | 0.132 | 0.132 | 100.0% | 1 | | keystone_v3.delete_role | 0.47 | 0.47 | 0.47 | 0.47 | 0.47 | 0.47 | 100.0% | 1 | | total | 0.602 | 0.602 | 0.602 | 0.602 | 0.602 | 0.602 | 100.0% | 1 | | -> duration | 0.602 | 0.602 | 0.602 | 0.602 | 0.602 | 0.602 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.602231 Full duration: 15.953047 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 67f9cc61-032e-4b1d-a6fb-8f16359c047d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.412 | 0.412 | 0.412 | 0.412 | 0.412 | 0.412 | 100.0% | 1 | | keystone_v3.delete_service | 0.117 | 0.117 | 0.117 | 0.117 | 0.117 | 0.117 | 100.0% | 1 | | total | 0.53 | 0.53 | 0.53 | 0.53 | 0.53 | 0.53 | 100.0% | 1 | | -> duration | 0.53 | 0.53 | 0.53 | 0.53 | 0.53 | 0.53 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.52951 Full duration: 16.278821 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 67f9cc61-032e-4b1d-a6fb-8f16359c047d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.65 | 0.65 | 0.65 | 0.65 | 0.65 | 0.65 | 100.0% | 1 | | keystone_v3.create_user | 1.834 | 1.834 | 1.834 | 1.834 | 1.834 | 1.834 | 100.0% | 1 | | -> keystone_v3.list_roles | 0.051 | 0.051 | 0.051 | 0.051 | 0.051 | 0.051 | 100.0% | 1 | | -> keystone_v3.add_role | 0.264 | 0.264 | 0.264 | 0.264 | 0.264 | 0.264 | 100.0% | 1 | | keystone_v3.create_role | 0.235 | 0.235 | 0.235 | 0.235 | 0.235 | 0.235 | 100.0% | 1 | | keystone_v3.get_project | 0.037 | 0.037 | 0.037 | 0.037 | 0.037 | 0.037 | 100.0% | 1 | | keystone_v3.get_user | 0.031 | 0.031 | 0.031 | 0.031 | 0.031 | 0.031 | 100.0% | 1 | | keystone_v3.get_role | 0.038 | 0.038 | 0.038 | 0.038 | 0.038 | 0.038 | 100.0% | 1 | | keystone_v3.list_services | 0.038 | 0.038 | 0.038 | 0.038 | 0.038 | 0.038 | 100.0% | 1 | | keystone_v3.get_services | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 100.0% | 1 | | total | 3.035 | 3.035 | 3.035 | 3.035 | 3.035 | 3.035 | 100.0% | 1 | | -> duration | 3.035 | 3.035 | 3.035 | 3.035 | 3.035 | 3.035 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.03477 Full duration: 26.919444 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 67f9cc61-032e-4b1d-a6fb-8f16359c047d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.232 | 0.232 | 0.232 | 0.232 | 0.232 | 0.232 | 100.0% | 1 | | keystone_v3.update_project | 0.318 | 0.318 | 0.318 | 0.318 | 0.318 | 0.318 | 100.0% | 1 | | keystone_v3.delete_project | 0.921 | 0.921 | 0.921 | 0.921 | 0.921 | 0.921 | 100.0% | 1 | | total | 1.472 | 1.472 | 1.472 | 1.472 | 1.472 | 1.472 | 100.0% | 1 | | -> duration | 1.472 | 1.472 | 1.472 | 1.472 | 1.472 | 1.472 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.472299 Full duration: 18.021684 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 67f9cc61-032e-4b1d-a6fb-8f16359c047d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.501 | 0.501 | 0.501 | 0.501 | 0.501 | 0.501 | 100.0% | 1 | | total | 0.581 | 0.581 | 0.581 | 0.581 | 0.581 | 0.581 | 100.0% | 1 | | -> duration | 0.581 | 0.581 | 0.581 | 0.581 | 0.581 | 0.581 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.58063 Full duration: 19.441904 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 67f9cc61-032e-4b1d-a6fb-8f16359c047d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 2.064 | 2.064 | 2.064 | 2.064 | 2.064 | 2.064 | 100.0% | 1 | | total | 2.064 | 2.064 | 2.064 | 2.064 | 2.064 | 2.064 | 100.0% | 1 | | -> duration | 2.064 | 2.064 | 2.064 | 2.064 | 2.064 | 2.064 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.063987 Full duration: 19.957835 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 67f9cc61-032e-4b1d-a6fb-8f16359c047d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 1.322 | 1.322 | 1.322 | 1.322 | 1.322 | 1.322 | 100.0% | 1 | | keystone_v3.list_users | 0.081 | 0.081 | 0.081 | 0.081 | 0.081 | 0.081 | 100.0% | 1 | | total | 1.486 | 1.486 | 1.486 | 1.486 | 1.486 | 1.486 | 100.0% | 1 | | -> duration | 1.486 | 1.486 | 1.486 | 1.486 | 1.486 | 1.486 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.486395 Full duration: 22.302899 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 67f9cc61-032e-4b1d-a6fb-8f16359c047d has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.414 | 0.414 | 0.414 | 0.414 | 0.414 | 0.414 | 100.0% | 1 | | keystone_v3.create_users | 9.812 | 9.812 | 9.812 | 9.812 | 9.812 | 9.812 | 100.0% | 1 | | -> keystone_v3.create_user (x10) | 9.812 | 9.812 | 9.812 | 9.812 | 9.812 | 9.812 | 100.0% | 1 | | --> keystone_v3.list_roles (x10) | 0.661 | 0.661 | 0.661 | 0.661 | 0.661 | 0.661 | 100.0% | 1 | | --> keystone_v3.add_role (x10) | 3.123 | 3.123 | 3.123 | 3.123 | 3.123 | 3.123 | 100.0% | 1 | | total | 10.667 | 10.667 | 10.667 | 10.667 | 10.667 | 10.667 | 100.0% | 1 | | -> duration | 10.667 | 10.667 | 10.667 | 10.667 | 10.667 | 10.667 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.667489 Full duration: 36.241034 HINTS: * To plot HTML graphics with this data, run: rally task report 67f9cc61-032e-4b1d-a6fb-8f16359c047d --out output.html * To generate a JUnit report, run: rally task export 67f9cc61-032e-4b1d-a6fb-8f16359c047d --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 67f9cc61-032e-4b1d-a6fb-8f16359c047d --json --out output.json 2020-12-19 09:00:04,852 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 67f9cc61-032e-4b1d-a6fb-8f16359c047d --out /home/opnfv/functest/results/rally_sanity/keystone.json 2020-12-19 09:00:04,864 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2020-12-19 09:00:04,895 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-19 09:00:05,565 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-12-19 09:04:05,596 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 95cd1862-eb44-4e3f-aa6b-5571bd898942 2020-12-19 09:04:06,989 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 95cd1862-eb44-4e3f-aa6b-5571bd898942 -------------------------------------------------------------------------------- Task 95cd1862-eb44-4e3f-aa6b-5571bd898942: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 95cd1862-eb44-4e3f-aa6b-5571bd898942 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.522 | 2.522 | 2.522 | 2.522 | 2.522 | 2.522 | 100.0% | 1 | | neutron.delete_network | 1.242 | 1.242 | 1.242 | 1.242 | 1.242 | 1.242 | 100.0% | 1 | | total | 3.765 | 3.765 | 3.765 | 3.765 | 3.765 | 3.765 | 100.0% | 1 | | -> duration | 3.765 | 3.765 | 3.765 | 3.765 | 3.765 | 3.765 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.764669 Full duration: 21.191363 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 95cd1862-eb44-4e3f-aa6b-5571bd898942 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.722 | 2.722 | 2.722 | 2.722 | 2.722 | 2.722 | 100.0% | 1 | | neutron.delete_port | 1.289 | 1.289 | 1.289 | 1.289 | 1.289 | 1.289 | 100.0% | 1 | | total | 4.011 | 4.011 | 4.011 | 4.011 | 4.011 | 4.011 | 100.0% | 1 | | -> duration | 4.011 | 4.011 | 4.011 | 4.011 | 4.011 | 4.011 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.011281 Full duration: 30.112999 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 95cd1862-eb44-4e3f-aa6b-5571bd898942 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 2.508 | 2.508 | 2.508 | 2.508 | 2.508 | 2.508 | 100.0% | 1 | | neutron.delete_subnet | 0.963 | 0.963 | 0.963 | 0.963 | 0.963 | 0.963 | 100.0% | 1 | | total | 3.471 | 3.471 | 3.471 | 3.471 | 3.471 | 3.471 | 100.0% | 1 | | -> duration | 3.471 | 3.471 | 3.471 | 3.471 | 3.471 | 3.471 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.471376 Full duration: 26.201029 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 95cd1862-eb44-4e3f-aa6b-5571bd898942 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.146 | 2.146 | 2.146 | 2.146 | 2.146 | 2.146 | 100.0% | 1 | | neutron.list_networks | 0.226 | 0.226 | 0.226 | 0.226 | 0.226 | 0.226 | 100.0% | 1 | | total | 2.372 | 2.372 | 2.372 | 2.372 | 2.372 | 2.372 | 100.0% | 1 | | -> duration | 2.372 | 2.372 | 2.372 | 2.372 | 2.372 | 2.372 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.371894 Full duration: 24.913247 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 95cd1862-eb44-4e3f-aa6b-5571bd898942 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.421 | 2.421 | 2.421 | 2.421 | 2.421 | 2.421 | 100.0% | 1 | | neutron.list_ports | 0.12 | 0.12 | 0.12 | 0.12 | 0.12 | 0.12 | 100.0% | 1 | | total | 2.541 | 2.541 | 2.541 | 2.541 | 2.541 | 2.541 | 100.0% | 1 | | -> duration | 2.541 | 2.541 | 2.541 | 2.541 | 2.541 | 2.541 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.540939 Full duration: 30.262628 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 95cd1862-eb44-4e3f-aa6b-5571bd898942 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.594 | 1.594 | 1.594 | 1.594 | 1.594 | 1.594 | 100.0% | 1 | | neutron.create_subnet | 2.773 | 2.773 | 2.773 | 2.773 | 2.773 | 2.773 | 100.0% | 1 | | neutron.list_subnets | 0.121 | 0.121 | 0.121 | 0.121 | 0.121 | 0.121 | 100.0% | 1 | | total | 4.488 | 4.488 | 4.488 | 4.488 | 4.488 | 4.488 | 100.0% | 1 | | -> duration | 4.488 | 4.488 | 4.488 | 4.488 | 4.488 | 4.488 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.488463 Full duration: 28.912757 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 95cd1862-eb44-4e3f-aa6b-5571bd898942 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 2.23 | 2.23 | 2.23 | 2.23 | 2.23 | 2.23 | 100.0% | 1 | | neutron.delete_security_group | 0.27 | 0.27 | 0.27 | 0.27 | 0.27 | 0.27 | 100.0% | 1 | | total | 2.501 | 2.501 | 2.501 | 2.501 | 2.501 | 2.501 | 100.0% | 1 | | -> duration | 2.501 | 2.501 | 2.501 | 2.501 | 2.501 | 2.501 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.500507 Full duration: 18.469746 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 95cd1862-eb44-4e3f-aa6b-5571bd898942 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.524 | 1.524 | 1.524 | 1.524 | 1.524 | 1.524 | 100.0% | 1 | | neutron.create_security_group_rule | 1.493 | 1.493 | 1.493 | 1.493 | 1.493 | 1.493 | 100.0% | 1 | | neutron.delete_security_group_rule | 0.353 | 0.353 | 0.353 | 0.353 | 0.353 | 0.353 | 100.0% | 1 | | neutron.delete_security_group | 0.538 | 0.538 | 0.538 | 0.538 | 0.538 | 0.538 | 100.0% | 1 | | total | 3.908 | 3.908 | 3.908 | 3.908 | 3.908 | 3.908 | 100.0% | 1 | | -> duration | 3.908 | 3.908 | 3.908 | 3.908 | 3.908 | 3.908 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.907778 Full duration: 21.059672 HINTS: * To plot HTML graphics with this data, run: rally task report 95cd1862-eb44-4e3f-aa6b-5571bd898942 --out output.html * To generate a JUnit report, run: rally task export 95cd1862-eb44-4e3f-aa6b-5571bd898942 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 95cd1862-eb44-4e3f-aa6b-5571bd898942 --json --out output.json 2020-12-19 09:04:10,293 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 95cd1862-eb44-4e3f-aa6b-5571bd898942 --out /home/opnfv/functest/results/rally_sanity/neutron.json 2020-12-19 09:04:10,303 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2020-12-19 09:04:10,336 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-19 09:04:10,486 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2020-12-19 09:05:32,543 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: b9201b85-1d79-433f-9294-9c91f9337505 2020-12-19 09:05:33,904 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid b9201b85-1d79-433f-9294-9c91f9337505 -------------------------------------------------------------------------------- Task b9201b85-1d79-433f-9294-9c91f9337505: aborted -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_live_migrate_server args position 0 args values: { "args": { "flavor": { "name": "rally_sanity-flavor_27750471-d131-4fdd-a179-b8bcd9427160" }, "image": { "name": "rally_sanity-img_27750471-d131-4fdd-a179-b8bcd9427160" }, "block_migration": false, "nics": [ { "net-id": "c407c003-1bc2-4be9-a7f6-f4074855a758" } ] }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b9201b85-1d79-433f-9294-9c91f9337505 has 1 error(s) -------------------------------------------------------------------------------- BadRequest: Migration pre-check error: Instance has an associated NUMA topology. Instance NUMA topologies, including related attributes such as CPU pinning, huge page and emulator thread pinning information, are not currently recalculated on live migration. See bug #1289064 for more information. (HTTP 400) (Request-ID: req-13c7d0a0-3f5d-459f-bc18-171d2b055f9b) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 720, in run self._live_migrate(server, block_migration, disk_over_commit) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 798, in _live_migrate disk_over_commit=disk_over_commit) File "/usr/lib/python3.6/site-packages/novaclient/api_versions.py", line 393, in substitution return methods[-1].func(obj, *args, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 438, in live_migrate disk_over_commit) File "/usr/lib/python3.6/site-packages/novaclient/api_versions.py", line 393, in substitution return methods[-1].func(obj, *args, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1742, in live_migrate force=None) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1726, in _live_migrate return self._action('os-migrateLive', server, body) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: Migration pre-check error: Instance has an associated NUMA topology. Instance NUMA topologies, including related attributes such as CPU pinning, huge page and emulator thread pinning information, are not currently recalculated on live migration. See bug #1289064 for more information. (HTTP 400) (Request-ID: req-13c7d0a0-3f5d-459f-bc18-171d2b055f9b) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 20.385 | 20.385 | 20.385 | 20.385 | 20.385 | 20.385 | 100.0% | 1 | | nova.live_migrate | 3.407 | 3.407 | 3.407 | 3.407 | 3.407 | 3.407 | 0.0% | 1 | | -> nova.list_hypervisors | 0.651 | 0.651 | 0.651 | 0.651 | 0.651 | 0.651 | 100.0% | 1 | | total | 23.793 | 23.793 | 23.793 | 23.793 | 23.793 | 23.793 | 0.0% | 1 | | -> duration | 22.793 | 22.793 | 22.793 | 22.793 | 22.793 | 22.793 | 0.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.793033 Full duration: 47.645356 HINTS: * To plot HTML graphics with this data, run: rally task report b9201b85-1d79-433f-9294-9c91f9337505 --out output.html * To generate a JUnit report, run: rally task export b9201b85-1d79-433f-9294-9c91f9337505 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report b9201b85-1d79-433f-9294-9c91f9337505 --json --out output.json At least one workload did not pass SLA criteria. 2020-12-19 09:05:37,129 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid b9201b85-1d79-433f-9294-9c91f9337505 --out /home/opnfv/functest/results/rally_sanity/nova.json 2020-12-19 09:05:37,131 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2020-12-19 09:05:37,162 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-19 09:05:37,527 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2020-12-19 09:06:38,963 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: d356726e-25c4-4c61-9a56-d601da119017 2020-12-19 09:06:40,422 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid d356726e-25c4-4c61-9a56-d601da119017 -------------------------------------------------------------------------------- Task d356726e-25c4-4c61-9a56-d601da119017: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d356726e-25c4-4c61-9a56-d601da119017 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.539 | 1.539 | 1.539 | 1.539 | 1.539 | 1.539 | 100.0% | 1 | | quotas.delete_quotas | 0.244 | 0.244 | 0.244 | 0.244 | 0.244 | 0.244 | 100.0% | 1 | | total | 1.782 | 1.782 | 1.782 | 1.782 | 1.782 | 1.782 | 100.0% | 1 | | -> duration | 1.782 | 1.782 | 1.782 | 1.782 | 1.782 | 1.782 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.782444 Full duration: 15.148217 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d356726e-25c4-4c61-9a56-d601da119017 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 2.972 | 2.972 | 2.972 | 2.972 | 2.972 | 2.972 | 100.0% | 1 | | total | 2.972 | 2.972 | 2.972 | 2.972 | 2.972 | 2.972 | 100.0% | 1 | | -> duration | 2.972 | 2.972 | 2.972 | 2.972 | 2.972 | 2.972 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.971716 Full duration: 12.919821 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d356726e-25c4-4c61-9a56-d601da119017 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.555 | 1.555 | 1.555 | 1.555 | 1.555 | 1.555 | 100.0% | 1 | | total | 1.555 | 1.555 | 1.555 | 1.555 | 1.555 | 1.555 | 100.0% | 1 | | -> duration | 1.555 | 1.555 | 1.555 | 1.555 | 1.555 | 1.555 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.554962 Full duration: 12.150485 HINTS: * To plot HTML graphics with this data, run: rally task report d356726e-25c4-4c61-9a56-d601da119017 --out output.html * To generate a JUnit report, run: rally task export d356726e-25c4-4c61-9a56-d601da119017 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report d356726e-25c4-4c61-9a56-d601da119017 --json --out output.json 2020-12-19 09:06:43,674 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid d356726e-25c4-4c61-9a56-d601da119017 --out /home/opnfv/functest/results/rally_sanity/quotas.json 2020-12-19 09:06:43,678 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2020-12-19 09:06:43,709 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-19 09:06:43,875 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2020-12-19 09:09:21,662 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: 22ab930a-6ba0-41e1-8298-f295c2bfbc97 2020-12-19 09:09:23,061 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 22ab930a-6ba0-41e1-8298-f295c2bfbc97 -------------------------------------------------------------------------------- Task 22ab930a-6ba0-41e1-8298-f295c2bfbc97: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 22ab930a-6ba0-41e1-8298-f295c2bfbc97 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.23 | 1.23 | 1.23 | 1.23 | 1.23 | 1.23 | 100.0% | 1 | | swift.upload_object (x2) | 1.06 | 1.06 | 1.06 | 1.06 | 1.06 | 1.06 | 100.0% | 1 | | swift.list_objects | 0.82 | 0.82 | 0.82 | 0.82 | 0.82 | 0.82 | 100.0% | 1 | | total | 3.111 | 3.111 | 3.111 | 3.111 | 3.111 | 3.111 | 100.0% | 1 | | -> duration | 3.111 | 3.111 | 3.111 | 3.111 | 3.111 | 3.111 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.11062 Full duration: 25.310252 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 22ab930a-6ba0-41e1-8298-f295c2bfbc97 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.485 | 1.485 | 1.485 | 1.485 | 1.485 | 1.485 | 100.0% | 1 | | swift.list_objects | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | | total | 2.486 | 2.486 | 2.486 | 2.486 | 2.486 | 2.486 | 100.0% | 1 | | -> duration | 2.486 | 2.486 | 2.486 | 2.486 | 2.486 | 2.486 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.485671 Full duration: 25.366447 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 22ab930a-6ba0-41e1-8298-f295c2bfbc97 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.326 | 1.326 | 1.326 | 1.326 | 1.326 | 1.326 | 100.0% | 1 | | swift.upload_object (x5) | 2.867 | 2.867 | 2.867 | 2.867 | 2.867 | 2.867 | 100.0% | 1 | | swift.download_object (x5) | 2.615 | 2.615 | 2.615 | 2.615 | 2.615 | 2.615 | 100.0% | 1 | | total | 6.809 | 6.809 | 6.809 | 6.809 | 6.809 | 6.809 | 100.0% | 1 | | -> duration | 6.809 | 6.809 | 6.809 | 6.809 | 6.809 | 6.809 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.808586 Full duration: 30.689909 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 22ab930a-6ba0-41e1-8298-f295c2bfbc97 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.221 | 1.221 | 1.221 | 1.221 | 1.221 | 1.221 | 100.0% | 1 | | swift.upload_object (x5) | 2.86 | 2.86 | 2.86 | 2.86 | 2.86 | 2.86 | 100.0% | 1 | | swift.delete_object (x5) | 2.89 | 2.89 | 2.89 | 2.89 | 2.89 | 2.89 | 100.0% | 1 | | swift.delete_container | 0.563 | 0.563 | 0.563 | 0.563 | 0.563 | 0.563 | 100.0% | 1 | | total | 7.536 | 7.536 | 7.536 | 7.536 | 7.536 | 7.536 | 100.0% | 1 | | -> duration | 7.536 | 7.536 | 7.536 | 7.536 | 7.536 | 7.536 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.535758 Full duration: 25.580735 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 22ab930a-6ba0-41e1-8298-f295c2bfbc97 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.498 | 1.498 | 1.498 | 1.498 | 1.498 | 1.498 | 100.0% | 1 | | swift.list_objects | 1.068 | 1.068 | 1.068 | 1.068 | 1.068 | 1.068 | 100.0% | 1 | | swift.download_object (x5) | 2.443 | 2.443 | 2.443 | 2.443 | 2.443 | 2.443 | 100.0% | 1 | | total | 5.009 | 5.009 | 5.009 | 5.009 | 5.009 | 5.009 | 100.0% | 1 | | -> duration | 5.009 | 5.009 | 5.009 | 5.009 | 5.009 | 5.009 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.008831 Full duration: 27.247319 HINTS: * To plot HTML graphics with this data, run: rally task report 22ab930a-6ba0-41e1-8298-f295c2bfbc97 --out output.html * To generate a JUnit report, run: rally task export 22ab930a-6ba0-41e1-8298-f295c2bfbc97 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 22ab930a-6ba0-41e1-8298-f295c2bfbc97 --json --out output.json 2020-12-19 09:09:26,363 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 22ab930a-6ba0-41e1-8298-f295c2bfbc97 --out /home/opnfv/functest/results/rally_sanity/swift.json 2020-12-19 09:09:26,370 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2020-12-19 09:09:26,376 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:01:06 | 6 | 100.00% | | glance | 00:01:48 | 4 | 100.00% | | cinder | 00:04:00 | 10 | 100.00% | | heat | 00:02:35 | 4 | 100.00% | | keystone | 00:03:52 | 11 | 100.00% | | neutron | 00:03:21 | 8 | 100.00% | | nova | 00:00:47 | 1 | 0.00% | | quotas | 00:00:40 | 3 | 100.00% | | swift | 00:02:14 | 5 | 100.00% | | | | | | | TOTAL: | 00:20:26 | 52 | 98.08% | +----------------+------------+----------------+-----------+ 2020-12-19 09:09:26,376 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_sanity' success_rate is 98.08% in 8/9 modules 2020-12-19 09:09:30,042 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_sanity/rally_sanity.html 2020-12-19 09:09:33,570 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_sanity/rally_sanity.xml 2020-12-19 09:09:33,571 - xtesting.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | rally_sanity | functest | 26:02 | FAIL | +----------------------+------------------+------------------+----------------+