2020-12-04 13:57:57,300 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | TZKZRGTT525U | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/TZKZRGTT525U/airs | | | hip-opnfv-functest-smoke-latest-rally_sanity- | | | run-190 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/TZKZRGTT525U/ai | | | rship-opnfv-functest-smoke-latest-rally_sanity- | | | run-190 | +-------------------------+------------------------------------------------------------+ 2020-12-04 13:57:57,365 - xtesting.ci.run_tests - INFO - Loading test case 'rally_sanity'... 2020-12-04 13:58:05,396 - xtesting.ci.run_tests - INFO - Running test case 'rally_sanity'... 2020-12-04 13:58:11,679 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2020-12-04 13:58:18,552 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 8ccebdcf-fc74-4c84-9306-a29f4dc34f5c | 2020-12-04T13:58:18.307295 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 8ccebdcf-fc74-4c84-9306-a29f4dc34f5c ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-12-04 13:58:23,685 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-12-04 13:58:25,715 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-04 13:58:25,897 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2020-12-04 14:00:00,982 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: b799ca80-1f60-4805-aa84-da0f19fa92ab 2020-12-04 14:00:02,343 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid b799ca80-1f60-4805-aa84-da0f19fa92ab -------------------------------------------------------------------------------- Task b799ca80-1f60-4805-aa84-da0f19fa92ab: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b799ca80-1f60-4805-aa84-da0f19fa92ab has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 1.045 | 1.045 | 1.045 | 1.045 | 1.045 | 1.045 | 100.0% | 1 | | total | 1.045 | 1.045 | 1.045 | 1.045 | 1.045 | 1.045 | 100.0% | 1 | | -> duration | 1.045 | 1.045 | 1.045 | 1.045 | 1.045 | 1.045 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.044715 Full duration: 12.701087 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b799ca80-1f60-4805-aa84-da0f19fa92ab has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.302 | 0.302 | 0.302 | 0.302 | 0.302 | 0.302 | 100.0% | 1 | | total | 0.939 | 0.939 | 0.939 | 0.939 | 0.939 | 0.939 | 100.0% | 1 | | -> duration | 0.939 | 0.939 | 0.939 | 0.939 | 0.939 | 0.939 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.939067 Full duration: 12.575015 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b799ca80-1f60-4805-aa84-da0f19fa92ab has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.503 | 0.503 | 0.503 | 0.503 | 0.503 | 0.503 | 100.0% | 1 | | total | 1.111 | 1.111 | 1.111 | 1.111 | 1.111 | 1.111 | 100.0% | 1 | | -> duration | 1.111 | 1.111 | 1.111 | 1.111 | 1.111 | 1.111 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.110875 Full duration: 10.741289 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b799ca80-1f60-4805-aa84-da0f19fa92ab has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.391 | 0.391 | 0.391 | 0.391 | 0.391 | 0.391 | 100.0% | 1 | | total | 1.126 | 1.126 | 1.126 | 1.126 | 1.126 | 1.126 | 100.0% | 1 | | -> duration | 1.126 | 1.126 | 1.126 | 1.126 | 1.126 | 1.126 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.125884 Full duration: 12.87952 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b799ca80-1f60-4805-aa84-da0f19fa92ab has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.609 | 0.609 | 0.609 | 0.609 | 0.609 | 0.609 | 100.0% | 1 | | total | 1.168 | 1.168 | 1.168 | 1.168 | 1.168 | 1.168 | 100.0% | 1 | | -> duration | 1.168 | 1.168 | 1.168 | 1.168 | 1.168 | 1.168 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.167914 Full duration: 9.245837 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b799ca80-1f60-4805-aa84-da0f19fa92ab has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.276 | 0.276 | 0.276 | 0.276 | 0.276 | 0.276 | 100.0% | 1 | | total | 0.97 | 0.97 | 0.97 | 0.97 | 0.97 | 0.97 | 100.0% | 1 | | -> duration | 0.97 | 0.97 | 0.97 | 0.97 | 0.97 | 0.97 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.970195 Full duration: 12.750838 HINTS: * To plot HTML graphics with this data, run: rally task report b799ca80-1f60-4805-aa84-da0f19fa92ab --out output.html * To generate a JUnit report, run: rally task export b799ca80-1f60-4805-aa84-da0f19fa92ab --type junit --to output.xml * To get raw JSON output of task results, run: rally task report b799ca80-1f60-4805-aa84-da0f19fa92ab --json --out output.json 2020-12-04 14:00:05,601 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid b799ca80-1f60-4805-aa84-da0f19fa92ab --out /home/opnfv/functest/results/rally_sanity/authenticate.json 2020-12-04 14:00:05,606 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2020-12-04 14:00:05,634 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-04 14:00:05,798 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2020-12-04 14:02:43,169 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: e2349a04-70fa-4ba5-aeb8-ac4cec8a80ca 2020-12-04 14:02:44,507 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid e2349a04-70fa-4ba5-aeb8-ac4cec8a80ca -------------------------------------------------------------------------------- Task e2349a04-70fa-4ba5-aeb8-ac4cec8a80ca: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e2349a04-70fa-4ba5-aeb8-ac4cec8a80ca has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 6.584 | 6.584 | 6.584 | 6.584 | 6.584 | 6.584 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.105 | 0.105 | 0.105 | 0.105 | 0.105 | 0.105 | 100.0% | 1 | | -> glance_v2.upload_data | 4.025 | 4.025 | 4.025 | 4.025 | 4.025 | 4.025 | 100.0% | 1 | | glance_v2.delete_image | 2.244 | 2.244 | 2.244 | 2.244 | 2.244 | 2.244 | 100.0% | 1 | | total | 8.829 | 8.829 | 8.829 | 8.829 | 8.829 | 8.829 | 100.0% | 1 | | -> duration | 8.829 | 8.829 | 8.829 | 8.829 | 8.829 | 8.829 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.828571 Full duration: 22.788737 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e2349a04-70fa-4ba5-aeb8-ac4cec8a80ca has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.904 | 4.904 | 4.904 | 4.904 | 4.904 | 4.904 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.092 | 0.092 | 0.092 | 0.092 | 0.092 | 0.092 | 100.0% | 1 | | -> glance_v2.upload_data | 2.423 | 2.423 | 2.423 | 2.423 | 2.423 | 2.423 | 100.0% | 1 | | glance_v2.list_images | 0.074 | 0.074 | 0.074 | 0.074 | 0.074 | 0.074 | 100.0% | 1 | | total | 4.979 | 4.979 | 4.979 | 4.979 | 4.979 | 4.979 | 100.0% | 1 | | -> duration | 4.979 | 4.979 | 4.979 | 4.979 | 4.979 | 4.979 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.978511 Full duration: 20.334424 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e2349a04-70fa-4ba5-aeb8-ac4cec8a80ca has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.314 | 0.314 | 0.314 | 0.314 | 0.314 | 0.314 | 100.0% | 1 | | total | 0.315 | 0.315 | 0.315 | 0.315 | 0.315 | 0.315 | 100.0% | 1 | | -> duration | 0.315 | 0.315 | 0.315 | 0.315 | 0.315 | 0.315 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.315096 Full duration: 11.335425 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_sanity-flavor_0e4d96fe-6610-4768-ad4e-555931d43b52" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "7de63140-5c6b-4dbd-b530-8175450f9287" } ] } }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e2349a04-70fa-4ba5-aeb8-ac4cec8a80ca has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.848 | 5.848 | 5.848 | 5.848 | 5.848 | 5.848 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.1 | 0.1 | 0.1 | 0.1 | 0.1 | 0.1 | 100.0% | 1 | | -> glance_v2.upload_data | 2.767 | 2.767 | 2.767 | 2.767 | 2.767 | 2.767 | 100.0% | 1 | | nova.boot_servers | 33.957 | 33.957 | 33.957 | 33.957 | 33.957 | 33.957 | 100.0% | 1 | | total | 39.805 | 39.805 | 39.805 | 39.805 | 39.805 | 39.805 | 100.0% | 1 | | -> duration | 38.805 | 38.805 | 38.805 | 38.805 | 38.805 | 38.805 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 38.805111 Full duration: 79.886348 HINTS: * To plot HTML graphics with this data, run: rally task report e2349a04-70fa-4ba5-aeb8-ac4cec8a80ca --out output.html * To generate a JUnit report, run: rally task export e2349a04-70fa-4ba5-aeb8-ac4cec8a80ca --type junit --to output.xml * To get raw JSON output of task results, run: rally task report e2349a04-70fa-4ba5-aeb8-ac4cec8a80ca --json --out output.json 2020-12-04 14:02:47,762 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid e2349a04-70fa-4ba5-aeb8-ac4cec8a80ca --out /home/opnfv/functest/results/rally_sanity/glance.json 2020-12-04 14:02:47,767 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2020-12-04 14:02:47,802 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-04 14:02:47,964 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2020-12-04 14:07:07,190 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: 543a72f7-0ec2-4a2a-aa03-d4a4f71d1284 2020-12-04 14:07:08,547 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 543a72f7-0ec2-4a2a-aa03-d4a4f71d1284 -------------------------------------------------------------------------------- Task 543a72f7-0ec2-4a2a-aa03-d4a4f71d1284: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 543a72f7-0ec2-4a2a-aa03-d4a4f71d1284 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 4.377 | 4.377 | 4.377 | 4.377 | 4.377 | 4.377 | 100.0% | 1 | | cinder_v3.delete_snapshot | 2.203 | 2.203 | 2.203 | 2.203 | 2.203 | 2.203 | 100.0% | 1 | | total | 6.58 | 6.58 | 6.58 | 6.58 | 6.58 | 6.58 | 100.0% | 1 | | -> duration | 6.58 | 6.58 | 6.58 | 6.58 | 6.58 | 6.58 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.579839 Full duration: 29.110734 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 543a72f7-0ec2-4a2a-aa03-d4a4f71d1284 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.82 | 4.82 | 4.82 | 4.82 | 4.82 | 4.82 | 100.0% | 1 | | cinder_v3.delete_volume | 2.697 | 2.697 | 2.697 | 2.697 | 2.697 | 2.697 | 100.0% | 1 | | total | 7.516 | 7.516 | 7.516 | 7.516 | 7.516 | 7.516 | 100.0% | 1 | | -> duration | 7.516 | 7.516 | 7.516 | 7.516 | 7.516 | 7.516 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.516292 Full duration: 21.135987 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_sanity-img_0e4d96fe-6610-4768-ad4e-555931d43b52" }, "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 543a72f7-0ec2-4a2a-aa03-d4a4f71d1284 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 14.727 | 14.727 | 14.727 | 14.727 | 14.727 | 14.727 | 100.0% | 1 | | cinder_v3.delete_volume | 5.231 | 5.231 | 5.231 | 5.231 | 5.231 | 5.231 | 100.0% | 1 | | total | 19.959 | 19.959 | 19.959 | 19.959 | 19.959 | 19.959 | 100.0% | 1 | | -> duration | 19.959 | 19.959 | 19.959 | 19.959 | 19.959 | 19.959 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.958634 Full duration: 32.701877 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 543a72f7-0ec2-4a2a-aa03-d4a4f71d1284 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.158 | 4.158 | 4.158 | 4.158 | 4.158 | 4.158 | 100.0% | 1 | | cinder_v3.delete_volume | 2.445 | 2.445 | 2.445 | 2.445 | 2.445 | 2.445 | 100.0% | 1 | | total | 6.604 | 6.604 | 6.604 | 6.604 | 6.604 | 6.604 | 100.0% | 1 | | -> duration | 6.604 | 6.604 | 6.604 | 6.604 | 6.604 | 6.604 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.603689 Full duration: 20.01906 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 543a72f7-0ec2-4a2a-aa03-d4a4f71d1284 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.035 | 5.035 | 5.035 | 5.035 | 5.035 | 5.035 | 100.0% | 1 | | cinder_v3.extend_volume | 2.75 | 2.75 | 2.75 | 2.75 | 2.75 | 2.75 | 100.0% | 1 | | cinder_v3.delete_volume | 2.435 | 2.435 | 2.435 | 2.435 | 2.435 | 2.435 | 100.0% | 1 | | total | 10.22 | 10.22 | 10.22 | 10.22 | 10.22 | 10.22 | 100.0% | 1 | | -> duration | 10.22 | 10.22 | 10.22 | 10.22 | 10.22 | 10.22 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.220298 Full duration: 22.669345 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 543a72f7-0ec2-4a2a-aa03-d4a4f71d1284 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.851 | 5.851 | 5.851 | 5.851 | 5.851 | 5.851 | 100.0% | 1 | | cinder_v3.delete_volume | 5.276 | 5.276 | 5.276 | 5.276 | 5.276 | 5.276 | 100.0% | 1 | | total | 11.127 | 11.127 | 11.127 | 11.127 | 11.127 | 11.127 | 100.0% | 1 | | -> duration | 11.127 | 11.127 | 11.127 | 11.127 | 11.127 | 11.127 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.127093 Full duration: 36.989145 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 543a72f7-0ec2-4a2a-aa03-d4a4f71d1284 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.889 | 0.889 | 0.889 | 0.889 | 0.889 | 0.889 | 100.0% | 1 | | cinder_v3.list_qos | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 100.0% | 1 | | total | 0.933 | 0.933 | 0.933 | 0.933 | 0.933 | 0.933 | 100.0% | 1 | | -> duration | 0.933 | 0.933 | 0.933 | 0.933 | 0.933 | 0.933 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.933387 Full duration: 13.805199 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 543a72f7-0ec2-4a2a-aa03-d4a4f71d1284 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.737 | 0.737 | 0.737 | 0.737 | 0.737 | 0.737 | 100.0% | 1 | | cinder_v3.set_qos | 0.671 | 0.671 | 0.671 | 0.671 | 0.671 | 0.671 | 100.0% | 1 | | total | 1.408 | 1.408 | 1.408 | 1.408 | 1.408 | 1.408 | 100.0% | 1 | | -> duration | 1.408 | 1.408 | 1.408 | 1.408 | 1.408 | 1.408 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.408076 Full duration: 16.525831 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 543a72f7-0ec2-4a2a-aa03-d4a4f71d1284 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.88 | 0.88 | 0.88 | 0.88 | 0.88 | 0.88 | 100.0% | 1 | | cinder_v3.list_types | 0.042 | 0.042 | 0.042 | 0.042 | 0.042 | 0.042 | 100.0% | 1 | | total | 0.922 | 0.922 | 0.922 | 0.922 | 0.922 | 0.922 | 100.0% | 1 | | -> duration | 0.922 | 0.922 | 0.922 | 0.922 | 0.922 | 0.922 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.922395 Full duration: 18.213682 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 543a72f7-0ec2-4a2a-aa03-d4a4f71d1284 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 1.08 | 1.08 | 1.08 | 1.08 | 1.08 | 1.08 | 100.0% | 1 | | cinder_v3.create_encryption_type | 0.354 | 0.354 | 0.354 | 0.354 | 0.354 | 0.354 | 100.0% | 1 | | total | 1.434 | 1.434 | 1.434 | 1.434 | 1.434 | 1.434 | 100.0% | 1 | | -> duration | 1.434 | 1.434 | 1.434 | 1.434 | 1.434 | 1.434 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.433592 Full duration: 15.689922 HINTS: * To plot HTML graphics with this data, run: rally task report 543a72f7-0ec2-4a2a-aa03-d4a4f71d1284 --out output.html * To generate a JUnit report, run: rally task export 543a72f7-0ec2-4a2a-aa03-d4a4f71d1284 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 543a72f7-0ec2-4a2a-aa03-d4a4f71d1284 --json --out output.json 2020-12-04 14:07:11,876 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 543a72f7-0ec2-4a2a-aa03-d4a4f71d1284 --out /home/opnfv/functest/results/rally_sanity/cinder.json 2020-12-04 14:07:11,891 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2020-12-04 14:07:11,916 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-04 14:07:12,370 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2020-12-04 14:11:25,962 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: bf7fc4e6-d3c1-4f49-b101-c9ad845f1121 2020-12-04 14:11:27,344 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid bf7fc4e6-d3c1-4f49-b101-c9ad845f1121 -------------------------------------------------------------------------------- Task bf7fc4e6-d3c1-4f49-b101-c9ad845f1121: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bf7fc4e6-d3c1-4f49-b101-c9ad845f1121 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 9.022 | 9.022 | 9.022 | 9.022 | 9.022 | 9.022 | 100.0% | 1 | | heat.update_stack | 10.511 | 10.511 | 10.511 | 10.511 | 10.511 | 10.511 | 100.0% | 1 | | heat.delete_stack | 20.713 | 20.713 | 20.713 | 20.713 | 20.713 | 20.713 | 100.0% | 1 | | total | 40.247 | 40.247 | 40.247 | 40.247 | 40.247 | 40.247 | 100.0% | 1 | | -> duration | 36.247 | 36.247 | 36.247 | 36.247 | 36.247 | 36.247 | 100.0% | 1 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 36.246794 Full duration: 60.86667 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bf7fc4e6-d3c1-4f49-b101-c9ad845f1121 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 10.916 | 10.916 | 10.916 | 10.916 | 10.916 | 10.916 | 100.0% | 1 | | heat.check_stack | 1.919 | 1.919 | 1.919 | 1.919 | 1.919 | 1.919 | 100.0% | 1 | | heat.delete_stack | 8.615 | 8.615 | 8.615 | 8.615 | 8.615 | 8.615 | 100.0% | 1 | | total | 21.45 | 21.45 | 21.45 | 21.45 | 21.45 | 21.45 | 100.0% | 1 | | -> duration | 19.45 | 19.45 | 19.45 | 19.45 | 19.45 | 19.45 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.449763 Full duration: 43.334964 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bf7fc4e6-d3c1-4f49-b101-c9ad845f1121 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 13.805 | 13.805 | 13.805 | 13.805 | 13.805 | 13.805 | 100.0% | 1 | | heat.suspend_stack | 6.626 | 6.626 | 6.626 | 6.626 | 6.626 | 6.626 | 100.0% | 1 | | heat.resume_stack | 33.173 | 33.173 | 33.173 | 33.173 | 33.173 | 33.173 | 100.0% | 1 | | heat.delete_stack | 19.466 | 19.466 | 19.466 | 19.466 | 19.466 | 19.466 | 100.0% | 1 | | total | 73.069 | 73.069 | 73.069 | 73.069 | 73.069 | 73.069 | 100.0% | 1 | | -> duration | 71.069 | 71.069 | 71.069 | 71.069 | 71.069 | 71.069 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 71.069389 Full duration: 97.45922 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task bf7fc4e6-d3c1-4f49-b101-c9ad845f1121 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.731 | 0.731 | 0.731 | 0.731 | 0.731 | 0.731 | 100.0% | 1 | | total | 0.731 | 0.731 | 0.731 | 0.731 | 0.731 | 0.731 | 100.0% | 1 | | -> duration | 0.731 | 0.731 | 0.731 | 0.731 | 0.731 | 0.731 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.731242 Full duration: 13.362854 HINTS: * To plot HTML graphics with this data, run: rally task report bf7fc4e6-d3c1-4f49-b101-c9ad845f1121 --out output.html * To generate a JUnit report, run: rally task export bf7fc4e6-d3c1-4f49-b101-c9ad845f1121 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report bf7fc4e6-d3c1-4f49-b101-c9ad845f1121 --json --out output.json 2020-12-04 14:11:30,644 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid bf7fc4e6-d3c1-4f49-b101-c9ad845f1121 --out /home/opnfv/functest/results/rally_sanity/heat.json 2020-12-04 14:11:30,649 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2020-12-04 14:11:30,679 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-04 14:11:31,089 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2020-12-04 14:16:04,042 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: 3dea9c3e-83a0-4139-a958-2dd57b65e9cf 2020-12-04 14:16:05,447 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 3dea9c3e-83a0-4139-a958-2dd57b65e9cf -------------------------------------------------------------------------------- Task 3dea9c3e-83a0-4139-a958-2dd57b65e9cf: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3dea9c3e-83a0-4139-a958-2dd57b65e9cf has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.104 | 0.104 | 0.104 | 0.104 | 0.104 | 0.104 | 100.0% | 1 | | keystone_v3.add_role | 0.083 | 0.083 | 0.083 | 0.083 | 0.083 | 0.083 | 100.0% | 1 | | keystone_v3.revoke_role | 0.204 | 0.204 | 0.204 | 0.204 | 0.204 | 0.204 | 100.0% | 1 | | total | 0.391 | 0.391 | 0.391 | 0.391 | 0.391 | 0.391 | 100.0% | 1 | | -> duration | 0.391 | 0.391 | 0.391 | 0.391 | 0.391 | 0.391 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.391295 Full duration: 17.998094 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3dea9c3e-83a0-4139-a958-2dd57b65e9cf has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.699 | 0.699 | 0.699 | 0.699 | 0.699 | 0.699 | 100.0% | 1 | | keystone_v3.add_role | 0.14 | 0.14 | 0.14 | 0.14 | 0.14 | 0.14 | 100.0% | 1 | | keystone_v3.list_roles | 0.112 | 0.112 | 0.112 | 0.112 | 0.112 | 0.112 | 100.0% | 1 | | total | 0.951 | 0.951 | 0.951 | 0.951 | 0.951 | 0.951 | 100.0% | 1 | | -> duration | 0.951 | 0.951 | 0.951 | 0.951 | 0.951 | 0.951 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.95149 Full duration: 21.381176 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3dea9c3e-83a0-4139-a958-2dd57b65e9cf has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 1.623 | 1.623 | 1.623 | 1.623 | 1.623 | 1.623 | 100.0% | 1 | | keystone_v3.list_projects | 0.147 | 0.147 | 0.147 | 0.147 | 0.147 | 0.147 | 100.0% | 1 | | total | 1.771 | 1.771 | 1.771 | 1.771 | 1.771 | 1.771 | 100.0% | 1 | | -> duration | 1.771 | 1.771 | 1.771 | 1.771 | 1.771 | 1.771 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.770861 Full duration: 25.866528 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3dea9c3e-83a0-4139-a958-2dd57b65e9cf has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.665 | 0.665 | 0.665 | 0.665 | 0.665 | 0.665 | 100.0% | 1 | | keystone_v3.delete_role | 1.162 | 1.162 | 1.162 | 1.162 | 1.162 | 1.162 | 100.0% | 1 | | total | 1.828 | 1.828 | 1.828 | 1.828 | 1.828 | 1.828 | 100.0% | 1 | | -> duration | 1.828 | 1.828 | 1.828 | 1.828 | 1.828 | 1.828 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.827618 Full duration: 17.585461 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3dea9c3e-83a0-4139-a958-2dd57b65e9cf has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.788 | 0.788 | 0.788 | 0.788 | 0.788 | 0.788 | 100.0% | 1 | | keystone_v3.delete_service | 2.456 | 2.456 | 2.456 | 2.456 | 2.456 | 2.456 | 100.0% | 1 | | total | 3.245 | 3.245 | 3.245 | 3.245 | 3.245 | 3.245 | 100.0% | 1 | | -> duration | 3.245 | 3.245 | 3.245 | 3.245 | 3.245 | 3.245 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.244855 Full duration: 20.766512 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3dea9c3e-83a0-4139-a958-2dd57b65e9cf has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.263 | 0.263 | 0.263 | 0.263 | 0.263 | 0.263 | 100.0% | 1 | | keystone_v3.create_user | 2.221 | 2.221 | 2.221 | 2.221 | 2.221 | 2.221 | 100.0% | 1 | | -> keystone_v3.list_roles | 0.046 | 0.046 | 0.046 | 0.046 | 0.046 | 0.046 | 100.0% | 1 | | -> keystone_v3.add_role | 0.484 | 0.484 | 0.484 | 0.484 | 0.484 | 0.484 | 100.0% | 1 | | keystone_v3.create_role | 0.575 | 0.575 | 0.575 | 0.575 | 0.575 | 0.575 | 100.0% | 1 | | keystone_v3.get_project | 0.038 | 0.038 | 0.038 | 0.038 | 0.038 | 0.038 | 100.0% | 1 | | keystone_v3.get_user | 0.039 | 0.039 | 0.039 | 0.039 | 0.039 | 0.039 | 100.0% | 1 | | keystone_v3.get_role | 0.035 | 0.035 | 0.035 | 0.035 | 0.035 | 0.035 | 100.0% | 1 | | keystone_v3.list_services | 0.047 | 0.047 | 0.047 | 0.047 | 0.047 | 0.047 | 100.0% | 1 | | keystone_v3.get_services | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 100.0% | 1 | | total | 3.374 | 3.374 | 3.374 | 3.374 | 3.374 | 3.374 | 100.0% | 1 | | -> duration | 3.374 | 3.374 | 3.374 | 3.374 | 3.374 | 3.374 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.373592 Full duration: 27.891839 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3dea9c3e-83a0-4139-a958-2dd57b65e9cf has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.582 | 0.582 | 0.582 | 0.582 | 0.582 | 0.582 | 100.0% | 1 | | keystone_v3.update_project | 0.176 | 0.176 | 0.176 | 0.176 | 0.176 | 0.176 | 100.0% | 1 | | keystone_v3.delete_project | 1.789 | 1.789 | 1.789 | 1.789 | 1.789 | 1.789 | 100.0% | 1 | | total | 2.548 | 2.548 | 2.548 | 2.548 | 2.548 | 2.548 | 100.0% | 1 | | -> duration | 2.548 | 2.548 | 2.548 | 2.548 | 2.548 | 2.548 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.548265 Full duration: 19.484564 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3dea9c3e-83a0-4139-a958-2dd57b65e9cf has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.454 | 0.454 | 0.454 | 0.454 | 0.454 | 0.454 | 100.0% | 1 | | total | 0.527 | 0.527 | 0.527 | 0.527 | 0.527 | 0.527 | 100.0% | 1 | | -> duration | 0.527 | 0.527 | 0.527 | 0.527 | 0.527 | 0.527 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.527271 Full duration: 22.329913 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3dea9c3e-83a0-4139-a958-2dd57b65e9cf has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.485 | 0.485 | 0.485 | 0.485 | 0.485 | 0.485 | 100.0% | 1 | | total | 0.485 | 0.485 | 0.485 | 0.485 | 0.485 | 0.485 | 100.0% | 1 | | -> duration | 0.485 | 0.485 | 0.485 | 0.485 | 0.485 | 0.485 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.484617 Full duration: 18.643771 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3dea9c3e-83a0-4139-a958-2dd57b65e9cf has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.394 | 0.394 | 0.394 | 0.394 | 0.394 | 0.394 | 100.0% | 1 | | keystone_v3.list_users | 0.078 | 0.078 | 0.078 | 0.078 | 0.078 | 0.078 | 100.0% | 1 | | total | 0.547 | 0.547 | 0.547 | 0.547 | 0.547 | 0.547 | 100.0% | 1 | | -> duration | 0.547 | 0.547 | 0.547 | 0.547 | 0.547 | 0.547 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.547305 Full duration: 19.718186 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3dea9c3e-83a0-4139-a958-2dd57b65e9cf has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.425 | 0.425 | 0.425 | 0.425 | 0.425 | 0.425 | 100.0% | 1 | | keystone_v3.create_users | 8.909 | 8.909 | 8.909 | 8.909 | 8.909 | 8.909 | 100.0% | 1 | | -> keystone_v3.create_user (x10) | 8.909 | 8.909 | 8.909 | 8.909 | 8.909 | 8.909 | 100.0% | 1 | | --> keystone_v3.list_roles (x10) | 0.543 | 0.543 | 0.543 | 0.543 | 0.543 | 0.543 | 100.0% | 1 | | --> keystone_v3.add_role (x10) | 2.649 | 2.649 | 2.649 | 2.649 | 2.649 | 2.649 | 100.0% | 1 | | total | 9.772 | 9.772 | 9.772 | 9.772 | 9.772 | 9.772 | 100.0% | 1 | | -> duration | 9.772 | 9.772 | 9.772 | 9.772 | 9.772 | 9.772 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.771904 Full duration: 35.368521 HINTS: * To plot HTML graphics with this data, run: rally task report 3dea9c3e-83a0-4139-a958-2dd57b65e9cf --out output.html * To generate a JUnit report, run: rally task export 3dea9c3e-83a0-4139-a958-2dd57b65e9cf --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 3dea9c3e-83a0-4139-a958-2dd57b65e9cf --json --out output.json 2020-12-04 14:16:08,735 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 3dea9c3e-83a0-4139-a958-2dd57b65e9cf --out /home/opnfv/functest/results/rally_sanity/keystone.json 2020-12-04 14:16:08,746 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2020-12-04 14:16:08,775 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-04 14:16:09,161 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-12-04 14:19:59,987 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 34926768-120e-40b9-a6e6-3ecb2bf594c5 2020-12-04 14:20:01,384 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 34926768-120e-40b9-a6e6-3ecb2bf594c5 -------------------------------------------------------------------------------- Task 34926768-120e-40b9-a6e6-3ecb2bf594c5: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 34926768-120e-40b9-a6e6-3ecb2bf594c5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.469 | 2.469 | 2.469 | 2.469 | 2.469 | 2.469 | 100.0% | 1 | | neutron.delete_network | 1.006 | 1.006 | 1.006 | 1.006 | 1.006 | 1.006 | 100.0% | 1 | | total | 3.475 | 3.475 | 3.475 | 3.475 | 3.475 | 3.475 | 100.0% | 1 | | -> duration | 3.475 | 3.475 | 3.475 | 3.475 | 3.475 | 3.475 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.475131 Full duration: 21.005594 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 34926768-120e-40b9-a6e6-3ecb2bf594c5 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 3.849 | 3.849 | 3.849 | 3.849 | 3.849 | 3.849 | 100.0% | 1 | | neutron.delete_port | 0.962 | 0.962 | 0.962 | 0.962 | 0.962 | 0.962 | 100.0% | 1 | | total | 4.812 | 4.812 | 4.812 | 4.812 | 4.812 | 4.812 | 100.0% | 1 | | -> duration | 4.812 | 4.812 | 4.812 | 4.812 | 4.812 | 4.812 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.811672 Full duration: 33.758684 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 34926768-120e-40b9-a6e6-3ecb2bf594c5 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 2.628 | 2.628 | 2.628 | 2.628 | 2.628 | 2.628 | 100.0% | 1 | | neutron.delete_subnet | 1.342 | 1.342 | 1.342 | 1.342 | 1.342 | 1.342 | 100.0% | 1 | | total | 3.97 | 3.97 | 3.97 | 3.97 | 3.97 | 3.97 | 100.0% | 1 | | -> duration | 3.97 | 3.97 | 3.97 | 3.97 | 3.97 | 3.97 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.969785 Full duration: 27.095243 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 34926768-120e-40b9-a6e6-3ecb2bf594c5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.23 | 2.23 | 2.23 | 2.23 | 2.23 | 2.23 | 100.0% | 1 | | neutron.list_networks | 0.176 | 0.176 | 0.176 | 0.176 | 0.176 | 0.176 | 100.0% | 1 | | total | 2.406 | 2.406 | 2.406 | 2.406 | 2.406 | 2.406 | 100.0% | 1 | | -> duration | 2.406 | 2.406 | 2.406 | 2.406 | 2.406 | 2.406 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.405778 Full duration: 21.250663 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 34926768-120e-40b9-a6e6-3ecb2bf594c5 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.044 | 2.044 | 2.044 | 2.044 | 2.044 | 2.044 | 100.0% | 1 | | neutron.list_ports | 0.193 | 0.193 | 0.193 | 0.193 | 0.193 | 0.193 | 100.0% | 1 | | total | 2.237 | 2.237 | 2.237 | 2.237 | 2.237 | 2.237 | 100.0% | 1 | | -> duration | 2.237 | 2.237 | 2.237 | 2.237 | 2.237 | 2.237 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.236624 Full duration: 27.875739 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 34926768-120e-40b9-a6e6-3ecb2bf594c5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.418 | 1.418 | 1.418 | 1.418 | 1.418 | 1.418 | 100.0% | 1 | | neutron.create_subnet | 1.6 | 1.6 | 1.6 | 1.6 | 1.6 | 1.6 | 100.0% | 1 | | neutron.list_subnets | 0.097 | 0.097 | 0.097 | 0.097 | 0.097 | 0.097 | 100.0% | 1 | | total | 3.115 | 3.115 | 3.115 | 3.115 | 3.115 | 3.115 | 100.0% | 1 | | -> duration | 3.115 | 3.115 | 3.115 | 3.115 | 3.115 | 3.115 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.114721 Full duration: 26.924848 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 34926768-120e-40b9-a6e6-3ecb2bf594c5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.376 | 1.376 | 1.376 | 1.376 | 1.376 | 1.376 | 100.0% | 1 | | neutron.delete_security_group | 0.265 | 0.265 | 0.265 | 0.265 | 0.265 | 0.265 | 100.0% | 1 | | total | 1.641 | 1.641 | 1.641 | 1.641 | 1.641 | 1.641 | 100.0% | 1 | | -> duration | 1.641 | 1.641 | 1.641 | 1.641 | 1.641 | 1.641 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.640719 Full duration: 18.978279 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 34926768-120e-40b9-a6e6-3ecb2bf594c5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 3.419 | 3.419 | 3.419 | 3.419 | 3.419 | 3.419 | 100.0% | 1 | | neutron.create_security_group_rule | 2.947 | 2.947 | 2.947 | 2.947 | 2.947 | 2.947 | 100.0% | 1 | | neutron.delete_security_group_rule | 0.843 | 0.843 | 0.843 | 0.843 | 0.843 | 0.843 | 100.0% | 1 | | neutron.delete_security_group | 1.038 | 1.038 | 1.038 | 1.038 | 1.038 | 1.038 | 100.0% | 1 | | total | 8.247 | 8.247 | 8.247 | 8.247 | 8.247 | 8.247 | 100.0% | 1 | | -> duration | 8.247 | 8.247 | 8.247 | 8.247 | 8.247 | 8.247 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.247071 Full duration: 25.2898 HINTS: * To plot HTML graphics with this data, run: rally task report 34926768-120e-40b9-a6e6-3ecb2bf594c5 --out output.html * To generate a JUnit report, run: rally task export 34926768-120e-40b9-a6e6-3ecb2bf594c5 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 34926768-120e-40b9-a6e6-3ecb2bf594c5 --json --out output.json 2020-12-04 14:20:04,682 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 34926768-120e-40b9-a6e6-3ecb2bf594c5 --out /home/opnfv/functest/results/rally_sanity/neutron.json 2020-12-04 14:20:04,690 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2020-12-04 14:20:04,720 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-04 14:20:05,136 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2020-12-04 14:21:23,819 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: 15006252-ef0c-4321-9a71-10bd3a70eac1 2020-12-04 14:21:25,142 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 15006252-ef0c-4321-9a71-10bd3a70eac1 -------------------------------------------------------------------------------- Task 15006252-ef0c-4321-9a71-10bd3a70eac1: aborted -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_live_migrate_server args position 0 args values: { "args": { "flavor": { "name": "rally_sanity-flavor_0e4d96fe-6610-4768-ad4e-555931d43b52" }, "image": { "name": "rally_sanity-img_0e4d96fe-6610-4768-ad4e-555931d43b52" }, "block_migration": false, "nics": [ { "net-id": "7de63140-5c6b-4dbd-b530-8175450f9287" } ] }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 15006252-ef0c-4321-9a71-10bd3a70eac1 has 1 error(s) -------------------------------------------------------------------------------- BadRequest: Migration pre-check error: Instance has an associated NUMA topology. Instance NUMA topologies, including related attributes such as CPU pinning, huge page and emulator thread pinning information, are not currently recalculated on live migration. See bug #1289064 for more information. (HTTP 400) (Request-ID: req-66e90378-f799-434c-bea2-9ad9b5b505e4) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 720, in run self._live_migrate(server, block_migration, disk_over_commit) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 798, in _live_migrate disk_over_commit=disk_over_commit) File "/usr/lib/python3.6/site-packages/novaclient/api_versions.py", line 393, in substitution return methods[-1].func(obj, *args, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 438, in live_migrate disk_over_commit) File "/usr/lib/python3.6/site-packages/novaclient/api_versions.py", line 393, in substitution return methods[-1].func(obj, *args, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1742, in live_migrate force=None) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1726, in _live_migrate return self._action('os-migrateLive', server, body) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: Migration pre-check error: Instance has an associated NUMA topology. Instance NUMA topologies, including related attributes such as CPU pinning, huge page and emulator thread pinning information, are not currently recalculated on live migration. See bug #1289064 for more information. (HTTP 400) (Request-ID: req-66e90378-f799-434c-bea2-9ad9b5b505e4) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 19.771 | 19.771 | 19.771 | 19.771 | 19.771 | 19.771 | 100.0% | 1 | | nova.live_migrate | 2.817 | 2.817 | 2.817 | 2.817 | 2.817 | 2.817 | 0.0% | 1 | | -> nova.list_hypervisors | 0.597 | 0.597 | 0.597 | 0.597 | 0.597 | 0.597 | 100.0% | 1 | | total | 22.588 | 22.588 | 22.588 | 22.588 | 22.588 | 22.588 | 0.0% | 1 | | -> duration | 21.588 | 21.588 | 21.588 | 21.588 | 21.588 | 21.588 | 0.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.588114 Full duration: 42.418808 HINTS: * To plot HTML graphics with this data, run: rally task report 15006252-ef0c-4321-9a71-10bd3a70eac1 --out output.html * To generate a JUnit report, run: rally task export 15006252-ef0c-4321-9a71-10bd3a70eac1 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 15006252-ef0c-4321-9a71-10bd3a70eac1 --json --out output.json At least one workload did not pass SLA criteria. 2020-12-04 14:21:28,391 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 15006252-ef0c-4321-9a71-10bd3a70eac1 --out /home/opnfv/functest/results/rally_sanity/nova.json 2020-12-04 14:21:28,393 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2020-12-04 14:21:28,421 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-04 14:21:29,159 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2020-12-04 14:22:27,502 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: b69346b5-fb1e-4e48-9d3a-266283175cda 2020-12-04 14:22:28,901 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid b69346b5-fb1e-4e48-9d3a-266283175cda -------------------------------------------------------------------------------- Task b69346b5-fb1e-4e48-9d3a-266283175cda: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b69346b5-fb1e-4e48-9d3a-266283175cda has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.194 | 1.194 | 1.194 | 1.194 | 1.194 | 1.194 | 100.0% | 1 | | quotas.delete_quotas | 0.607 | 0.607 | 0.607 | 0.607 | 0.607 | 0.607 | 100.0% | 1 | | total | 1.801 | 1.801 | 1.801 | 1.801 | 1.801 | 1.801 | 100.0% | 1 | | -> duration | 1.801 | 1.801 | 1.801 | 1.801 | 1.801 | 1.801 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.800629 Full duration: 11.695276 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b69346b5-fb1e-4e48-9d3a-266283175cda has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.465 | 1.465 | 1.465 | 1.465 | 1.465 | 1.465 | 100.0% | 1 | | total | 1.465 | 1.465 | 1.465 | 1.465 | 1.465 | 1.465 | 100.0% | 1 | | -> duration | 1.465 | 1.465 | 1.465 | 1.465 | 1.465 | 1.465 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.465212 Full duration: 14.57767 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b69346b5-fb1e-4e48-9d3a-266283175cda has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.803 | 1.803 | 1.803 | 1.803 | 1.803 | 1.803 | 100.0% | 1 | | total | 1.803 | 1.803 | 1.803 | 1.803 | 1.803 | 1.803 | 100.0% | 1 | | -> duration | 1.803 | 1.803 | 1.803 | 1.803 | 1.803 | 1.803 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.802654 Full duration: 13.499237 HINTS: * To plot HTML graphics with this data, run: rally task report b69346b5-fb1e-4e48-9d3a-266283175cda --out output.html * To generate a JUnit report, run: rally task export b69346b5-fb1e-4e48-9d3a-266283175cda --type junit --to output.xml * To get raw JSON output of task results, run: rally task report b69346b5-fb1e-4e48-9d3a-266283175cda --json --out output.json 2020-12-04 14:22:32,146 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid b69346b5-fb1e-4e48-9d3a-266283175cda --out /home/opnfv/functest/results/rally_sanity/quotas.json 2020-12-04 14:22:32,150 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2020-12-04 14:22:32,178 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-04 14:22:32,349 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2020-12-04 14:25:14,665 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: 6aca603f-1a41-4d94-a50d-581d186bc3a7 2020-12-04 14:25:15,990 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 6aca603f-1a41-4d94-a50d-581d186bc3a7 -------------------------------------------------------------------------------- Task 6aca603f-1a41-4d94-a50d-581d186bc3a7: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6aca603f-1a41-4d94-a50d-581d186bc3a7 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.792 | 1.792 | 1.792 | 1.792 | 1.792 | 1.792 | 100.0% | 1 | | swift.upload_object (x2) | 1.086 | 1.086 | 1.086 | 1.086 | 1.086 | 1.086 | 100.0% | 1 | | swift.list_objects | 1.009 | 1.009 | 1.009 | 1.009 | 1.009 | 1.009 | 100.0% | 1 | | total | 3.888 | 3.888 | 3.888 | 3.888 | 3.888 | 3.888 | 100.0% | 1 | | -> duration | 3.888 | 3.888 | 3.888 | 3.888 | 3.888 | 3.888 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.887892 Full duration: 25.940358 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6aca603f-1a41-4d94-a50d-581d186bc3a7 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.272 | 1.272 | 1.272 | 1.272 | 1.272 | 1.272 | 100.0% | 1 | | swift.list_objects | 0.957 | 0.957 | 0.957 | 0.957 | 0.957 | 0.957 | 100.0% | 1 | | total | 2.229 | 2.229 | 2.229 | 2.229 | 2.229 | 2.229 | 100.0% | 1 | | -> duration | 2.229 | 2.229 | 2.229 | 2.229 | 2.229 | 2.229 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.228945 Full duration: 23.534163 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6aca603f-1a41-4d94-a50d-581d186bc3a7 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.196 | 1.196 | 1.196 | 1.196 | 1.196 | 1.196 | 100.0% | 1 | | swift.upload_object (x5) | 2.665 | 2.665 | 2.665 | 2.665 | 2.665 | 2.665 | 100.0% | 1 | | swift.download_object (x5) | 2.49 | 2.49 | 2.49 | 2.49 | 2.49 | 2.49 | 100.0% | 1 | | total | 6.353 | 6.353 | 6.353 | 6.353 | 6.353 | 6.353 | 100.0% | 1 | | -> duration | 6.353 | 6.353 | 6.353 | 6.353 | 6.353 | 6.353 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.353068 Full duration: 26.764719 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6aca603f-1a41-4d94-a50d-581d186bc3a7 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.351 | 1.351 | 1.351 | 1.351 | 1.351 | 1.351 | 100.0% | 1 | | swift.upload_object (x5) | 2.772 | 2.772 | 2.772 | 2.772 | 2.772 | 2.772 | 100.0% | 1 | | swift.delete_object (x5) | 2.56 | 2.56 | 2.56 | 2.56 | 2.56 | 2.56 | 100.0% | 1 | | swift.delete_container | 0.549 | 0.549 | 0.549 | 0.549 | 0.549 | 0.549 | 100.0% | 1 | | total | 7.233 | 7.233 | 7.233 | 7.233 | 7.233 | 7.233 | 100.0% | 1 | | -> duration | 7.233 | 7.233 | 7.233 | 7.233 | 7.233 | 7.233 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.233418 Full duration: 26.442889 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6aca603f-1a41-4d94-a50d-581d186bc3a7 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.297 | 1.297 | 1.297 | 1.297 | 1.297 | 1.297 | 100.0% | 1 | | swift.list_objects | 0.99 | 0.99 | 0.99 | 0.99 | 0.99 | 0.99 | 100.0% | 1 | | swift.download_object (x5) | 2.392 | 2.392 | 2.392 | 2.392 | 2.392 | 2.392 | 100.0% | 1 | | total | 4.68 | 4.68 | 4.68 | 4.68 | 4.68 | 4.68 | 100.0% | 1 | | -> duration | 4.68 | 4.68 | 4.68 | 4.68 | 4.68 | 4.68 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.679528 Full duration: 37.476974 HINTS: * To plot HTML graphics with this data, run: rally task report 6aca603f-1a41-4d94-a50d-581d186bc3a7 --out output.html * To generate a JUnit report, run: rally task export 6aca603f-1a41-4d94-a50d-581d186bc3a7 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 6aca603f-1a41-4d94-a50d-581d186bc3a7 --json --out output.json 2020-12-04 14:25:19,252 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 6aca603f-1a41-4d94-a50d-581d186bc3a7 --out /home/opnfv/functest/results/rally_sanity/swift.json 2020-12-04 14:25:19,259 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2020-12-04 14:25:19,265 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:01:10 | 6 | 100.00% | | glance | 00:02:14 | 4 | 100.00% | | cinder | 00:03:46 | 10 | 100.00% | | heat | 00:03:35 | 4 | 100.00% | | keystone | 00:04:07 | 11 | 100.00% | | neutron | 00:03:22 | 8 | 100.00% | | nova | 00:00:42 | 1 | 0.00% | | quotas | 00:00:39 | 3 | 100.00% | | swift | 00:02:20 | 5 | 100.00% | | | | | | | TOTAL: | 00:21:58 | 52 | 98.08% | +----------------+------------+----------------+-----------+ 2020-12-04 14:25:19,265 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_sanity' success_rate is 98.08% in 8/9 modules 2020-12-04 14:25:22,846 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_sanity/rally_sanity.html 2020-12-04 14:25:26,363 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_sanity/rally_sanity.xml 2020-12-04 14:25:26,364 - xtesting.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | rally_sanity | functest | 27:20 | FAIL | +----------------------+------------------+------------------+----------------+