2020-12-09 12:04:36,224 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | E4QQGUBM31BK | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/E4QQGUBM31BK/airs | | | hip-opnfv-functest-smoke-latest-rally_sanity- | | | run-192 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/E4QQGUBM31BK/ai | | | rship-opnfv-functest-smoke-latest-rally_sanity- | | | run-192 | +-------------------------+------------------------------------------------------------+ 2020-12-09 12:04:36,289 - xtesting.ci.run_tests - INFO - Loading test case 'rally_sanity'... 2020-12-09 12:04:40,633 - xtesting.ci.run_tests - INFO - Running test case 'rally_sanity'... 2020-12-09 12:04:47,182 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2020-12-09 12:04:53,907 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 2947e50f-8c2c-4fd4-9e99-63b824930d2d | 2020-12-09T12:04:53.639585 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 2947e50f-8c2c-4fd4-9e99-63b824930d2d ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-12-09 12:04:59,043 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-12-09 12:05:03,233 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-09 12:05:03,401 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2020-12-09 12:06:32,781 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: 7eef2b97-9afa-417a-b95e-d03431e6c754 2020-12-09 12:06:34,184 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 7eef2b97-9afa-417a-b95e-d03431e6c754 -------------------------------------------------------------------------------- Task 7eef2b97-9afa-417a-b95e-d03431e6c754: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7eef2b97-9afa-417a-b95e-d03431e6c754 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 1.091 | 1.091 | 1.091 | 1.091 | 1.091 | 1.091 | 100.0% | 1 | | total | 1.091 | 1.091 | 1.091 | 1.091 | 1.091 | 1.091 | 100.0% | 1 | | -> duration | 1.091 | 1.091 | 1.091 | 1.091 | 1.091 | 1.091 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.091123 Full duration: 11.611647 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7eef2b97-9afa-417a-b95e-d03431e6c754 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.311 | 0.311 | 0.311 | 0.311 | 0.311 | 0.311 | 100.0% | 1 | | total | 0.974 | 0.974 | 0.974 | 0.974 | 0.974 | 0.974 | 100.0% | 1 | | -> duration | 0.974 | 0.974 | 0.974 | 0.974 | 0.974 | 0.974 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.973577 Full duration: 10.483339 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7eef2b97-9afa-417a-b95e-d03431e6c754 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.38 | 0.38 | 0.38 | 0.38 | 0.38 | 0.38 | 100.0% | 1 | | total | 0.978 | 0.978 | 0.978 | 0.978 | 0.978 | 0.978 | 100.0% | 1 | | -> duration | 0.978 | 0.978 | 0.978 | 0.978 | 0.978 | 0.978 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.977878 Full duration: 10.714451 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7eef2b97-9afa-417a-b95e-d03431e6c754 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.263 | 0.263 | 0.263 | 0.263 | 0.263 | 0.263 | 100.0% | 1 | | total | 1.044 | 1.044 | 1.044 | 1.044 | 1.044 | 1.044 | 100.0% | 1 | | -> duration | 1.044 | 1.044 | 1.044 | 1.044 | 1.044 | 1.044 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.043609 Full duration: 10.827616 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7eef2b97-9afa-417a-b95e-d03431e6c754 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.634 | 0.634 | 0.634 | 0.634 | 0.634 | 0.634 | 100.0% | 1 | | total | 1.255 | 1.255 | 1.255 | 1.255 | 1.255 | 1.255 | 100.0% | 1 | | -> duration | 1.255 | 1.255 | 1.255 | 1.255 | 1.255 | 1.255 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.254757 Full duration: 11.056163 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7eef2b97-9afa-417a-b95e-d03431e6c754 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.261 | 0.261 | 0.261 | 0.261 | 0.261 | 0.261 | 100.0% | 1 | | total | 0.932 | 0.932 | 0.932 | 0.932 | 0.932 | 0.932 | 100.0% | 1 | | -> duration | 0.932 | 0.932 | 0.932 | 0.932 | 0.932 | 0.932 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.932284 Full duration: 11.767638 HINTS: * To plot HTML graphics with this data, run: rally task report 7eef2b97-9afa-417a-b95e-d03431e6c754 --out output.html * To generate a JUnit report, run: rally task export 7eef2b97-9afa-417a-b95e-d03431e6c754 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 7eef2b97-9afa-417a-b95e-d03431e6c754 --json --out output.json 2020-12-09 12:06:37,449 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 7eef2b97-9afa-417a-b95e-d03431e6c754 --out /home/opnfv/functest/results/rally_sanity/authenticate.json 2020-12-09 12:06:37,455 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2020-12-09 12:06:37,483 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-09 12:06:37,627 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2020-12-09 12:09:00,602 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: 0a4bd808-a448-47f9-9312-148682e15a0f 2020-12-09 12:09:01,992 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 0a4bd808-a448-47f9-9312-148682e15a0f -------------------------------------------------------------------------------- Task 0a4bd808-a448-47f9-9312-148682e15a0f: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0a4bd808-a448-47f9-9312-148682e15a0f has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.787 | 4.787 | 4.787 | 4.787 | 4.787 | 4.787 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.101 | 0.101 | 0.101 | 0.101 | 0.101 | 0.101 | 100.0% | 1 | | -> glance_v2.upload_data | 2.375 | 2.375 | 2.375 | 2.375 | 2.375 | 2.375 | 100.0% | 1 | | glance_v2.delete_image | 1.72 | 1.72 | 1.72 | 1.72 | 1.72 | 1.72 | 100.0% | 1 | | total | 6.507 | 6.507 | 6.507 | 6.507 | 6.507 | 6.507 | 100.0% | 1 | | -> duration | 6.507 | 6.507 | 6.507 | 6.507 | 6.507 | 6.507 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.507014 Full duration: 16.877048 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0a4bd808-a448-47f9-9312-148682e15a0f has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 6.308 | 6.308 | 6.308 | 6.308 | 6.308 | 6.308 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.112 | 0.112 | 0.112 | 0.112 | 0.112 | 0.112 | 100.0% | 1 | | -> glance_v2.upload_data | 3.697 | 3.697 | 3.697 | 3.697 | 3.697 | 3.697 | 100.0% | 1 | | glance_v2.list_images | 0.058 | 0.058 | 0.058 | 0.058 | 0.058 | 0.058 | 100.0% | 1 | | total | 6.367 | 6.367 | 6.367 | 6.367 | 6.367 | 6.367 | 100.0% | 1 | | -> duration | 6.367 | 6.367 | 6.367 | 6.367 | 6.367 | 6.367 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.366878 Full duration: 20.982386 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0a4bd808-a448-47f9-9312-148682e15a0f has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.252 | 0.252 | 0.252 | 0.252 | 0.252 | 0.252 | 100.0% | 1 | | total | 0.252 | 0.252 | 0.252 | 0.252 | 0.252 | 0.252 | 100.0% | 1 | | -> duration | 0.252 | 0.252 | 0.252 | 0.252 | 0.252 | 0.252 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.252119 Full duration: 10.312999 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_sanity-flavor_8742c310-a5ce-4fb0-82e2-abe0e45e02bd" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "da96e3b6-a11e-49cb-aeac-d2957051a0c9" } ] } }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 0a4bd808-a448-47f9-9312-148682e15a0f has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.202 | 5.202 | 5.202 | 5.202 | 5.202 | 5.202 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.099 | 0.099 | 0.099 | 0.099 | 0.099 | 0.099 | 100.0% | 1 | | -> glance_v2.upload_data | 2.651 | 2.651 | 2.651 | 2.651 | 2.651 | 2.651 | 100.0% | 1 | | nova.boot_servers | 33.807 | 33.807 | 33.807 | 33.807 | 33.807 | 33.807 | 100.0% | 1 | | total | 39.009 | 39.009 | 39.009 | 39.009 | 39.009 | 39.009 | 100.0% | 1 | | -> duration | 38.009 | 38.009 | 38.009 | 38.009 | 38.009 | 38.009 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 38.008682 Full duration: 71.83815 HINTS: * To plot HTML graphics with this data, run: rally task report 0a4bd808-a448-47f9-9312-148682e15a0f --out output.html * To generate a JUnit report, run: rally task export 0a4bd808-a448-47f9-9312-148682e15a0f --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 0a4bd808-a448-47f9-9312-148682e15a0f --json --out output.json 2020-12-09 12:09:05,286 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 0a4bd808-a448-47f9-9312-148682e15a0f --out /home/opnfv/functest/results/rally_sanity/glance.json 2020-12-09 12:09:05,291 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2020-12-09 12:09:05,323 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-09 12:09:05,477 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2020-12-09 12:13:46,033 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: 3da32e04-e623-4e69-9ce1-05cb019aaeb5 2020-12-09 12:13:47,434 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 3da32e04-e623-4e69-9ce1-05cb019aaeb5 -------------------------------------------------------------------------------- Task 3da32e04-e623-4e69-9ce1-05cb019aaeb5: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3da32e04-e623-4e69-9ce1-05cb019aaeb5 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 3.875 | 3.875 | 3.875 | 3.875 | 3.875 | 3.875 | 100.0% | 1 | | cinder_v3.delete_snapshot | 2.706 | 2.706 | 2.706 | 2.706 | 2.706 | 2.706 | 100.0% | 1 | | total | 6.581 | 6.581 | 6.581 | 6.581 | 6.581 | 6.581 | 100.0% | 1 | | -> duration | 6.581 | 6.581 | 6.581 | 6.581 | 6.581 | 6.581 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.580898 Full duration: 35.045667 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3da32e04-e623-4e69-9ce1-05cb019aaeb5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 11.195 | 11.195 | 11.195 | 11.195 | 11.195 | 11.195 | 100.0% | 1 | | cinder_v3.delete_volume | 2.589 | 2.589 | 2.589 | 2.589 | 2.589 | 2.589 | 100.0% | 1 | | total | 13.784 | 13.784 | 13.784 | 13.784 | 13.784 | 13.784 | 100.0% | 1 | | -> duration | 13.784 | 13.784 | 13.784 | 13.784 | 13.784 | 13.784 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.783627 Full duration: 30.951636 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_sanity-img_8742c310-a5ce-4fb0-82e2-abe0e45e02bd" }, "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3da32e04-e623-4e69-9ce1-05cb019aaeb5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 15.468 | 15.468 | 15.468 | 15.468 | 15.468 | 15.468 | 100.0% | 1 | | cinder_v3.delete_volume | 3.657 | 3.657 | 3.657 | 3.657 | 3.657 | 3.657 | 100.0% | 1 | | total | 19.126 | 19.126 | 19.126 | 19.126 | 19.126 | 19.126 | 100.0% | 1 | | -> duration | 19.126 | 19.126 | 19.126 | 19.126 | 19.126 | 19.126 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.125812 Full duration: 38.059085 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3da32e04-e623-4e69-9ce1-05cb019aaeb5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.139 | 3.139 | 3.139 | 3.139 | 3.139 | 3.139 | 100.0% | 1 | | cinder_v3.delete_volume | 2.54 | 2.54 | 2.54 | 2.54 | 2.54 | 2.54 | 100.0% | 1 | | total | 5.679 | 5.679 | 5.679 | 5.679 | 5.679 | 5.679 | 100.0% | 1 | | -> duration | 5.679 | 5.679 | 5.679 | 5.679 | 5.679 | 5.679 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.678853 Full duration: 19.944649 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3da32e04-e623-4e69-9ce1-05cb019aaeb5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.425 | 3.425 | 3.425 | 3.425 | 3.425 | 3.425 | 100.0% | 1 | | cinder_v3.extend_volume | 2.645 | 2.645 | 2.645 | 2.645 | 2.645 | 2.645 | 100.0% | 1 | | cinder_v3.delete_volume | 3.675 | 3.675 | 3.675 | 3.675 | 3.675 | 3.675 | 100.0% | 1 | | total | 9.746 | 9.746 | 9.746 | 9.746 | 9.746 | 9.746 | 100.0% | 1 | | -> duration | 9.746 | 9.746 | 9.746 | 9.746 | 9.746 | 9.746 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.745601 Full duration: 26.382949 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3da32e04-e623-4e69-9ce1-05cb019aaeb5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 6.182 | 6.182 | 6.182 | 6.182 | 6.182 | 6.182 | 100.0% | 1 | | cinder_v3.delete_volume | 5.205 | 5.205 | 5.205 | 5.205 | 5.205 | 5.205 | 100.0% | 1 | | total | 11.387 | 11.387 | 11.387 | 11.387 | 11.387 | 11.387 | 100.0% | 1 | | -> duration | 11.387 | 11.387 | 11.387 | 11.387 | 11.387 | 11.387 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.386514 Full duration: 33.713812 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3da32e04-e623-4e69-9ce1-05cb019aaeb5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.789 | 0.789 | 0.789 | 0.789 | 0.789 | 0.789 | 100.0% | 1 | | cinder_v3.list_qos | 0.039 | 0.039 | 0.039 | 0.039 | 0.039 | 0.039 | 100.0% | 1 | | total | 0.829 | 0.829 | 0.829 | 0.829 | 0.829 | 0.829 | 100.0% | 1 | | -> duration | 0.829 | 0.829 | 0.829 | 0.829 | 0.829 | 0.829 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.828843 Full duration: 16.973211 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3da32e04-e623-4e69-9ce1-05cb019aaeb5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.809 | 0.809 | 0.809 | 0.809 | 0.809 | 0.809 | 100.0% | 1 | | cinder_v3.set_qos | 0.544 | 0.544 | 0.544 | 0.544 | 0.544 | 0.544 | 100.0% | 1 | | total | 1.353 | 1.353 | 1.353 | 1.353 | 1.353 | 1.353 | 100.0% | 1 | | -> duration | 1.353 | 1.353 | 1.353 | 1.353 | 1.353 | 1.353 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.353372 Full duration: 15.736219 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3da32e04-e623-4e69-9ce1-05cb019aaeb5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.973 | 0.973 | 0.973 | 0.973 | 0.973 | 0.973 | 100.0% | 1 | | cinder_v3.list_types | 0.043 | 0.043 | 0.043 | 0.043 | 0.043 | 0.043 | 100.0% | 1 | | total | 1.017 | 1.017 | 1.017 | 1.017 | 1.017 | 1.017 | 100.0% | 1 | | -> duration | 1.017 | 1.017 | 1.017 | 1.017 | 1.017 | 1.017 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.016605 Full duration: 14.275304 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3da32e04-e623-4e69-9ce1-05cb019aaeb5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.778 | 0.778 | 0.778 | 0.778 | 0.778 | 0.778 | 100.0% | 1 | | cinder_v3.create_encryption_type | 0.271 | 0.271 | 0.271 | 0.271 | 0.271 | 0.271 | 100.0% | 1 | | total | 1.049 | 1.049 | 1.049 | 1.049 | 1.049 | 1.049 | 100.0% | 1 | | -> duration | 1.049 | 1.049 | 1.049 | 1.049 | 1.049 | 1.049 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.049078 Full duration: 15.565497 HINTS: * To plot HTML graphics with this data, run: rally task report 3da32e04-e623-4e69-9ce1-05cb019aaeb5 --out output.html * To generate a JUnit report, run: rally task export 3da32e04-e623-4e69-9ce1-05cb019aaeb5 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 3da32e04-e623-4e69-9ce1-05cb019aaeb5 --json --out output.json 2020-12-09 12:13:50,734 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 3da32e04-e623-4e69-9ce1-05cb019aaeb5 --out /home/opnfv/functest/results/rally_sanity/cinder.json 2020-12-09 12:13:50,746 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2020-12-09 12:13:50,771 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-09 12:13:51,184 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2020-12-09 12:17:23,815 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: 85a3db4a-3163-4202-9197-df3b6fba8430 2020-12-09 12:17:25,256 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 85a3db4a-3163-4202-9197-df3b6fba8430 -------------------------------------------------------------------------------- Task 85a3db4a-3163-4202-9197-df3b6fba8430: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 85a3db4a-3163-4202-9197-df3b6fba8430 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 15.722 | 15.722 | 15.722 | 15.722 | 15.722 | 15.722 | 100.0% | 1 | | heat.update_stack | 13.354 | 13.354 | 13.354 | 13.354 | 13.354 | 13.354 | 100.0% | 1 | | heat.delete_stack | 12.821 | 12.821 | 12.821 | 12.821 | 12.821 | 12.821 | 100.0% | 1 | | total | 41.898 | 41.898 | 41.898 | 41.898 | 41.898 | 41.898 | 100.0% | 1 | | -> duration | 37.898 | 37.898 | 37.898 | 37.898 | 37.898 | 37.898 | 100.0% | 1 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 37.897503 Full duration: 63.305382 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 85a3db4a-3163-4202-9197-df3b6fba8430 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 12.828 | 12.828 | 12.828 | 12.828 | 12.828 | 12.828 | 100.0% | 1 | | heat.check_stack | 2.165 | 2.165 | 2.165 | 2.165 | 2.165 | 2.165 | 100.0% | 1 | | heat.delete_stack | 7.077 | 7.077 | 7.077 | 7.077 | 7.077 | 7.077 | 100.0% | 1 | | total | 22.07 | 22.07 | 22.07 | 22.07 | 22.07 | 22.07 | 100.0% | 1 | | -> duration | 20.07 | 20.07 | 20.07 | 20.07 | 20.07 | 20.07 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.070342 Full duration: 41.14191 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 85a3db4a-3163-4202-9197-df3b6fba8430 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 13.305 | 13.305 | 13.305 | 13.305 | 13.305 | 13.305 | 100.0% | 1 | | heat.suspend_stack | 3.659 | 3.659 | 3.659 | 3.659 | 3.659 | 3.659 | 100.0% | 1 | | heat.resume_stack | 3.051 | 3.051 | 3.051 | 3.051 | 3.051 | 3.051 | 100.0% | 1 | | heat.delete_stack | 4.725 | 4.725 | 4.725 | 4.725 | 4.725 | 4.725 | 100.0% | 1 | | total | 24.74 | 24.74 | 24.74 | 24.74 | 24.74 | 24.74 | 100.0% | 1 | | -> duration | 22.74 | 22.74 | 22.74 | 22.74 | 22.74 | 22.74 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.739649 Full duration: 57.822851 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 85a3db4a-3163-4202-9197-df3b6fba8430 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.91 | 0.91 | 0.91 | 0.91 | 0.91 | 0.91 | 100.0% | 1 | | total | 0.91 | 0.91 | 0.91 | 0.91 | 0.91 | 0.91 | 100.0% | 1 | | -> duration | 0.91 | 0.91 | 0.91 | 0.91 | 0.91 | 0.91 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.910115 Full duration: 14.235426 HINTS: * To plot HTML graphics with this data, run: rally task report 85a3db4a-3163-4202-9197-df3b6fba8430 --out output.html * To generate a JUnit report, run: rally task export 85a3db4a-3163-4202-9197-df3b6fba8430 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 85a3db4a-3163-4202-9197-df3b6fba8430 --json --out output.json 2020-12-09 12:17:28,495 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 85a3db4a-3163-4202-9197-df3b6fba8430 --out /home/opnfv/functest/results/rally_sanity/heat.json 2020-12-09 12:17:28,500 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2020-12-09 12:17:28,530 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-09 12:17:28,697 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2020-12-09 12:22:10,449 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: ce4b9a75-3249-42c5-917b-865934b2cc7f 2020-12-09 12:22:11,916 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid ce4b9a75-3249-42c5-917b-865934b2cc7f -------------------------------------------------------------------------------- Task ce4b9a75-3249-42c5-917b-865934b2cc7f: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ce4b9a75-3249-42c5-917b-865934b2cc7f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.413 | 0.413 | 0.413 | 0.413 | 0.413 | 0.413 | 100.0% | 1 | | keystone_v3.add_role | 0.363 | 0.363 | 0.363 | 0.363 | 0.363 | 0.363 | 100.0% | 1 | | keystone_v3.revoke_role | 0.163 | 0.163 | 0.163 | 0.163 | 0.163 | 0.163 | 100.0% | 1 | | total | 0.94 | 0.94 | 0.94 | 0.94 | 0.94 | 0.94 | 100.0% | 1 | | -> duration | 0.94 | 0.94 | 0.94 | 0.94 | 0.94 | 0.94 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.939851 Full duration: 18.812091 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ce4b9a75-3249-42c5-917b-865934b2cc7f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 1.154 | 1.154 | 1.154 | 1.154 | 1.154 | 1.154 | 100.0% | 1 | | keystone_v3.add_role | 0.209 | 0.209 | 0.209 | 0.209 | 0.209 | 0.209 | 100.0% | 1 | | keystone_v3.list_roles | 0.131 | 0.131 | 0.131 | 0.131 | 0.131 | 0.131 | 100.0% | 1 | | total | 1.495 | 1.495 | 1.495 | 1.495 | 1.495 | 1.495 | 100.0% | 1 | | -> duration | 1.495 | 1.495 | 1.495 | 1.495 | 1.495 | 1.495 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.495081 Full duration: 21.409976 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ce4b9a75-3249-42c5-917b-865934b2cc7f has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.46 | 0.46 | 0.46 | 0.46 | 0.46 | 0.46 | 100.0% | 1 | | keystone_v3.list_projects | 0.13 | 0.13 | 0.13 | 0.13 | 0.13 | 0.13 | 100.0% | 1 | | total | 0.59 | 0.59 | 0.59 | 0.59 | 0.59 | 0.59 | 100.0% | 1 | | -> duration | 0.59 | 0.59 | 0.59 | 0.59 | 0.59 | 0.59 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.590328 Full duration: 21.258862 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ce4b9a75-3249-42c5-917b-865934b2cc7f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.252 | 0.252 | 0.252 | 0.252 | 0.252 | 0.252 | 100.0% | 1 | | keystone_v3.delete_role | 0.331 | 0.331 | 0.331 | 0.331 | 0.331 | 0.331 | 100.0% | 1 | | total | 0.583 | 0.583 | 0.583 | 0.583 | 0.583 | 0.583 | 100.0% | 1 | | -> duration | 0.583 | 0.583 | 0.583 | 0.583 | 0.583 | 0.583 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.583158 Full duration: 16.296909 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ce4b9a75-3249-42c5-917b-865934b2cc7f has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.128 | 0.128 | 0.128 | 0.128 | 0.128 | 0.128 | 100.0% | 1 | | keystone_v3.delete_service | 0.456 | 0.456 | 0.456 | 0.456 | 0.456 | 0.456 | 100.0% | 1 | | total | 0.584 | 0.584 | 0.584 | 0.584 | 0.584 | 0.584 | 100.0% | 1 | | -> duration | 0.584 | 0.584 | 0.584 | 0.584 | 0.584 | 0.584 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.583893 Full duration: 16.949339 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ce4b9a75-3249-42c5-917b-865934b2cc7f has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.378 | 0.378 | 0.378 | 0.378 | 0.378 | 0.378 | 100.0% | 1 | | keystone_v3.create_user | 0.725 | 0.725 | 0.725 | 0.725 | 0.725 | 0.725 | 100.0% | 1 | | -> keystone_v3.list_roles | 0.038 | 0.038 | 0.038 | 0.038 | 0.038 | 0.038 | 100.0% | 1 | | -> keystone_v3.add_role | 0.242 | 0.242 | 0.242 | 0.242 | 0.242 | 0.242 | 100.0% | 1 | | keystone_v3.create_role | 0.523 | 0.523 | 0.523 | 0.523 | 0.523 | 0.523 | 100.0% | 1 | | keystone_v3.get_project | 0.039 | 0.039 | 0.039 | 0.039 | 0.039 | 0.039 | 100.0% | 1 | | keystone_v3.get_user | 0.054 | 0.054 | 0.054 | 0.054 | 0.054 | 0.054 | 100.0% | 1 | | keystone_v3.get_role | 0.042 | 0.042 | 0.042 | 0.042 | 0.042 | 0.042 | 100.0% | 1 | | keystone_v3.list_services | 0.055 | 0.055 | 0.055 | 0.055 | 0.055 | 0.055 | 100.0% | 1 | | keystone_v3.get_services | 0.06 | 0.06 | 0.06 | 0.06 | 0.06 | 0.06 | 100.0% | 1 | | total | 1.998 | 1.998 | 1.998 | 1.998 | 1.998 | 1.998 | 100.0% | 1 | | -> duration | 1.998 | 1.998 | 1.998 | 1.998 | 1.998 | 1.998 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.998137 Full duration: 31.511967 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ce4b9a75-3249-42c5-917b-865934b2cc7f has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.42 | 0.42 | 0.42 | 0.42 | 0.42 | 0.42 | 100.0% | 1 | | keystone_v3.update_project | 0.158 | 0.158 | 0.158 | 0.158 | 0.158 | 0.158 | 100.0% | 1 | | keystone_v3.delete_project | 0.408 | 0.408 | 0.408 | 0.408 | 0.408 | 0.408 | 100.0% | 1 | | total | 0.987 | 0.987 | 0.987 | 0.987 | 0.987 | 0.987 | 100.0% | 1 | | -> duration | 0.987 | 0.987 | 0.987 | 0.987 | 0.987 | 0.987 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.986982 Full duration: 20.17266 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ce4b9a75-3249-42c5-917b-865934b2cc7f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.732 | 0.732 | 0.732 | 0.732 | 0.732 | 0.732 | 100.0% | 1 | | total | 0.797 | 0.797 | 0.797 | 0.797 | 0.797 | 0.797 | 100.0% | 1 | | -> duration | 0.797 | 0.797 | 0.797 | 0.797 | 0.797 | 0.797 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.797276 Full duration: 19.248599 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ce4b9a75-3249-42c5-917b-865934b2cc7f has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.883 | 0.883 | 0.883 | 0.883 | 0.883 | 0.883 | 100.0% | 1 | | total | 0.883 | 0.883 | 0.883 | 0.883 | 0.883 | 0.883 | 100.0% | 1 | | -> duration | 0.883 | 0.883 | 0.883 | 0.883 | 0.883 | 0.883 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.88323 Full duration: 20.648373 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ce4b9a75-3249-42c5-917b-865934b2cc7f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.64 | 0.64 | 0.64 | 0.64 | 0.64 | 0.64 | 100.0% | 1 | | keystone_v3.list_users | 0.084 | 0.084 | 0.084 | 0.084 | 0.084 | 0.084 | 100.0% | 1 | | total | 0.803 | 0.803 | 0.803 | 0.803 | 0.803 | 0.803 | 100.0% | 1 | | -> duration | 0.803 | 0.803 | 0.803 | 0.803 | 0.803 | 0.803 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.803238 Full duration: 21.041044 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ce4b9a75-3249-42c5-917b-865934b2cc7f has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.405 | 0.405 | 0.405 | 0.405 | 0.405 | 0.405 | 100.0% | 1 | | keystone_v3.create_users | 11.899 | 11.899 | 11.899 | 11.899 | 11.899 | 11.899 | 100.0% | 1 | | -> keystone_v3.create_user (x10) | 11.898 | 11.898 | 11.898 | 11.898 | 11.898 | 11.898 | 100.0% | 1 | | --> keystone_v3.list_roles (x10) | 0.538 | 0.538 | 0.538 | 0.538 | 0.538 | 0.538 | 100.0% | 1 | | --> keystone_v3.add_role (x10) | 4.82 | 4.82 | 4.82 | 4.82 | 4.82 | 4.82 | 100.0% | 1 | | total | 12.762 | 12.762 | 12.762 | 12.762 | 12.762 | 12.762 | 100.0% | 1 | | -> duration | 12.762 | 12.762 | 12.762 | 12.762 | 12.762 | 12.762 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.762331 Full duration: 43.35812 HINTS: * To plot HTML graphics with this data, run: rally task report ce4b9a75-3249-42c5-917b-865934b2cc7f --out output.html * To generate a JUnit report, run: rally task export ce4b9a75-3249-42c5-917b-865934b2cc7f --type junit --to output.xml * To get raw JSON output of task results, run: rally task report ce4b9a75-3249-42c5-917b-865934b2cc7f --json --out output.json 2020-12-09 12:22:15,187 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid ce4b9a75-3249-42c5-917b-865934b2cc7f --out /home/opnfv/functest/results/rally_sanity/keystone.json 2020-12-09 12:22:15,199 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2020-12-09 12:22:15,228 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-09 12:22:15,632 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-12-09 12:26:31,435 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: c9d04a0c-aad5-49eb-ac30-ac6d8eeeb4ae 2020-12-09 12:26:32,795 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid c9d04a0c-aad5-49eb-ac30-ac6d8eeeb4ae -------------------------------------------------------------------------------- Task c9d04a0c-aad5-49eb-ac30-ac6d8eeeb4ae: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c9d04a0c-aad5-49eb-ac30-ac6d8eeeb4ae has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.238 | 2.238 | 2.238 | 2.238 | 2.238 | 2.238 | 100.0% | 1 | | neutron.delete_network | 1.742 | 1.742 | 1.742 | 1.742 | 1.742 | 1.742 | 100.0% | 1 | | total | 3.98 | 3.98 | 3.98 | 3.98 | 3.98 | 3.98 | 100.0% | 1 | | -> duration | 3.98 | 3.98 | 3.98 | 3.98 | 3.98 | 3.98 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.980178 Full duration: 23.078397 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c9d04a0c-aad5-49eb-ac30-ac6d8eeeb4ae has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 4.363 | 4.363 | 4.363 | 4.363 | 4.363 | 4.363 | 100.0% | 1 | | neutron.delete_port | 1.712 | 1.712 | 1.712 | 1.712 | 1.712 | 1.712 | 100.0% | 1 | | total | 6.075 | 6.075 | 6.075 | 6.075 | 6.075 | 6.075 | 100.0% | 1 | | -> duration | 6.075 | 6.075 | 6.075 | 6.075 | 6.075 | 6.075 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.075093 Full duration: 32.165246 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c9d04a0c-aad5-49eb-ac30-ac6d8eeeb4ae has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 2.999 | 2.999 | 2.999 | 2.999 | 2.999 | 2.999 | 100.0% | 1 | | neutron.delete_subnet | 0.888 | 0.888 | 0.888 | 0.888 | 0.888 | 0.888 | 100.0% | 1 | | total | 3.887 | 3.887 | 3.887 | 3.887 | 3.887 | 3.887 | 100.0% | 1 | | -> duration | 3.887 | 3.887 | 3.887 | 3.887 | 3.887 | 3.887 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.887001 Full duration: 32.485833 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c9d04a0c-aad5-49eb-ac30-ac6d8eeeb4ae has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.257 | 2.257 | 2.257 | 2.257 | 2.257 | 2.257 | 100.0% | 1 | | neutron.list_networks | 0.179 | 0.179 | 0.179 | 0.179 | 0.179 | 0.179 | 100.0% | 1 | | total | 2.435 | 2.435 | 2.435 | 2.435 | 2.435 | 2.435 | 100.0% | 1 | | -> duration | 2.435 | 2.435 | 2.435 | 2.435 | 2.435 | 2.435 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.435431 Full duration: 25.705791 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c9d04a0c-aad5-49eb-ac30-ac6d8eeeb4ae has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.57 | 2.57 | 2.57 | 2.57 | 2.57 | 2.57 | 100.0% | 1 | | neutron.list_ports | 0.316 | 0.316 | 0.316 | 0.316 | 0.316 | 0.316 | 100.0% | 1 | | total | 2.886 | 2.886 | 2.886 | 2.886 | 2.886 | 2.886 | 100.0% | 1 | | -> duration | 2.886 | 2.886 | 2.886 | 2.886 | 2.886 | 2.886 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.886466 Full duration: 33.077135 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c9d04a0c-aad5-49eb-ac30-ac6d8eeeb4ae has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 3.538 | 3.538 | 3.538 | 3.538 | 3.538 | 3.538 | 100.0% | 1 | | neutron.create_subnet | 3.259 | 3.259 | 3.259 | 3.259 | 3.259 | 3.259 | 100.0% | 1 | | neutron.list_subnets | 0.096 | 0.096 | 0.096 | 0.096 | 0.096 | 0.096 | 100.0% | 1 | | total | 6.893 | 6.893 | 6.893 | 6.893 | 6.893 | 6.893 | 100.0% | 1 | | -> duration | 6.893 | 6.893 | 6.893 | 6.893 | 6.893 | 6.893 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.892792 Full duration: 32.91874 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c9d04a0c-aad5-49eb-ac30-ac6d8eeeb4ae has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 2.938 | 2.938 | 2.938 | 2.938 | 2.938 | 2.938 | 100.0% | 1 | | neutron.delete_security_group | 0.688 | 0.688 | 0.688 | 0.688 | 0.688 | 0.688 | 100.0% | 1 | | total | 3.626 | 3.626 | 3.626 | 3.626 | 3.626 | 3.626 | 100.0% | 1 | | -> duration | 3.626 | 3.626 | 3.626 | 3.626 | 3.626 | 3.626 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.625683 Full duration: 23.631053 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task c9d04a0c-aad5-49eb-ac30-ac6d8eeeb4ae has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 2.586 | 2.586 | 2.586 | 2.586 | 2.586 | 2.586 | 100.0% | 1 | | neutron.create_security_group_rule | 0.764 | 0.764 | 0.764 | 0.764 | 0.764 | 0.764 | 100.0% | 1 | | neutron.delete_security_group_rule | 0.48 | 0.48 | 0.48 | 0.48 | 0.48 | 0.48 | 100.0% | 1 | | neutron.delete_security_group | 0.226 | 0.226 | 0.226 | 0.226 | 0.226 | 0.226 | 100.0% | 1 | | total | 4.056 | 4.056 | 4.056 | 4.056 | 4.056 | 4.056 | 100.0% | 1 | | -> duration | 4.056 | 4.056 | 4.056 | 4.056 | 4.056 | 4.056 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.055782 Full duration: 23.349238 HINTS: * To plot HTML graphics with this data, run: rally task report c9d04a0c-aad5-49eb-ac30-ac6d8eeeb4ae --out output.html * To generate a JUnit report, run: rally task export c9d04a0c-aad5-49eb-ac30-ac6d8eeeb4ae --type junit --to output.xml * To get raw JSON output of task results, run: rally task report c9d04a0c-aad5-49eb-ac30-ac6d8eeeb4ae --json --out output.json 2020-12-09 12:26:36,003 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid c9d04a0c-aad5-49eb-ac30-ac6d8eeeb4ae --out /home/opnfv/functest/results/rally_sanity/neutron.json 2020-12-09 12:26:36,014 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2020-12-09 12:26:36,050 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-09 12:26:36,219 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2020-12-09 12:28:17,693 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: 48da90f7-52d6-4839-9f80-22352690555d 2020-12-09 12:28:19,019 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 48da90f7-52d6-4839-9f80-22352690555d -------------------------------------------------------------------------------- Task 48da90f7-52d6-4839-9f80-22352690555d: aborted -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_live_migrate_server args position 0 args values: { "args": { "flavor": { "name": "rally_sanity-flavor_8742c310-a5ce-4fb0-82e2-abe0e45e02bd" }, "image": { "name": "rally_sanity-img_8742c310-a5ce-4fb0-82e2-abe0e45e02bd" }, "block_migration": false, "nics": [ { "net-id": "da96e3b6-a11e-49cb-aeac-d2957051a0c9" } ] }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 48da90f7-52d6-4839-9f80-22352690555d has 1 error(s) -------------------------------------------------------------------------------- BadRequest: Migration pre-check error: Instance has an associated NUMA topology. Instance NUMA topologies, including related attributes such as CPU pinning, huge page and emulator thread pinning information, are not currently recalculated on live migration. See bug #1289064 for more information. (HTTP 400) (Request-ID: req-00849da4-2c38-4057-a15f-18f3d522671e) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 720, in run self._live_migrate(server, block_migration, disk_over_commit) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 798, in _live_migrate disk_over_commit=disk_over_commit) File "/usr/lib/python3.6/site-packages/novaclient/api_versions.py", line 393, in substitution return methods[-1].func(obj, *args, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 438, in live_migrate disk_over_commit) File "/usr/lib/python3.6/site-packages/novaclient/api_versions.py", line 393, in substitution return methods[-1].func(obj, *args, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1742, in live_migrate force=None) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1726, in _live_migrate return self._action('os-migrateLive', server, body) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: Migration pre-check error: Instance has an associated NUMA topology. Instance NUMA topologies, including related attributes such as CPU pinning, huge page and emulator thread pinning information, are not currently recalculated on live migration. See bug #1289064 for more information. (HTTP 400) (Request-ID: req-00849da4-2c38-4057-a15f-18f3d522671e) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 32.276 | 32.276 | 32.276 | 32.276 | 32.276 | 32.276 | 100.0% | 1 | | nova.live_migrate | 6.707 | 6.707 | 6.707 | 6.707 | 6.707 | 6.707 | 0.0% | 1 | | -> nova.list_hypervisors | 0.595 | 0.595 | 0.595 | 0.595 | 0.595 | 0.595 | 100.0% | 1 | | total | 38.984 | 38.984 | 38.984 | 38.984 | 38.984 | 38.984 | 0.0% | 1 | | -> duration | 37.984 | 37.984 | 37.984 | 37.984 | 37.984 | 37.984 | 0.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 37.9841 Full duration: 64.852384 HINTS: * To plot HTML graphics with this data, run: rally task report 48da90f7-52d6-4839-9f80-22352690555d --out output.html * To generate a JUnit report, run: rally task export 48da90f7-52d6-4839-9f80-22352690555d --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 48da90f7-52d6-4839-9f80-22352690555d --json --out output.json At least one workload did not pass SLA criteria. 2020-12-09 12:28:22,206 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 48da90f7-52d6-4839-9f80-22352690555d --out /home/opnfv/functest/results/rally_sanity/nova.json 2020-12-09 12:28:22,209 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2020-12-09 12:28:22,237 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-09 12:28:22,620 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2020-12-09 12:29:33,574 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: 4ffaae49-863c-44af-9221-9d48f910603b 2020-12-09 12:29:34,920 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 4ffaae49-863c-44af-9221-9d48f910603b -------------------------------------------------------------------------------- Task 4ffaae49-863c-44af-9221-9d48f910603b: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4ffaae49-863c-44af-9221-9d48f910603b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 2.053 | 2.053 | 2.053 | 2.053 | 2.053 | 2.053 | 100.0% | 1 | | quotas.delete_quotas | 0.11 | 0.11 | 0.11 | 0.11 | 0.11 | 0.11 | 100.0% | 1 | | total | 2.163 | 2.163 | 2.163 | 2.163 | 2.163 | 2.163 | 100.0% | 1 | | -> duration | 2.163 | 2.163 | 2.163 | 2.163 | 2.163 | 2.163 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.162712 Full duration: 15.096495 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4ffaae49-863c-44af-9221-9d48f910603b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.947 | 0.947 | 0.947 | 0.947 | 0.947 | 0.947 | 100.0% | 1 | | total | 0.947 | 0.947 | 0.947 | 0.947 | 0.947 | 0.947 | 100.0% | 1 | | -> duration | 0.947 | 0.947 | 0.947 | 0.947 | 0.947 | 0.947 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.946718 Full duration: 19.739314 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4ffaae49-863c-44af-9221-9d48f910603b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.628 | 1.628 | 1.628 | 1.628 | 1.628 | 1.628 | 100.0% | 1 | | total | 1.628 | 1.628 | 1.628 | 1.628 | 1.628 | 1.628 | 100.0% | 1 | | -> duration | 1.628 | 1.628 | 1.628 | 1.628 | 1.628 | 1.628 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.627934 Full duration: 14.918453 HINTS: * To plot HTML graphics with this data, run: rally task report 4ffaae49-863c-44af-9221-9d48f910603b --out output.html * To generate a JUnit report, run: rally task export 4ffaae49-863c-44af-9221-9d48f910603b --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 4ffaae49-863c-44af-9221-9d48f910603b --json --out output.json 2020-12-09 12:29:38,317 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 4ffaae49-863c-44af-9221-9d48f910603b --out /home/opnfv/functest/results/rally_sanity/quotas.json 2020-12-09 12:29:38,321 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2020-12-09 12:29:38,351 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-09 12:29:38,496 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2020-12-09 12:32:17,271 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: 49cb5ae6-3576-4d32-9a00-a77cb8330000 2020-12-09 12:32:18,633 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 49cb5ae6-3576-4d32-9a00-a77cb8330000 -------------------------------------------------------------------------------- Task 49cb5ae6-3576-4d32-9a00-a77cb8330000: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 49cb5ae6-3576-4d32-9a00-a77cb8330000 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.297 | 1.297 | 1.297 | 1.297 | 1.297 | 1.297 | 100.0% | 1 | | swift.upload_object (x2) | 1.134 | 1.134 | 1.134 | 1.134 | 1.134 | 1.134 | 100.0% | 1 | | swift.list_objects | 0.981 | 0.981 | 0.981 | 0.981 | 0.981 | 0.981 | 100.0% | 1 | | total | 3.412 | 3.412 | 3.412 | 3.412 | 3.412 | 3.412 | 100.0% | 1 | | -> duration | 3.412 | 3.412 | 3.412 | 3.412 | 3.412 | 3.412 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.412225 Full duration: 27.519559 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 49cb5ae6-3576-4d32-9a00-a77cb8330000 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.748 | 1.748 | 1.748 | 1.748 | 1.748 | 1.748 | 100.0% | 1 | | swift.list_objects | 0.963 | 0.963 | 0.963 | 0.963 | 0.963 | 0.963 | 100.0% | 1 | | total | 2.711 | 2.711 | 2.711 | 2.711 | 2.711 | 2.711 | 100.0% | 1 | | -> duration | 2.711 | 2.711 | 2.711 | 2.711 | 2.711 | 2.711 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.711396 Full duration: 23.352903 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 49cb5ae6-3576-4d32-9a00-a77cb8330000 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.26 | 1.26 | 1.26 | 1.26 | 1.26 | 1.26 | 100.0% | 1 | | swift.upload_object (x5) | 2.837 | 2.837 | 2.837 | 2.837 | 2.837 | 2.837 | 100.0% | 1 | | swift.download_object (x5) | 2.519 | 2.519 | 2.519 | 2.519 | 2.519 | 2.519 | 100.0% | 1 | | total | 6.617 | 6.617 | 6.617 | 6.617 | 6.617 | 6.617 | 100.0% | 1 | | -> duration | 6.617 | 6.617 | 6.617 | 6.617 | 6.617 | 6.617 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.617302 Full duration: 31.758705 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 49cb5ae6-3576-4d32-9a00-a77cb8330000 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.196 | 1.196 | 1.196 | 1.196 | 1.196 | 1.196 | 100.0% | 1 | | swift.upload_object (x5) | 2.846 | 2.846 | 2.846 | 2.846 | 2.846 | 2.846 | 100.0% | 1 | | swift.delete_object (x5) | 2.722 | 2.722 | 2.722 | 2.722 | 2.722 | 2.722 | 100.0% | 1 | | swift.delete_container | 0.603 | 0.603 | 0.603 | 0.603 | 0.603 | 0.603 | 100.0% | 1 | | total | 7.369 | 7.369 | 7.369 | 7.369 | 7.369 | 7.369 | 100.0% | 1 | | -> duration | 7.369 | 7.369 | 7.369 | 7.369 | 7.369 | 7.369 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.369039 Full duration: 24.567385 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 49cb5ae6-3576-4d32-9a00-a77cb8330000 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.284 | 1.284 | 1.284 | 1.284 | 1.284 | 1.284 | 100.0% | 1 | | swift.list_objects | 0.994 | 0.994 | 0.994 | 0.994 | 0.994 | 0.994 | 100.0% | 1 | | swift.download_object (x5) | 2.493 | 2.493 | 2.493 | 2.493 | 2.493 | 2.493 | 100.0% | 1 | | total | 4.772 | 4.772 | 4.772 | 4.772 | 4.772 | 4.772 | 100.0% | 1 | | -> duration | 4.772 | 4.772 | 4.772 | 4.772 | 4.772 | 4.772 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.771514 Full duration: 28.727447 HINTS: * To plot HTML graphics with this data, run: rally task report 49cb5ae6-3576-4d32-9a00-a77cb8330000 --out output.html * To generate a JUnit report, run: rally task export 49cb5ae6-3576-4d32-9a00-a77cb8330000 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 49cb5ae6-3576-4d32-9a00-a77cb8330000 --json --out output.json 2020-12-09 12:32:21,870 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 49cb5ae6-3576-4d32-9a00-a77cb8330000 --out /home/opnfv/functest/results/rally_sanity/swift.json 2020-12-09 12:32:21,877 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2020-12-09 12:32:21,883 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:01:06 | 6 | 100.00% | | glance | 00:02:00 | 4 | 100.00% | | cinder | 00:04:06 | 10 | 100.00% | | heat | 00:02:56 | 4 | 100.00% | | keystone | 00:04:10 | 11 | 100.00% | | neutron | 00:03:46 | 8 | 100.00% | | nova | 00:01:04 | 1 | 0.00% | | quotas | 00:00:49 | 3 | 100.00% | | swift | 00:02:15 | 5 | 100.00% | | | | | | | TOTAL: | 00:22:17 | 52 | 98.08% | +----------------+------------+----------------+-----------+ 2020-12-09 12:32:21,883 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_sanity' success_rate is 98.08% in 8/9 modules 2020-12-09 12:32:25,622 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_sanity/rally_sanity.html 2020-12-09 12:32:29,225 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_sanity/rally_sanity.xml 2020-12-09 12:32:29,226 - xtesting.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | rally_sanity | functest | 27:48 | FAIL | +----------------------+------------------+------------------+----------------+