2020-12-10 07:39:46,952 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | XKUPGEC106NW | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/XKUPGEC106NW/airs | | | hip-opnfv-functest-smoke-latest-rally_sanity- | | | run-193 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/XKUPGEC106NW/ai | | | rship-opnfv-functest-smoke-latest-rally_sanity- | | | run-193 | +-------------------------+------------------------------------------------------------+ 2020-12-10 07:39:47,025 - xtesting.ci.run_tests - INFO - Loading test case 'rally_sanity'... 2020-12-10 07:39:51,421 - xtesting.ci.run_tests - INFO - Running test case 'rally_sanity'... 2020-12-10 07:39:58,248 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2020-12-10 07:40:05,266 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 5ebacb6f-10e5-4d90-98b3-a3620481db24 | 2020-12-10T07:40:05.006769 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 5ebacb6f-10e5-4d90-98b3-a3620481db24 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-12-10 07:40:10,428 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-12-10 07:40:13,043 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-10 07:40:13,224 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2020-12-10 07:41:52,082 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: 7eb6f207-5f60-4f41-9ee4-1a824e4942ef 2020-12-10 07:41:53,431 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 7eb6f207-5f60-4f41-9ee4-1a824e4942ef -------------------------------------------------------------------------------- Task 7eb6f207-5f60-4f41-9ee4-1a824e4942ef: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7eb6f207-5f60-4f41-9ee4-1a824e4942ef has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 1.145 | 1.145 | 1.145 | 1.145 | 1.145 | 1.145 | 100.0% | 1 | | total | 1.145 | 1.145 | 1.145 | 1.145 | 1.145 | 1.145 | 100.0% | 1 | | -> duration | 1.145 | 1.145 | 1.145 | 1.145 | 1.145 | 1.145 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.145254 Full duration: 11.595758 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7eb6f207-5f60-4f41-9ee4-1a824e4942ef has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.35 | 0.35 | 0.35 | 0.35 | 0.35 | 0.35 | 100.0% | 1 | | total | 1.005 | 1.005 | 1.005 | 1.005 | 1.005 | 1.005 | 100.0% | 1 | | -> duration | 1.005 | 1.005 | 1.005 | 1.005 | 1.005 | 1.005 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.00463 Full duration: 10.390253 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7eb6f207-5f60-4f41-9ee4-1a824e4942ef has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.327 | 0.327 | 0.327 | 0.327 | 0.327 | 0.327 | 100.0% | 1 | | total | 0.873 | 0.873 | 0.873 | 0.873 | 0.873 | 0.873 | 100.0% | 1 | | -> duration | 0.873 | 0.873 | 0.873 | 0.873 | 0.873 | 0.873 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.872904 Full duration: 11.651727 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7eb6f207-5f60-4f41-9ee4-1a824e4942ef has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.32 | 0.32 | 0.32 | 0.32 | 0.32 | 0.32 | 100.0% | 1 | | total | 1.009 | 1.009 | 1.009 | 1.009 | 1.009 | 1.009 | 100.0% | 1 | | -> duration | 1.009 | 1.009 | 1.009 | 1.009 | 1.009 | 1.009 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.008805 Full duration: 12.036464 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7eb6f207-5f60-4f41-9ee4-1a824e4942ef has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.602 | 0.602 | 0.602 | 0.602 | 0.602 | 0.602 | 100.0% | 1 | | total | 1.19 | 1.19 | 1.19 | 1.19 | 1.19 | 1.19 | 100.0% | 1 | | -> duration | 1.19 | 1.19 | 1.19 | 1.19 | 1.19 | 1.19 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.189984 Full duration: 15.923914 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7eb6f207-5f60-4f41-9ee4-1a824e4942ef has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.276 | 0.276 | 0.276 | 0.276 | 0.276 | 0.276 | 100.0% | 1 | | total | 0.896 | 0.896 | 0.896 | 0.896 | 0.896 | 0.896 | 100.0% | 1 | | -> duration | 0.896 | 0.896 | 0.896 | 0.896 | 0.896 | 0.896 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.896267 Full duration: 12.974347 HINTS: * To plot HTML graphics with this data, run: rally task report 7eb6f207-5f60-4f41-9ee4-1a824e4942ef --out output.html * To generate a JUnit report, run: rally task export 7eb6f207-5f60-4f41-9ee4-1a824e4942ef --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 7eb6f207-5f60-4f41-9ee4-1a824e4942ef --json --out output.json 2020-12-10 07:41:56,665 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 7eb6f207-5f60-4f41-9ee4-1a824e4942ef --out /home/opnfv/functest/results/rally_sanity/authenticate.json 2020-12-10 07:41:56,670 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2020-12-10 07:41:56,701 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-10 07:41:56,905 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2020-12-10 07:45:19,483 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: a95a93d2-0ec2-439b-bb68-da4829930fb0 2020-12-10 07:45:20,847 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid a95a93d2-0ec2-439b-bb68-da4829930fb0 -------------------------------------------------------------------------------- Task a95a93d2-0ec2-439b-bb68-da4829930fb0: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a95a93d2-0ec2-439b-bb68-da4829930fb0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 6.701 | 6.701 | 6.701 | 6.701 | 6.701 | 6.701 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.127 | 0.127 | 0.127 | 0.127 | 0.127 | 0.127 | 100.0% | 1 | | -> glance_v2.upload_data | 4.065 | 4.065 | 4.065 | 4.065 | 4.065 | 4.065 | 100.0% | 1 | | glance_v2.delete_image | 2.712 | 2.712 | 2.712 | 2.712 | 2.712 | 2.712 | 100.0% | 1 | | total | 9.413 | 9.413 | 9.413 | 9.413 | 9.413 | 9.413 | 100.0% | 1 | | -> duration | 9.413 | 9.413 | 9.413 | 9.413 | 9.413 | 9.413 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.412748 Full duration: 28.386041 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a95a93d2-0ec2-439b-bb68-da4829930fb0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 6.5 | 6.5 | 6.5 | 6.5 | 6.5 | 6.5 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.102 | 0.102 | 0.102 | 0.102 | 0.102 | 0.102 | 100.0% | 1 | | -> glance_v2.upload_data | 3.703 | 3.703 | 3.703 | 3.703 | 3.703 | 3.703 | 100.0% | 1 | | glance_v2.list_images | 0.064 | 0.064 | 0.064 | 0.064 | 0.064 | 0.064 | 100.0% | 1 | | total | 6.564 | 6.564 | 6.564 | 6.564 | 6.564 | 6.564 | 100.0% | 1 | | -> duration | 6.564 | 6.564 | 6.564 | 6.564 | 6.564 | 6.564 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.564113 Full duration: 23.795388 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a95a93d2-0ec2-439b-bb68-da4829930fb0 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.255 | 0.255 | 0.255 | 0.255 | 0.255 | 0.255 | 100.0% | 1 | | total | 0.255 | 0.255 | 0.255 | 0.255 | 0.255 | 0.255 | 100.0% | 1 | | -> duration | 0.255 | 0.255 | 0.255 | 0.255 | 0.255 | 0.255 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.255145 Full duration: 18.469067 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_sanity-flavor_1e1af09b-2259-4534-a0b7-642d83342a10" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "da96e3b6-a11e-49cb-aeac-d2957051a0c9" } ] } }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a95a93d2-0ec2-439b-bb68-da4829930fb0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 12.281 | 12.281 | 12.281 | 12.281 | 12.281 | 12.281 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.107 | 0.107 | 0.107 | 0.107 | 0.107 | 0.107 | 100.0% | 1 | | -> glance_v2.upload_data | 9.792 | 9.792 | 9.792 | 9.792 | 9.792 | 9.792 | 100.0% | 1 | | nova.boot_servers | 45.85 | 45.85 | 45.85 | 45.85 | 45.85 | 45.85 | 100.0% | 1 | | total | 58.131 | 58.131 | 58.131 | 58.131 | 58.131 | 58.131 | 100.0% | 1 | | -> duration | 57.131 | 57.131 | 57.131 | 57.131 | 57.131 | 57.131 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 57.130929 Full duration: 103.235004 HINTS: * To plot HTML graphics with this data, run: rally task report a95a93d2-0ec2-439b-bb68-da4829930fb0 --out output.html * To generate a JUnit report, run: rally task export a95a93d2-0ec2-439b-bb68-da4829930fb0 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report a95a93d2-0ec2-439b-bb68-da4829930fb0 --json --out output.json 2020-12-10 07:45:24,053 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid a95a93d2-0ec2-439b-bb68-da4829930fb0 --out /home/opnfv/functest/results/rally_sanity/glance.json 2020-12-10 07:45:24,058 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2020-12-10 07:45:24,099 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-10 07:45:24,591 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2020-12-10 07:50:42,934 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: 668ae119-90c7-4dbb-99d1-7608049047e5 2020-12-10 07:50:44,235 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 668ae119-90c7-4dbb-99d1-7608049047e5 -------------------------------------------------------------------------------- Task 668ae119-90c7-4dbb-99d1-7608049047e5: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 668ae119-90c7-4dbb-99d1-7608049047e5 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 6.346 | 6.346 | 6.346 | 6.346 | 6.346 | 6.346 | 100.0% | 1 | | cinder_v3.delete_snapshot | 2.34 | 2.34 | 2.34 | 2.34 | 2.34 | 2.34 | 100.0% | 1 | | total | 8.686 | 8.686 | 8.686 | 8.686 | 8.686 | 8.686 | 100.0% | 1 | | -> duration | 8.686 | 8.686 | 8.686 | 8.686 | 8.686 | 8.686 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.68559 Full duration: 34.981463 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 668ae119-90c7-4dbb-99d1-7608049047e5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 7.419 | 7.419 | 7.419 | 7.419 | 7.419 | 7.419 | 100.0% | 1 | | cinder_v3.delete_volume | 5.613 | 5.613 | 5.613 | 5.613 | 5.613 | 5.613 | 100.0% | 1 | | total | 13.032 | 13.032 | 13.032 | 13.032 | 13.032 | 13.032 | 100.0% | 1 | | -> duration | 13.032 | 13.032 | 13.032 | 13.032 | 13.032 | 13.032 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.032441 Full duration: 28.645583 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_sanity-img_1e1af09b-2259-4534-a0b7-642d83342a10" }, "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 668ae119-90c7-4dbb-99d1-7608049047e5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 17.035 | 17.035 | 17.035 | 17.035 | 17.035 | 17.035 | 100.0% | 1 | | cinder_v3.delete_volume | 4.003 | 4.003 | 4.003 | 4.003 | 4.003 | 4.003 | 100.0% | 1 | | total | 21.038 | 21.038 | 21.038 | 21.038 | 21.038 | 21.038 | 100.0% | 1 | | -> duration | 21.038 | 21.038 | 21.038 | 21.038 | 21.038 | 21.038 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.038414 Full duration: 43.45429 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 668ae119-90c7-4dbb-99d1-7608049047e5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.805 | 5.805 | 5.805 | 5.805 | 5.805 | 5.805 | 100.0% | 1 | | cinder_v3.delete_volume | 2.44 | 2.44 | 2.44 | 2.44 | 2.44 | 2.44 | 100.0% | 1 | | total | 8.245 | 8.245 | 8.245 | 8.245 | 8.245 | 8.245 | 100.0% | 1 | | -> duration | 8.245 | 8.245 | 8.245 | 8.245 | 8.245 | 8.245 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.245178 Full duration: 23.057724 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 668ae119-90c7-4dbb-99d1-7608049047e5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.531 | 5.531 | 5.531 | 5.531 | 5.531 | 5.531 | 100.0% | 1 | | cinder_v3.extend_volume | 3.371 | 3.371 | 3.371 | 3.371 | 3.371 | 3.371 | 100.0% | 1 | | cinder_v3.delete_volume | 5.125 | 5.125 | 5.125 | 5.125 | 5.125 | 5.125 | 100.0% | 1 | | total | 14.027 | 14.027 | 14.027 | 14.027 | 14.027 | 14.027 | 100.0% | 1 | | -> duration | 14.027 | 14.027 | 14.027 | 14.027 | 14.027 | 14.027 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.027372 Full duration: 31.02428 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 668ae119-90c7-4dbb-99d1-7608049047e5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 10.457 | 10.457 | 10.457 | 10.457 | 10.457 | 10.457 | 100.0% | 1 | | cinder_v3.delete_volume | 2.751 | 2.751 | 2.751 | 2.751 | 2.751 | 2.751 | 100.0% | 1 | | total | 13.208 | 13.208 | 13.208 | 13.208 | 13.208 | 13.208 | 100.0% | 1 | | -> duration | 13.208 | 13.208 | 13.208 | 13.208 | 13.208 | 13.208 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.207864 Full duration: 42.991894 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 668ae119-90c7-4dbb-99d1-7608049047e5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.786 | 0.786 | 0.786 | 0.786 | 0.786 | 0.786 | 100.0% | 1 | | cinder_v3.list_qos | 0.045 | 0.045 | 0.045 | 0.045 | 0.045 | 0.045 | 100.0% | 1 | | total | 0.832 | 0.832 | 0.832 | 0.832 | 0.832 | 0.832 | 100.0% | 1 | | -> duration | 0.832 | 0.832 | 0.832 | 0.832 | 0.832 | 0.832 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.831658 Full duration: 18.944437 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 668ae119-90c7-4dbb-99d1-7608049047e5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.931 | 0.931 | 0.931 | 0.931 | 0.931 | 0.931 | 100.0% | 1 | | cinder_v3.set_qos | 0.342 | 0.342 | 0.342 | 0.342 | 0.342 | 0.342 | 100.0% | 1 | | total | 1.274 | 1.274 | 1.274 | 1.274 | 1.274 | 1.274 | 100.0% | 1 | | -> duration | 1.274 | 1.274 | 1.274 | 1.274 | 1.274 | 1.274 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.273724 Full duration: 17.914656 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 668ae119-90c7-4dbb-99d1-7608049047e5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 1.116 | 1.116 | 1.116 | 1.116 | 1.116 | 1.116 | 100.0% | 1 | | cinder_v3.list_types | 0.036 | 0.036 | 0.036 | 0.036 | 0.036 | 0.036 | 100.0% | 1 | | total | 1.152 | 1.152 | 1.152 | 1.152 | 1.152 | 1.152 | 100.0% | 1 | | -> duration | 1.152 | 1.152 | 1.152 | 1.152 | 1.152 | 1.152 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.152038 Full duration: 17.843735 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 668ae119-90c7-4dbb-99d1-7608049047e5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 1.967 | 1.967 | 1.967 | 1.967 | 1.967 | 1.967 | 100.0% | 1 | | cinder_v3.create_encryption_type | 1.342 | 1.342 | 1.342 | 1.342 | 1.342 | 1.342 | 100.0% | 1 | | total | 3.309 | 3.309 | 3.309 | 3.309 | 3.309 | 3.309 | 100.0% | 1 | | -> duration | 3.309 | 3.309 | 3.309 | 3.309 | 3.309 | 3.309 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.309441 Full duration: 24.550541 HINTS: * To plot HTML graphics with this data, run: rally task report 668ae119-90c7-4dbb-99d1-7608049047e5 --out output.html * To generate a JUnit report, run: rally task export 668ae119-90c7-4dbb-99d1-7608049047e5 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 668ae119-90c7-4dbb-99d1-7608049047e5 --json --out output.json 2020-12-10 07:50:47,541 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 668ae119-90c7-4dbb-99d1-7608049047e5 --out /home/opnfv/functest/results/rally_sanity/cinder.json 2020-12-10 07:50:47,555 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2020-12-10 07:50:47,584 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-10 07:50:48,031 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2020-12-10 07:56:20,765 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: b9c5e1e7-3771-4786-97fd-dc4728b38772 2020-12-10 07:56:22,130 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid b9c5e1e7-3771-4786-97fd-dc4728b38772 -------------------------------------------------------------------------------- Task b9c5e1e7-3771-4786-97fd-dc4728b38772: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b9c5e1e7-3771-4786-97fd-dc4728b38772 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 21.586 | 21.586 | 21.586 | 21.586 | 21.586 | 21.586 | 100.0% | 1 | | heat.update_stack | 15.254 | 15.254 | 15.254 | 15.254 | 15.254 | 15.254 | 100.0% | 1 | | heat.delete_stack | 16.097 | 16.097 | 16.097 | 16.097 | 16.097 | 16.097 | 100.0% | 1 | | total | 52.938 | 52.938 | 52.938 | 52.938 | 52.938 | 52.938 | 100.0% | 1 | | -> duration | 48.938 | 48.938 | 48.938 | 48.938 | 48.938 | 48.938 | 100.0% | 1 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 48.93752 Full duration: 80.230117 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b9c5e1e7-3771-4786-97fd-dc4728b38772 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 25.838 | 25.838 | 25.838 | 25.838 | 25.838 | 25.838 | 100.0% | 1 | | heat.check_stack | 13.554 | 13.554 | 13.554 | 13.554 | 13.554 | 13.554 | 100.0% | 1 | | heat.delete_stack | 10.843 | 10.843 | 10.843 | 10.843 | 10.843 | 10.843 | 100.0% | 1 | | total | 50.235 | 50.235 | 50.235 | 50.235 | 50.235 | 50.235 | 100.0% | 1 | | -> duration | 48.235 | 48.235 | 48.235 | 48.235 | 48.235 | 48.235 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 48.235075 Full duration: 80.157681 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b9c5e1e7-3771-4786-97fd-dc4728b38772 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 26.582 | 26.582 | 26.582 | 26.582 | 26.582 | 26.582 | 100.0% | 1 | | heat.suspend_stack | 13.996 | 13.996 | 13.996 | 13.996 | 13.996 | 13.996 | 100.0% | 1 | | heat.resume_stack | 14.365 | 14.365 | 14.365 | 14.365 | 14.365 | 14.365 | 100.0% | 1 | | heat.delete_stack | 27.015 | 27.015 | 27.015 | 27.015 | 27.015 | 27.015 | 100.0% | 1 | | total | 81.958 | 81.958 | 81.958 | 81.958 | 81.958 | 81.958 | 100.0% | 1 | | -> duration | 79.958 | 79.958 | 79.958 | 79.958 | 79.958 | 79.958 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 79.958391 Full duration: 109.178301 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b9c5e1e7-3771-4786-97fd-dc4728b38772 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.822 | 0.822 | 0.822 | 0.822 | 0.822 | 0.822 | 100.0% | 1 | | total | 0.822 | 0.822 | 0.822 | 0.822 | 0.822 | 0.822 | 100.0% | 1 | | -> duration | 0.822 | 0.822 | 0.822 | 0.822 | 0.822 | 0.822 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.821995 Full duration: 22.131238 HINTS: * To plot HTML graphics with this data, run: rally task report b9c5e1e7-3771-4786-97fd-dc4728b38772 --out output.html * To generate a JUnit report, run: rally task export b9c5e1e7-3771-4786-97fd-dc4728b38772 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report b9c5e1e7-3771-4786-97fd-dc4728b38772 --json --out output.json 2020-12-10 07:56:25,465 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid b9c5e1e7-3771-4786-97fd-dc4728b38772 --out /home/opnfv/functest/results/rally_sanity/heat.json 2020-12-10 07:56:25,470 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2020-12-10 07:56:25,502 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-10 07:56:25,834 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2020-12-10 08:03:18,516 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: aeca11f8-4ac2-47ab-ac1b-ecddeed1f5f2 2020-12-10 08:03:19,871 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid aeca11f8-4ac2-47ab-ac1b-ecddeed1f5f2 -------------------------------------------------------------------------------- Task aeca11f8-4ac2-47ab-ac1b-ecddeed1f5f2: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task aeca11f8-4ac2-47ab-ac1b-ecddeed1f5f2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.561 | 0.561 | 0.561 | 0.561 | 0.561 | 0.561 | 100.0% | 1 | | keystone_v3.add_role | 0.739 | 0.739 | 0.739 | 0.739 | 0.739 | 0.739 | 100.0% | 1 | | keystone_v3.revoke_role | 1.477 | 1.477 | 1.477 | 1.477 | 1.477 | 1.477 | 100.0% | 1 | | total | 2.776 | 2.776 | 2.776 | 2.776 | 2.776 | 2.776 | 100.0% | 1 | | -> duration | 2.776 | 2.776 | 2.776 | 2.776 | 2.776 | 2.776 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.775986 Full duration: 28.645 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task aeca11f8-4ac2-47ab-ac1b-ecddeed1f5f2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 1.117 | 1.117 | 1.117 | 1.117 | 1.117 | 1.117 | 100.0% | 1 | | keystone_v3.add_role | 0.643 | 0.643 | 0.643 | 0.643 | 0.643 | 0.643 | 100.0% | 1 | | keystone_v3.list_roles | 0.126 | 0.126 | 0.126 | 0.126 | 0.126 | 0.126 | 100.0% | 1 | | total | 1.886 | 1.886 | 1.886 | 1.886 | 1.886 | 1.886 | 100.0% | 1 | | -> duration | 1.886 | 1.886 | 1.886 | 1.886 | 1.886 | 1.886 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.886149 Full duration: 29.103444 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task aeca11f8-4ac2-47ab-ac1b-ecddeed1f5f2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 1.463 | 1.463 | 1.463 | 1.463 | 1.463 | 1.463 | 100.0% | 1 | | keystone_v3.list_projects | 0.124 | 0.124 | 0.124 | 0.124 | 0.124 | 0.124 | 100.0% | 1 | | total | 1.588 | 1.588 | 1.588 | 1.588 | 1.588 | 1.588 | 100.0% | 1 | | -> duration | 1.588 | 1.588 | 1.588 | 1.588 | 1.588 | 1.588 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.588165 Full duration: 25.929119 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task aeca11f8-4ac2-47ab-ac1b-ecddeed1f5f2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 1.07 | 1.07 | 1.07 | 1.07 | 1.07 | 1.07 | 100.0% | 1 | | keystone_v3.delete_role | 1.59 | 1.59 | 1.59 | 1.59 | 1.59 | 1.59 | 100.0% | 1 | | total | 2.66 | 2.66 | 2.66 | 2.66 | 2.66 | 2.66 | 100.0% | 1 | | -> duration | 2.66 | 2.66 | 2.66 | 2.66 | 2.66 | 2.66 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.660064 Full duration: 24.211839 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task aeca11f8-4ac2-47ab-ac1b-ecddeed1f5f2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.328 | 0.328 | 0.328 | 0.328 | 0.328 | 0.328 | 100.0% | 1 | | keystone_v3.delete_service | 0.489 | 0.489 | 0.489 | 0.489 | 0.489 | 0.489 | 100.0% | 1 | | total | 0.817 | 0.817 | 0.817 | 0.817 | 0.817 | 0.817 | 100.0% | 1 | | -> duration | 0.817 | 0.817 | 0.817 | 0.817 | 0.817 | 0.817 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.817111 Full duration: 24.712171 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task aeca11f8-4ac2-47ab-ac1b-ecddeed1f5f2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 1.341 | 1.341 | 1.341 | 1.341 | 1.341 | 1.341 | 100.0% | 1 | | keystone_v3.create_user | 4.199 | 4.199 | 4.199 | 4.199 | 4.199 | 4.199 | 100.0% | 1 | | -> keystone_v3.list_roles | 0.057 | 0.057 | 0.057 | 0.057 | 0.057 | 0.057 | 100.0% | 1 | | -> keystone_v3.add_role | 1.079 | 1.079 | 1.079 | 1.079 | 1.079 | 1.079 | 100.0% | 1 | | keystone_v3.create_role | 1.055 | 1.055 | 1.055 | 1.055 | 1.055 | 1.055 | 100.0% | 1 | | keystone_v3.get_project | 0.033 | 0.033 | 0.033 | 0.033 | 0.033 | 0.033 | 100.0% | 1 | | keystone_v3.get_user | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 100.0% | 1 | | keystone_v3.get_role | 0.036 | 0.036 | 0.036 | 0.036 | 0.036 | 0.036 | 100.0% | 1 | | keystone_v3.list_services | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 100.0% | 1 | | keystone_v3.get_services | 0.043 | 0.043 | 0.043 | 0.043 | 0.043 | 0.043 | 100.0% | 1 | | total | 6.904 | 6.904 | 6.904 | 6.904 | 6.904 | 6.904 | 100.0% | 1 | | -> duration | 6.904 | 6.904 | 6.904 | 6.904 | 6.904 | 6.904 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.904014 Full duration: 42.983575 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task aeca11f8-4ac2-47ab-ac1b-ecddeed1f5f2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 1.971 | 1.971 | 1.971 | 1.971 | 1.971 | 1.971 | 100.0% | 1 | | keystone_v3.update_project | 0.459 | 0.459 | 0.459 | 0.459 | 0.459 | 0.459 | 100.0% | 1 | | keystone_v3.delete_project | 3.423 | 3.423 | 3.423 | 3.423 | 3.423 | 3.423 | 100.0% | 1 | | total | 5.854 | 5.854 | 5.854 | 5.854 | 5.854 | 5.854 | 100.0% | 1 | | -> duration | 5.854 | 5.854 | 5.854 | 5.854 | 5.854 | 5.854 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.853822 Full duration: 30.676505 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task aeca11f8-4ac2-47ab-ac1b-ecddeed1f5f2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 2.928 | 2.928 | 2.928 | 2.928 | 2.928 | 2.928 | 100.0% | 1 | | total | 3.013 | 3.013 | 3.013 | 3.013 | 3.013 | 3.013 | 100.0% | 1 | | -> duration | 3.013 | 3.013 | 3.013 | 3.013 | 3.013 | 3.013 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.012994 Full duration: 28.007627 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task aeca11f8-4ac2-47ab-ac1b-ecddeed1f5f2 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 3.277 | 3.277 | 3.277 | 3.277 | 3.277 | 3.277 | 100.0% | 1 | | total | 3.277 | 3.277 | 3.277 | 3.277 | 3.277 | 3.277 | 100.0% | 1 | | -> duration | 3.277 | 3.277 | 3.277 | 3.277 | 3.277 | 3.277 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.277004 Full duration: 28.61825 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task aeca11f8-4ac2-47ab-ac1b-ecddeed1f5f2 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.594 | 0.594 | 0.594 | 0.594 | 0.594 | 0.594 | 100.0% | 1 | | keystone_v3.list_users | 0.076 | 0.076 | 0.076 | 0.076 | 0.076 | 0.076 | 100.0% | 1 | | total | 0.761 | 0.761 | 0.761 | 0.761 | 0.761 | 0.761 | 100.0% | 1 | | -> duration | 0.761 | 0.761 | 0.761 | 0.761 | 0.761 | 0.761 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.760755 Full duration: 35.222975 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task aeca11f8-4ac2-47ab-ac1b-ecddeed1f5f2 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 1.727 | 1.727 | 1.727 | 1.727 | 1.727 | 1.727 | 100.0% | 1 | | keystone_v3.create_users | 30.513 | 30.513 | 30.513 | 30.513 | 30.513 | 30.513 | 100.0% | 1 | | -> keystone_v3.create_user (x10) | 30.512 | 30.512 | 30.512 | 30.512 | 30.512 | 30.512 | 100.0% | 1 | | --> keystone_v3.list_roles (x10) | 0.55 | 0.55 | 0.55 | 0.55 | 0.55 | 0.55 | 100.0% | 1 | | --> keystone_v3.add_role (x10) | 14.093 | 14.093 | 14.093 | 14.093 | 14.093 | 14.093 | 100.0% | 1 | | total | 32.683 | 32.683 | 32.683 | 32.683 | 32.683 | 32.683 | 100.0% | 1 | | -> duration | 32.683 | 32.683 | 32.683 | 32.683 | 32.683 | 32.683 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 32.683325 Full duration: 78.802204 HINTS: * To plot HTML graphics with this data, run: rally task report aeca11f8-4ac2-47ab-ac1b-ecddeed1f5f2 --out output.html * To generate a JUnit report, run: rally task export aeca11f8-4ac2-47ab-ac1b-ecddeed1f5f2 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report aeca11f8-4ac2-47ab-ac1b-ecddeed1f5f2 --json --out output.json 2020-12-10 08:03:23,069 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid aeca11f8-4ac2-47ab-ac1b-ecddeed1f5f2 --out /home/opnfv/functest/results/rally_sanity/keystone.json 2020-12-10 08:03:23,081 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2020-12-10 08:03:23,112 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-10 08:03:23,584 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-12-10 08:10:09,655 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 2e3b0b10-2324-47a1-a2d3-9af871f9ae69 2020-12-10 08:10:11,047 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 2e3b0b10-2324-47a1-a2d3-9af871f9ae69 -------------------------------------------------------------------------------- Task 2e3b0b10-2324-47a1-a2d3-9af871f9ae69: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e3b0b10-2324-47a1-a2d3-9af871f9ae69 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.446 | 2.446 | 2.446 | 2.446 | 2.446 | 2.446 | 100.0% | 1 | | neutron.delete_network | 3.203 | 3.203 | 3.203 | 3.203 | 3.203 | 3.203 | 100.0% | 1 | | total | 5.649 | 5.649 | 5.649 | 5.649 | 5.649 | 5.649 | 100.0% | 1 | | -> duration | 5.649 | 5.649 | 5.649 | 5.649 | 5.649 | 5.649 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.649094 Full duration: 33.61863 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e3b0b10-2324-47a1-a2d3-9af871f9ae69 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 6.757 | 6.757 | 6.757 | 6.757 | 6.757 | 6.757 | 100.0% | 1 | | neutron.delete_port | 1.404 | 1.404 | 1.404 | 1.404 | 1.404 | 1.404 | 100.0% | 1 | | total | 8.162 | 8.162 | 8.162 | 8.162 | 8.162 | 8.162 | 100.0% | 1 | | -> duration | 8.162 | 8.162 | 8.162 | 8.162 | 8.162 | 8.162 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.161858 Full duration: 50.790503 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e3b0b10-2324-47a1-a2d3-9af871f9ae69 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 4.448 | 4.448 | 4.448 | 4.448 | 4.448 | 4.448 | 100.0% | 1 | | neutron.delete_subnet | 1.502 | 1.502 | 1.502 | 1.502 | 1.502 | 1.502 | 100.0% | 1 | | total | 5.951 | 5.951 | 5.951 | 5.951 | 5.951 | 5.951 | 100.0% | 1 | | -> duration | 5.951 | 5.951 | 5.951 | 5.951 | 5.951 | 5.951 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.950628 Full duration: 64.404634 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e3b0b10-2324-47a1-a2d3-9af871f9ae69 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 5.273 | 5.273 | 5.273 | 5.273 | 5.273 | 5.273 | 100.0% | 1 | | neutron.list_networks | 0.154 | 0.154 | 0.154 | 0.154 | 0.154 | 0.154 | 100.0% | 1 | | total | 5.428 | 5.428 | 5.428 | 5.428 | 5.428 | 5.428 | 100.0% | 1 | | -> duration | 5.428 | 5.428 | 5.428 | 5.428 | 5.428 | 5.428 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.427622 Full duration: 46.013924 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e3b0b10-2324-47a1-a2d3-9af871f9ae69 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 3.621 | 3.621 | 3.621 | 3.621 | 3.621 | 3.621 | 100.0% | 1 | | neutron.list_ports | 0.14 | 0.14 | 0.14 | 0.14 | 0.14 | 0.14 | 100.0% | 1 | | total | 3.761 | 3.761 | 3.761 | 3.761 | 3.761 | 3.761 | 100.0% | 1 | | -> duration | 3.761 | 3.761 | 3.761 | 3.761 | 3.761 | 3.761 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.761415 Full duration: 47.466314 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e3b0b10-2324-47a1-a2d3-9af871f9ae69 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 3.14 | 3.14 | 3.14 | 3.14 | 3.14 | 3.14 | 100.0% | 1 | | neutron.create_subnet | 3.897 | 3.897 | 3.897 | 3.897 | 3.897 | 3.897 | 100.0% | 1 | | neutron.list_subnets | 0.159 | 0.159 | 0.159 | 0.159 | 0.159 | 0.159 | 100.0% | 1 | | total | 7.197 | 7.197 | 7.197 | 7.197 | 7.197 | 7.197 | 100.0% | 1 | | -> duration | 7.197 | 7.197 | 7.197 | 7.197 | 7.197 | 7.197 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.196648 Full duration: 39.047003 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e3b0b10-2324-47a1-a2d3-9af871f9ae69 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 13.257 | 13.257 | 13.257 | 13.257 | 13.257 | 13.257 | 100.0% | 1 | | neutron.delete_security_group | 1.551 | 1.551 | 1.551 | 1.551 | 1.551 | 1.551 | 100.0% | 1 | | total | 14.808 | 14.808 | 14.808 | 14.808 | 14.808 | 14.808 | 100.0% | 1 | | -> duration | 14.808 | 14.808 | 14.808 | 14.808 | 14.808 | 14.808 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.807805 Full duration: 41.05815 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2e3b0b10-2324-47a1-a2d3-9af871f9ae69 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 5.269 | 5.269 | 5.269 | 5.269 | 5.269 | 5.269 | 100.0% | 1 | | neutron.create_security_group_rule | 1.971 | 1.971 | 1.971 | 1.971 | 1.971 | 1.971 | 100.0% | 1 | | neutron.delete_security_group_rule | 2.359 | 2.359 | 2.359 | 2.359 | 2.359 | 2.359 | 100.0% | 1 | | neutron.delete_security_group | 0.839 | 0.839 | 0.839 | 0.839 | 0.839 | 0.839 | 100.0% | 1 | | total | 10.438 | 10.438 | 10.438 | 10.438 | 10.438 | 10.438 | 100.0% | 1 | | -> duration | 10.438 | 10.438 | 10.438 | 10.438 | 10.438 | 10.438 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.438189 Full duration: 37.457123 HINTS: * To plot HTML graphics with this data, run: rally task report 2e3b0b10-2324-47a1-a2d3-9af871f9ae69 --out output.html * To generate a JUnit report, run: rally task export 2e3b0b10-2324-47a1-a2d3-9af871f9ae69 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 2e3b0b10-2324-47a1-a2d3-9af871f9ae69 --json --out output.json 2020-12-10 08:10:14,372 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 2e3b0b10-2324-47a1-a2d3-9af871f9ae69 --out /home/opnfv/functest/results/rally_sanity/neutron.json 2020-12-10 08:10:14,380 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2020-12-10 08:10:14,405 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-10 08:10:15,401 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2020-12-10 08:12:39,144 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: 89c15cf4-34bb-45da-aad1-11610693939f 2020-12-10 08:12:40,583 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 89c15cf4-34bb-45da-aad1-11610693939f -------------------------------------------------------------------------------- Task 89c15cf4-34bb-45da-aad1-11610693939f: aborted -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_live_migrate_server args position 0 args values: { "args": { "flavor": { "name": "rally_sanity-flavor_1e1af09b-2259-4534-a0b7-642d83342a10" }, "image": { "name": "rally_sanity-img_1e1af09b-2259-4534-a0b7-642d83342a10" }, "block_migration": false, "nics": [ { "net-id": "da96e3b6-a11e-49cb-aeac-d2957051a0c9" } ] }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 89c15cf4-34bb-45da-aad1-11610693939f has 1 error(s) -------------------------------------------------------------------------------- BadRequest: Migration pre-check error: Instance has an associated NUMA topology. Instance NUMA topologies, including related attributes such as CPU pinning, huge page and emulator thread pinning information, are not currently recalculated on live migration. See bug #1289064 for more information. (HTTP 400) (Request-ID: req-eaddb899-3182-498b-9086-a1efaf1bc3d0) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 720, in run self._live_migrate(server, block_migration, disk_over_commit) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 798, in _live_migrate disk_over_commit=disk_over_commit) File "/usr/lib/python3.6/site-packages/novaclient/api_versions.py", line 393, in substitution return methods[-1].func(obj, *args, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 438, in live_migrate disk_over_commit) File "/usr/lib/python3.6/site-packages/novaclient/api_versions.py", line 393, in substitution return methods[-1].func(obj, *args, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1742, in live_migrate force=None) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1726, in _live_migrate return self._action('os-migrateLive', server, body) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: Migration pre-check error: Instance has an associated NUMA topology. Instance NUMA topologies, including related attributes such as CPU pinning, huge page and emulator thread pinning information, are not currently recalculated on live migration. See bug #1289064 for more information. (HTTP 400) (Request-ID: req-eaddb899-3182-498b-9086-a1efaf1bc3d0) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 40.347 | 40.347 | 40.347 | 40.347 | 40.347 | 40.347 | 100.0% | 1 | | nova.live_migrate | 14.119 | 14.119 | 14.119 | 14.119 | 14.119 | 14.119 | 0.0% | 1 | | -> nova.list_hypervisors | 0.732 | 0.732 | 0.732 | 0.732 | 0.732 | 0.732 | 100.0% | 1 | | total | 54.466 | 54.466 | 54.466 | 54.466 | 54.466 | 54.466 | 0.0% | 1 | | -> duration | 53.466 | 53.466 | 53.466 | 53.466 | 53.466 | 53.466 | 0.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 53.465964 Full duration: 100.040742 HINTS: * To plot HTML graphics with this data, run: rally task report 89c15cf4-34bb-45da-aad1-11610693939f --out output.html * To generate a JUnit report, run: rally task export 89c15cf4-34bb-45da-aad1-11610693939f --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 89c15cf4-34bb-45da-aad1-11610693939f --json --out output.json At least one workload did not pass SLA criteria. 2020-12-10 08:12:43,915 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 89c15cf4-34bb-45da-aad1-11610693939f --out /home/opnfv/functest/results/rally_sanity/nova.json 2020-12-10 08:12:43,917 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2020-12-10 08:12:43,949 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-10 08:12:44,138 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2020-12-10 08:14:25,688 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: 5b7e0b98-0d56-4be4-a3bc-28318d866e57 2020-12-10 08:14:27,051 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 5b7e0b98-0d56-4be4-a3bc-28318d866e57 -------------------------------------------------------------------------------- Task 5b7e0b98-0d56-4be4-a3bc-28318d866e57: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5b7e0b98-0d56-4be4-a3bc-28318d866e57 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 4.28 | 4.28 | 4.28 | 4.28 | 4.28 | 4.28 | 100.0% | 1 | | quotas.delete_quotas | 0.222 | 0.222 | 0.222 | 0.222 | 0.222 | 0.222 | 100.0% | 1 | | total | 4.502 | 4.502 | 4.502 | 4.502 | 4.502 | 4.502 | 100.0% | 1 | | -> duration | 4.502 | 4.502 | 4.502 | 4.502 | 4.502 | 4.502 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.502274 Full duration: 21.96078 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5b7e0b98-0d56-4be4-a3bc-28318d866e57 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 5.367 | 5.367 | 5.367 | 5.367 | 5.367 | 5.367 | 100.0% | 1 | | total | 5.367 | 5.367 | 5.367 | 5.367 | 5.367 | 5.367 | 100.0% | 1 | | -> duration | 5.367 | 5.367 | 5.367 | 5.367 | 5.367 | 5.367 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.367131 Full duration: 26.315086 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5b7e0b98-0d56-4be4-a3bc-28318d866e57 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 4.672 | 4.672 | 4.672 | 4.672 | 4.672 | 4.672 | 100.0% | 1 | | total | 4.672 | 4.672 | 4.672 | 4.672 | 4.672 | 4.672 | 100.0% | 1 | | -> duration | 4.672 | 4.672 | 4.672 | 4.672 | 4.672 | 4.672 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.672471 Full duration: 18.164134 HINTS: * To plot HTML graphics with this data, run: rally task report 5b7e0b98-0d56-4be4-a3bc-28318d866e57 --out output.html * To generate a JUnit report, run: rally task export 5b7e0b98-0d56-4be4-a3bc-28318d866e57 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 5b7e0b98-0d56-4be4-a3bc-28318d866e57 --json --out output.json 2020-12-10 08:14:30,279 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 5b7e0b98-0d56-4be4-a3bc-28318d866e57 --out /home/opnfv/functest/results/rally_sanity/quotas.json 2020-12-10 08:14:30,283 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2020-12-10 08:14:30,323 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-10 08:14:30,501 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2020-12-10 08:18:21,488 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: 413640a9-38b8-4457-be8c-ba019b9f0a4a 2020-12-10 08:18:22,834 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 413640a9-38b8-4457-be8c-ba019b9f0a4a -------------------------------------------------------------------------------- Task 413640a9-38b8-4457-be8c-ba019b9f0a4a: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 413640a9-38b8-4457-be8c-ba019b9f0a4a has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.764 | 1.764 | 1.764 | 1.764 | 1.764 | 1.764 | 100.0% | 1 | | swift.upload_object (x2) | 1.306 | 1.306 | 1.306 | 1.306 | 1.306 | 1.306 | 100.0% | 1 | | swift.list_objects | 1.044 | 1.044 | 1.044 | 1.044 | 1.044 | 1.044 | 100.0% | 1 | | total | 4.115 | 4.115 | 4.115 | 4.115 | 4.115 | 4.115 | 100.0% | 1 | | -> duration | 4.115 | 4.115 | 4.115 | 4.115 | 4.115 | 4.115 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.114933 Full duration: 38.587613 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 413640a9-38b8-4457-be8c-ba019b9f0a4a has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.517 | 1.517 | 1.517 | 1.517 | 1.517 | 1.517 | 100.0% | 1 | | swift.list_objects | 1.016 | 1.016 | 1.016 | 1.016 | 1.016 | 1.016 | 100.0% | 1 | | total | 2.533 | 2.533 | 2.533 | 2.533 | 2.533 | 2.533 | 100.0% | 1 | | -> duration | 2.533 | 2.533 | 2.533 | 2.533 | 2.533 | 2.533 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.532764 Full duration: 42.58863 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 413640a9-38b8-4457-be8c-ba019b9f0a4a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.321 | 1.321 | 1.321 | 1.321 | 1.321 | 1.321 | 100.0% | 1 | | swift.upload_object (x5) | 2.863 | 2.863 | 2.863 | 2.863 | 2.863 | 2.863 | 100.0% | 1 | | swift.download_object (x5) | 2.385 | 2.385 | 2.385 | 2.385 | 2.385 | 2.385 | 100.0% | 1 | | total | 6.571 | 6.571 | 6.571 | 6.571 | 6.571 | 6.571 | 100.0% | 1 | | -> duration | 6.571 | 6.571 | 6.571 | 6.571 | 6.571 | 6.571 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.570698 Full duration: 40.603936 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 413640a9-38b8-4457-be8c-ba019b9f0a4a has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.272 | 1.272 | 1.272 | 1.272 | 1.272 | 1.272 | 100.0% | 1 | | swift.upload_object (x5) | 6.706 | 6.706 | 6.706 | 6.706 | 6.706 | 6.706 | 100.0% | 1 | | swift.delete_object (x5) | 2.782 | 2.782 | 2.782 | 2.782 | 2.782 | 2.782 | 100.0% | 1 | | swift.delete_container | 0.529 | 0.529 | 0.529 | 0.529 | 0.529 | 0.529 | 100.0% | 1 | | total | 11.29 | 11.29 | 11.29 | 11.29 | 11.29 | 11.29 | 100.0% | 1 | | -> duration | 11.29 | 11.29 | 11.29 | 11.29 | 11.29 | 11.29 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.289778 Full duration: 34.614884 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 413640a9-38b8-4457-be8c-ba019b9f0a4a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.273 | 1.273 | 1.273 | 1.273 | 1.273 | 1.273 | 100.0% | 1 | | swift.list_objects | 0.897 | 0.897 | 0.897 | 0.897 | 0.897 | 0.897 | 100.0% | 1 | | swift.download_object (x5) | 2.291 | 2.291 | 2.291 | 2.291 | 2.291 | 2.291 | 100.0% | 1 | | total | 4.46 | 4.46 | 4.46 | 4.46 | 4.46 | 4.46 | 100.0% | 1 | | -> duration | 4.46 | 4.46 | 4.46 | 4.46 | 4.46 | 4.46 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.460213 Full duration: 33.41901 HINTS: * To plot HTML graphics with this data, run: rally task report 413640a9-38b8-4457-be8c-ba019b9f0a4a --out output.html * To generate a JUnit report, run: rally task export 413640a9-38b8-4457-be8c-ba019b9f0a4a --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 413640a9-38b8-4457-be8c-ba019b9f0a4a --json --out output.json 2020-12-10 08:18:26,088 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 413640a9-38b8-4457-be8c-ba019b9f0a4a --out /home/opnfv/functest/results/rally_sanity/swift.json 2020-12-10 08:18:26,095 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2020-12-10 08:18:26,101 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:01:14 | 6 | 100.00% | | glance | 00:02:53 | 4 | 100.00% | | cinder | 00:04:43 | 10 | 100.00% | | heat | 00:04:51 | 4 | 100.00% | | keystone | 00:06:16 | 11 | 100.00% | | neutron | 00:05:59 | 8 | 100.00% | | nova | 00:01:40 | 1 | 0.00% | | quotas | 00:01:06 | 3 | 100.00% | | swift | 00:03:09 | 5 | 100.00% | | | | | | | TOTAL: | 00:31:56 | 52 | 98.08% | +----------------+------------+----------------+-----------+ 2020-12-10 08:18:26,101 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_sanity' success_rate is 98.08% in 8/9 modules 2020-12-10 08:18:29,703 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_sanity/rally_sanity.html 2020-12-10 08:18:33,168 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_sanity/rally_sanity.xml 2020-12-10 08:18:33,169 - xtesting.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | rally_sanity | functest | 38:41 | FAIL | +----------------------+------------------+------------------+----------------+