2021-01-02 07:39:53,790 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | ID94RKM5V0CO | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/ID94RKM5V0CO/airs | | | hip-opnfv-functest-smoke-latest-rally_sanity- | | | run-197 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/ID94RKM5V0CO/ai | | | rship-opnfv-functest-smoke-latest-rally_sanity- | | | run-197 | +-------------------------+------------------------------------------------------------+ 2021-01-02 07:39:53,859 - xtesting.ci.run_tests - INFO - Loading test case 'rally_sanity'... 2021-01-02 07:39:56,966 - xtesting.ci.run_tests - INFO - Running test case 'rally_sanity'... 2021-01-02 07:40:01,517 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2021-01-02 07:40:08,322 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 47bb6df0-53dd-4804-9ec7-df706c119e45 | 2021-01-02T07:40:08.056964 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 47bb6df0-53dd-4804-9ec7-df706c119e45 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2021-01-02 07:40:13,685 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2021-01-02 07:40:15,640 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-01-02 07:40:15,808 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2021-01-02 07:41:44,055 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: dfc661b5-9287-4cb0-860b-a794c7314c7e 2021-01-02 07:41:45,458 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid dfc661b5-9287-4cb0-860b-a794c7314c7e -------------------------------------------------------------------------------- Task dfc661b5-9287-4cb0-860b-a794c7314c7e: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dfc661b5-9287-4cb0-860b-a794c7314c7e has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 1.121 | 1.121 | 1.121 | 1.121 | 1.121 | 1.121 | 100.0% | 1 | | total | 1.121 | 1.121 | 1.121 | 1.121 | 1.121 | 1.121 | 100.0% | 1 | | -> duration | 1.121 | 1.121 | 1.121 | 1.121 | 1.121 | 1.121 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.121349 Full duration: 12.136917 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dfc661b5-9287-4cb0-860b-a794c7314c7e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.436 | 0.436 | 0.436 | 0.436 | 0.436 | 0.436 | 100.0% | 1 | | total | 1.066 | 1.066 | 1.066 | 1.066 | 1.066 | 1.066 | 100.0% | 1 | | -> duration | 1.066 | 1.066 | 1.066 | 1.066 | 1.066 | 1.066 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.065535 Full duration: 10.030684 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dfc661b5-9287-4cb0-860b-a794c7314c7e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.38 | 0.38 | 0.38 | 0.38 | 0.38 | 0.38 | 100.0% | 1 | | total | 1.006 | 1.006 | 1.006 | 1.006 | 1.006 | 1.006 | 100.0% | 1 | | -> duration | 1.006 | 1.006 | 1.006 | 1.006 | 1.006 | 1.006 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.006389 Full duration: 10.413535 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dfc661b5-9287-4cb0-860b-a794c7314c7e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.326 | 0.326 | 0.326 | 0.326 | 0.326 | 0.326 | 100.0% | 1 | | total | 1.007 | 1.007 | 1.007 | 1.007 | 1.007 | 1.007 | 100.0% | 1 | | -> duration | 1.007 | 1.007 | 1.007 | 1.007 | 1.007 | 1.007 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.007257 Full duration: 10.416427 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dfc661b5-9287-4cb0-860b-a794c7314c7e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.522 | 0.522 | 0.522 | 0.522 | 0.522 | 0.522 | 100.0% | 1 | | total | 1.116 | 1.116 | 1.116 | 1.116 | 1.116 | 1.116 | 100.0% | 1 | | -> duration | 1.116 | 1.116 | 1.116 | 1.116 | 1.116 | 1.116 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.115919 Full duration: 10.900179 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task dfc661b5-9287-4cb0-860b-a794c7314c7e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.339 | 0.339 | 0.339 | 0.339 | 0.339 | 0.339 | 100.0% | 1 | | total | 0.992 | 0.992 | 0.992 | 0.992 | 0.992 | 0.992 | 100.0% | 1 | | -> duration | 0.992 | 0.992 | 0.992 | 0.992 | 0.992 | 0.992 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.992457 Full duration: 11.203502 HINTS: * To plot HTML graphics with this data, run: rally task report dfc661b5-9287-4cb0-860b-a794c7314c7e --out output.html * To generate a JUnit report, run: rally task export dfc661b5-9287-4cb0-860b-a794c7314c7e --type junit --to output.xml * To get raw JSON output of task results, run: rally task report dfc661b5-9287-4cb0-860b-a794c7314c7e --json --out output.json 2021-01-02 07:41:48,669 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid dfc661b5-9287-4cb0-860b-a794c7314c7e --out /home/opnfv/functest/results/rally_sanity/authenticate.json 2021-01-02 07:41:48,675 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2021-01-02 07:41:48,705 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-01-02 07:41:48,875 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2021-01-02 07:44:03,858 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: 2c1a2008-bdec-46ab-85a0-c03a7d0b2ee5 2021-01-02 07:44:05,225 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 2c1a2008-bdec-46ab-85a0-c03a7d0b2ee5 -------------------------------------------------------------------------------- Task 2c1a2008-bdec-46ab-85a0-c03a7d0b2ee5: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2c1a2008-bdec-46ab-85a0-c03a7d0b2ee5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.32 | 5.32 | 5.32 | 5.32 | 5.32 | 5.32 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.104 | 0.104 | 0.104 | 0.104 | 0.104 | 0.104 | 100.0% | 1 | | -> glance_v2.upload_data | 2.637 | 2.637 | 2.637 | 2.637 | 2.637 | 2.637 | 100.0% | 1 | | glance_v2.delete_image | 1.831 | 1.831 | 1.831 | 1.831 | 1.831 | 1.831 | 100.0% | 1 | | total | 7.152 | 7.152 | 7.152 | 7.152 | 7.152 | 7.152 | 100.0% | 1 | | -> duration | 7.152 | 7.152 | 7.152 | 7.152 | 7.152 | 7.152 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.15156 Full duration: 20.405762 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2c1a2008-bdec-46ab-85a0-c03a7d0b2ee5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.938 | 4.938 | 4.938 | 4.938 | 4.938 | 4.938 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.099 | 0.099 | 0.099 | 0.099 | 0.099 | 0.099 | 100.0% | 1 | | -> glance_v2.upload_data | 2.531 | 2.531 | 2.531 | 2.531 | 2.531 | 2.531 | 100.0% | 1 | | glance_v2.list_images | 0.059 | 0.059 | 0.059 | 0.059 | 0.059 | 0.059 | 100.0% | 1 | | total | 4.997 | 4.997 | 4.997 | 4.997 | 4.997 | 4.997 | 100.0% | 1 | | -> duration | 4.997 | 4.997 | 4.997 | 4.997 | 4.997 | 4.997 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.997499 Full duration: 21.023992 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2c1a2008-bdec-46ab-85a0-c03a7d0b2ee5 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.237 | 0.237 | 0.237 | 0.237 | 0.237 | 0.237 | 100.0% | 1 | | total | 0.237 | 0.237 | 0.237 | 0.237 | 0.237 | 0.237 | 100.0% | 1 | | -> duration | 0.237 | 0.237 | 0.237 | 0.237 | 0.237 | 0.237 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.236912 Full duration: 9.267647 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_sanity-flavor_dec3f21f-3b9b-4eaa-a731-6fc267e732eb" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "2fd9f975-1a92-43a0-b1da-438cec8bdd99" } ] } }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 2c1a2008-bdec-46ab-85a0-c03a7d0b2ee5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 6.097 | 6.097 | 6.097 | 6.097 | 6.097 | 6.097 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.087 | 0.087 | 0.087 | 0.087 | 0.087 | 0.087 | 100.0% | 1 | | -> glance_v2.upload_data | 3.609 | 3.609 | 3.609 | 3.609 | 3.609 | 3.609 | 100.0% | 1 | | nova.boot_servers | 26.242 | 26.242 | 26.242 | 26.242 | 26.242 | 26.242 | 100.0% | 1 | | total | 32.339 | 32.339 | 32.339 | 32.339 | 32.339 | 32.339 | 100.0% | 1 | | -> duration | 31.339 | 31.339 | 31.339 | 31.339 | 31.339 | 31.339 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 31.339288 Full duration: 62.018176 HINTS: * To plot HTML graphics with this data, run: rally task report 2c1a2008-bdec-46ab-85a0-c03a7d0b2ee5 --out output.html * To generate a JUnit report, run: rally task export 2c1a2008-bdec-46ab-85a0-c03a7d0b2ee5 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 2c1a2008-bdec-46ab-85a0-c03a7d0b2ee5 --json --out output.json 2021-01-02 07:44:08,507 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 2c1a2008-bdec-46ab-85a0-c03a7d0b2ee5 --out /home/opnfv/functest/results/rally_sanity/glance.json 2021-01-02 07:44:08,509 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2021-01-02 07:44:08,528 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-01-02 07:44:08,668 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2021-01-02 07:48:21,572 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: e02b425f-a531-413c-98d4-f54d5a1cfcc8 2021-01-02 07:48:22,933 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid e02b425f-a531-413c-98d4-f54d5a1cfcc8 -------------------------------------------------------------------------------- Task e02b425f-a531-413c-98d4-f54d5a1cfcc8: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e02b425f-a531-413c-98d4-f54d5a1cfcc8 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 6.925 | 6.925 | 6.925 | 6.925 | 6.925 | 6.925 | 100.0% | 1 | | cinder_v3.delete_snapshot | 2.306 | 2.306 | 2.306 | 2.306 | 2.306 | 2.306 | 100.0% | 1 | | total | 9.231 | 9.231 | 9.231 | 9.231 | 9.231 | 9.231 | 100.0% | 1 | | -> duration | 9.231 | 9.231 | 9.231 | 9.231 | 9.231 | 9.231 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.230873 Full duration: 29.83865 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e02b425f-a531-413c-98d4-f54d5a1cfcc8 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.574 | 3.574 | 3.574 | 3.574 | 3.574 | 3.574 | 100.0% | 1 | | cinder_v3.delete_volume | 3.722 | 3.722 | 3.722 | 3.722 | 3.722 | 3.722 | 100.0% | 1 | | total | 7.297 | 7.297 | 7.297 | 7.297 | 7.297 | 7.297 | 100.0% | 1 | | -> duration | 7.297 | 7.297 | 7.297 | 7.297 | 7.297 | 7.297 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.296843 Full duration: 19.772186 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_sanity-img_dec3f21f-3b9b-4eaa-a731-6fc267e732eb" }, "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e02b425f-a531-413c-98d4-f54d5a1cfcc8 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 15.023 | 15.023 | 15.023 | 15.023 | 15.023 | 15.023 | 100.0% | 1 | | cinder_v3.delete_volume | 2.359 | 2.359 | 2.359 | 2.359 | 2.359 | 2.359 | 100.0% | 1 | | total | 17.382 | 17.382 | 17.382 | 17.382 | 17.382 | 17.382 | 100.0% | 1 | | -> duration | 17.382 | 17.382 | 17.382 | 17.382 | 17.382 | 17.382 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.382182 Full duration: 32.435796 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e02b425f-a531-413c-98d4-f54d5a1cfcc8 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.201 | 4.201 | 4.201 | 4.201 | 4.201 | 4.201 | 100.0% | 1 | | cinder_v3.delete_volume | 3.082 | 3.082 | 3.082 | 3.082 | 3.082 | 3.082 | 100.0% | 1 | | total | 7.282 | 7.282 | 7.282 | 7.282 | 7.282 | 7.282 | 100.0% | 1 | | -> duration | 7.282 | 7.282 | 7.282 | 7.282 | 7.282 | 7.282 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.282438 Full duration: 21.763015 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e02b425f-a531-413c-98d4-f54d5a1cfcc8 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.72 | 3.72 | 3.72 | 3.72 | 3.72 | 3.72 | 100.0% | 1 | | cinder_v3.extend_volume | 4.253 | 4.253 | 4.253 | 4.253 | 4.253 | 4.253 | 100.0% | 1 | | cinder_v3.delete_volume | 2.532 | 2.532 | 2.532 | 2.532 | 2.532 | 2.532 | 100.0% | 1 | | total | 10.506 | 10.506 | 10.506 | 10.506 | 10.506 | 10.506 | 100.0% | 1 | | -> duration | 10.506 | 10.506 | 10.506 | 10.506 | 10.506 | 10.506 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.505979 Full duration: 29.862366 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e02b425f-a531-413c-98d4-f54d5a1cfcc8 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.883 | 3.883 | 3.883 | 3.883 | 3.883 | 3.883 | 100.0% | 1 | | cinder_v3.delete_volume | 2.468 | 2.468 | 2.468 | 2.468 | 2.468 | 2.468 | 100.0% | 1 | | total | 6.352 | 6.352 | 6.352 | 6.352 | 6.352 | 6.352 | 100.0% | 1 | | -> duration | 6.352 | 6.352 | 6.352 | 6.352 | 6.352 | 6.352 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.352321 Full duration: 28.047078 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e02b425f-a531-413c-98d4-f54d5a1cfcc8 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 1.398 | 1.398 | 1.398 | 1.398 | 1.398 | 1.398 | 100.0% | 1 | | cinder_v3.list_qos | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 0.041 | 100.0% | 1 | | total | 1.439 | 1.439 | 1.439 | 1.439 | 1.439 | 1.439 | 100.0% | 1 | | -> duration | 1.439 | 1.439 | 1.439 | 1.439 | 1.439 | 1.439 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.439495 Full duration: 17.197372 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e02b425f-a531-413c-98d4-f54d5a1cfcc8 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.653 | 0.653 | 0.653 | 0.653 | 0.653 | 0.653 | 100.0% | 1 | | cinder_v3.set_qos | 0.472 | 0.472 | 0.472 | 0.472 | 0.472 | 0.472 | 100.0% | 1 | | total | 1.126 | 1.126 | 1.126 | 1.126 | 1.126 | 1.126 | 100.0% | 1 | | -> duration | 1.126 | 1.126 | 1.126 | 1.126 | 1.126 | 1.126 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.12573 Full duration: 16.067161 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e02b425f-a531-413c-98d4-f54d5a1cfcc8 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.897 | 0.897 | 0.897 | 0.897 | 0.897 | 0.897 | 100.0% | 1 | | cinder_v3.list_types | 0.045 | 0.045 | 0.045 | 0.045 | 0.045 | 0.045 | 100.0% | 1 | | total | 0.942 | 0.942 | 0.942 | 0.942 | 0.942 | 0.942 | 100.0% | 1 | | -> duration | 0.942 | 0.942 | 0.942 | 0.942 | 0.942 | 0.942 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.94232 Full duration: 13.610744 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e02b425f-a531-413c-98d4-f54d5a1cfcc8 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.988 | 0.988 | 0.988 | 0.988 | 0.988 | 0.988 | 100.0% | 1 | | cinder_v3.create_encryption_type | 0.1 | 0.1 | 0.1 | 0.1 | 0.1 | 0.1 | 100.0% | 1 | | total | 1.088 | 1.088 | 1.088 | 1.088 | 1.088 | 1.088 | 100.0% | 1 | | -> duration | 1.088 | 1.088 | 1.088 | 1.088 | 1.088 | 1.088 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.087816 Full duration: 14.534916 HINTS: * To plot HTML graphics with this data, run: rally task report e02b425f-a531-413c-98d4-f54d5a1cfcc8 --out output.html * To generate a JUnit report, run: rally task export e02b425f-a531-413c-98d4-f54d5a1cfcc8 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report e02b425f-a531-413c-98d4-f54d5a1cfcc8 --json --out output.json 2021-01-02 07:48:26,275 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid e02b425f-a531-413c-98d4-f54d5a1cfcc8 --out /home/opnfv/functest/results/rally_sanity/cinder.json 2021-01-02 07:48:26,291 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2021-01-02 07:48:26,320 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-01-02 07:48:26,711 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2021-01-02 07:51:24,887 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: 76588143-08e2-489a-a7d6-a6fd9cc78e6e 2021-01-02 07:51:26,240 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 76588143-08e2-489a-a7d6-a6fd9cc78e6e -------------------------------------------------------------------------------- Task 76588143-08e2-489a-a7d6-a6fd9cc78e6e: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 76588143-08e2-489a-a7d6-a6fd9cc78e6e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 12.117 | 12.117 | 12.117 | 12.117 | 12.117 | 12.117 | 100.0% | 1 | | heat.update_stack | 11.919 | 11.919 | 11.919 | 11.919 | 11.919 | 11.919 | 100.0% | 1 | | heat.delete_stack | 11.014 | 11.014 | 11.014 | 11.014 | 11.014 | 11.014 | 100.0% | 1 | | total | 35.05 | 35.05 | 35.05 | 35.05 | 35.05 | 35.05 | 100.0% | 1 | | -> duration | 31.05 | 31.05 | 31.05 | 31.05 | 31.05 | 31.05 | 100.0% | 1 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 31.050434 Full duration: 51.941904 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 76588143-08e2-489a-a7d6-a6fd9cc78e6e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 8.033 | 8.033 | 8.033 | 8.033 | 8.033 | 8.033 | 100.0% | 1 | | heat.check_stack | 1.582 | 1.582 | 1.582 | 1.582 | 1.582 | 1.582 | 100.0% | 1 | | heat.delete_stack | 6.165 | 6.165 | 6.165 | 6.165 | 6.165 | 6.165 | 100.0% | 1 | | total | 15.78 | 15.78 | 15.78 | 15.78 | 15.78 | 15.78 | 100.0% | 1 | | -> duration | 13.78 | 13.78 | 13.78 | 13.78 | 13.78 | 13.78 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.779998 Full duration: 32.380533 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 76588143-08e2-489a-a7d6-a6fd9cc78e6e has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 12.756 | 12.756 | 12.756 | 12.756 | 12.756 | 12.756 | 100.0% | 1 | | heat.suspend_stack | 3.986 | 3.986 | 3.986 | 3.986 | 3.986 | 3.986 | 100.0% | 1 | | heat.resume_stack | 2.81 | 2.81 | 2.81 | 2.81 | 2.81 | 2.81 | 100.0% | 1 | | heat.delete_stack | 3.212 | 3.212 | 3.212 | 3.212 | 3.212 | 3.212 | 100.0% | 1 | | total | 22.765 | 22.765 | 22.765 | 22.765 | 22.765 | 22.765 | 100.0% | 1 | | -> duration | 20.765 | 20.765 | 20.765 | 20.765 | 20.765 | 20.765 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.764971 Full duration: 40.907956 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 76588143-08e2-489a-a7d6-a6fd9cc78e6e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.776 | 0.776 | 0.776 | 0.776 | 0.776 | 0.776 | 100.0% | 1 | | total | 0.776 | 0.776 | 0.776 | 0.776 | 0.776 | 0.776 | 100.0% | 1 | | -> duration | 0.776 | 0.776 | 0.776 | 0.776 | 0.776 | 0.776 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.776346 Full duration: 16.287733 HINTS: * To plot HTML graphics with this data, run: rally task report 76588143-08e2-489a-a7d6-a6fd9cc78e6e --out output.html * To generate a JUnit report, run: rally task export 76588143-08e2-489a-a7d6-a6fd9cc78e6e --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 76588143-08e2-489a-a7d6-a6fd9cc78e6e --json --out output.json 2021-01-02 07:51:29,532 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 76588143-08e2-489a-a7d6-a6fd9cc78e6e --out /home/opnfv/functest/results/rally_sanity/heat.json 2021-01-02 07:51:29,536 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2021-01-02 07:51:29,569 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-01-02 07:51:29,930 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2021-01-02 07:56:08,449 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: 4f604715-079b-4b7d-86c6-48a86ad6e859 2021-01-02 07:56:09,883 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 4f604715-079b-4b7d-86c6-48a86ad6e859 -------------------------------------------------------------------------------- Task 4f604715-079b-4b7d-86c6-48a86ad6e859: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4f604715-079b-4b7d-86c6-48a86ad6e859 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.138 | 0.138 | 0.138 | 0.138 | 0.138 | 0.138 | 100.0% | 1 | | keystone_v3.add_role | 0.244 | 0.244 | 0.244 | 0.244 | 0.244 | 0.244 | 100.0% | 1 | | keystone_v3.revoke_role | 0.446 | 0.446 | 0.446 | 0.446 | 0.446 | 0.446 | 100.0% | 1 | | total | 0.828 | 0.828 | 0.828 | 0.828 | 0.828 | 0.828 | 100.0% | 1 | | -> duration | 0.828 | 0.828 | 0.828 | 0.828 | 0.828 | 0.828 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.828457 Full duration: 19.670667 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4f604715-079b-4b7d-86c6-48a86ad6e859 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.222 | 0.222 | 0.222 | 0.222 | 0.222 | 0.222 | 100.0% | 1 | | keystone_v3.add_role | 0.484 | 0.484 | 0.484 | 0.484 | 0.484 | 0.484 | 100.0% | 1 | | keystone_v3.list_roles | 0.146 | 0.146 | 0.146 | 0.146 | 0.146 | 0.146 | 100.0% | 1 | | total | 0.853 | 0.853 | 0.853 | 0.853 | 0.853 | 0.853 | 100.0% | 1 | | -> duration | 0.853 | 0.853 | 0.853 | 0.853 | 0.853 | 0.853 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.853169 Full duration: 24.876066 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4f604715-079b-4b7d-86c6-48a86ad6e859 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.328 | 0.328 | 0.328 | 0.328 | 0.328 | 0.328 | 100.0% | 1 | | keystone_v3.list_projects | 0.124 | 0.124 | 0.124 | 0.124 | 0.124 | 0.124 | 100.0% | 1 | | total | 0.452 | 0.452 | 0.452 | 0.452 | 0.452 | 0.452 | 100.0% | 1 | | -> duration | 0.452 | 0.452 | 0.452 | 0.452 | 0.452 | 0.452 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.451627 Full duration: 21.505704 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4f604715-079b-4b7d-86c6-48a86ad6e859 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.415 | 0.415 | 0.415 | 0.415 | 0.415 | 0.415 | 100.0% | 1 | | keystone_v3.delete_role | 0.17 | 0.17 | 0.17 | 0.17 | 0.17 | 0.17 | 100.0% | 1 | | total | 0.585 | 0.585 | 0.585 | 0.585 | 0.585 | 0.585 | 100.0% | 1 | | -> duration | 0.585 | 0.585 | 0.585 | 0.585 | 0.585 | 0.585 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.584657 Full duration: 17.327598 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4f604715-079b-4b7d-86c6-48a86ad6e859 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.188 | 0.188 | 0.188 | 0.188 | 0.188 | 0.188 | 100.0% | 1 | | keystone_v3.delete_service | 0.718 | 0.718 | 0.718 | 0.718 | 0.718 | 0.718 | 100.0% | 1 | | total | 0.905 | 0.905 | 0.905 | 0.905 | 0.905 | 0.905 | 100.0% | 1 | | -> duration | 0.905 | 0.905 | 0.905 | 0.905 | 0.905 | 0.905 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.905428 Full duration: 18.524412 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4f604715-079b-4b7d-86c6-48a86ad6e859 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.271 | 0.271 | 0.271 | 0.271 | 0.271 | 0.271 | 100.0% | 1 | | keystone_v3.create_user | 0.852 | 0.852 | 0.852 | 0.852 | 0.852 | 0.852 | 100.0% | 1 | | -> keystone_v3.list_roles | 0.059 | 0.059 | 0.059 | 0.059 | 0.059 | 0.059 | 100.0% | 1 | | -> keystone_v3.add_role | 0.113 | 0.113 | 0.113 | 0.113 | 0.113 | 0.113 | 100.0% | 1 | | keystone_v3.create_role | 0.235 | 0.235 | 0.235 | 0.235 | 0.235 | 0.235 | 100.0% | 1 | | keystone_v3.get_project | 0.036 | 0.036 | 0.036 | 0.036 | 0.036 | 0.036 | 100.0% | 1 | | keystone_v3.get_user | 0.036 | 0.036 | 0.036 | 0.036 | 0.036 | 0.036 | 100.0% | 1 | | keystone_v3.get_role | 0.038 | 0.038 | 0.038 | 0.038 | 0.038 | 0.038 | 100.0% | 1 | | keystone_v3.list_services | 0.04 | 0.04 | 0.04 | 0.04 | 0.04 | 0.04 | 100.0% | 1 | | keystone_v3.get_services | 0.047 | 0.047 | 0.047 | 0.047 | 0.047 | 0.047 | 100.0% | 1 | | total | 1.679 | 1.679 | 1.679 | 1.679 | 1.679 | 1.679 | 100.0% | 1 | | -> duration | 1.679 | 1.679 | 1.679 | 1.679 | 1.679 | 1.679 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.678937 Full duration: 28.685781 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4f604715-079b-4b7d-86c6-48a86ad6e859 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.654 | 0.654 | 0.654 | 0.654 | 0.654 | 0.654 | 100.0% | 1 | | keystone_v3.update_project | 0.439 | 0.439 | 0.439 | 0.439 | 0.439 | 0.439 | 100.0% | 1 | | keystone_v3.delete_project | 0.3 | 0.3 | 0.3 | 0.3 | 0.3 | 0.3 | 100.0% | 1 | | total | 1.394 | 1.394 | 1.394 | 1.394 | 1.394 | 1.394 | 100.0% | 1 | | -> duration | 1.394 | 1.394 | 1.394 | 1.394 | 1.394 | 1.394 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.393856 Full duration: 18.150254 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4f604715-079b-4b7d-86c6-48a86ad6e859 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.307 | 0.307 | 0.307 | 0.307 | 0.307 | 0.307 | 100.0% | 1 | | total | 0.389 | 0.389 | 0.389 | 0.389 | 0.389 | 0.389 | 100.0% | 1 | | -> duration | 0.389 | 0.389 | 0.389 | 0.389 | 0.389 | 0.389 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.389104 Full duration: 20.567983 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4f604715-079b-4b7d-86c6-48a86ad6e859 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.396 | 0.396 | 0.396 | 0.396 | 0.396 | 0.396 | 100.0% | 1 | | total | 0.397 | 0.397 | 0.397 | 0.397 | 0.397 | 0.397 | 100.0% | 1 | | -> duration | 0.397 | 0.397 | 0.397 | 0.397 | 0.397 | 0.397 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.396583 Full duration: 19.77265 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4f604715-079b-4b7d-86c6-48a86ad6e859 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.333 | 0.333 | 0.333 | 0.333 | 0.333 | 0.333 | 100.0% | 1 | | keystone_v3.list_users | 0.07 | 0.07 | 0.07 | 0.07 | 0.07 | 0.07 | 100.0% | 1 | | total | 0.492 | 0.492 | 0.492 | 0.492 | 0.492 | 0.492 | 100.0% | 1 | | -> duration | 0.492 | 0.492 | 0.492 | 0.492 | 0.492 | 0.492 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.492024 Full duration: 19.112921 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4f604715-079b-4b7d-86c6-48a86ad6e859 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.553 | 0.553 | 0.553 | 0.553 | 0.553 | 0.553 | 100.0% | 1 | | keystone_v3.create_users | 9.022 | 9.022 | 9.022 | 9.022 | 9.022 | 9.022 | 100.0% | 1 | | -> keystone_v3.create_user (x10) | 9.021 | 9.021 | 9.021 | 9.021 | 9.021 | 9.021 | 100.0% | 1 | | --> keystone_v3.list_roles (x10) | 0.524 | 0.524 | 0.524 | 0.524 | 0.524 | 0.524 | 100.0% | 1 | | --> keystone_v3.add_role (x10) | 3.846 | 3.846 | 3.846 | 3.846 | 3.846 | 3.846 | 100.0% | 1 | | total | 10.039 | 10.039 | 10.039 | 10.039 | 10.039 | 10.039 | 100.0% | 1 | | -> duration | 10.039 | 10.039 | 10.039 | 10.039 | 10.039 | 10.039 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.038867 Full duration: 40.730082 HINTS: * To plot HTML graphics with this data, run: rally task report 4f604715-079b-4b7d-86c6-48a86ad6e859 --out output.html * To generate a JUnit report, run: rally task export 4f604715-079b-4b7d-86c6-48a86ad6e859 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 4f604715-079b-4b7d-86c6-48a86ad6e859 --json --out output.json 2021-01-02 07:56:13,138 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 4f604715-079b-4b7d-86c6-48a86ad6e859 --out /home/opnfv/functest/results/rally_sanity/keystone.json 2021-01-02 07:56:13,150 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2021-01-02 07:56:13,182 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-01-02 07:56:13,575 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2021-01-02 08:00:33,459 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: aad2d041-fdfd-42db-9f9d-3a5e2d415b8b 2021-01-02 08:00:34,833 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid aad2d041-fdfd-42db-9f9d-3a5e2d415b8b -------------------------------------------------------------------------------- Task aad2d041-fdfd-42db-9f9d-3a5e2d415b8b: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task aad2d041-fdfd-42db-9f9d-3a5e2d415b8b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 5.543 | 5.543 | 5.543 | 5.543 | 5.543 | 5.543 | 100.0% | 1 | | neutron.delete_network | 1.405 | 1.405 | 1.405 | 1.405 | 1.405 | 1.405 | 100.0% | 1 | | total | 6.948 | 6.948 | 6.948 | 6.948 | 6.948 | 6.948 | 100.0% | 1 | | -> duration | 6.948 | 6.948 | 6.948 | 6.948 | 6.948 | 6.948 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.947598 Full duration: 24.271086 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task aad2d041-fdfd-42db-9f9d-3a5e2d415b8b has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 4.122 | 4.122 | 4.122 | 4.122 | 4.122 | 4.122 | 100.0% | 1 | | neutron.delete_port | 2.73 | 2.73 | 2.73 | 2.73 | 2.73 | 2.73 | 100.0% | 1 | | total | 6.851 | 6.851 | 6.851 | 6.851 | 6.851 | 6.851 | 100.0% | 1 | | -> duration | 6.851 | 6.851 | 6.851 | 6.851 | 6.851 | 6.851 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.851413 Full duration: 32.944496 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task aad2d041-fdfd-42db-9f9d-3a5e2d415b8b has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 2.815 | 2.815 | 2.815 | 2.815 | 2.815 | 2.815 | 100.0% | 1 | | neutron.delete_subnet | 1.653 | 1.653 | 1.653 | 1.653 | 1.653 | 1.653 | 100.0% | 1 | | total | 4.469 | 4.469 | 4.469 | 4.469 | 4.469 | 4.469 | 100.0% | 1 | | -> duration | 4.469 | 4.469 | 4.469 | 4.469 | 4.469 | 4.469 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.468588 Full duration: 32.623145 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task aad2d041-fdfd-42db-9f9d-3a5e2d415b8b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.636 | 1.636 | 1.636 | 1.636 | 1.636 | 1.636 | 100.0% | 1 | | neutron.list_networks | 0.388 | 0.388 | 0.388 | 0.388 | 0.388 | 0.388 | 100.0% | 1 | | total | 2.024 | 2.024 | 2.024 | 2.024 | 2.024 | 2.024 | 100.0% | 1 | | -> duration | 2.024 | 2.024 | 2.024 | 2.024 | 2.024 | 2.024 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.024249 Full duration: 26.306674 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task aad2d041-fdfd-42db-9f9d-3a5e2d415b8b has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 3.0 | 3.0 | 3.0 | 3.0 | 3.0 | 3.0 | 100.0% | 1 | | neutron.list_ports | 0.112 | 0.112 | 0.112 | 0.112 | 0.112 | 0.112 | 100.0% | 1 | | total | 3.111 | 3.111 | 3.111 | 3.111 | 3.111 | 3.111 | 100.0% | 1 | | -> duration | 3.111 | 3.111 | 3.111 | 3.111 | 3.111 | 3.111 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.111427 Full duration: 32.375386 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task aad2d041-fdfd-42db-9f9d-3a5e2d415b8b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.481 | 2.481 | 2.481 | 2.481 | 2.481 | 2.481 | 100.0% | 1 | | neutron.create_subnet | 2.179 | 2.179 | 2.179 | 2.179 | 2.179 | 2.179 | 100.0% | 1 | | neutron.list_subnets | 0.082 | 0.082 | 0.082 | 0.082 | 0.082 | 0.082 | 100.0% | 1 | | total | 4.742 | 4.742 | 4.742 | 4.742 | 4.742 | 4.742 | 100.0% | 1 | | -> duration | 4.742 | 4.742 | 4.742 | 4.742 | 4.742 | 4.742 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.74184 Full duration: 30.686396 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task aad2d041-fdfd-42db-9f9d-3a5e2d415b8b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 2.561 | 2.561 | 2.561 | 2.561 | 2.561 | 2.561 | 100.0% | 1 | | neutron.delete_security_group | 0.41 | 0.41 | 0.41 | 0.41 | 0.41 | 0.41 | 100.0% | 1 | | total | 2.972 | 2.972 | 2.972 | 2.972 | 2.972 | 2.972 | 100.0% | 1 | | -> duration | 2.972 | 2.972 | 2.972 | 2.972 | 2.972 | 2.972 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.971527 Full duration: 23.071822 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task aad2d041-fdfd-42db-9f9d-3a5e2d415b8b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.929 | 1.929 | 1.929 | 1.929 | 1.929 | 1.929 | 100.0% | 1 | | neutron.create_security_group_rule | 1.091 | 1.091 | 1.091 | 1.091 | 1.091 | 1.091 | 100.0% | 1 | | neutron.delete_security_group_rule | 0.542 | 0.542 | 0.542 | 0.542 | 0.542 | 0.542 | 100.0% | 1 | | neutron.delete_security_group | 0.664 | 0.664 | 0.664 | 0.664 | 0.664 | 0.664 | 100.0% | 1 | | total | 4.226 | 4.226 | 4.226 | 4.226 | 4.226 | 4.226 | 100.0% | 1 | | -> duration | 4.226 | 4.226 | 4.226 | 4.226 | 4.226 | 4.226 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.225806 Full duration: 24.304793 HINTS: * To plot HTML graphics with this data, run: rally task report aad2d041-fdfd-42db-9f9d-3a5e2d415b8b --out output.html * To generate a JUnit report, run: rally task export aad2d041-fdfd-42db-9f9d-3a5e2d415b8b --type junit --to output.xml * To get raw JSON output of task results, run: rally task report aad2d041-fdfd-42db-9f9d-3a5e2d415b8b --json --out output.json 2021-01-02 08:00:38,101 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid aad2d041-fdfd-42db-9f9d-3a5e2d415b8b --out /home/opnfv/functest/results/rally_sanity/neutron.json 2021-01-02 08:00:38,110 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2021-01-02 08:00:38,143 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-01-02 08:00:38,280 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2021-01-02 08:02:14,172 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: 1201cd1e-80d5-4eb9-b59d-fb04f7570dd9 2021-01-02 08:02:15,521 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 1201cd1e-80d5-4eb9-b59d-fb04f7570dd9 -------------------------------------------------------------------------------- Task 1201cd1e-80d5-4eb9-b59d-fb04f7570dd9: aborted -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_live_migrate_server args position 0 args values: { "args": { "flavor": { "name": "rally_sanity-flavor_dec3f21f-3b9b-4eaa-a731-6fc267e732eb" }, "image": { "name": "rally_sanity-img_dec3f21f-3b9b-4eaa-a731-6fc267e732eb" }, "block_migration": false, "nics": [ { "net-id": "2fd9f975-1a92-43a0-b1da-438cec8bdd99" } ] }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1201cd1e-80d5-4eb9-b59d-fb04f7570dd9 has 1 error(s) -------------------------------------------------------------------------------- BadRequest: Migration pre-check error: Instance has an associated NUMA topology. Instance NUMA topologies, including related attributes such as CPU pinning, huge page and emulator thread pinning information, are not currently recalculated on live migration. See bug #1289064 for more information. (HTTP 400) (Request-ID: req-0a19409b-4d67-4df9-84b9-0cb6a400f4f4) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 720, in run self._live_migrate(server, block_migration, disk_over_commit) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 798, in _live_migrate disk_over_commit=disk_over_commit) File "/usr/lib/python3.6/site-packages/novaclient/api_versions.py", line 393, in substitution return methods[-1].func(obj, *args, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 438, in live_migrate disk_over_commit) File "/usr/lib/python3.6/site-packages/novaclient/api_versions.py", line 393, in substitution return methods[-1].func(obj, *args, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1742, in live_migrate force=None) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1726, in _live_migrate return self._action('os-migrateLive', server, body) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: Migration pre-check error: Instance has an associated NUMA topology. Instance NUMA topologies, including related attributes such as CPU pinning, huge page and emulator thread pinning information, are not currently recalculated on live migration. See bug #1289064 for more information. (HTTP 400) (Request-ID: req-0a19409b-4d67-4df9-84b9-0cb6a400f4f4) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 31.212 | 31.212 | 31.212 | 31.212 | 31.212 | 31.212 | 100.0% | 1 | | nova.live_migrate | 4.35 | 4.35 | 4.35 | 4.35 | 4.35 | 4.35 | 0.0% | 1 | | -> nova.list_hypervisors | 0.555 | 0.555 | 0.555 | 0.555 | 0.555 | 0.555 | 100.0% | 1 | | total | 35.563 | 35.563 | 35.563 | 35.563 | 35.563 | 35.563 | 0.0% | 1 | | -> duration | 34.563 | 34.563 | 34.563 | 34.563 | 34.563 | 34.563 | 0.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 34.56324 Full duration: 56.502399 HINTS: * To plot HTML graphics with this data, run: rally task report 1201cd1e-80d5-4eb9-b59d-fb04f7570dd9 --out output.html * To generate a JUnit report, run: rally task export 1201cd1e-80d5-4eb9-b59d-fb04f7570dd9 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 1201cd1e-80d5-4eb9-b59d-fb04f7570dd9 --json --out output.json At least one workload did not pass SLA criteria. 2021-01-02 08:02:18,661 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 1201cd1e-80d5-4eb9-b59d-fb04f7570dd9 --out /home/opnfv/functest/results/rally_sanity/nova.json 2021-01-02 08:02:18,664 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2021-01-02 08:02:18,694 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-01-02 08:02:19,088 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2021-01-02 08:03:18,869 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: 8b442d6f-3e28-46c4-8fee-4f6f550d5c97 2021-01-02 08:03:20,217 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 8b442d6f-3e28-46c4-8fee-4f6f550d5c97 -------------------------------------------------------------------------------- Task 8b442d6f-3e28-46c4-8fee-4f6f550d5c97: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8b442d6f-3e28-46c4-8fee-4f6f550d5c97 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.229 | 1.229 | 1.229 | 1.229 | 1.229 | 1.229 | 100.0% | 1 | | quotas.delete_quotas | 0.196 | 0.196 | 0.196 | 0.196 | 0.196 | 0.196 | 100.0% | 1 | | total | 1.425 | 1.425 | 1.425 | 1.425 | 1.425 | 1.425 | 100.0% | 1 | | -> duration | 1.425 | 1.425 | 1.425 | 1.425 | 1.425 | 1.425 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.425408 Full duration: 14.680992 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8b442d6f-3e28-46c4-8fee-4f6f550d5c97 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 2.698 | 2.698 | 2.698 | 2.698 | 2.698 | 2.698 | 100.0% | 1 | | total | 2.698 | 2.698 | 2.698 | 2.698 | 2.698 | 2.698 | 100.0% | 1 | | -> duration | 2.698 | 2.698 | 2.698 | 2.698 | 2.698 | 2.698 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.697556 Full duration: 13.798773 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 8b442d6f-3e28-46c4-8fee-4f6f550d5c97 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 2.199 | 2.199 | 2.199 | 2.199 | 2.199 | 2.199 | 100.0% | 1 | | total | 2.199 | 2.199 | 2.199 | 2.199 | 2.199 | 2.199 | 100.0% | 1 | | -> duration | 2.199 | 2.199 | 2.199 | 2.199 | 2.199 | 2.199 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.199039 Full duration: 11.83153 HINTS: * To plot HTML graphics with this data, run: rally task report 8b442d6f-3e28-46c4-8fee-4f6f550d5c97 --out output.html * To generate a JUnit report, run: rally task export 8b442d6f-3e28-46c4-8fee-4f6f550d5c97 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 8b442d6f-3e28-46c4-8fee-4f6f550d5c97 --json --out output.json 2021-01-02 08:03:23,513 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 8b442d6f-3e28-46c4-8fee-4f6f550d5c97 --out /home/opnfv/functest/results/rally_sanity/quotas.json 2021-01-02 08:03:23,518 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2021-01-02 08:03:23,551 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2021-01-02 08:03:23,706 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2021-01-02 08:05:49,874 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: b4a39d79-3113-4645-b68b-f9991802fcd8 2021-01-02 08:05:51,221 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid b4a39d79-3113-4645-b68b-f9991802fcd8 -------------------------------------------------------------------------------- Task b4a39d79-3113-4645-b68b-f9991802fcd8: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b4a39d79-3113-4645-b68b-f9991802fcd8 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.276 | 1.276 | 1.276 | 1.276 | 1.276 | 1.276 | 100.0% | 1 | | swift.upload_object (x2) | 1.019 | 1.019 | 1.019 | 1.019 | 1.019 | 1.019 | 100.0% | 1 | | swift.list_objects | 0.916 | 0.916 | 0.916 | 0.916 | 0.916 | 0.916 | 100.0% | 1 | | total | 3.212 | 3.212 | 3.212 | 3.212 | 3.212 | 3.212 | 100.0% | 1 | | -> duration | 3.212 | 3.212 | 3.212 | 3.212 | 3.212 | 3.212 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.212077 Full duration: 25.197796 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b4a39d79-3113-4645-b68b-f9991802fcd8 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.638 | 1.638 | 1.638 | 1.638 | 1.638 | 1.638 | 100.0% | 1 | | swift.list_objects | 0.996 | 0.996 | 0.996 | 0.996 | 0.996 | 0.996 | 100.0% | 1 | | total | 2.634 | 2.634 | 2.634 | 2.634 | 2.634 | 2.634 | 100.0% | 1 | | -> duration | 2.634 | 2.634 | 2.634 | 2.634 | 2.634 | 2.634 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.634179 Full duration: 23.637093 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b4a39d79-3113-4645-b68b-f9991802fcd8 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.23 | 1.23 | 1.23 | 1.23 | 1.23 | 1.23 | 100.0% | 1 | | swift.upload_object (x5) | 2.727 | 2.727 | 2.727 | 2.727 | 2.727 | 2.727 | 100.0% | 1 | | swift.download_object (x5) | 2.439 | 2.439 | 2.439 | 2.439 | 2.439 | 2.439 | 100.0% | 1 | | total | 6.397 | 6.397 | 6.397 | 6.397 | 6.397 | 6.397 | 100.0% | 1 | | -> duration | 6.397 | 6.397 | 6.397 | 6.397 | 6.397 | 6.397 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.396911 Full duration: 28.180774 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b4a39d79-3113-4645-b68b-f9991802fcd8 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.253 | 1.253 | 1.253 | 1.253 | 1.253 | 1.253 | 100.0% | 1 | | swift.upload_object (x5) | 2.734 | 2.734 | 2.734 | 2.734 | 2.734 | 2.734 | 100.0% | 1 | | swift.delete_object (x5) | 2.489 | 2.489 | 2.489 | 2.489 | 2.489 | 2.489 | 100.0% | 1 | | swift.delete_container | 0.516 | 0.516 | 0.516 | 0.516 | 0.516 | 0.516 | 100.0% | 1 | | total | 6.993 | 6.993 | 6.993 | 6.993 | 6.993 | 6.993 | 100.0% | 1 | | -> duration | 6.993 | 6.993 | 6.993 | 6.993 | 6.993 | 6.993 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.993488 Full duration: 22.853128 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task b4a39d79-3113-4645-b68b-f9991802fcd8 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.307 | 1.307 | 1.307 | 1.307 | 1.307 | 1.307 | 100.0% | 1 | | swift.list_objects | 0.889 | 0.889 | 0.889 | 0.889 | 0.889 | 0.889 | 100.0% | 1 | | swift.download_object (x5) | 2.565 | 2.565 | 2.565 | 2.565 | 2.565 | 2.565 | 100.0% | 1 | | total | 4.761 | 4.761 | 4.761 | 4.761 | 4.761 | 4.761 | 100.0% | 1 | | -> duration | 4.761 | 4.761 | 4.761 | 4.761 | 4.761 | 4.761 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.761315 Full duration: 22.555747 HINTS: * To plot HTML graphics with this data, run: rally task report b4a39d79-3113-4645-b68b-f9991802fcd8 --out output.html * To generate a JUnit report, run: rally task export b4a39d79-3113-4645-b68b-f9991802fcd8 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report b4a39d79-3113-4645-b68b-f9991802fcd8 --json --out output.json 2021-01-02 08:05:54,479 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid b4a39d79-3113-4645-b68b-f9991802fcd8 --out /home/opnfv/functest/results/rally_sanity/swift.json 2021-01-02 08:05:54,486 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2021-01-02 08:05:54,492 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:01:05 | 6 | 100.00% | | glance | 00:01:52 | 4 | 100.00% | | cinder | 00:03:43 | 10 | 100.00% | | heat | 00:02:21 | 4 | 100.00% | | keystone | 00:04:08 | 11 | 100.00% | | neutron | 00:03:46 | 8 | 100.00% | | nova | 00:00:56 | 1 | 0.00% | | quotas | 00:00:40 | 3 | 100.00% | | swift | 00:02:02 | 5 | 100.00% | | | | | | | TOTAL: | 00:20:37 | 52 | 98.08% | +----------------+------------+----------------+-----------+ 2021-01-02 08:05:54,492 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_sanity' success_rate is 98.08% in 8/9 modules 2021-01-02 08:05:58,093 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_sanity/rally_sanity.html 2021-01-02 08:06:01,776 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_sanity/rally_sanity.xml 2021-01-02 08:06:01,777 - xtesting.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | rally_sanity | functest | 26:04 | FAIL | +----------------------+------------------+------------------+----------------+