2020-12-15 11:59:36,414 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | ovs | | INSTALLER_TYPE | airship | | BUILD_TAG | CCSRJV0ADDJR | | NODE_NAME | intel-pod17 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/airship/CCSRJV0ADDJR/airs | | | hip-opnfv-functest-smoke-latest-rally_sanity- | | | run-194 | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/CCSRJV0ADDJR/ai | | | rship-opnfv-functest-smoke-latest-rally_sanity- | | | run-194 | +-------------------------+------------------------------------------------------------+ 2020-12-15 11:59:36,480 - xtesting.ci.run_tests - INFO - Loading test case 'rally_sanity'... 2020-12-15 11:59:40,451 - xtesting.ci.run_tests - INFO - Running test case 'rally_sanity'... 2020-12-15 11:59:46,077 - functest.opnfv_tests.openstack.rally.rally - INFO - Creating Rally environment... 2020-12-15 11:59:53,113 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | cd23acd3-edf5-4630-a8b9-000359f6b752 | 2020-12-15T11:59:52.831375 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: cd23acd3-edf5-4630-a8b9-000359f6b752 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-12-15 11:59:58,243 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-12-15 12:00:00,503 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-15 12:00:00,676 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2020-12-15 12:01:31,334 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag authenticate --uuids-only: 37442db6-6fd5-49a6-84b1-ee8ee7abaf0e 2020-12-15 12:01:32,744 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 37442db6-6fd5-49a6-84b1-ee8ee7abaf0e -------------------------------------------------------------------------------- Task 37442db6-6fd5-49a6-84b1-ee8ee7abaf0e: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 37442db6-6fd5-49a6-84b1-ee8ee7abaf0e has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 1.136 | 1.136 | 1.136 | 1.136 | 1.136 | 1.136 | 100.0% | 1 | | total | 1.136 | 1.136 | 1.136 | 1.136 | 1.136 | 1.136 | 100.0% | 1 | | -> duration | 1.136 | 1.136 | 1.136 | 1.136 | 1.136 | 1.136 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.135912 Full duration: 13.23417 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 37442db6-6fd5-49a6-84b1-ee8ee7abaf0e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.315 | 0.315 | 0.315 | 0.315 | 0.315 | 0.315 | 100.0% | 1 | | total | 0.951 | 0.951 | 0.951 | 0.951 | 0.951 | 0.951 | 100.0% | 1 | | -> duration | 0.951 | 0.951 | 0.951 | 0.951 | 0.951 | 0.951 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.951086 Full duration: 11.799263 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 37442db6-6fd5-49a6-84b1-ee8ee7abaf0e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.401 | 0.401 | 0.401 | 0.401 | 0.401 | 0.401 | 100.0% | 1 | | total | 1.038 | 1.038 | 1.038 | 1.038 | 1.038 | 1.038 | 100.0% | 1 | | -> duration | 1.038 | 1.038 | 1.038 | 1.038 | 1.038 | 1.038 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.038337 Full duration: 11.567727 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 37442db6-6fd5-49a6-84b1-ee8ee7abaf0e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.361 | 0.361 | 0.361 | 0.361 | 0.361 | 0.361 | 100.0% | 1 | | total | 0.995 | 0.995 | 0.995 | 0.995 | 0.995 | 0.995 | 100.0% | 1 | | -> duration | 0.995 | 0.995 | 0.995 | 0.995 | 0.995 | 0.995 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.99514 Full duration: 10.37818 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 37442db6-6fd5-49a6-84b1-ee8ee7abaf0e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.593 | 0.593 | 0.593 | 0.593 | 0.593 | 0.593 | 100.0% | 1 | | total | 1.178 | 1.178 | 1.178 | 1.178 | 1.178 | 1.178 | 100.0% | 1 | | -> duration | 1.178 | 1.178 | 1.178 | 1.178 | 1.178 | 1.178 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.177719 Full duration: 9.713905 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "args": { "repetitions": 2 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 37442db6-6fd5-49a6-84b1-ee8ee7abaf0e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.33 | 0.33 | 0.33 | 0.33 | 0.33 | 0.33 | 100.0% | 1 | | total | 1.012 | 1.012 | 1.012 | 1.012 | 1.012 | 1.012 | 100.0% | 1 | | -> duration | 1.012 | 1.012 | 1.012 | 1.012 | 1.012 | 1.012 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.012323 Full duration: 11.239466 HINTS: * To plot HTML graphics with this data, run: rally task report 37442db6-6fd5-49a6-84b1-ee8ee7abaf0e --out output.html * To generate a JUnit report, run: rally task export 37442db6-6fd5-49a6-84b1-ee8ee7abaf0e --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 37442db6-6fd5-49a6-84b1-ee8ee7abaf0e --json --out output.json 2020-12-15 12:01:35,970 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 37442db6-6fd5-49a6-84b1-ee8ee7abaf0e --out /home/opnfv/functest/results/rally_sanity/authenticate.json 2020-12-15 12:01:35,975 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2020-12-15 12:01:36,005 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-15 12:01:36,168 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2020-12-15 12:04:11,351 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag glance --uuids-only: 5c57a484-b037-439d-aa96-8d5e0cca43f2 2020-12-15 12:04:12,725 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 5c57a484-b037-439d-aa96-8d5e0cca43f2 -------------------------------------------------------------------------------- Task 5c57a484-b037-439d-aa96-8d5e0cca43f2: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5c57a484-b037-439d-aa96-8d5e0cca43f2 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.261 | 5.261 | 5.261 | 5.261 | 5.261 | 5.261 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.112 | 0.112 | 0.112 | 0.112 | 0.112 | 0.112 | 100.0% | 1 | | -> glance_v2.upload_data | 2.606 | 2.606 | 2.606 | 2.606 | 2.606 | 2.606 | 100.0% | 1 | | glance_v2.delete_image | 2.932 | 2.932 | 2.932 | 2.932 | 2.932 | 2.932 | 100.0% | 1 | | total | 8.194 | 8.194 | 8.194 | 8.194 | 8.194 | 8.194 | 100.0% | 1 | | -> duration | 8.194 | 8.194 | 8.194 | 8.194 | 8.194 | 8.194 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.193599 Full duration: 19.264857 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5c57a484-b037-439d-aa96-8d5e0cca43f2 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.917 | 4.917 | 4.917 | 4.917 | 4.917 | 4.917 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.128 | 0.128 | 0.128 | 0.128 | 0.128 | 0.128 | 100.0% | 1 | | -> glance_v2.upload_data | 2.329 | 2.329 | 2.329 | 2.329 | 2.329 | 2.329 | 100.0% | 1 | | glance_v2.list_images | 0.065 | 0.065 | 0.065 | 0.065 | 0.065 | 0.065 | 100.0% | 1 | | total | 4.982 | 4.982 | 4.982 | 4.982 | 4.982 | 4.982 | 100.0% | 1 | | -> duration | 4.982 | 4.982 | 4.982 | 4.982 | 4.982 | 4.982 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.982415 Full duration: 20.955033 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5c57a484-b037-439d-aa96-8d5e0cca43f2 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.258 | 0.258 | 0.258 | 0.258 | 0.258 | 0.258 | 100.0% | 1 | | total | 0.258 | 0.258 | 0.258 | 0.258 | 0.258 | 0.258 | 100.0% | 1 | | -> duration | 0.258 | 0.258 | 0.258 | 0.258 | 0.258 | 0.258 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.257852 Full duration: 12.929459 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally_sanity-flavor_d00f5545-3377-4c0b-9b02-4a93ecc6a500" }, "number_instances": 2, "boot_server_kwargs": { "nics": [ { "net-id": "e71f1cf0-dee1-4bb4-9d36-8d924b33c231" } ] } }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 5c57a484-b037-439d-aa96-8d5e0cca43f2 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 7.317 | 7.317 | 7.317 | 7.317 | 7.317 | 7.317 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.092 | 0.092 | 0.092 | 0.092 | 0.092 | 0.092 | 100.0% | 1 | | -> glance_v2.upload_data | 3.35 | 3.35 | 3.35 | 3.35 | 3.35 | 3.35 | 100.0% | 1 | | nova.boot_servers | 31.009 | 31.009 | 31.009 | 31.009 | 31.009 | 31.009 | 100.0% | 1 | | total | 38.326 | 38.326 | 38.326 | 38.326 | 38.326 | 38.326 | 100.0% | 1 | | -> duration | 37.326 | 37.326 | 37.326 | 37.326 | 37.326 | 37.326 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 37.326303 Full duration: 77.84049 HINTS: * To plot HTML graphics with this data, run: rally task report 5c57a484-b037-439d-aa96-8d5e0cca43f2 --out output.html * To generate a JUnit report, run: rally task export 5c57a484-b037-439d-aa96-8d5e0cca43f2 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 5c57a484-b037-439d-aa96-8d5e0cca43f2 --json --out output.json 2020-12-15 12:04:15,979 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 5c57a484-b037-439d-aa96-8d5e0cca43f2 --out /home/opnfv/functest/results/rally_sanity/glance.json 2020-12-15 12:04:15,985 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2020-12-15 12:04:16,019 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-15 12:04:16,179 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2020-12-15 12:09:10,565 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag cinder --uuids-only: 41e44015-4d85-4e9b-bfe8-42e6394b751a 2020-12-15 12:09:11,943 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 41e44015-4d85-4e9b-bfe8-42e6394b751a -------------------------------------------------------------------------------- Task 41e44015-4d85-4e9b-bfe8-42e6394b751a: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "args": { "force": false }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 41e44015-4d85-4e9b-bfe8-42e6394b751a has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_snapshot | 7.673 | 7.673 | 7.673 | 7.673 | 7.673 | 7.673 | 100.0% | 1 | | cinder_v3.delete_snapshot | 3.731 | 3.731 | 3.731 | 3.731 | 3.731 | 3.731 | 100.0% | 1 | | total | 11.405 | 11.405 | 11.405 | 11.405 | 11.405 | 11.405 | 100.0% | 1 | | -> duration | 11.405 | 11.405 | 11.405 | 11.405 | 11.405 | 11.405 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.404506 Full duration: 42.021747 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "args": { "size": { "max": 1, "min": 1 } }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 41e44015-4d85-4e9b-bfe8-42e6394b751a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 9.165 | 9.165 | 9.165 | 9.165 | 9.165 | 9.165 | 100.0% | 1 | | cinder_v3.delete_volume | 2.866 | 2.866 | 2.866 | 2.866 | 2.866 | 2.866 | 100.0% | 1 | | total | 12.031 | 12.031 | 12.031 | 12.031 | 12.031 | 12.031 | 100.0% | 1 | | -> duration | 12.031 | 12.031 | 12.031 | 12.031 | 12.031 | 12.031 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.03052 Full duration: 30.006803 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 1 args values: { "args": { "image": { "name": "rally_sanity-img_d00f5545-3377-4c0b-9b02-4a93ecc6a500" }, "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 41e44015-4d85-4e9b-bfe8-42e6394b751a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 14.938 | 14.938 | 14.938 | 14.938 | 14.938 | 14.938 | 100.0% | 1 | | cinder_v3.delete_volume | 3.857 | 3.857 | 3.857 | 3.857 | 3.857 | 3.857 | 100.0% | 1 | | total | 18.795 | 18.795 | 18.795 | 18.795 | 18.795 | 18.795 | 100.0% | 1 | | -> duration | 18.795 | 18.795 | 18.795 | 18.795 | 18.795 | 18.795 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.795257 Full duration: 36.127442 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 2 args values: { "args": { "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 41e44015-4d85-4e9b-bfe8-42e6394b751a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 4.124 | 4.124 | 4.124 | 4.124 | 4.124 | 4.124 | 100.0% | 1 | | cinder_v3.delete_volume | 2.351 | 2.351 | 2.351 | 2.351 | 2.351 | 2.351 | 100.0% | 1 | | total | 6.475 | 6.475 | 6.475 | 6.475 | 6.475 | 6.475 | 100.0% | 1 | | -> duration | 6.475 | 6.475 | 6.475 | 6.475 | 6.475 | 6.475 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.475038 Full duration: 25.807822 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "args": { "new_size": 2, "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 41e44015-4d85-4e9b-bfe8-42e6394b751a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 3.427 | 3.427 | 3.427 | 3.427 | 3.427 | 3.427 | 100.0% | 1 | | cinder_v3.extend_volume | 2.83 | 2.83 | 2.83 | 2.83 | 2.83 | 2.83 | 100.0% | 1 | | cinder_v3.delete_volume | 2.363 | 2.363 | 2.363 | 2.363 | 2.363 | 2.363 | 100.0% | 1 | | total | 8.621 | 8.621 | 8.621 | 8.621 | 8.621 | 8.621 | 100.0% | 1 | | -> duration | 8.621 | 8.621 | 8.621 | 8.621 | 8.621 | 8.621 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.620631 Full duration: 22.027404 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "args": { "size": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 41e44015-4d85-4e9b-bfe8-42e6394b751a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume | 5.744 | 5.744 | 5.744 | 5.744 | 5.744 | 5.744 | 100.0% | 1 | | cinder_v3.delete_volume | 2.45 | 2.45 | 2.45 | 2.45 | 2.45 | 2.45 | 100.0% | 1 | | total | 8.194 | 8.194 | 8.194 | 8.194 | 8.194 | 8.194 | 100.0% | 1 | | -> duration | 8.194 | 8.194 | 8.194 | 8.194 | 8.194 | 8.194 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.194155 Full duration: 38.288237 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 41e44015-4d85-4e9b-bfe8-42e6394b751a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.89 | 0.89 | 0.89 | 0.89 | 0.89 | 0.89 | 100.0% | 1 | | cinder_v3.list_qos | 0.036 | 0.036 | 0.036 | 0.036 | 0.036 | 0.036 | 100.0% | 1 | | total | 0.926 | 0.926 | 0.926 | 0.926 | 0.926 | 0.926 | 100.0% | 1 | | -> duration | 0.926 | 0.926 | 0.926 | 0.926 | 0.926 | 0.926 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.926304 Full duration: 15.087457 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 41e44015-4d85-4e9b-bfe8-42e6394b751a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_qos | 0.76 | 0.76 | 0.76 | 0.76 | 0.76 | 0.76 | 100.0% | 1 | | cinder_v3.set_qos | 0.536 | 0.536 | 0.536 | 0.536 | 0.536 | 0.536 | 100.0% | 1 | | total | 1.296 | 1.296 | 1.296 | 1.296 | 1.296 | 1.296 | 100.0% | 1 | | -> duration | 1.296 | 1.296 | 1.296 | 1.296 | 1.296 | 1.296 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.296178 Full duration: 20.0814 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "args": { "description": "rally tests creating types" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 41e44015-4d85-4e9b-bfe8-42e6394b751a has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.883 | 0.883 | 0.883 | 0.883 | 0.883 | 0.883 | 100.0% | 1 | | cinder_v3.list_types | 0.036 | 0.036 | 0.036 | 0.036 | 0.036 | 0.036 | 100.0% | 1 | | total | 0.919 | 0.919 | 0.919 | 0.919 | 0.919 | 0.919 | 100.0% | 1 | | -> duration | 0.919 | 0.919 | 0.919 | 0.919 | 0.919 | 0.919 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.919355 Full duration: 15.409205 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 41e44015-4d85-4e9b-bfe8-42e6394b751a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v3.create_volume_type | 0.885 | 0.885 | 0.885 | 0.885 | 0.885 | 0.885 | 100.0% | 1 | | cinder_v3.create_encryption_type | 0.185 | 0.185 | 0.185 | 0.185 | 0.185 | 0.185 | 100.0% | 1 | | total | 1.07 | 1.07 | 1.07 | 1.07 | 1.07 | 1.07 | 100.0% | 1 | | -> duration | 1.07 | 1.07 | 1.07 | 1.07 | 1.07 | 1.07 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.069504 Full duration: 19.750321 HINTS: * To plot HTML graphics with this data, run: rally task report 41e44015-4d85-4e9b-bfe8-42e6394b751a --out output.html * To generate a JUnit report, run: rally task export 41e44015-4d85-4e9b-bfe8-42e6394b751a --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 41e44015-4d85-4e9b-bfe8-42e6394b751a --json --out output.json 2020-12-15 12:09:15,179 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 41e44015-4d85-4e9b-bfe8-42e6394b751a --out /home/opnfv/functest/results/rally_sanity/cinder.json 2020-12-15 12:09:15,192 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2020-12-15 12:09:15,211 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-15 12:09:15,625 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2020-12-15 12:12:52,951 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag heat --uuids-only: 6e8f98ea-6cb1-4418-aa06-05cf9b0a6a09 2020-12-15 12:12:54,336 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 6e8f98ea-6cb1-4418-aa06-05cf9b0a6a09 -------------------------------------------------------------------------------- Task 6e8f98ea-6cb1-4418-aa06-05cf9b0a6a09: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6e8f98ea-6cb1-4418-aa06-05cf9b0a6a09 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 17.627 | 17.627 | 17.627 | 17.627 | 17.627 | 17.627 | 100.0% | 1 | | heat.update_stack | 22.26 | 22.26 | 22.26 | 22.26 | 22.26 | 22.26 | 100.0% | 1 | | heat.delete_stack | 12.293 | 12.293 | 12.293 | 12.293 | 12.293 | 12.293 | 100.0% | 1 | | total | 52.18 | 52.18 | 52.18 | 52.18 | 52.18 | 52.18 | 100.0% | 1 | | -> duration | 48.18 | 48.18 | 48.18 | 48.18 | 48.18 | 48.18 | 100.0% | 1 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 48.179856 Full duration: 69.527532 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6e8f98ea-6cb1-4418-aa06-05cf9b0a6a09 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 8.831 | 8.831 | 8.831 | 8.831 | 8.831 | 8.831 | 100.0% | 1 | | heat.check_stack | 3.561 | 3.561 | 3.561 | 3.561 | 3.561 | 3.561 | 100.0% | 1 | | heat.delete_stack | 5.189 | 5.189 | 5.189 | 5.189 | 5.189 | 5.189 | 100.0% | 1 | | total | 17.581 | 17.581 | 17.581 | 17.581 | 17.581 | 17.581 | 100.0% | 1 | | -> duration | 15.581 | 15.581 | 15.581 | 15.581 | 15.581 | 15.581 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.5814 Full duration: 42.674399 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "args": { "template_path": "/usr/lib/python3.6/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6e8f98ea-6cb1-4418-aa06-05cf9b0a6a09 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 10.977 | 10.977 | 10.977 | 10.977 | 10.977 | 10.977 | 100.0% | 1 | | heat.suspend_stack | 5.574 | 5.574 | 5.574 | 5.574 | 5.574 | 5.574 | 100.0% | 1 | | heat.resume_stack | 4.105 | 4.105 | 4.105 | 4.105 | 4.105 | 4.105 | 100.0% | 1 | | heat.delete_stack | 8.047 | 8.047 | 8.047 | 8.047 | 8.047 | 8.047 | 100.0% | 1 | | total | 28.702 | 28.702 | 28.702 | 28.702 | 28.702 | 28.702 | 100.0% | 1 | | -> duration | 26.702 | 26.702 | 26.702 | 26.702 | 26.702 | 26.702 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 26.70234 Full duration: 51.048967 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 6e8f98ea-6cb1-4418-aa06-05cf9b0a6a09 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.717 | 0.717 | 0.717 | 0.717 | 0.717 | 0.717 | 100.0% | 1 | | total | 0.718 | 0.718 | 0.718 | 0.718 | 0.718 | 0.718 | 100.0% | 1 | | -> duration | 0.718 | 0.718 | 0.718 | 0.718 | 0.718 | 0.718 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.717517 Full duration: 15.730771 HINTS: * To plot HTML graphics with this data, run: rally task report 6e8f98ea-6cb1-4418-aa06-05cf9b0a6a09 --out output.html * To generate a JUnit report, run: rally task export 6e8f98ea-6cb1-4418-aa06-05cf9b0a6a09 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 6e8f98ea-6cb1-4418-aa06-05cf9b0a6a09 --json --out output.json 2020-12-15 12:12:57,619 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 6e8f98ea-6cb1-4418-aa06-05cf9b0a6a09 --out /home/opnfv/functest/results/rally_sanity/heat.json 2020-12-15 12:12:57,624 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2020-12-15 12:12:57,656 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-15 12:12:57,840 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2020-12-15 12:17:48,292 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag keystone --uuids-only: 97ffb175-51d4-493b-b4e2-ec46300eb02a 2020-12-15 12:17:49,677 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 97ffb175-51d4-493b-b4e2-ec46300eb02a -------------------------------------------------------------------------------- Task 97ffb175-51d4-493b-b4e2-ec46300eb02a: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 97ffb175-51d4-493b-b4e2-ec46300eb02a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.467 | 0.467 | 0.467 | 0.467 | 0.467 | 0.467 | 100.0% | 1 | | keystone_v3.add_role | 0.14 | 0.14 | 0.14 | 0.14 | 0.14 | 0.14 | 100.0% | 1 | | keystone_v3.revoke_role | 0.551 | 0.551 | 0.551 | 0.551 | 0.551 | 0.551 | 100.0% | 1 | | total | 1.158 | 1.158 | 1.158 | 1.158 | 1.158 | 1.158 | 100.0% | 1 | | -> duration | 1.158 | 1.158 | 1.158 | 1.158 | 1.158 | 1.158 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.158261 Full duration: 19.547648 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 97ffb175-51d4-493b-b4e2-ec46300eb02a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.166 | 0.166 | 0.166 | 0.166 | 0.166 | 0.166 | 100.0% | 1 | | keystone_v3.add_role | 0.287 | 0.287 | 0.287 | 0.287 | 0.287 | 0.287 | 100.0% | 1 | | keystone_v3.list_roles | 0.149 | 0.149 | 0.149 | 0.149 | 0.149 | 0.149 | 100.0% | 1 | | total | 0.602 | 0.602 | 0.602 | 0.602 | 0.602 | 0.602 | 100.0% | 1 | | -> duration | 0.602 | 0.602 | 0.602 | 0.602 | 0.602 | 0.602 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.60219 Full duration: 21.326684 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 97ffb175-51d4-493b-b4e2-ec46300eb02a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.291 | 0.291 | 0.291 | 0.291 | 0.291 | 0.291 | 100.0% | 1 | | keystone_v3.list_projects | 0.14 | 0.14 | 0.14 | 0.14 | 0.14 | 0.14 | 100.0% | 1 | | total | 0.431 | 0.431 | 0.431 | 0.431 | 0.431 | 0.431 | 100.0% | 1 | | -> duration | 0.431 | 0.431 | 0.431 | 0.431 | 0.431 | 0.431 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.431026 Full duration: 20.862378 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 97ffb175-51d4-493b-b4e2-ec46300eb02a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.255 | 0.255 | 0.255 | 0.255 | 0.255 | 0.255 | 100.0% | 1 | | keystone_v3.delete_role | 0.194 | 0.194 | 0.194 | 0.194 | 0.194 | 0.194 | 100.0% | 1 | | total | 0.449 | 0.449 | 0.449 | 0.449 | 0.449 | 0.449 | 100.0% | 1 | | -> duration | 0.449 | 0.449 | 0.449 | 0.449 | 0.449 | 0.449 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.448971 Full duration: 16.443415 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 97ffb175-51d4-493b-b4e2-ec46300eb02a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.116 | 0.116 | 0.116 | 0.116 | 0.116 | 0.116 | 100.0% | 1 | | keystone_v3.delete_service | 0.302 | 0.302 | 0.302 | 0.302 | 0.302 | 0.302 | 100.0% | 1 | | total | 0.418 | 0.418 | 0.418 | 0.418 | 0.418 | 0.418 | 100.0% | 1 | | -> duration | 0.418 | 0.418 | 0.418 | 0.418 | 0.418 | 0.418 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.41845 Full duration: 16.544693 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 97ffb175-51d4-493b-b4e2-ec46300eb02a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.374 | 0.374 | 0.374 | 0.374 | 0.374 | 0.374 | 100.0% | 1 | | keystone_v3.create_user | 1.199 | 1.199 | 1.199 | 1.199 | 1.199 | 1.199 | 100.0% | 1 | | -> keystone_v3.list_roles | 0.054 | 0.054 | 0.054 | 0.054 | 0.054 | 0.054 | 100.0% | 1 | | -> keystone_v3.add_role | 0.595 | 0.595 | 0.595 | 0.595 | 0.595 | 0.595 | 100.0% | 1 | | keystone_v3.create_role | 1.045 | 1.045 | 1.045 | 1.045 | 1.045 | 1.045 | 100.0% | 1 | | keystone_v3.get_project | 0.047 | 0.047 | 0.047 | 0.047 | 0.047 | 0.047 | 100.0% | 1 | | keystone_v3.get_user | 0.038 | 0.038 | 0.038 | 0.038 | 0.038 | 0.038 | 100.0% | 1 | | keystone_v3.get_role | 0.033 | 0.033 | 0.033 | 0.033 | 0.033 | 0.033 | 100.0% | 1 | | keystone_v3.list_services | 0.048 | 0.048 | 0.048 | 0.048 | 0.048 | 0.048 | 100.0% | 1 | | keystone_v3.get_services | 0.039 | 0.039 | 0.039 | 0.039 | 0.039 | 0.039 | 100.0% | 1 | | total | 2.945 | 2.945 | 2.945 | 2.945 | 2.945 | 2.945 | 100.0% | 1 | | -> duration | 2.945 | 2.945 | 2.945 | 2.945 | 2.945 | 2.945 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.945193 Full duration: 31.635895 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 97ffb175-51d4-493b-b4e2-ec46300eb02a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.303 | 0.303 | 0.303 | 0.303 | 0.303 | 0.303 | 100.0% | 1 | | keystone_v3.update_project | 0.924 | 0.924 | 0.924 | 0.924 | 0.924 | 0.924 | 100.0% | 1 | | keystone_v3.delete_project | 1.015 | 1.015 | 1.015 | 1.015 | 1.015 | 1.015 | 100.0% | 1 | | total | 2.243 | 2.243 | 2.243 | 2.243 | 2.243 | 2.243 | 100.0% | 1 | | -> duration | 2.243 | 2.243 | 2.243 | 2.243 | 2.243 | 2.243 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.242715 Full duration: 18.823305 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 97ffb175-51d4-493b-b4e2-ec46300eb02a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.244 | 0.244 | 0.244 | 0.244 | 0.244 | 0.244 | 100.0% | 1 | | total | 0.337 | 0.337 | 0.337 | 0.337 | 0.337 | 0.337 | 100.0% | 1 | | -> duration | 0.337 | 0.337 | 0.337 | 0.337 | 0.337 | 0.337 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.336589 Full duration: 22.083451 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 97ffb175-51d4-493b-b4e2-ec46300eb02a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.402 | 0.402 | 0.402 | 0.402 | 0.402 | 0.402 | 100.0% | 1 | | total | 0.402 | 0.402 | 0.402 | 0.402 | 0.402 | 0.402 | 100.0% | 1 | | -> duration | 0.402 | 0.402 | 0.402 | 0.402 | 0.402 | 0.402 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.402498 Full duration: 24.541785 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 97ffb175-51d4-493b-b4e2-ec46300eb02a has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.677 | 0.677 | 0.677 | 0.677 | 0.677 | 0.677 | 100.0% | 1 | | keystone_v3.list_users | 0.075 | 0.075 | 0.075 | 0.075 | 0.075 | 0.075 | 100.0% | 1 | | total | 0.84 | 0.84 | 0.84 | 0.84 | 0.84 | 0.84 | 100.0% | 1 | | -> duration | 0.84 | 0.84 | 0.84 | 0.84 | 0.84 | 0.84 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.839951 Full duration: 23.133615 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "args": { "users_per_tenant": 10 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 97ffb175-51d4-493b-b4e2-ec46300eb02a has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.56 | 0.56 | 0.56 | 0.56 | 0.56 | 0.56 | 100.0% | 1 | | keystone_v3.create_users | 7.932 | 7.932 | 7.932 | 7.932 | 7.932 | 7.932 | 100.0% | 1 | | -> keystone_v3.create_user (x10) | 7.931 | 7.931 | 7.931 | 7.931 | 7.931 | 7.931 | 100.0% | 1 | | --> keystone_v3.list_roles (x10) | 0.543 | 0.543 | 0.543 | 0.543 | 0.543 | 0.543 | 100.0% | 1 | | --> keystone_v3.add_role (x10) | 3.231 | 3.231 | 3.231 | 3.231 | 3.231 | 3.231 | 100.0% | 1 | | total | 8.932 | 8.932 | 8.932 | 8.932 | 8.932 | 8.932 | 100.0% | 1 | | -> duration | 8.932 | 8.932 | 8.932 | 8.932 | 8.932 | 8.932 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.932239 Full duration: 47.783306 HINTS: * To plot HTML graphics with this data, run: rally task report 97ffb175-51d4-493b-b4e2-ec46300eb02a --out output.html * To generate a JUnit report, run: rally task export 97ffb175-51d4-493b-b4e2-ec46300eb02a --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 97ffb175-51d4-493b-b4e2-ec46300eb02a --json --out output.json 2020-12-15 12:17:53,051 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 97ffb175-51d4-493b-b4e2-ec46300eb02a --out /home/opnfv/functest/results/rally_sanity/keystone.json 2020-12-15 12:17:53,063 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2020-12-15 12:17:53,094 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-15 12:17:53,510 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-12-15 12:22:12,745 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: 4ada6941-4d13-4bd0-a1c8-991b5b09f85e 2020-12-15 12:22:14,128 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 4ada6941-4d13-4bd0-a1c8-991b5b09f85e -------------------------------------------------------------------------------- Task 4ada6941-4d13-4bd0-a1c8-991b5b09f85e: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4ada6941-4d13-4bd0-a1c8-991b5b09f85e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 5.945 | 5.945 | 5.945 | 5.945 | 5.945 | 5.945 | 100.0% | 1 | | neutron.delete_network | 3.27 | 3.27 | 3.27 | 3.27 | 3.27 | 3.27 | 100.0% | 1 | | total | 9.215 | 9.215 | 9.215 | 9.215 | 9.215 | 9.215 | 100.0% | 1 | | -> duration | 9.215 | 9.215 | 9.215 | 9.215 | 9.215 | 9.215 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.215222 Full duration: 28.185676 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4ada6941-4d13-4bd0-a1c8-991b5b09f85e has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 4.876 | 4.876 | 4.876 | 4.876 | 4.876 | 4.876 | 100.0% | 1 | | neutron.delete_port | 2.284 | 2.284 | 2.284 | 2.284 | 2.284 | 2.284 | 100.0% | 1 | | total | 7.159 | 7.159 | 7.159 | 7.159 | 7.159 | 7.159 | 100.0% | 1 | | -> duration | 7.159 | 7.159 | 7.159 | 7.159 | 7.159 | 7.159 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.159407 Full duration: 39.982906 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4ada6941-4d13-4bd0-a1c8-991b5b09f85e has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 3.024 | 3.024 | 3.024 | 3.024 | 3.024 | 3.024 | 100.0% | 1 | | neutron.delete_subnet | 1.569 | 1.569 | 1.569 | 1.569 | 1.569 | 1.569 | 100.0% | 1 | | total | 4.593 | 4.593 | 4.593 | 4.593 | 4.593 | 4.593 | 100.0% | 1 | | -> duration | 4.593 | 4.593 | 4.593 | 4.593 | 4.593 | 4.593 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.593417 Full duration: 29.689295 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": { "network_create_args": {} }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4ada6941-4d13-4bd0-a1c8-991b5b09f85e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 2.416 | 2.416 | 2.416 | 2.416 | 2.416 | 2.416 | 100.0% | 1 | | neutron.list_networks | 0.167 | 0.167 | 0.167 | 0.167 | 0.167 | 0.167 | 100.0% | 1 | | total | 2.583 | 2.583 | 2.583 | 2.583 | 2.583 | 2.583 | 100.0% | 1 | | -> duration | 2.583 | 2.583 | 2.583 | 2.583 | 2.583 | 2.583 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.583471 Full duration: 22.908385 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "router": {} }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4ada6941-4d13-4bd0-a1c8-991b5b09f85e has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 5.045 | 5.045 | 5.045 | 5.045 | 5.045 | 5.045 | 100.0% | 1 | | neutron.list_ports | 0.117 | 0.117 | 0.117 | 0.117 | 0.117 | 0.117 | 100.0% | 1 | | total | 5.162 | 5.162 | 5.162 | 5.162 | 5.162 | 5.162 | 100.0% | 1 | | -> duration | 5.162 | 5.162 | 5.162 | 5.162 | 5.162 | 5.162 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.161903 Full duration: 33.749615 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4ada6941-4d13-4bd0-a1c8-991b5b09f85e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 3.869 | 3.869 | 3.869 | 3.869 | 3.869 | 3.869 | 100.0% | 1 | | neutron.create_subnet | 1.775 | 1.775 | 1.775 | 1.775 | 1.775 | 1.775 | 100.0% | 1 | | neutron.list_subnets | 0.087 | 0.087 | 0.087 | 0.087 | 0.087 | 0.087 | 100.0% | 1 | | total | 5.731 | 5.731 | 5.731 | 5.731 | 5.731 | 5.731 | 100.0% | 1 | | -> duration | 5.731 | 5.731 | 5.731 | 5.731 | 5.731 | 5.731 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.730984 Full duration: 29.292701 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4ada6941-4d13-4bd0-a1c8-991b5b09f85e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 3.879 | 3.879 | 3.879 | 3.879 | 3.879 | 3.879 | 100.0% | 1 | | neutron.delete_security_group | 0.693 | 0.693 | 0.693 | 0.693 | 0.693 | 0.693 | 100.0% | 1 | | total | 4.572 | 4.572 | 4.572 | 4.572 | 4.572 | 4.572 | 100.0% | 1 | | -> duration | 4.572 | 4.572 | 4.572 | 4.572 | 4.572 | 4.572 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.572342 Full duration: 23.355225 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 4ada6941-4d13-4bd0-a1c8-991b5b09f85e has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 3.727 | 3.727 | 3.727 | 3.727 | 3.727 | 3.727 | 100.0% | 1 | | neutron.create_security_group_rule | 0.598 | 0.598 | 0.598 | 0.598 | 0.598 | 0.598 | 100.0% | 1 | | neutron.delete_security_group_rule | 0.141 | 0.141 | 0.141 | 0.141 | 0.141 | 0.141 | 100.0% | 1 | | neutron.delete_security_group | 0.352 | 0.352 | 0.352 | 0.352 | 0.352 | 0.352 | 100.0% | 1 | | total | 4.817 | 4.817 | 4.817 | 4.817 | 4.817 | 4.817 | 100.0% | 1 | | -> duration | 4.817 | 4.817 | 4.817 | 4.817 | 4.817 | 4.817 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.816841 Full duration: 22.745984 HINTS: * To plot HTML graphics with this data, run: rally task report 4ada6941-4d13-4bd0-a1c8-991b5b09f85e --out output.html * To generate a JUnit report, run: rally task export 4ada6941-4d13-4bd0-a1c8-991b5b09f85e --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 4ada6941-4d13-4bd0-a1c8-991b5b09f85e --json --out output.json 2020-12-15 12:22:17,401 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 4ada6941-4d13-4bd0-a1c8-991b5b09f85e --out /home/opnfv/functest/results/rally_sanity/neutron.json 2020-12-15 12:22:17,410 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2020-12-15 12:22:17,441 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-15 12:22:17,570 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2020-12-15 12:23:50,254 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag nova --uuids-only: 783a4e65-9ac7-49c9-84c1-320375c167c1 2020-12-15 12:23:51,598 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 783a4e65-9ac7-49c9-84c1-320375c167c1 -------------------------------------------------------------------------------- Task 783a4e65-9ac7-49c9-84c1-320375c167c1: aborted -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_live_migrate_server args position 0 args values: { "args": { "flavor": { "name": "rally_sanity-flavor_d00f5545-3377-4c0b-9b02-4a93ecc6a500" }, "image": { "name": "rally_sanity-img_d00f5545-3377-4c0b-9b02-4a93ecc6a500" }, "block_migration": false, "nics": [ { "net-id": "e71f1cf0-dee1-4bb4-9d36-8d924b33c231" } ] }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 783a4e65-9ac7-49c9-84c1-320375c167c1 has 1 error(s) -------------------------------------------------------------------------------- BadRequest: Migration pre-check error: Instance has an associated NUMA topology. Instance NUMA topologies, including related attributes such as CPU pinning, huge page and emulator thread pinning information, are not currently recalculated on live migration. See bug #1289064 for more information. (HTTP 400) (Request-ID: req-f4a42171-edb2-47ee-b6df-4537b7d1b21a) Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/rally/task/runner.py", line 72, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/servers.py", line 720, in run self._live_migrate(server, block_migration, disk_over_commit) File "/usr/lib/python3.6/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python3.6/site-packages/rally_openstack/scenarios/nova/utils.py", line 798, in _live_migrate disk_over_commit=disk_over_commit) File "/usr/lib/python3.6/site-packages/novaclient/api_versions.py", line 393, in substitution return methods[-1].func(obj, *args, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 438, in live_migrate disk_over_commit) File "/usr/lib/python3.6/site-packages/novaclient/api_versions.py", line 393, in substitution return methods[-1].func(obj, *args, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1742, in live_migrate force=None) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 1726, in _live_migrate return self._action('os-migrateLive', server, body) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2012, in _action info=info, **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/v2/servers.py", line 2023, in _action_return_resp_and_body return self.api.client.post(url, body=body) File "/usr/lib/python3.6/site-packages/keystoneauth1/adapter.py", line 381, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python3.6/site-packages/novaclient/client.py", line 78, in request raise exceptions.from_response(resp, body, url, method) novaclient.exceptions.BadRequest: Migration pre-check error: Instance has an associated NUMA topology. Instance NUMA topologies, including related attributes such as CPU pinning, huge page and emulator thread pinning information, are not currently recalculated on live migration. See bug #1289064 for more information. (HTTP 400) (Request-ID: req-f4a42171-edb2-47ee-b6df-4537b7d1b21a) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 31.034 | 31.034 | 31.034 | 31.034 | 31.034 | 31.034 | 100.0% | 1 | | nova.live_migrate | 6.563 | 6.563 | 6.563 | 6.563 | 6.563 | 6.563 | 0.0% | 1 | | -> nova.list_hypervisors | 0.617 | 0.617 | 0.617 | 0.617 | 0.617 | 0.617 | 100.0% | 1 | | total | 37.597 | 37.597 | 37.597 | 37.597 | 37.597 | 37.597 | 0.0% | 1 | | -> duration | 36.597 | 36.597 | 36.597 | 36.597 | 36.597 | 36.597 | 0.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 36.59716 Full duration: 59.250593 HINTS: * To plot HTML graphics with this data, run: rally task report 783a4e65-9ac7-49c9-84c1-320375c167c1 --out output.html * To generate a JUnit report, run: rally task export 783a4e65-9ac7-49c9-84c1-320375c167c1 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 783a4e65-9ac7-49c9-84c1-320375c167c1 --json --out output.json At least one workload did not pass SLA criteria. 2020-12-15 12:23:54,874 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 783a4e65-9ac7-49c9-84c1-320375c167c1 --out /home/opnfv/functest/results/rally_sanity/nova.json 2020-12-15 12:23:54,876 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2020-12-15 12:23:54,907 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-15 12:23:55,321 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2020-12-15 12:25:00,135 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag quotas --uuids-only: 1ebed3d4-e0fb-4304-9f39-fefba21a1aaf 2020-12-15 12:25:01,560 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid 1ebed3d4-e0fb-4304-9f39-fefba21a1aaf -------------------------------------------------------------------------------- Task 1ebed3d4-e0fb-4304-9f39-fefba21a1aaf: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1ebed3d4-e0fb-4304-9f39-fefba21a1aaf has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.415 | 1.415 | 1.415 | 1.415 | 1.415 | 1.415 | 100.0% | 1 | | quotas.delete_quotas | 0.602 | 0.602 | 0.602 | 0.602 | 0.602 | 0.602 | 100.0% | 1 | | total | 2.017 | 2.017 | 2.017 | 2.017 | 2.017 | 2.017 | 100.0% | 1 | | -> duration | 2.017 | 2.017 | 2.017 | 2.017 | 2.017 | 2.017 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.016511 Full duration: 12.754455 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "api_versions": { "cinder": { "version": 3, "service_type": "volumev3" } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1ebed3d4-e0fb-4304-9f39-fefba21a1aaf has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.972 | 0.972 | 0.972 | 0.972 | 0.972 | 0.972 | 100.0% | 1 | | total | 0.972 | 0.972 | 0.972 | 0.972 | 0.972 | 0.972 | 100.0% | 1 | | -> duration | 0.972 | 0.972 | 0.972 | 0.972 | 0.972 | 0.972 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.97155 Full duration: 10.838488 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1ebed3d4-e0fb-4304-9f39-fefba21a1aaf has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 7.161 | 7.161 | 7.161 | 7.161 | 7.161 | 7.161 | 100.0% | 1 | | total | 7.161 | 7.161 | 7.161 | 7.161 | 7.161 | 7.161 | 100.0% | 1 | | -> duration | 7.161 | 7.161 | 7.161 | 7.161 | 7.161 | 7.161 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.160903 Full duration: 18.811606 HINTS: * To plot HTML graphics with this data, run: rally task report 1ebed3d4-e0fb-4304-9f39-fefba21a1aaf --out output.html * To generate a JUnit report, run: rally task export 1ebed3d4-e0fb-4304-9f39-fefba21a1aaf --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 1ebed3d4-e0fb-4304-9f39-fefba21a1aaf --json --out output.json 2020-12-15 12:25:04,820 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid 1ebed3d4-e0fb-4304-9f39-fefba21a1aaf --out /home/opnfv/functest/results/rally_sanity/quotas.json 2020-12-15 12:25:04,823 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2020-12-15 12:25:04,855 - functest.opnfv_tests.openstack.rally.rally - WARNING - No tenant network created. Trying EXTERNAL_NETWORK as a fallback 2020-12-15 12:25:05,015 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "swift" ... 2020-12-15 12:27:54,387 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag swift --uuids-only: fdb09d12-5d14-4caf-a55c-b1764bddefbe 2020-12-15 12:27:55,798 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid fdb09d12-5d14-4caf-a55c-b1764bddefbe -------------------------------------------------------------------------------- Task fdb09d12-5d14-4caf-a55c-b1764bddefbe: finished -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_list_objects args position 0 args values: { "args": { "objects_per_container": 2, "object_size": 5120 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fdb09d12-5d14-4caf-a55c-b1764bddefbe has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.294 | 1.294 | 1.294 | 1.294 | 1.294 | 1.294 | 100.0% | 1 | | swift.upload_object (x2) | 1.241 | 1.241 | 1.241 | 1.241 | 1.241 | 1.241 | 100.0% | 1 | | swift.list_objects | 0.961 | 0.961 | 0.961 | 0.961 | 0.961 | 0.961 | 100.0% | 1 | | total | 3.497 | 3.497 | 3.497 | 3.497 | 3.497 | 3.497 | 100.0% | 1 | | -> duration | 3.497 | 3.497 | 3.497 | 3.497 | 3.497 | 3.497 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.496505 Full duration: 27.524352 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 10, "object_size": 1024 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fdb09d12-5d14-4caf-a55c-b1764bddefbe has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.305 | 1.305 | 1.305 | 1.305 | 1.305 | 1.305 | 100.0% | 1 | | swift.list_objects | 1.004 | 1.004 | 1.004 | 1.004 | 1.004 | 1.004 | 100.0% | 1 | | total | 2.308 | 2.308 | 2.308 | 2.308 | 2.308 | 2.308 | 100.0% | 1 | | -> duration | 2.308 | 2.308 | 2.308 | 2.308 | 2.308 | 2.308 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.308341 Full duration: 26.211069 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_download_object args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 1024 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fdb09d12-5d14-4caf-a55c-b1764bddefbe has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.305 | 1.305 | 1.305 | 1.305 | 1.305 | 1.305 | 100.0% | 1 | | swift.upload_object (x5) | 2.865 | 2.865 | 2.865 | 2.865 | 2.865 | 2.865 | 100.0% | 1 | | swift.download_object (x5) | 2.311 | 2.311 | 2.311 | 2.311 | 2.311 | 2.311 | 100.0% | 1 | | total | 6.482 | 6.482 | 6.482 | 6.482 | 6.482 | 6.482 | 100.0% | 1 | | -> duration | 6.482 | 6.482 | 6.482 | 6.482 | 6.482 | 6.482 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.481833 Full duration: 40.997925 -------------------------------------------------------------------------------- test scenario SwiftObjects.create_container_and_object_then_delete_all args position 0 args values: { "args": { "objects_per_container": 5, "object_size": 102400 }, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fdb09d12-5d14-4caf-a55c-b1764bddefbe has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.create_container | 1.317 | 1.317 | 1.317 | 1.317 | 1.317 | 1.317 | 100.0% | 1 | | swift.upload_object (x5) | 2.856 | 2.856 | 2.856 | 2.856 | 2.856 | 2.856 | 100.0% | 1 | | swift.delete_object (x5) | 2.775 | 2.775 | 2.775 | 2.775 | 2.775 | 2.775 | 100.0% | 1 | | swift.delete_container | 0.72 | 0.72 | 0.72 | 0.72 | 0.72 | 0.72 | 100.0% | 1 | | total | 7.67 | 7.67 | 7.67 | 7.67 | 7.67 | 7.67 | 100.0% | 1 | | -> duration | 7.67 | 7.67 | 7.67 | 7.67 | 7.67 | 7.67 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.669894 Full duration: 22.251785 -------------------------------------------------------------------------------- test scenario SwiftObjects.list_and_download_objects_in_containers args position 0 args values: { "args": {}, "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "admin" ], "swift_objects": { "containers_per_tenant": 1, "objects_per_container": 5, "object_size": 10240 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task fdb09d12-5d14-4caf-a55c-b1764bddefbe has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | swift.list_containers | 1.421 | 1.421 | 1.421 | 1.421 | 1.421 | 1.421 | 100.0% | 1 | | swift.list_objects | 0.997 | 0.997 | 0.997 | 0.997 | 0.997 | 0.997 | 100.0% | 1 | | swift.download_object (x5) | 2.522 | 2.522 | 2.522 | 2.522 | 2.522 | 2.522 | 100.0% | 1 | | total | 4.94 | 4.94 | 4.94 | 4.94 | 4.94 | 4.94 | 100.0% | 1 | | -> duration | 4.94 | 4.94 | 4.94 | 4.94 | 4.94 | 4.94 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.940326 Full duration: 24.581899 HINTS: * To plot HTML graphics with this data, run: rally task report fdb09d12-5d14-4caf-a55c-b1764bddefbe --out output.html * To generate a JUnit report, run: rally task export fdb09d12-5d14-4caf-a55c-b1764bddefbe --type junit --to output.xml * To get raw JSON output of task results, run: rally task report fdb09d12-5d14-4caf-a55c-b1764bddefbe --json --out output.json 2020-12-15 12:27:58,966 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid fdb09d12-5d14-4caf-a55c-b1764bddefbe --out /home/opnfv/functest/results/rally_sanity/swift.json 2020-12-15 12:27:58,973 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "swift" OK. 2020-12-15 12:27:58,978 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:01:07 | 6 | 100.00% | | glance | 00:02:10 | 4 | 100.00% | | cinder | 00:04:24 | 10 | 100.00% | | heat | 00:02:58 | 4 | 100.00% | | keystone | 00:04:22 | 11 | 100.00% | | neutron | 00:03:49 | 8 | 100.00% | | nova | 00:00:59 | 1 | 0.00% | | quotas | 00:00:42 | 3 | 100.00% | | swift | 00:02:21 | 5 | 100.00% | | | | | | | TOTAL: | 00:22:58 | 52 | 98.08% | +----------------+------------+----------------+-----------+ 2020-12-15 12:27:58,979 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_sanity' success_rate is 98.08% in 8/9 modules 2020-12-15 12:28:02,623 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_sanity/rally_sanity.html 2020-12-15 12:28:06,174 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_sanity/rally_sanity.xml 2020-12-15 12:28:06,175 - xtesting.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | rally_sanity | functest | 28:25 | FAIL | +----------------------+------------------+------------------+----------------+