2020-04-10 06:08:59,277 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+-------------------------------------------------------------------------------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+-------------------------------------------------------------------------------------------------------------------------------------+ | CI_LOOP | daily | | DEBUG | true | | DEPLOY_SCENARIO | os-ovn-nofeature-noha | | INSTALLER_TYPE | unknown | | BUILD_TAG | 0S7HBR685ZOB | | NODE_NAME | lf-pod4-2 | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | TEST_DB_EXT_URL | | | S3_ENDPOINT_URL | https://storage.googleapis.com | | S3_DST_URL | s3://artifacts.opnfv.org/functest/0S7HBR685ZOB/functest-ovn-opnfv-functest-benchmarking-cntt-jerma-rally_jobs_cntt-run-10 | | HTTP_DST_URL | http://artifacts.opnfv.org/functest/0S7HBR685ZOB/functest-ovn-opnfv-functest-benchmarking-cntt-jerma-rally_jobs_cntt-run-10 | +-------------------------+-------------------------------------------------------------------------------------------------------------------------------------+ 2020-04-10 06:08:59,283 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file export OS_AUTH_URL=http://172.30.12.85/identity/v3 export OS_PROJECT_NAME="demo" export OS_USER_DOMAIN_NAME="Default" export OS_PROJECT_DOMAIN_NAME="Default" export OS_USERNAME="admin" export OS_PASSWORD="secret" export OS_REGION_NAME="RegionOne" export OS_INTERFACE=public export OS_IDENTITY_API_VERSION=3 2020-04-10 06:08:59,283 - xtesting.ci.run_tests - DEBUG - Test args: rally_jobs_cntt 2020-04-10 06:08:59,298 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs_cntt'... 2020-04-10 06:09:01,114 - functest.core.tenantnetwork - DEBUG - password: stnQ.ZYU32y^sk}finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: ee8a2cfe-50f5-42a6-82fd-5c7f021d9bea ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2020-04-10 06:09:21,474 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | compute_legacy | Available | | __unknown__ | placement | Available | | barbican | key-manager | Available | | cinder | block-storage | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2020-04-10 06:09:22,799 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests... 2020-04-10 06:09:22,915 - functest.core.singlevm - DEBUG - flavor: Munch({'location': Munch({'cloud': 'envvars', 'region_name': 'RegionOne', 'zone': None, 'project': Munch({'id': '67255c4d5f2f4aa4b05f5e7666d2adaa', 'name': 'demo', 'domain_id': None, 'domain_name': 'Default'})}), 'id': '67aed393-ca9c-4521-b6e9-e84702aa4ede', 'name': 'rally_jobs_cntt-flavor_alt_0ba61c1e-436b-4beb-85a4-df44899b1097', 'is_public': True, 'is_disabled': False, 'ram': 1024, 'vcpus': 1, 'disk': 1, 'ephemeral': 0, 'swap': 0, 'rxtx_factor': 1.0, 'properties': Munch({'OS-FLV-DISABLED:disabled': False, 'os-flavor-access:is_public': True, 'OS-FLV-EXT-DATA:ephemeral': 0}), 'extra_specs': Munch({}), 'OS-FLV-DISABLED:disabled': False, 'os-flavor-access:is_public': True, 'OS-FLV-EXT-DATA:ephemeral': 0}) 2020-04-10 06:09:23,012 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'location': Munch({'cloud': 'envvars', 'region_name': 'RegionOne', 'zone': None, 'project': Munch({'id': '67255c4d5f2f4aa4b05f5e7666d2adaa', 'name': 'demo', 'domain_id': None, 'domain_name': 'Default'})}), 'id': '67aed393-ca9c-4521-b6e9-e84702aa4ede', 'name': 'rally_jobs_cntt-flavor_alt_0ba61c1e-436b-4beb-85a4-df44899b1097', 'is_public': True, 'is_disabled': False, 'ram': 1024, 'vcpus': 1, 'disk': 1, 'ephemeral': 0, 'swap': 0, 'rxtx_factor': 1.0, 'properties': Munch({'OS-FLV-DISABLED:disabled': False, 'os-flavor-access:is_public': True, 'OS-FLV-EXT-DATA:ephemeral': 0}), 'extra_specs': Munch({}), 'OS-FLV-DISABLED:disabled': False, 'os-flavor-access:is_public': True, 'OS-FLV-EXT-DATA:ephemeral': 0}) 2020-04-10 06:09:23,017 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /home/opnfv/functest/data/rally/neutron/rally-jobs/task-neutron.yaml 2020-04-10 06:09:23,017 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2020-04-10 06:09:23,045 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: ['NeutronNetworks.create_and_list_floating_ips', 'NeutronSecurityGroup.create_and_list_security_groups', 'NeutronNetworks.create_and_delete_floating_ips', 'NeutronNetworks.associate_and_dissociate_floating_ips', 'NovaServers.boot_and_delete_server', 'NeutronSecurityGroup.create_and_delete_security_group_rule', 'NeutronSecurityGroup.create_and_update_security_groups', 'NeutronSecurityGroup.create_and_show_security_group', 'NeutronNetworks.create_and_bind_ports', 'NeutronSecurityGroup.create_and_show_security_group_rule', 'NeutronSecurityGroup.create_and_list_security_group_rules', 'NeutronSecurityGroup.create_and_delete_security_groups'] 2020-04-10 06:09:23,381 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2020-04-10 06:09:23,381 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'neutron', '--task', '/home/opnfv/functest/data/rally/task/var/task-neutron.yaml', '--task-args', "{'floating_network': 'public', 'image_name': 'rally_jobs_cntt-img_0ba61c1e-436b-4beb-85a4-df44899b1097', 'flavor_name': 'rally_jobs_cntt-flavor_0ba61c1e-436b-4beb-85a4-df44899b1097'}"] 2020-04-10 06:32:26,785 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: e6d8596e-ab08-49ee-bc47-31c142205d9c 2020-04-10 06:32:26,785 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : e6d8596e-ab08-49ee-bc47-31c142205d9c 2020-04-10 06:32:26,786 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', 'e6d8596e-ab08-49ee-bc47-31c142205d9c'] 2020-04-10 06:32:28,313 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid e6d8596e-ab08-49ee-bc47-31c142205d9c -------------------------------------------------------------------------------- Task e6d8596e-ab08-49ee-bc47-31c142205d9c: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "args": {}, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": 119 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e6d8596e-ab08-49ee-bc47-31c142205d9c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.926 | 3.105 | 24.915 | 34.077 | 46.814 | 7.366 | 100.0% | 100 | | neutron.list_networks | 0.154 | 0.367 | 1.1 | 1.256 | 1.516 | 0.446 | 100.0% | 100 | | total | 1.16 | 3.389 | 25.279 | 34.526 | 47.174 | 7.812 | 100.0% | 100 | | -> duration | 1.16 | 3.389 | 25.279 | 34.526 | 47.174 | 7.812 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 47.207936 Full duration: 73.064956 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "args": { "network_create_args": {}, "network_update_args": { "admin_state_up": false, "name": "_updated" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e6d8596e-ab08-49ee-bc47-31c142205d9c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.951 | 4.362 | 19.456 | 27.314 | 32.414 | 7.717 | 100.0% | 40 | | neutron.update_network | 0.368 | 0.547 | 1.336 | 1.5 | 1.629 | 0.704 | 100.0% | 40 | | total | 1.474 | 5.354 | 19.918 | 27.904 | 32.79 | 8.422 | 100.0% | 40 | | -> duration | 1.474 | 5.354 | 19.918 | 27.904 | 32.79 | 8.422 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 32.794498 Full duration: 48.952556 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "args": {}, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e6d8596e-ab08-49ee-bc47-31c142205d9c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.069 | 4.693 | 10.797 | 13.907 | 24.444 | 5.903 | 100.0% | 40 | | neutron.delete_network | 1.089 | 1.999 | 3.922 | 4.165 | 5.351 | 2.267 | 100.0% | 40 | | total | 2.888 | 7.499 | 13.66 | 15.033 | 26.716 | 8.17 | 100.0% | 40 | | -> duration | 2.888 | 7.499 | 13.66 | 15.033 | 26.716 | 8.17 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 26.78218 Full duration: 31.324153 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "args": { "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e6d8596e-ab08-49ee-bc47-31c142205d9c has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.898 | 3.461 | 12.988 | 19.978 | 31.481 | 5.984 | 100.0% | 40 | | neutron.create_subnet (x2) | 2.413 | 5.172 | 10.321 | 10.961 | 11.481 | 5.878 | 100.0% | 40 | | neutron.list_subnets | 0.094 | 0.18 | 0.341 | 0.453 | 1.285 | 0.235 | 100.0% | 40 | | total | 4.68 | 10.461 | 18.89 | 26.897 | 34.061 | 12.098 | 100.0% | 40 | | -> duration | 4.68 | 10.461 | 18.89 | 26.897 | 34.061 | 12.098 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 34.060949 Full duration: 66.27528 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_update_args": { "enable_dhcp": true, "name": "_subnet_updated" } }, "runner": { "times": 100, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 5 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e6d8596e-ab08-49ee-bc47-31c142205d9c has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.88 | 2.388 | 9.454 | 14.921 | 49.654 | 4.577 | 100.0% | 100 | | neutron.create_subnet (x2) | 2.628 | 5.502 | 10.047 | 11.777 | 14.056 | 5.971 | 100.0% | 100 | | neutron.update_subnet (x2) | 1.251 | 2.908 | 4.677 | 5.17 | 7.482 | 2.937 | 100.0% | 100 | | total | 5.701 | 11.482 | 22.524 | 28.533 | 55.678 | 13.485 | 100.0% | 100 | | -> duration | 5.701 | 11.482 | 22.524 | 28.533 | 55.678 | 13.485 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 80.296283 Full duration: 145.770075 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e6d8596e-ab08-49ee-bc47-31c142205d9c has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.853 | 4.166 | 12.841 | 16.107 | 28.838 | 5.661 | 100.0% | 40 | | neutron.create_subnet (x2) | 2.657 | 6.038 | 10.106 | 10.514 | 12.35 | 6.287 | 100.0% | 40 | | neutron.delete_subnet (x2) | 2.036 | 4.16 | 6.59 | 7.294 | 7.834 | 4.369 | 100.0% | 40 | | total | 6.639 | 14.993 | 25.387 | 26.723 | 36.385 | 16.318 | 100.0% | 40 | | -> duration | 6.639 | 14.993 | 25.387 | 26.723 | 36.385 | 16.318 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 43.943023 Full duration: 59.447543 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "args": { "network_create_args": null, "subnet_create_args": null, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": null }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e6d8596e-ab08-49ee-bc47-31c142205d9c has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.896 | 3.404 | 15.483 | 20.689 | 27.1 | 6.467 | 100.0% | 40 | | neutron.create_subnet (x2) | 2.861 | 5.656 | 15.4 | 19.283 | 21.193 | 7.296 | 100.0% | 40 | | neutron.create_router (x2) | 0.693 | 1.822 | 3.246 | 3.79 | 4.486 | 1.982 | 100.0% | 40 | | neutron.add_interface_router (x2) | 4.812 | 9.677 | 22.064 | 29.593 | 32.862 | 12.362 | 100.0% | 40 | | neutron.list_routers | 0.144 | 0.28 | 1.269 | 1.352 | 1.961 | 0.506 | 100.0% | 40 | | total | 12.442 | 22.169 | 53.501 | 64.21 | 66.839 | 28.614 | 100.0% | 40 | | -> duration | 12.442 | 22.169 | 53.501 | 64.21 | 66.839 | 28.614 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 67.303813 Full duration: 134.036353 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 1 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {}, "router_update_args": { "admin_state_up": false, "name": "_router_updated" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e6d8596e-ab08-49ee-bc47-31c142205d9c has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.893 | 2.706 | 7.042 | 9.484 | 14.545 | 3.586 | 100.0% | 40 | | neutron.create_subnet (x2) | 2.771 | 6.742 | 11.629 | 13.378 | 19.611 | 7.324 | 100.0% | 40 | | neutron.create_router (x2) | 0.665 | 1.757 | 3.398 | 3.642 | 4.81 | 1.95 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.095 | 12.429 | 20.689 | 29.633 | 31.501 | 14.097 | 100.0% | 40 | | neutron.update_router (x2) | 1.477 | 3.891 | 7.531 | 8.675 | 11.851 | 4.332 | 100.0% | 40 | | total | 16.71 | 26.955 | 47.328 | 63.111 | 66.2 | 31.289 | 100.0% | 40 | | -> duration | 16.71 | 26.955 | 47.328 | 63.111 | 66.2 | 31.289 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 77.367519 Full duration: 147.730599 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 2 args values: { "args": { "network_create_args": {}, "subnet_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "router_create_args": {} }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e6d8596e-ab08-49ee-bc47-31c142205d9c has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.008 | 3.02 | 10.202 | 12.298 | 20.28 | 4.578 | 100.0% | 40 | | neutron.create_subnet (x2) | 2.762 | 6.901 | 12.449 | 13.341 | 14.609 | 7.382 | 100.0% | 40 | | neutron.create_router (x2) | 0.727 | 1.653 | 2.861 | 3.371 | 3.774 | 1.789 | 100.0% | 40 | | neutron.add_interface_router (x2) | 4.942 | 12.828 | 19.395 | 22.132 | 23.836 | 13.054 | 100.0% | 40 | | neutron.remove_interface_router (x2) | 2.678 | 6.639 | 11.364 | 12.245 | 12.511 | 6.773 | 100.0% | 40 | | neutron.delete_router (x2) | 0.922 | 2.343 | 3.398 | 3.663 | 3.931 | 2.369 | 100.0% | 40 | | total | 18.445 | 33.356 | 55.619 | 58.82 | 61.297 | 35.946 | 100.0% | 40 | | -> duration | 18.445 | 33.356 | 55.619 | 58.82 | 61.297 | 35.946 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 89.740896 Full duration: 120.819347 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "args": { "network_create_args": null, "port_create_args": null, "ports_per_network": 50 }, "runner": { "times": 8, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1, "port": 811 } } }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e6d8596e-ab08-49ee-bc47-31c142205d9c has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.011 | 1.743 | 3.321 | 3.749 | 4.177 | 2.155 | 100.0% | 8 | | neutron.create_port (x50) | 34.525 | 36.984 | 38.199 | 38.261 | 38.322 | 36.658 | 100.0% | 8 | | neutron.list_ports | 0.687 | 1.285 | 1.411 | 1.472 | 1.533 | 1.145 | 100.0% | 8 | | total | 36.912 | 39.357 | 42.454 | 42.862 | 43.27 | 39.961 | 100.0% | 8 | | -> duration | 36.912 | 39.357 | 42.454 | 42.862 | 43.27 | 39.961 | 100.0% | 8 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 82.210271 Full duration: 135.723642 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5, "port_update_args": { "admin_state_up": false, "device_id": "dummy_id", "device_owner": "dummy_owner", "name": "_port_updated" } }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e6d8596e-ab08-49ee-bc47-31c142205d9c has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.901 | 3.009 | 10.411 | 13.76 | 34.511 | 5.376 | 100.0% | 40 | | neutron.create_port (x5) | 2.86 | 6.326 | 9.807 | 12.129 | 13.76 | 6.504 | 100.0% | 40 | | neutron.update_port (x5) | 1.92 | 3.98 | 6.319 | 7.998 | 8.231 | 4.398 | 100.0% | 40 | | total | 7.241 | 15.325 | 23.555 | 27.699 | 40.214 | 16.279 | 100.0% | 40 | | -> duration | 7.241 | 15.325 | 23.555 | 27.699 | 40.214 | 16.279 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 40.797855 Full duration: 79.289502 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 2 args values: { "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 5 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e6d8596e-ab08-49ee-bc47-31c142205d9c has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.906 | 3.714 | 12.807 | 22.195 | 37.605 | 6.255 | 100.0% | 40 | | neutron.create_port (x5) | 2.609 | 5.981 | 8.919 | 10.536 | 11.414 | 6.262 | 100.0% | 40 | | neutron.delete_port (x5) | 2.276 | 4.298 | 7.026 | 7.651 | 9.919 | 4.594 | 100.0% | 40 | | total | 8.032 | 14.447 | 30.124 | 34.334 | 43.194 | 17.113 | 100.0% | 40 | | -> duration | 8.032 | 14.447 | 30.124 | 34.334 | 43.194 | 17.113 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 43.253269 Full duration: 59.496047 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "args": { "max_quota": 1024 }, "runner": { "times": 40, "concurrency": 20 }, "contexts": { "users": { "tenants": 20, "users_per_tenant": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e6d8596e-ab08-49ee-bc47-31c142205d9c has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.228 | 0.38 | 0.464 | 1.124 | 1.136 | 0.426 | 100.0% | 40 | | total | 0.277 | 0.441 | 0.533 | 1.185 | 1.208 | 0.486 | 100.0% | 40 | | -> duration | 0.277 | 0.441 | 0.533 | 1.185 | 1.208 | 0.486 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.231951 Full duration: 25.410196 -------------------------------------------------------------------------------- test scenario NeutronTrunks.create_and_list_trunks args position 0 args values: { "args": { "subport_count": 125 }, "runner": { "times": 4, "concurrency": 4 }, "contexts": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "port": 1000 } } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e6d8596e-ab08-49ee-bc47-31c142205d9c has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.131 | 2.071 | 2.812 | 2.907 | 3.002 | 2.069 | 100.0% | 4 | | neutron.create_port (x126) | 104.263 | 107.407 | 111.335 | 111.794 | 112.254 | 107.833 | 100.0% | 4 | | neutron.create_trunk | 27.637 | 29.105 | 30.472 | 30.761 | 31.05 | 29.224 | 100.0% | 4 | | neutron.update_port | 1.271 | 1.381 | 1.425 | 1.426 | 1.428 | 1.365 | 100.0% | 4 | | neutron.list_trunks | 0.068 | 0.078 | 0.092 | 0.094 | 0.097 | 0.08 | 100.0% | 4 | | neutron.list_subports_by_trunk | 0.053 | 0.061 | 0.083 | 0.087 | 0.09 | 0.066 | 100.0% | 4 | | neutron.list_ports_by_device_id | 0.254 | 0.932 | 1.641 | 1.718 | 1.795 | 0.978 | 100.0% | 4 | | total | 137.324 | 141.953 | 145.072 | 145.165 | 145.257 | 141.622 | 100.0% | 4 | | -> duration | 137.324 | 141.953 | 145.072 | 145.165 | 145.257 | 141.622 | 100.0% | 4 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 4 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 145.26212 Full duration: 230.671002 HINTS: * To plot HTML graphics with this data, run: rally task report e6d8596e-ab08-49ee-bc47-31c142205d9c --out output.html * To generate a JUnit report, run: rally task export e6d8596e-ab08-49ee-bc47-31c142205d9c --type junit-xml --to output.xml * To get raw JSON output of task results, run: rally task report e6d8596e-ab08-49ee-bc47-31c142205d9c --json --out output.json 2020-04-10 06:32:28,315 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', 'e6d8596e-ab08-49ee-bc47-31c142205d9c', '--out', '/home/opnfv/functest/results/rally_jobs_cntt/neutron.json'] 2020-04-10 06:32:32,211 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid e6d8596e-ab08-49ee-bc47-31c142205d9c --out /home/opnfv/functest/results/rally_jobs_cntt/neutron.json 2020-04-10 06:32:32,370 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2020-04-10 06:32:32,371 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 00:22:38 | 612 | 100.00% | | | | | | | TOTAL: | 00:22:38 | 612 | 100.00% | +-----------+------------+----------------+-----------+ 2020-04-10 06:32:32,372 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs_cntt' success_rate is 100.00% in 1/1 modules 2020-04-10 06:32:32,372 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.html'] 2020-04-10 06:32:36,052 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.html 2020-04-10 06:32:36,053 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.xml'] 2020-04-10 06:32:39,204 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs_cntt/rally_jobs_cntt.xml 2020-04-10 06:32:39,204 - xtesting.ci.run_tests - INFO - Test result: +-------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------------+------------------+------------------+----------------+ | rally_jobs_cntt | functest | 23:37 | PASS | +-------------------------+------------------+------------------+----------------+ 2020-04-10 06:32:48,670 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)