2019-12-13 17:27:26,088 - xtesting.ci.run_tests - INFO - Deployment description: +-------------------------+---------------------------------------------------------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+---------------------------------------------------------------------------------------------------------+ | TEST_DB_EXT_URL | http://testresults.opnfv.org/test/api/v1/results | | S3_DST_URL | s3://artifacts.opnfv.org/airship/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-44 | | S3_ENDPOINT_URL | https://storage.googleapis.com | | DEPLOY_SCENARIO | os-nosdn-nofeature-ha | | BUILD_TAG | KBOIHS88MCL0 | | DEBUG | true | | INSTALLER_TYPE | airship | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | HTTP_DST_URL | http://artifacts.opnfv.org/airship/airship-opnfv-functest-benchmarking-latest-rally_jobs-run-44 | | NODE_NAME | intel-pod17 | +-------------------------+---------------------------------------------------------------------------------------------------------+ 2019-12-13 17:27:26,092 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file export OS_AUTH_URL=http://identity-airship.intel-pod17.opnfv.org:80/v3 export OS_USER_DOMAIN_NAME=default export OS_PROJECT_DOMAIN_NAME=default export OS_USERNAME=admin export OS_PROJECT_NAME=admin export OS_PASSWORD=password123 export OS_IDENTITY_API_VERSION=3 export OS_INTERFACE=public export OS_REGION_NAME=intel-pod17 2019-12-13 17:27:26,092 - xtesting.ci.run_tests - DEBUG - Test args: rally_jobs 2019-12-13 17:27:26,101 - xtesting.ci.run_tests - INFO - Loading test case 'rally_jobs'... 2019-12-13 17:27:26,924 - functest.core.tenantnetwork - DEBUG - password: 2A_z]@6j|Lfinished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 77662b58-7e04-4a46-8b8a-3a7ceec86d59 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2019-12-13 17:27:46,817 - functest.opnfv_tests.openstack.rally.rally - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | placement | Available | | cinder | volume | Available | | cinder | volumev2 | Available | | cinder | volumev3 | Available | | cloud | cloudformation | Available | | glance | image | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | | swift | object-store | Available | +-------------+----------------+-----------+ 2019-12-13 17:27:47,586 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating run tests... 2019-12-13 17:27:47,771 - functest.core.singlevm - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_alt_1993dde4-dc94-485c-baec-25f438e57760', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'96c535b1698647bb8b7a169563e81178', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'7cf70325-2519-4ad2-ab47-503a1f1822ad', 'swap': 0}) 2019-12-13 17:27:47,867 - functest.opnfv_tests.openstack.rally.rally - DEBUG - flavor: Munch({'name': u'rally_jobs-flavor_alt_1993dde4-dc94-485c-baec-25f438e57760', 'ephemeral': 0, 'ram': 1024, 'is_disabled': False, 'properties': Munch({u'OS-FLV-DISABLED:disabled': False, u'OS-FLV-EXT-DATA:ephemeral': 0, u'os-flavor-access:is_public': True}), u'OS-FLV-DISABLED:disabled': False, 'vcpus': 1, 'extra_specs': Munch({}), 'location': Munch({'project': Munch({'domain_id': None, 'id': u'96c535b1698647bb8b7a169563e81178', 'name': 'admin', 'domain_name': 'default'}), 'zone': None, 'region_name': 'intel-pod17', 'cloud': 'envvars'}), u'os-flavor-access:is_public': True, 'rxtx_factor': 1.0, 'is_public': True, u'OS-FLV-EXT-DATA:ephemeral': 0, 'disk': 1, 'id': u'7cf70325-2519-4ad2-ab47-503a1f1822ad', 'swap': 0}) 2019-12-13 17:27:47,871 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /home/opnfv/functest/data/rally/neutron/rally-jobs/task-neutron.yaml 2019-12-13 17:27:47,872 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2019-12-13 17:27:47,889 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete', u'^NeutronTrunk'] 2019-12-13 17:27:48,147 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2019-12-13 17:27:48,147 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--tag', 'neutron', '--task', u'/home/opnfv/functest/data/rally/task/var/task-neutron.yaml'] 2019-12-13 17:47:39,511 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task list --tag neutron --uuids-only: e0882c5d-fa0d-4220-b701-393905d42074 2019-12-13 17:47:39,512 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : e0882c5d-fa0d-4220-b701-393905d42074 2019-12-13 17:47:39,512 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '--uuid', u'e0882c5d-fa0d-4220-b701-393905d42074'] 2019-12-13 17:47:40,534 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task detailed --uuid e0882c5d-fa0d-4220-b701-393905d42074 -------------------------------------------------------------------------------- Task e0882c5d-fa0d-4220-b701-393905d42074: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 20, "times": 100 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": 119 } } }, "args": {}, "sla": { "max_avg_duration_per_atomic": { "neutron.list_networks": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e0882c5d-fa0d-4220-b701-393905d42074 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.528 | 1.216 | 2.281 | 2.601 | 3.033 | 1.337 | 100.0% | 100 | | neutron.list_networks | 0.239 | 0.679 | 1.124 | 1.367 | 1.8 | 0.741 | 100.0% | 100 | | total | 1.039 | 2.045 | 3.034 | 3.519 | 4.073 | 2.078 | 100.0% | 100 | | -> duration | 1.039 | 2.045 | 3.034 | 3.519 | 4.073 | 2.078 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.416081 Full duration: 33.238948 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_networks args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {}, "network_update_args": { "name": "_updated", "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e0882c5d-fa0d-4220-b701-393905d42074 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.455 | 1.129 | 2.406 | 2.794 | 2.891 | 1.32 | 100.0% | 40 | | neutron.update_network | 0.562 | 1.589 | 2.233 | 2.329 | 2.711 | 1.56 | 100.0% | 40 | | total | 1.109 | 2.705 | 4.587 | 4.804 | 4.868 | 2.88 | 100.0% | 40 | | -> duration | 1.109 | 2.705 | 4.587 | 4.804 | 4.868 | 2.88 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.261076 Full duration: 19.893412 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e0882c5d-fa0d-4220-b701-393905d42074 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.506 | 1.258 | 2.078 | 2.243 | 2.589 | 1.28 | 100.0% | 40 | | neutron.delete_network | 0.762 | 1.292 | 2.361 | 2.408 | 2.619 | 1.504 | 100.0% | 40 | | total | 1.532 | 2.712 | 3.916 | 4.086 | 4.491 | 2.785 | 100.0% | 40 | | -> duration | 1.532 | 2.712 | 3.916 | 4.086 | 4.491 | 2.785 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.628609 Full duration: 12.197398 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": { "subnets_per_network": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e0882c5d-fa0d-4220-b701-393905d42074 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.458 | 1.031 | 2.528 | 2.663 | 2.796 | 1.243 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.339 | 3.292 | 6.208 | 8.167 | 8.499 | 3.982 | 100.0% | 40 | | neutron.list_subnets | 0.235 | 0.535 | 0.845 | 1.1 | 1.238 | 0.56 | 100.0% | 40 | | total | 2.274 | 4.672 | 9.066 | 10.485 | 11.597 | 5.785 | 100.0% | 40 | | -> duration | 2.274 | 4.672 | 9.066 | 10.485 | 11.597 | 5.785 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.028294 Full duration: 48.097788 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_subnets args position 1 args values: { "runner": { "concurrency": 20, "times": 100 }, "contexts": { "users": { "users_per_tenant": 5, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.4.0.0/16", "subnets_per_network": 2, "subnet_create_args": {}, "subnet_update_args": { "name": "_subnet_updated", "enable_dhcp": true } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e0882c5d-fa0d-4220-b701-393905d42074 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.434 | 0.984 | 1.891 | 2.559 | 2.872 | 1.153 | 100.0% | 100 | | neutron.create_subnet (x2) | 1.339 | 3.688 | 6.254 | 7.427 | 8.552 | 4.151 | 100.0% | 100 | | neutron.update_subnet (x2) | 1.435 | 3.341 | 6.702 | 7.16 | 8.269 | 3.683 | 100.0% | 100 | | total | 3.827 | 9.039 | 12.114 | 13.219 | 14.175 | 8.987 | 100.0% | 100 | | -> duration | 3.827 | 9.039 | 12.114 | 13.219 | 14.175 | 8.987 | 100.0% | 100 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 100 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 47.907347 Full duration: 97.927975 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e0882c5d-fa0d-4220-b701-393905d42074 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.471 | 1.032 | 1.689 | 1.931 | 2.26 | 1.164 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.324 | 3.472 | 5.526 | 7.007 | 7.286 | 3.588 | 100.0% | 40 | | neutron.delete_subnet (x2) | 1.456 | 4.014 | 6.252 | 6.416 | 7.191 | 4.077 | 100.0% | 40 | | total | 3.88 | 8.801 | 12.895 | 14.284 | 14.652 | 8.83 | 100.0% | 40 | | -> duration | 3.88 | 8.801 | 12.895 | 14.284 | 14.652 | 8.83 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 23.383961 Full duration: 37.361008 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": null, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": null, "router_create_args": null }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e0882c5d-fa0d-4220-b701-393905d42074 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.491 | 1.069 | 1.681 | 2.029 | 2.8 | 1.158 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.463 | 3.482 | 5.337 | 6.383 | 8.17 | 3.603 | 100.0% | 40 | | neutron.create_router (x2) | 9.774 | 17.865 | 28.206 | 30.323 | 40.496 | 19.043 | 100.0% | 40 | | neutron.add_interface_router (x2) | 4.794 | 9.074 | 18.37 | 19.835 | 24.179 | 10.644 | 100.0% | 40 | | neutron.list_routers | 0.232 | 0.511 | 0.647 | 0.708 | 1.063 | 0.508 | 100.0% | 40 | | total | 18.81 | 33.076 | 51.857 | 59.529 | 66.118 | 34.957 | 100.0% | 40 | | -> duration | 18.81 | 33.076 | 51.857 | 59.529 | 66.118 | 34.957 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 89.222598 Full duration: 177.043512 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_routers args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "subnets_per_network": 2, "subnet_cidr_start": "1.1.0.0/30", "network_create_args": {}, "subnet_create_args": {}, "router_update_args": { "name": "_router_updated", "admin_state_up": false }, "router_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e0882c5d-fa0d-4220-b701-393905d42074 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.493 | 1.155 | 1.792 | 1.835 | 2.702 | 1.203 | 100.0% | 40 | | neutron.create_subnet (x2) | 2.011 | 3.316 | 5.309 | 5.364 | 6.382 | 3.524 | 100.0% | 40 | | neutron.create_router (x2) | 11.022 | 19.183 | 28.003 | 30.125 | 33.418 | 19.813 | 100.0% | 40 | | neutron.add_interface_router (x2) | 5.807 | 8.981 | 12.858 | 13.001 | 19.638 | 9.53 | 100.0% | 40 | | neutron.update_router (x2) | 1.112 | 2.172 | 3.75 | 4.121 | 4.44 | 2.498 | 100.0% | 40 | | total | 25.56 | 35.567 | 50.293 | 50.688 | 53.781 | 36.568 | 100.0% | 40 | | -> duration | 25.56 | 35.567 | 50.293 | 50.688 | 53.781 | 36.568 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 89.803039 Full duration: 183.832835 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 2, "subnet_create_args": {}, "router_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e0882c5d-fa0d-4220-b701-393905d42074 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.447 | 1.033 | 2.162 | 2.469 | 3.167 | 1.209 | 100.0% | 40 | | neutron.create_subnet (x2) | 1.545 | 3.815 | 5.614 | 5.698 | 5.774 | 3.655 | 100.0% | 40 | | neutron.create_router (x2) | 8.042 | 20.543 | 31.839 | 33.059 | 39.341 | 21.115 | 100.0% | 40 | | neutron.add_interface_router (x2) | 4.616 | 9.617 | 14.981 | 18.513 | 21.181 | 10.052 | 100.0% | 40 | | neutron.remove_interface_router (x2) | 3.862 | 7.177 | 11.782 | 13.682 | 18.603 | 8.055 | 100.0% | 40 | | neutron.delete_router (x2) | 4.712 | 10.41 | 16.061 | 17.792 | 21.66 | 10.705 | 100.0% | 40 | | total | 35.621 | 52.42 | 74.347 | 78.253 | 84.7 | 54.791 | 100.0% | 40 | | -> duration | 35.621 | 52.42 | 74.347 | 78.253 | 84.7 | 54.791 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 125.357289 Full duration: 158.440308 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 4, "times": 8 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "port": 811, "subnet": -1, "network": -1, "router": -1 } } }, "args": { "network_create_args": null, "ports_per_network": 50, "port_create_args": null }, "sla": { "max_avg_duration_per_atomic": { "neutron.list_ports": 15 }, "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e0882c5d-fa0d-4220-b701-393905d42074 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.48 | 0.646 | 1.064 | 1.079 | 1.095 | 0.709 | 100.0% | 8 | | neutron.create_port (x50) | 67.919 | 90.646 | 103.779 | 105.281 | 106.784 | 89.206 | 100.0% | 8 | | neutron.list_ports | 0.826 | 1.111 | 1.38 | 1.497 | 1.615 | 1.131 | 100.0% | 8 | | total | 69.618 | 92.699 | 105.691 | 107.177 | 108.663 | 91.048 | 100.0% | 8 | | -> duration | 69.618 | 92.699 | 105.691 | 107.177 | 108.663 | 91.048 | 100.0% | 8 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 8 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 189.989682 Full duration: 246.461448 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_update_ports args position 1 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "ports_per_network": 5, "port_create_args": {}, "port_update_args": { "device_owner": "dummy_owner", "device_id": "dummy_id", "name": "_port_updated", "admin_state_up": false } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e0882c5d-fa0d-4220-b701-393905d42074 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.519 | 1.003 | 1.713 | 1.89 | 2.333 | 1.143 | 100.0% | 40 | | neutron.create_port (x5) | 6.077 | 9.769 | 12.354 | 13.993 | 16.593 | 10.063 | 100.0% | 40 | | neutron.update_port (x5) | 3.103 | 6.066 | 8.718 | 9.824 | 10.655 | 6.061 | 100.0% | 40 | | total | 11.034 | 16.857 | 22.315 | 23.972 | 27.406 | 17.268 | 100.0% | 40 | | -> duration | 11.034 | 16.857 | 22.315 | 23.972 | 27.406 | 17.268 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 38.462976 Full duration: 77.013317 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 2 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1, "port": -1 } } }, "args": { "network_create_args": {}, "ports_per_network": 5, "port_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e0882c5d-fa0d-4220-b701-393905d42074 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.404 | 1.156 | 1.727 | 1.887 | 2.073 | 1.129 | 100.0% | 40 | | neutron.create_port (x5) | 6.52 | 10.028 | 12.074 | 12.265 | 12.502 | 10.068 | 100.0% | 40 | | neutron.delete_port (x5) | 5.485 | 7.549 | 8.918 | 9.286 | 10.148 | 7.641 | 100.0% | 40 | | total | 14.207 | 18.464 | 22.254 | 22.566 | 22.718 | 18.839 | 100.0% | 40 | | -> duration | 14.207 | 18.464 | 22.254 | 22.566 | 22.718 | 18.839 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 41.87239 Full duration: 56.166288 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 20, "times": 40 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 20 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e0882c5d-fa0d-4220-b701-393905d42074 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.182 | 0.305 | 0.567 | 0.606 | 0.611 | 0.356 | 100.0% | 40 | | total | 0.344 | 0.655 | 0.766 | 0.813 | 0.831 | 0.615 | 100.0% | 40 | | -> duration | 0.344 | 0.655 | 0.766 | 0.813 | 0.831 | 0.615 | 100.0% | 40 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 40 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.532384 Full duration: 23.778442 HINTS: * To plot HTML graphics with this data, run: rally task report e0882c5d-fa0d-4220-b701-393905d42074 --out output.html * To generate a JUnit report, run: rally task export e0882c5d-fa0d-4220-b701-393905d42074 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report e0882c5d-fa0d-4220-b701-393905d42074 --json --out output.json 2019-12-13 17:47:40,536 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '--json', '--uuid', u'e0882c5d-fa0d-4220-b701-393905d42074', '--out', u'/home/opnfv/functest/results/rally_jobs/neutron.json'] 2019-12-13 17:47:42,920 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task report --json --uuid e0882c5d-fa0d-4220-b701-393905d42074 --out /home/opnfv/functest/results/rally_jobs/neutron.json 2019-12-13 17:47:43,035 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2019-12-13 17:47:43,036 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +-----------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +-----------+------------+----------------+-----------+ | neutron | 00:19:31 | 608 | 100.00% | | | | | | | TOTAL: | 00:19:31 | 608 | 100.00% | +-----------+------------+----------------+-----------+ 2019-12-13 17:47:43,036 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_jobs' success_rate is 100.00% in 1/1 modules 2019-12-13 17:47:43,036 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'html', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.html'] 2019-12-13 17:47:45,549 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type html --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.html 2019-12-13 17:47:45,550 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'export', '--type', 'junit-xml', '--deployment', 'opnfv-rally', '--to', '/home/opnfv/functest/results/rally_jobs/rally_jobs.xml'] 2019-12-13 17:47:47,821 - functest.opnfv_tests.openstack.rally.rally - INFO - rally task export --type junit-xml --deployment opnfv-rally --to /home/opnfv/functest/results/rally_jobs/rally_jobs.xml 2019-12-13 17:47:47,821 - xtesting.ci.run_tests - INFO - Test result: +--------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------+------------------+------------------+----------------+ | rally_jobs | functest | 20:20 | PASS | +--------------------+------------------+------------------+----------------+ 2019-12-13 17:48:02,014 - xtesting.core.testcase - DEBUG - Publishing /home/opnfv/functest/results/functest.log ('text/plain', None)