FuncTest test results¶
FuncTest test result document overview¶
Functest project is described in Functest user guide. The user guide details the different test cases as well as the possible errors. A developer guide and a configuration guide are also available.
Functest is run systematically at the end of an OPNFV fresh installation. All the runnable tests are run sequentially. The installer and the scenario are considered to evaluate whether the test case can be run or not. That is why all the number of test cases may vary from 1 installer to another and from 1 scenario to another.
The list of scenario supported by installer can be described as follows:
| Scenario | Apex | Compass | Fuel | Joid |
|---|---|---|---|---|
| odl_l2 | X | X | X | X |
| onos | X | |||
| nosdn | X | X | ||
| ovs (dpdk) | X |
The matrix below details the Functest runnable tests versus the installer and the scenario:
| Test cases | Apex | Compass | Fuel | Joid |
|---|---|---|---|---|
| vPing SSH | all | all | all | all |
| vPing userdata | all except ONOS | all except ONOS | all except ONOS | all except ONOS |
| Tempest | all | all | all | all |
| Rally | all | all | all | all |
| ODL | all ODL | all ODL | all ODL | all ODL |
| ONOS | ONOS | ONOS | ONOS | ONOS |
| Promise | no | no | all | all |
| vIMS | all except ONOS | all except ONOS | all except ONOS | all except ONOS |
| Doctor | all | no | no | no |
all means that the test case is run on all the scenarios related to the installer.
- Functest results from continuous integration can be found in:
- jenkins logs: https://build.opnfv.org/ci/view/functest/
- artifacts http://artifacts.opnfv.org/, it includes the tempest logs and the
Rally html pages
Additional test result assests and information¶
- The Functest deals with 2 dashboards:
The Test Dashboard provides an overview of all the projects
The Functest Dashboard dedicated to Functest real-time test results
- is used to provide a quick overview of the different testcases according to installer and scenario.
Results listed by scenario¶
The following sections describe the functest results as evaluated for the Brahmaputra release scenario validation runs. Each section describes the determined state of the specific scenario as deployed in the Brahmaputra release process.
To qualify for release the scenarios must have deployed and been successfully tested in four consecutive installations to establish stability of deployment and feature capability
Detailed test results for compass-os-nosdn-nofeature-ha¶
VIM¶
vping_ssh¶
FUNCTEST.info: Running vPing-SSH test...
vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
vPing_ssh- INFO - Creating neutron network vping-net...
vPing_ssh- INFO - Creating security group 'vPing-sg'...
vPing_ssh- INFO - Using existing Flavor 'm1.small'...
vPing_ssh- INFO - vPing Start Time:'2016-02-23 04:35:47'
vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
name=opnfv-vping-1
flavor=<Flavor: m1.small>
image=193891f9-6644-4668-9ac4-bd9336610a99
network=999caa31-8f28-4737-aa6e-3981e28a7e55
vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
name=opnfv-vping-2
flavor=<Flavor: m1.small>
image=193891f9-6644-4668-9ac4-bd9336610a99
network=999caa31-8f28-4737-aa6e-3981e28a7e55
vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
vPing_ssh- INFO - Floating IP created: '192.168.10.101'
vPing_ssh- INFO - Associating floating ip: '192.168.10.101' to VM 'opnfv-vping-2'
vPing_ssh- INFO - Trying to establish SSH connection to 192.168.10.101...
vPing_ssh- INFO - Waiting for ping...
vPing_ssh- INFO - vPing detected!
vPing_ssh- INFO - vPing duration:'43.2' s.
vPing_ssh- INFO - Cleaning up...
vPing_ssh- INFO - vPing OK
vping_userdata¶
FUNCTEST.info: Running vPing-userdata test...
vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
vPing_userdata- INFO - Creating neutron network vping-net...
vPing_userdata- INFO - Creating security group 'vPing-sg'...
vPing_userdata- INFO - Flavor found 'm1.small'
vPing_userdata- INFO - vPing Start Time:'2016-02-23 04:36:44'
vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
name=opnfv-vping-1
flavor=<Flavor: m1.small>
image=53004632-aa69-4868-8234-2ef945681fcd
network=bf5529b1-1cb7-4ea6-93b8-5ff436c5ed3c
vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
name=opnfv-vping-2
flavor=<Flavor: m1.small>
image=53004632-aa69-4868-8234-2ef945681fcd
network=bf5529b1-1cb7-4ea6-93b8-5ff436c5ed3c
userdata=
#!/bin/sh
while true; do
ping -c 1 192.168.130.3 2>&1 >/dev/null
RES=$?
if [ "Z$RES" = "Z0" ] ; then
echo 'vPing OK'
break
else
echo 'vPing KO'
fi
sleep 1
done
vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
vPing_userdata- INFO - Waiting for ping...
vPing_userdata- INFO - vPing detected!
vPing_userdata- INFO - vPing duration:'24.4'
vPing_userdata- INFO - vPing OK
vPing_userdata- INFO - Cleaning up...
vPing_userdata- INFO - Deleting network 'vping-net'...
Tempest¶
FUNCTEST.info: Running Tempest tests...
run_tempest - INFO - Creating tenant and user for Tempest suite
2016-02-23 04:37:19.865 23855 INFO rally.verification.tempest.tempest [-] Starting: Creating configuration file for Tempest.
2016-02-23 04:37:24.332 23855 INFO rally.verification.tempest.tempest [-] Completed: Creating configuration file for Tempest.
run_tempest - INFO - Starting Tempest test suite: '--tests-file /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/custom_tests/test_list.txt'.
Total results of verification:
+--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
| UUID | Deployment UUID | Set name | Tests | Failures | Created at | Status |
+--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
| 28be74fb-34e0-4247-833c-a8c5b3fd85d2 | d2a31b24-70b3-48ab-bd03-8d7a0dab20bd | | 210 | 0 | 2016-02-23 04:37:25.793306 | finished |
+--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
Tests:
+------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
| name | time | status |
+------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
| tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor | 0.20837 | success |
| tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors | 0.20097 | success |
| tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image | 27.41889 | success |
| tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image | 6.64765 | success |
| tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name | 7.27470 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since | 0.06285 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name | 0.06897 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id | 0.06414 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref | 0.11873 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status | 0.06762 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type | 0.06739 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results | 0.06986 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since | 0.06254 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name | 0.05104 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref | 0.12018 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status | 0.07818 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type | 0.10564 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results | 0.06481 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image | 0.30634 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images | 1.20722 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail | 0.13093 | success |
| tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create | 0.38276 | success |
| tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list | 0.54540 | success |
| tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete | 3.33321 | success |
| tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip | 17.36469 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name | 3.15517 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers | 0.06856 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail | 0.18377 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus | 0.16882 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details | 0.00068 | success |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name | 3.15690 | success |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers | 0.07962 | success |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail | 0.15120 | success |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus | 0.18218 | success |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details | 0.00110 | success |
| tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action | 0.06973 | success |
| tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions | 6.27398 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor | 0.20951 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image | 0.18499 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name | 0.15917 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status | 0.31948 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results | 0.14946 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor | 0.07635 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image | 0.07788 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit | 0.06447 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name | 0.05937 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status | 0.07365 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip | 0.19332 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex | 0.00071 | skip |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard | 0.15138 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date | 0.06312 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date | 0.01957 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits | 0.07095 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.08593 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value | 0.01455 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string | 0.01158 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor | 0.04029 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image | 0.06225 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name | 0.06189 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted | 0.26184 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing | 0.02082 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server | 0.06492 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password | 0.00083 | skip |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output | 3.32560 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server | 8.17266 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard | 8.58619 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft | 0.29429 | skip |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server | 79.87435 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm | 14.54175 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert | 23.12381 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server | 6.94824 | success |
| tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses | 0.08712 | success |
| tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network | 0.16214 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item | 0.68228 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item | 0.29523 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata | 0.35906 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata | 0.68377 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item | 0.54206 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata | 0.55368 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password | 2.45879 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair | 29.40153 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name | 25.63768 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address | 14.29183 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name | 12.85255 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name | 0.59683 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit | 0.78070 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 | 0.64926 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor | 0.79184 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image | 0.62816 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid | 0.67889 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant | 0.91872 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit | 0.67651 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id | 0.39363 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server | 0.50851 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address | 0.57311 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server | 0.45111 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server | 0.39532 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor | 0.43734 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor | 0.62367 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank | 0.59665 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server | 0.38844 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server | 1.29632 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 | 0.34865 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant | 0.46513 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name | 0.41424 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant | 0.08979 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect | 0.01101 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image | 0.07763 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails | 0.01368 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails | 0.50557 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails | 0.08336 | success |
| tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas | 0.23059 | success |
| tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas | 0.05377 | success |
| tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume | 42.94954 | success |
| tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list | 0.65627 | success |
| tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details | 0.08496 | success |
| tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id | 0.09567 | success |
| tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id | 0.00685 | success |
| tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services | 0.20509 | success |
| tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user | 0.12058 | success |
| tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete | 0.13306 | success |
| tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists | 0.03344 | success |
| tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain | 0.28451 | success |
| tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint | 0.15089 | success |
| tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete | 0.93789 | success |
| tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy | 0.11553 | success |
| tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id | 0.11774 | success |
| tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list | 0.20859 | success |
| tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service | 0.15701 | success |
| tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all | 0.84413 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.02197 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.01614 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.01513 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.01626 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.01377 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.01219 | success |
| tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params | 0.06385 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image | 0.74490 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file | 0.30669 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image | 0.42703 | success |
| tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions | 0.46679 | success |
| tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address | 1.11398 | success |
| tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip | 1.40153 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network | 0.62250 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port | 1.06048 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet | 3.64767 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network | 1.05674 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port | 1.46703 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet | 1.15288 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet | 1.19505 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility | 0.18705 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks | 0.16809 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets | 0.06150 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network | 0.06589 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet | 0.03918 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet | 1.09078 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility | 0.12778 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks | 0.04437 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets | 0.07037 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network | 0.08725 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet | 0.03485 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools | 0.94866 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups | 1.57085 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port | 0.63361 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports | 0.05208 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port | 0.04959 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools | 1.22772 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups | 1.51603 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port | 0.89179 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_list_ports | 0.16512 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_show_port | 0.05618 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces | 4.21613 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id | 1.92424 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id | 1.44097 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router | 1.08964 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces | 3.05695 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id | 1.48158 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id | 1.24519 | success |
| tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router | 1.01040 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group | 0.40816 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule | 0.55388 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups | 0.02194 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group | 0.51425 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule | 0.62336 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups | 0.02465 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list | 0.31894 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show | 6.32025 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template | 0.02302 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list | 0.66552 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata | 0.40307 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config | 0.43128 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate | 0.50089 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change | 0.47817 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change | 0.50681 | success |
| tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources | 3.37768 | success |
| tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds | 0.07322 | success |
| tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications | 0.82997 | success |
| tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications | 1.47396 | success |
| tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance | 2.64936 | success |
| tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance | 1.83658 | success |
| tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete | 12.39640 | success |
| tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image | 11.41953 | success |
| tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete | 11.27254 | success |
| tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image | 11.80658 | success |
| tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list | 0.05079 | success |
| tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list | 0.05690 | success |
| tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops | 44.43032 | success |
| tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops | 21.90475 | success |
| tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern | 121.16825 | success |
| tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern | 117.34801 | success |
+------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
run_tempest - INFO - Results: {'timestart': '2016-02-2304:37:25.793306', 'duration': 261, 'tests': 210, 'failures': 0}
run_tempest - INFO - Pushing results to DB: 'http://testresults.opnfv.org/testapi/results'.
run_tempest - INFO - Deleting tenant and user for Tempest suite)
Rally¶
FUNCTEST.info: Running Rally benchmark suite...
run_rally - INFO - Starting test scenario "authenticate" ...
run_rally - INFO -
Preparing input task
Task d78a7e66-b2a5-42de-ac0c-cc6145aaa77a: started
Task d78a7e66-b2a5-42de-ac0c-cc6145aaa77a: finished
test scenario Authenticate.validate_glance
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_glance | 0.122 | 0.136 | 0.153 | 0.155 | 0.158 | 0.138 | 100.0% | 10 |
| authenticate.validate_glance (2) | 0.039 | 0.045 | 0.056 | 0.06 | 0.064 | 0.047 | 100.0% | 10 |
| total | 0.227 | 0.264 | 0.28 | 0.283 | 0.285 | 0.26 | 100.0% | 10 |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.795955181122
Full duration: 2.89371585846
test scenario Authenticate.keystone
+-----------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
| total | 0.064 | 0.077 | 0.097 | 0.114 | 0.131 | 0.081 | 100.0% | 10 |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.246862888336
Full duration: 2.44218397141
test scenario Authenticate.validate_heat
+-----------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_heat | 0.127 | 0.151 | 0.186 | 0.195 | 0.205 | 0.157 | 100.0% | 10 |
| authenticate.validate_heat (2) | 0.026 | 0.09 | 0.113 | 0.133 | 0.153 | 0.08 | 100.0% | 10 |
| total | 0.228 | 0.319 | 0.383 | 0.402 | 0.422 | 0.321 | 100.0% | 10 |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.963713884354
Full duration: 3.11927700043
test scenario Authenticate.validate_nova
+-----------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_nova | 0.104 | 0.122 | 0.133 | 0.139 | 0.144 | 0.121 | 100.0% | 10 |
| authenticate.validate_nova (2) | 0.028 | 0.031 | 0.04 | 0.041 | 0.042 | 0.034 | 100.0% | 10 |
| total | 0.2 | 0.243 | 0.249 | 0.256 | 0.263 | 0.235 | 100.0% | 10 |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.704430103302
Full duration: 2.78888607025
test scenario Authenticate.validate_cinder
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_cinder | 0.102 | 0.117 | 0.131 | 0.139 | 0.147 | 0.119 | 100.0% | 10 |
| authenticate.validate_cinder (2) | 0.019 | 0.076 | 0.083 | 0.085 | 0.087 | 0.071 | 100.0% | 10 |
| total | 0.229 | 0.263 | 0.304 | 0.317 | 0.331 | 0.269 | 100.0% | 10 |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.82511305809
Full duration: 2.97128987312
test scenario Authenticate.validate_neutron
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_neutron | 0.111 | 0.12 | 0.134 | 0.135 | 0.135 | 0.123 | 100.0% | 10 |
| authenticate.validate_neutron (2) | 0.03 | 0.086 | 0.104 | 0.104 | 0.104 | 0.084 | 100.0% | 10 |
| total | 0.22 | 0.28 | 0.307 | 0.31 | 0.312 | 0.278 | 100.0% | 10 |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.855668067932
Full duration: 3.13501811028
run_rally - INFO - Test scenario: "authenticate" OK.
run_rally - INFO - Starting test scenario "glance" ...
run_rally - INFO -
Preparing input task
Task 3234c959-6176-4a4f-adf4-50f3f3083d67: started
Task 3234c959-6176-4a4f-adf4-50f3f3083d67: finished
test scenario GlanceImages.list_images
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| glance.list_images | 0.189 | 0.215 | 0.246 | 0.252 | 0.258 | 0.218 | 100.0% | 10 |
| total | 0.189 | 0.215 | 0.246 | 0.252 | 0.258 | 0.218 | 100.0% | 10 |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.649740934372
Full duration: 3.67985486984
test scenario GlanceImages.create_image_and_boot_instances
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| glance.create_image | 2.782 | 3.177 | 3.617 | 3.638 | 3.659 | 3.198 | 100.0% | 10 |
| nova.boot_servers | 9.48 | 13.931 | 17.26 | 17.274 | 17.287 | 13.824 | 100.0% | 10 |
| total | 12.296 | 16.956 | 20.848 | 20.857 | 20.866 | 17.022 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 49.9618289471
Full duration: 73.9044458866
test scenario GlanceImages.create_and_list_image
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| glance.create_image | 2.779 | 3.406 | 3.655 | 3.673 | 3.692 | 3.306 | 100.0% | 10 |
| glance.list_images | 0.039 | 0.046 | 0.048 | 0.049 | 0.049 | 0.045 | 100.0% | 10 |
| total | 2.82 | 3.453 | 3.703 | 3.722 | 3.741 | 3.351 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 9.77695393562
Full duration: 14.4172940254
test scenario GlanceImages.create_and_delete_image
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| glance.create_image | 2.788 | 3.69 | 3.785 | 3.83 | 3.876 | 3.489 | 100.0% | 10 |
| glance.delete_image | 0.129 | 0.146 | 0.203 | 0.239 | 0.275 | 0.166 | 100.0% | 10 |
| total | 2.933 | 3.884 | 3.951 | 3.986 | 4.02 | 3.655 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 10.762845993
Full duration: 13.6261451244
run_rally - INFO - Test scenario: "glance" OK.
run_rally - INFO - Starting test scenario "cinder" ...
run_rally - INFO -
Preparing input task
Task 21cb74f0-6bd9-44e3-aff3-99085ad0525f: started
Task 21cb74f0-6bd9-44e3-aff3-99085ad0525f: finished
test scenario CinderVolumes.create_and_attach_volume
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 7.723 | 10.184 | 13.839 | 13.936 | 14.032 | 10.913 | 100.0% | 10 |
| cinder.create_volume | 2.731 | 2.833 | 2.935 | 3.005 | 3.076 | 2.847 | 100.0% | 10 |
| nova.attach_volume | 7.613 | 7.977 | 8.755 | 9.542 | 10.33 | 8.197 | 100.0% | 10 |
| nova.detach_volume | 3.034 | 3.429 | 5.352 | 5.414 | 5.476 | 4.052 | 100.0% | 10 |
| cinder.delete_volume | 2.44 | 2.495 | 2.591 | 2.6 | 2.609 | 2.503 | 100.0% | 10 |
| nova.delete_server | 2.423 | 2.508 | 2.823 | 3.661 | 4.499 | 2.704 | 100.0% | 10 |
| total | 28.081 | 29.986 | 35.858 | 36.584 | 37.309 | 31.218 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 93.1938638687
Full duration: 105.67930007
test scenario CinderVolumes.create_and_list_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.887 | 5.424 | 5.581 | 5.636 | 5.69 | 4.98 | 100.0% | 10 |
| cinder.list_volumes | 0.079 | 0.157 | 0.177 | 0.182 | 0.186 | 0.147 | 100.0% | 10 |
| total | 2.966 | 5.594 | 5.745 | 5.781 | 5.817 | 5.127 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 14.3176538944
Full duration: 25.6212191582
test scenario CinderVolumes.create_and_list_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.813 | 2.965 | 3.036 | 3.048 | 3.059 | 2.962 | 100.0% | 10 |
| cinder.list_volumes | 0.08 | 0.127 | 0.142 | 0.161 | 0.18 | 0.128 | 100.0% | 10 |
| total | 2.893 | 3.093 | 3.178 | 3.209 | 3.239 | 3.09 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 9.30827403069
Full duration: 19.9378697872
test scenario CinderVolumes.create_and_list_snapshots
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_snapshot | 2.438 | 2.526 | 2.593 | 2.593 | 2.593 | 2.528 | 100.0% | 10 |
| cinder.list_snapshots | 0.018 | 0.088 | 0.099 | 0.104 | 0.109 | 0.083 | 100.0% | 10 |
| total | 2.523 | 2.613 | 2.683 | 2.687 | 2.692 | 2.611 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 7.79824590683
Full duration: 31.6265990734
test scenario CinderVolumes.create_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.891 | 3.012 | 3.068 | 3.069 | 3.069 | 2.987 | 100.0% | 10 |
| cinder.delete_volume | 2.505 | 2.583 | 2.686 | 2.713 | 2.739 | 2.598 | 100.0% | 10 |
| total | 5.445 | 5.6 | 5.697 | 5.7 | 5.703 | 5.586 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 16.8130619526
Full duration: 23.3862919807
test scenario CinderVolumes.create_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.06 | 5.419 | 5.676 | 5.725 | 5.774 | 4.793 | 100.0% | 10 |
| cinder.delete_volume | 2.457 | 2.536 | 2.613 | 2.63 | 2.648 | 2.548 | 100.0% | 10 |
| total | 5.557 | 7.997 | 8.239 | 8.276 | 8.313 | 7.341 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 21.6966080666
Full duration: 28.6927661896
test scenario CinderVolumes.create_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.819 | 2.943 | 3.235 | 3.249 | 3.264 | 3.001 | 100.0% | 10 |
| cinder.delete_volume | 2.545 | 2.581 | 2.665 | 2.684 | 2.702 | 2.603 | 100.0% | 10 |
| total | 5.375 | 5.546 | 5.826 | 5.896 | 5.966 | 5.604 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 16.8036949635
Full duration: 23.085185051
test scenario CinderVolumes.create_and_upload_volume_to_image
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 2.833 | 3.116 | 3.438 | 3.496 | 3.553 | 3.134 | 100.0% | 10 |
| cinder.upload_volume_to_image | 25.838 | 62.678 | 78.019 | 78.434 | 78.85 | 55.7 | 100.0% | 10 |
| cinder.delete_volume | 2.358 | 2.511 | 2.619 | 2.684 | 2.749 | 2.531 | 100.0% | 10 |
| nova.delete_image | 0.221 | 0.371 | 3.025 | 13.33 | 23.635 | 2.707 | 100.0% | 10 |
| total | 31.573 | 68.573 | 83.845 | 84.418 | 84.99 | 64.072 | 100.0% | 10 |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 182.231485128
Full duration: 189.13320303
test scenario CinderVolumes.create_and_delete_snapshot
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_snapshot | 2.43 | 2.545 | 2.599 | 2.6 | 2.602 | 2.539 | 100.0% | 10 |
| cinder.delete_snapshot | 2.326 | 2.495 | 2.611 | 2.675 | 2.739 | 2.493 | 100.0% | 10 |
| total | 4.887 | 5.04 | 5.173 | 5.186 | 5.199 | 5.032 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 14.9942228794
Full duration: 33.8261451721
test scenario CinderVolumes.create_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.829 | 2.973 | 3.402 | 3.412 | 3.422 | 3.063 | 100.0% | 10 |
| total | 2.829 | 2.973 | 3.403 | 3.412 | 3.422 | 3.063 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 9.0781109333
Full duration: 18.1423990726
test scenario CinderVolumes.create_volume
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+------+--------+--------+--------+------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+------+--------+--------+--------+------+-------+---------+-------+
| cinder.create_volume | 2.85 | 2.939 | 2.978 | 2.984 | 2.99 | 2.932 | 100.0% | 10 |
| total | 2.85 | 2.94 | 2.978 | 2.984 | 2.99 | 2.932 | 100.0% | 10 |
+----------------------+------+--------+--------+--------+------+-------+---------+-------+
Load duration: 8.73497700691
Full duration: 19.4855289459
test scenario CinderVolumes.list_volumes
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.list_volumes | 0.211 | 0.266 | 0.312 | 0.327 | 0.342 | 0.274 | 100.0% | 10 |
| total | 0.211 | 0.266 | 0.312 | 0.327 | 0.342 | 0.275 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.827063083649
Full duration: 47.6483559608
test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 2.852 | 3.009 | 3.091 | 3.106 | 3.122 | 3.005 | 100.0% | 10 |
| cinder.create_snapshot | 2.321 | 2.392 | 2.404 | 2.404 | 2.405 | 2.377 | 100.0% | 10 |
| nova.attach_volume | 5.473 | 7.981 | 11.399 | 12.215 | 13.031 | 8.96 | 100.0% | 10 |
| nova.detach_volume | 3.035 | 5.168 | 5.603 | 5.772 | 5.941 | 4.587 | 100.0% | 10 |
| cinder.delete_snapshot | 2.209 | 2.347 | 2.41 | 2.417 | 2.424 | 2.349 | 100.0% | 10 |
| cinder.delete_volume | 2.412 | 2.494 | 2.582 | 2.616 | 2.65 | 2.508 | 100.0% | 10 |
| total | 21.417 | 23.884 | 26.577 | 26.903 | 27.228 | 24.098 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 70.9750390053
Full duration: 126.263324976
test scenario CinderVolumes.create_from_volume_and_delete_volume
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 9.872 | 12.204 | 17.525 | 19.351 | 21.177 | 13.167 | 100.0% | 10 |
| cinder.delete_volume | 2.325 | 2.554 | 2.928 | 3.924 | 4.92 | 2.779 | 100.0% | 10 |
| total | 12.426 | 14.781 | 20.202 | 21.897 | 23.592 | 15.947 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 43.4407100677
Full duration: 62.327357769
test scenario CinderVolumes.create_and_extend_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.858 | 2.94 | 3.074 | 3.087 | 3.1 | 2.956 | 100.0% | 10 |
| cinder.extend_volume | 2.572 | 2.848 | 2.884 | 2.919 | 2.954 | 2.8 | 100.0% | 10 |
| cinder.delete_volume | 2.433 | 2.567 | 2.67 | 2.693 | 2.716 | 2.567 | 100.0% | 10 |
| total | 7.982 | 8.292 | 8.558 | 8.616 | 8.674 | 8.323 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 24.9033889771
Full duration: 31.5932898521
test scenario CinderVolumes.create_snapshot_and_attach_volume
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 2.882 | 2.947 | 3.229 | 3.231 | 3.233 | 3.005 | 100.0% | 10 |
| cinder.create_snapshot | 2.268 | 2.345 | 2.421 | 2.456 | 2.491 | 2.36 | 100.0% | 10 |
| nova.attach_volume | 7.593 | 8.071 | 12.707 | 13.727 | 14.747 | 9.373 | 100.0% | 10 |
| nova.detach_volume | 2.962 | 5.331 | 5.412 | 5.491 | 5.57 | 5.076 | 100.0% | 10 |
| cinder.delete_snapshot | 2.185 | 2.286 | 2.366 | 2.374 | 2.381 | 2.298 | 100.0% | 10 |
| cinder.delete_volume | 2.425 | 2.524 | 2.593 | 2.61 | 2.627 | 2.52 | 100.0% | 10 |
| total | 21.713 | 23.963 | 28.368 | 29.657 | 30.947 | 24.974 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 73.7474370003
Full duration: 132.963656902
test scenario CinderVolumes.create_snapshot_and_attach_volume
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 2.739 | 2.89 | 3.033 | 3.058 | 3.084 | 2.914 | 100.0% | 10 |
| cinder.create_snapshot | 2.247 | 2.401 | 2.466 | 2.485 | 2.503 | 2.388 | 100.0% | 10 |
| nova.attach_volume | 7.882 | 8.891 | 10.439 | 11.312 | 12.186 | 9.222 | 100.0% | 10 |
| nova.detach_volume | 2.94 | 5.373 | 5.635 | 5.661 | 5.687 | 4.764 | 100.0% | 10 |
| cinder.delete_snapshot | 2.283 | 2.332 | 2.481 | 2.585 | 2.688 | 2.381 | 100.0% | 10 |
| cinder.delete_volume | 2.425 | 2.495 | 2.547 | 2.558 | 2.569 | 2.489 | 100.0% | 10 |
| total | 21.386 | 24.555 | 26.13 | 26.247 | 26.365 | 24.746 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 76.0001449585
Full duration: 139.533368111
run_rally - INFO - Test scenario: "cinder" OK.
run_rally - INFO - Starting test scenario "heat" ...
run_rally - INFO -
Preparing input task
Task 7d1551b5-51d4-480b-816d-571bc61773ac: started
Task 7d1551b5-51d4-480b-816d-571bc61773ac: finished
test scenario HeatStacks.create_suspend_resume_delete_stack
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.896 | 3.025 | 3.297 | 3.342 | 3.386 | 3.075 | 100.0% | 10 |
| heat.suspend_stack | 0.444 | 1.622 | 1.791 | 1.817 | 1.844 | 1.332 | 100.0% | 10 |
| heat.resume_stack | 1.365 | 1.657 | 1.701 | 1.755 | 1.809 | 1.598 | 100.0% | 10 |
| heat.delete_stack | 0.499 | 1.531 | 1.644 | 1.655 | 1.665 | 1.451 | 100.0% | 10 |
| total | 5.782 | 7.652 | 8.146 | 8.28 | 8.414 | 7.455 | 100.0% | 10 |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 21.9193868637
Full duration: 25.3411290646
test scenario HeatStacks.create_and_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 3.023 | 3.144 | 3.331 | 3.531 | 3.73 | 3.206 | 100.0% | 10 |
| heat.delete_stack | 0.437 | 0.646 | 1.617 | 1.676 | 1.734 | 0.972 | 100.0% | 10 |
| total | 3.54 | 3.767 | 4.914 | 5.114 | 5.314 | 4.178 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 12.2326231003
Full duration: 15.3595271111
test scenario HeatStacks.create_and_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 14.933 | 16.348 | 17.828 | 18.321 | 18.813 | 16.471 | 100.0% | 10 |
| heat.delete_stack | 6.665 | 8.038 | 8.335 | 8.772 | 9.208 | 7.711 | 100.0% | 10 |
| total | 22.386 | 24.346 | 25.661 | 25.74 | 25.818 | 24.182 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 72.8466770649
Full duration: 76.0618572235
test scenario HeatStacks.create_and_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 16.663 | 19.357 | 20.553 | 21.32 | 22.088 | 19.17 | 100.0% | 10 |
| heat.delete_stack | 9.144 | 9.269 | 10.036 | 10.227 | 10.417 | 9.461 | 100.0% | 10 |
| total | 25.982 | 28.953 | 30.462 | 30.847 | 31.232 | 28.631 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 84.6888990402
Full duration: 88.1814341545
test scenario HeatStacks.list_stacks_and_resources
+------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.list_stacks | 0.219 | 0.246 | 0.383 | 0.4 | 0.417 | 0.287 | 100.0% | 10 |
| heat.list_resources_of_0_stacks | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
| total | 0.219 | 0.246 | 0.383 | 0.4 | 0.418 | 0.287 | 100.0% | 10 |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.863615989685
Full duration: 3.55412602425
test scenario HeatStacks.create_update_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.866 | 3.102 | 3.266 | 3.29 | 3.314 | 3.097 | 100.0% | 10 |
| heat.update_stack | 2.641 | 3.637 | 3.803 | 3.813 | 3.822 | 3.497 | 100.0% | 10 |
| heat.delete_stack | 1.394 | 1.515 | 1.651 | 1.666 | 1.681 | 1.534 | 100.0% | 10 |
| total | 7.247 | 8.255 | 8.454 | 8.543 | 8.631 | 8.127 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 24.2989928722
Full duration: 27.7337241173
test scenario HeatStacks.create_update_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.799 | 3.033 | 3.19 | 3.306 | 3.422 | 3.046 | 100.0% | 10 |
| heat.update_stack | 2.509 | 3.732 | 3.845 | 3.847 | 3.849 | 3.321 | 100.0% | 10 |
| heat.delete_stack | 1.302 | 1.538 | 1.641 | 1.733 | 1.824 | 1.542 | 100.0% | 10 |
| total | 7.14 | 8.084 | 8.351 | 8.371 | 8.39 | 7.909 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 23.4465420246
Full duration: 27.0243220329
test scenario HeatStacks.create_update_delete_stack
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 2.894 | 3.127 | 3.22 | 3.399 | 3.579 | 3.129 | 100.0% | 10 |
| heat.update_stack | 4.739 | 5.169 | 6.092 | 6.105 | 6.119 | 5.309 | 100.0% | 10 |
| heat.delete_stack | 1.422 | 1.839 | 2.562 | 2.565 | 2.567 | 1.989 | 100.0% | 10 |
| total | 9.674 | 10.622 | 10.9 | 10.921 | 10.941 | 10.427 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 30.9374701977
Full duration: 34.6409509182
test scenario HeatStacks.create_update_delete_stack
+-----------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----+--------+--------+--------+-----+-----+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------+-----+--------+--------+--------+-----+-----+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | 0.0% | 5 |
+--------+-----+--------+--------+--------+-----+-----+---------+-------+
Load duration: 6.25441002846
Full duration: 14.2524240017
test scenario HeatStacks.create_update_delete_stack
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 2.776 | 3.256 | 3.502 | 3.878 | 4.255 | 3.292 | 100.0% | 10 |
| heat.update_stack | 4.632 | 4.964 | 5.353 | 5.818 | 6.284 | 5.076 | 100.0% | 10 |
| heat.delete_stack | 1.439 | 2.134 | 2.645 | 2.668 | 2.691 | 2.088 | 100.0% | 10 |
| total | 9.373 | 10.496 | 11.129 | 11.584 | 12.039 | 10.455 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 31.1429200172
Full duration: 34.8937320709
test scenario HeatStacks.create_update_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.804 | 3.071 | 3.166 | 3.186 | 3.206 | 3.026 | 100.0% | 10 |
| heat.update_stack | 2.737 | 3.748 | 4.018 | 4.043 | 4.068 | 3.617 | 100.0% | 10 |
| heat.delete_stack | 1.31 | 1.555 | 1.823 | 1.832 | 1.841 | 1.569 | 100.0% | 10 |
| total | 7.424 | 8.294 | 8.696 | 8.74 | 8.783 | 8.212 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 24.5028841496
Full duration: 28.3026170731
test scenario HeatStacks.create_and_list_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.956 | 3.13 | 3.324 | 3.341 | 3.359 | 3.141 | 100.0% | 10 |
| heat.list_stacks | 0.033 | 0.168 | 0.248 | 0.276 | 0.304 | 0.14 | 100.0% | 10 |
| total | 3.124 | 3.262 | 3.41 | 3.453 | 3.497 | 3.281 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 10.0396568775
Full duration: 17.6087501049
test scenario HeatStacks.create_check_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.922 | 3.155 | 3.412 | 3.413 | 3.415 | 3.159 | 100.0% | 10 |
| heat.check_stack | 0.418 | 0.518 | 1.02 | 1.361 | 1.702 | 0.701 | 100.0% | 10 |
| heat.delete_stack | 0.687 | 1.665 | 1.773 | 1.786 | 1.799 | 1.56 | 100.0% | 10 |
| total | 4.445 | 5.362 | 5.863 | 6.138 | 6.413 | 5.42 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 16.1680779457
Full duration: 20.0481300354
run_rally - INFO - Test scenario: "heat" Failed.
run_rally - INFO - Starting test scenario "keystone" ...
run_rally - INFO -
Preparing input task
Task 5cfc1b63-088e-4840-a525-13064451e8d6: started
Task 5cfc1b63-088e-4840-a525-13064451e8d6: finished
test scenario KeystoneBasic.create_tenant_with_users
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.105 | 0.119 | 0.16 | 0.16 | 0.161 | 0.125 | 100.0% | 10 |
| keystone.create_users | 0.592 | 0.653 | 0.694 | 0.719 | 0.744 | 0.657 | 100.0% | 10 |
| total | 0.706 | 0.77 | 0.844 | 0.874 | 0.905 | 0.782 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.32407808304
Full duration: 12.4144320488
test scenario KeystoneBasic.create_add_and_list_user_roles
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.116 | 0.119 | 0.144 | 0.149 | 0.154 | 0.125 | 100.0% | 10 |
| keystone.add_role | 0.088 | 0.099 | 0.107 | 0.107 | 0.107 | 0.099 | 100.0% | 10 |
| keystone.list_roles | 0.054 | 0.058 | 0.095 | 0.097 | 0.1 | 0.067 | 100.0% | 10 |
| total | 0.27 | 0.28 | 0.345 | 0.35 | 0.355 | 0.292 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.863723993301
Full duration: 6.29958295822
test scenario KeystoneBasic.add_and_remove_user_role
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.121 | 0.217 | 0.274 | 0.281 | 0.288 | 0.2 | 100.0% | 10 |
| keystone.add_role | 0.089 | 0.092 | 0.098 | 0.098 | 0.099 | 0.093 | 100.0% | 10 |
| keystone.remove_role | 0.058 | 0.061 | 0.156 | 0.161 | 0.167 | 0.081 | 100.0% | 10 |
| total | 0.274 | 0.371 | 0.497 | 0.517 | 0.537 | 0.373 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.090020895
Full duration: 6.37877011299
test scenario KeystoneBasic.create_update_and_delete_tenant
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.123 | 0.223 | 0.286 | 0.291 | 0.296 | 0.209 | 100.0% | 10 |
| keystone.update_tenant | 0.052 | 0.056 | 0.065 | 0.066 | 0.068 | 0.057 | 100.0% | 10 |
| keystone.delete_tenant | 0.125 | 0.135 | 0.286 | 0.307 | 0.327 | 0.18 | 100.0% | 10 |
| total | 0.302 | 0.416 | 0.63 | 0.632 | 0.634 | 0.446 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.29043102264
Full duration: 5.07875084877
test scenario KeystoneBasic.create_and_delete_service
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_service | 0.109 | 0.123 | 0.128 | 0.132 | 0.135 | 0.122 | 100.0% | 10 |
| keystone.delete_service | 0.059 | 0.07 | 0.121 | 0.128 | 0.134 | 0.079 | 100.0% | 10 |
| total | 0.174 | 0.196 | 0.234 | 0.245 | 0.255 | 0.201 | 100.0% | 10 |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.603389024734
Full duration: 4.27351093292
test scenario KeystoneBasic.create_tenant
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.118 | 0.133 | 0.186 | 0.187 | 0.188 | 0.142 | 100.0% | 10 |
| total | 0.118 | 0.133 | 0.186 | 0.187 | 0.188 | 0.142 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.428766012192
Full duration: 4.18886899948
test scenario KeystoneBasic.create_user
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+------+---------+-------+
| keystone.create_user | 0.137 | 0.138 | 0.145 | 0.145 | 0.146 | 0.14 | 100.0% | 10 |
| total | 0.137 | 0.138 | 0.145 | 0.145 | 0.146 | 0.14 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+------+---------+-------+
Load duration: 0.443462133408
Full duration: 4.19236207008
test scenario KeystoneBasic.create_and_list_tenants
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.111 | 0.117 | 0.165 | 0.178 | 0.191 | 0.132 | 100.0% | 10 |
| keystone.list_tenants | 0.046 | 0.055 | 0.065 | 0.066 | 0.067 | 0.055 | 100.0% | 10 |
| total | 0.163 | 0.179 | 0.214 | 0.231 | 0.247 | 0.187 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.561487913132
Full duration: 5.7246799469
test scenario KeystoneBasic.create_and_delete_role
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.12 | 0.232 | 0.282 | 0.289 | 0.296 | 0.206 | 100.0% | 10 |
| keystone.delete_role | 0.104 | 0.117 | 0.133 | 0.169 | 0.206 | 0.124 | 100.0% | 10 |
| total | 0.239 | 0.342 | 0.401 | 0.452 | 0.502 | 0.33 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.990566015244
Full duration: 4.97686004639
test scenario KeystoneBasic.get_entities
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.106 | 0.133 | 0.16 | 0.174 | 0.187 | 0.139 | 100.0% | 10 |
| keystone.create_user | 0.058 | 0.066 | 0.07 | 0.071 | 0.071 | 0.065 | 100.0% | 10 |
| keystone.create_role | 0.046 | 0.053 | 0.07 | 0.086 | 0.103 | 0.059 | 100.0% | 10 |
| keystone.get_tenant | 0.044 | 0.048 | 0.055 | 0.076 | 0.098 | 0.053 | 100.0% | 10 |
| keystone.get_user | 0.051 | 0.057 | 0.063 | 0.063 | 0.063 | 0.057 | 100.0% | 10 |
| keystone.get_role | 0.044 | 0.047 | 0.055 | 0.056 | 0.058 | 0.049 | 100.0% | 10 |
| keystone.service_list | 0.045 | 0.049 | 0.06 | 0.081 | 0.101 | 0.054 | 100.0% | 10 |
| keystone.get_service | 0.043 | 0.049 | 0.062 | 0.079 | 0.097 | 0.053 | 100.0% | 10 |
| total | 0.475 | 0.518 | 0.577 | 0.6 | 0.622 | 0.529 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.58831310272
Full duration: 9.76444888115
test scenario KeystoneBasic.create_and_list_users
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_user | 0.13 | 0.145 | 0.177 | 0.195 | 0.213 | 0.152 | 100.0% | 10 |
| keystone.list_users | 0.052 | 0.055 | 0.08 | 0.093 | 0.106 | 0.062 | 100.0% | 10 |
| total | 0.183 | 0.2 | 0.269 | 0.274 | 0.279 | 0.214 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.642003059387
Full duration: 4.59805297852
run_rally - INFO - Test scenario: "keystone" OK.
run_rally - INFO - Starting test scenario "neutron" ...
run_rally - INFO -
Preparing input task
Task aa890d07-7f64-4bf2-9cc1-adb8d5a95c9e: started
Task aa890d07-7f64-4bf2-9cc1-adb8d5a95c9e: finished
test scenario NeutronNetworks.create_and_delete_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.42 | 0.516 | 0.669 | 0.677 | 0.684 | 0.538 | 100.0% | 10 |
| neutron.delete_port | 0.149 | 0.287 | 0.338 | 0.344 | 0.349 | 0.274 | 100.0% | 10 |
| total | 0.65 | 0.787 | 0.989 | 0.992 | 0.996 | 0.812 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.28342914581
Full duration: 25.3548538685
test scenario NeutronNetworks.create_and_list_routers
+---------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.389 | 0.492 | 0.542 | 0.564 | 0.587 | 0.479 | 100.0% | 10 |
| neutron.create_router | 0.034 | 0.165 | 0.179 | 0.18 | 0.181 | 0.118 | 100.0% | 10 |
| neutron.add_interface_router | 0.273 | 0.398 | 0.459 | 0.475 | 0.492 | 0.378 | 100.0% | 10 |
| neutron.list_routers | 0.042 | 0.111 | 0.208 | 0.214 | 0.219 | 0.12 | 100.0% | 10 |
| total | 0.873 | 1.083 | 1.266 | 1.32 | 1.373 | 1.095 | 100.0% | 10 |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.14495706558
Full duration: 27.2623529434
test scenario NeutronNetworks.create_and_delete_routers
+------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.421 | 0.528 | 0.576 | 0.593 | 0.609 | 0.516 | 100.0% | 10 |
| neutron.create_router | 0.037 | 0.174 | 0.193 | 0.194 | 0.196 | 0.138 | 100.0% | 10 |
| neutron.add_interface_router | 0.372 | 0.44 | 0.726 | 0.729 | 0.732 | 0.499 | 100.0% | 10 |
| neutron.remove_interface_router | 0.231 | 0.385 | 0.445 | 0.495 | 0.545 | 0.365 | 100.0% | 10 |
| neutron.delete_router | 0.155 | 0.243 | 0.363 | 0.374 | 0.385 | 0.257 | 100.0% | 10 |
| total | 1.492 | 1.722 | 2.126 | 2.135 | 2.145 | 1.776 | 100.0% | 10 |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 5.06723308563
Full duration: 27.7173280716
test scenario NeutronNetworks.create_and_list_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.429 | 0.479 | 0.682 | 0.709 | 0.736 | 0.518 | 100.0% | 10 |
| neutron.list_ports | 0.101 | 0.302 | 0.368 | 0.377 | 0.386 | 0.267 | 100.0% | 10 |
| total | 0.565 | 0.819 | 0.9 | 0.971 | 1.042 | 0.785 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.22692918777
Full duration: 25.9097590446
test scenario NeutronNetworks.create_and_delete_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.383 | 0.414 | 0.558 | 0.562 | 0.565 | 0.439 | 100.0% | 10 |
| neutron.delete_subnet | 0.134 | 0.271 | 0.307 | 0.34 | 0.372 | 0.235 | 100.0% | 10 |
| total | 0.522 | 0.677 | 0.872 | 0.901 | 0.93 | 0.674 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.97971510887
Full duration: 24.8733260632
test scenario NeutronNetworks.create_and_delete_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.3 | 0.32 | 0.403 | 0.407 | 0.411 | 0.338 | 100.0% | 10 |
| neutron.delete_network | 0.107 | 0.248 | 0.316 | 0.32 | 0.325 | 0.228 | 100.0% | 10 |
| total | 0.411 | 0.556 | 0.697 | 0.698 | 0.699 | 0.566 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.71673607826
Full duration: 13.4693968296
test scenario NeutronNetworks.create_and_list_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.279 | 0.326 | 0.389 | 0.406 | 0.423 | 0.334 | 100.0% | 10 |
| neutron.list_networks | 0.043 | 0.11 | 0.18 | 0.187 | 0.194 | 0.112 | 100.0% | 10 |
| total | 0.328 | 0.437 | 0.564 | 0.59 | 0.617 | 0.446 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.4160130024
Full duration: 15.1821639538
test scenario NeutronNetworks.create_and_update_routers
+---------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.401 | 0.436 | 0.454 | 0.473 | 0.492 | 0.433 | 100.0% | 10 |
| neutron.create_router | 0.035 | 0.175 | 0.181 | 0.186 | 0.191 | 0.123 | 100.0% | 10 |
| neutron.add_interface_router | 0.293 | 0.416 | 0.46 | 0.461 | 0.461 | 0.401 | 100.0% | 10 |
| neutron.update_router | 0.131 | 0.215 | 0.311 | 0.331 | 0.35 | 0.219 | 100.0% | 10 |
| total | 1.012 | 1.171 | 1.336 | 1.359 | 1.381 | 1.176 | 100.0% | 10 |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.52523398399
Full duration: 28.7934508324
test scenario NeutronNetworks.create_and_update_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.299 | 0.338 | 0.397 | 0.408 | 0.418 | 0.346 | 100.0% | 10 |
| neutron.update_network | 0.095 | 0.24 | 0.297 | 0.299 | 0.302 | 0.202 | 100.0% | 10 |
| total | 0.41 | 0.543 | 0.699 | 0.707 | 0.714 | 0.549 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.61482715607
Full duration: 15.459831953
test scenario NeutronNetworks.create_and_update_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.436 | 0.465 | 0.588 | 0.595 | 0.601 | 0.487 | 100.0% | 10 |
| neutron.update_port | 0.114 | 0.282 | 0.317 | 0.326 | 0.335 | 0.255 | 100.0% | 10 |
| total | 0.576 | 0.751 | 0.862 | 0.899 | 0.936 | 0.742 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.15260481834
Full duration: 25.8613479137
test scenario NeutronNetworks.create_and_list_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.4 | 0.495 | 0.538 | 0.551 | 0.564 | 0.483 | 100.0% | 10 |
| neutron.list_subnets | 0.065 | 0.217 | 0.28 | 0.319 | 0.357 | 0.22 | 100.0% | 10 |
| total | 0.563 | 0.718 | 0.793 | 0.798 | 0.802 | 0.703 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.06506896019
Full duration: 25.971654892
test scenario NeutronNetworks.create_and_update_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.398 | 0.465 | 0.543 | 0.564 | 0.584 | 0.475 | 100.0% | 10 |
| neutron.update_subnet | 0.152 | 0.178 | 0.348 | 0.366 | 0.383 | 0.234 | 100.0% | 10 |
| total | 0.557 | 0.693 | 0.85 | 0.867 | 0.883 | 0.709 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.06711506844
Full duration: 25.9731898308
run_rally - INFO - Test scenario: "neutron" OK.
run_rally - INFO - Starting test scenario "nova" ...
run_rally - INFO -
Preparing input task
Task 84ecab73-326c-41f9-9d80-ffb7b41c7f0d: started
Task 84ecab73-326c-41f9-9d80-ffb7b41c7f0d: finished
test scenario NovaKeypair.create_and_delete_keypair
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.create_keypair | 0.374 | 0.484 | 0.667 | 0.672 | 0.678 | 0.503 | 100.0% | 10 |
| nova.delete_keypair | 0.016 | 0.021 | 0.025 | 0.027 | 0.028 | 0.021 | 100.0% | 10 |
| total | 0.399 | 0.51 | 0.687 | 0.692 | 0.698 | 0.524 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.59278798103
Full duration: 15.4121351242
test scenario NovaServers.snapshot_server
+--------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+---------+---------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+---------+---------+--------+--------+---------+-------+
| nova.boot_server | 9.938 | 10.314 | 11.977 | 12.384 | 12.791 | 10.711 | 100.0% | 10 |
| nova.create_image | 33.802 | 39.898 | 69.264 | 70.135 | 71.005 | 45.583 | 100.0% | 10 |
| nova.delete_server | 2.408 | 2.848 | 3.266 | 4.121 | 4.975 | 2.967 | 100.0% | 10 |
| nova.boot_server (2) | 19.438 | 33.013 | 43.809 | 46.043 | 48.276 | 33.839 | 100.0% | 10 |
| nova.delete_server (2) | 2.395 | 2.453 | 4.821 | 4.891 | 4.961 | 3.009 | 100.0% | 10 |
| nova.delete_image | 0.264 | 0.373 | 0.749 | 1.036 | 1.323 | 0.484 | 100.0% | 10 |
| total | 70.267 | 96.724 | 117.768 | 118.599 | 119.43 | 96.593 | 100.0% | 10 |
+------------------------+--------+--------+---------+---------+--------+--------+---------+-------+
Load duration: 280.300797939
Full duration: 304.846863985
test scenario NovaKeypair.boot_and_delete_server_with_keypair
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_keypair | 0.406 | 0.458 | 0.533 | 0.575 | 0.616 | 0.474 | 100.0% | 10 |
| nova.boot_server | 8.324 | 10.158 | 11.335 | 11.766 | 12.197 | 10.115 | 100.0% | 10 |
| nova.delete_server | 2.382 | 2.425 | 2.618 | 2.621 | 2.625 | 2.456 | 100.0% | 10 |
| nova.delete_keypair | 0.014 | 0.019 | 0.028 | 0.029 | 0.029 | 0.02 | 100.0% | 10 |
| total | 11.352 | 13.038 | 14.228 | 14.667 | 15.107 | 13.066 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 39.3250300884
Full duration: 62.0274989605
test scenario NovaKeypair.create_and_list_keypairs
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.create_keypair | 0.389 | 0.483 | 0.646 | 0.673 | 0.701 | 0.503 | 100.0% | 10 |
| nova.list_keypairs | 0.013 | 0.018 | 0.021 | 0.024 | 0.027 | 0.018 | 100.0% | 10 |
| total | 0.405 | 0.504 | 0.659 | 0.688 | 0.716 | 0.521 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.55672502518
Full duration: 16.8414058685
test scenario NovaServers.list_servers
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.list_servers | 0.604 | 0.661 | 0.751 | 0.753 | 0.755 | 0.667 | 100.0% | 10 |
| total | 0.604 | 0.661 | 0.751 | 0.753 | 0.755 | 0.667 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.98178386688
Full duration: 66.4639019966
test scenario NovaServers.resize_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 8.516 | 10.952 | 12.492 | 12.717 | 12.943 | 11.085 | 100.0% | 10 |
| nova.resize | 21.055 | 26.446 | 42.177 | 42.263 | 42.349 | 29.612 | 100.0% | 10 |
| nova.resize_confirm | 2.392 | 2.451 | 2.573 | 2.592 | 2.611 | 2.47 | 100.0% | 10 |
| nova.delete_server | 2.375 | 2.427 | 2.595 | 2.673 | 2.751 | 2.475 | 100.0% | 10 |
| total | 34.884 | 42.48 | 59.742 | 59.88 | 60.019 | 45.642 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 133.771182775
Full duration: 147.319270134
test scenario NovaServers.boot_server_from_volume_and_delete
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.421 | 5.82 | 6.128 | 6.151 | 6.173 | 5.197 | 100.0% | 10 |
| nova.boot_server | 13.462 | 15.116 | 17.314 | 17.513 | 17.711 | 15.217 | 100.0% | 10 |
| nova.delete_server | 4.532 | 4.689 | 6.776 | 6.8 | 6.823 | 5.275 | 100.0% | 10 |
| total | 21.563 | 26.332 | 28.183 | 28.315 | 28.446 | 25.689 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 76.1264929771
Full duration: 105.501106024
test scenario NovaServers.boot_and_migrate_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 8.668 | 10.279 | 12.669 | 12.746 | 12.824 | 10.808 | 100.0% | 10 |
| nova.stop_server | 4.695 | 14.48 | 15.73 | 15.737 | 15.745 | 11.929 | 100.0% | 10 |
| nova.migrate | 16.259 | 18.003 | 25.275 | 25.347 | 25.419 | 19.085 | 100.0% | 10 |
| nova.resize_confirm | 2.394 | 2.416 | 2.564 | 2.604 | 2.644 | 2.46 | 100.0% | 10 |
| nova.delete_server | 2.383 | 2.408 | 2.55 | 2.58 | 2.61 | 2.448 | 100.0% | 10 |
| total | 35.744 | 47.034 | 56.397 | 57.427 | 58.457 | 46.73 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 131.940564156
Full duration: 145.82509613
test scenario NovaServers.boot_and_delete_server
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 8.359 | 10.277 | 11.312 | 11.367 | 11.422 | 10.063 | 100.0% | 10 |
| nova.delete_server | 2.388 | 2.607 | 4.826 | 4.853 | 4.881 | 3.21 | 100.0% | 10 |
| total | 11.023 | 12.798 | 15.929 | 16.116 | 16.303 | 13.273 | 100.0% | 10 |
+--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 39.1904668808
Full duration: 62.8628950119
test scenario NovaServers.boot_and_rebuild_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 8.636 | 9.789 | 12.354 | 12.414 | 12.474 | 10.12 | 100.0% | 10 |
| nova.rebuild_server | 11.032 | 13.82 | 21.821 | 22.321 | 22.821 | 16.342 | 100.0% | 10 |
| nova.delete_server | 2.382 | 2.461 | 2.664 | 2.759 | 2.854 | 2.524 | 100.0% | 10 |
| total | 24.342 | 28.632 | 33.812 | 34.242 | 34.671 | 28.986 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 82.0937809944
Full duration: 105.129650116
test scenario NovaSecGroup.create_and_list_secgroups
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 1.596 | 2.105 | 2.35 | 2.351 | 2.352 | 2.061 | 100.0% | 10 |
| nova.create_100_rules | 8.873 | 10.349 | 10.555 | 10.65 | 10.745 | 10.067 | 100.0% | 10 |
| nova.list_security_groups | 0.129 | 0.183 | 0.281 | 0.318 | 0.354 | 0.201 | 100.0% | 10 |
| total | 11.189 | 12.51 | 12.822 | 12.823 | 12.823 | 12.329 | 100.0% | 10 |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 36.4927339554
Full duration: 63.6400220394
test scenario NovaSecGroup.create_and_delete_secgroups
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 1.326 | 1.779 | 1.959 | 1.983 | 2.006 | 1.748 | 100.0% | 10 |
| nova.create_100_rules | 9.29 | 10.389 | 10.656 | 10.731 | 10.805 | 10.241 | 100.0% | 10 |
| nova.delete_10_security_groups | 0.833 | 0.896 | 1.02 | 1.03 | 1.04 | 0.918 | 100.0% | 10 |
| total | 11.55 | 13.143 | 13.488 | 13.549 | 13.611 | 12.907 | 100.0% | 10 |
+--------------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 38.0758161545
Full duration: 52.9351670742
test scenario NovaServers.boot_and_bounce_server
+----------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+--------+--------+---------+---------+---------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------+--------+--------+---------+---------+---------+--------+---------+-------+
| nova.boot_server | 8.49 | 12.054 | 12.335 | 12.336 | 12.338 | 11.077 | 100.0% | 10 |
| nova.reboot_server | 4.412 | 4.746 | 6.676 | 6.794 | 6.912 | 5.252 | 100.0% | 10 |
| nova.soft_reboot_server | 6.592 | 7.729 | 125.626 | 125.9 | 126.174 | 31.142 | 100.0% | 10 |
| nova.stop_server | 4.709 | 4.817 | 4.999 | 5.006 | 5.013 | 4.835 | 100.0% | 10 |
| nova.start_server | 2.636 | 3.348 | 4.108 | 4.153 | 4.198 | 3.361 | 100.0% | 10 |
| nova.rescue_server | 6.613 | 6.787 | 17.596 | 17.726 | 17.855 | 11.037 | 100.0% | 10 |
| nova.unrescue_server | 2.324 | 4.485 | 6.647 | 6.653 | 6.659 | 4.948 | 100.0% | 10 |
| nova.delete_server | 2.375 | 2.416 | 4.666 | 4.731 | 4.797 | 3.1 | 100.0% | 10 |
| total | 39.617 | 54.891 | 166.239 | 170.845 | 175.451 | 74.764 | 100.0% | 10 |
+-------------------------+--------+--------+---------+---------+---------+--------+---------+-------+
Load duration: 241.107405901
Full duration: 264.433083773
test scenario NovaServers.boot_server
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 9.537 | 9.723 | 12.302 | 12.597 | 12.891 | 10.539 | 100.0% | 10 |
| total | 9.537 | 9.723 | 12.302 | 12.597 | 12.891 | 10.539 | 100.0% | 10 |
+------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 31.5377810001
Full duration: 56.3936619759
test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 1.677 | 1.957 | 2.26 | 2.317 | 2.373 | 1.975 | 100.0% | 10 |
| nova.create_100_rules | 9.032 | 10.031 | 10.512 | 10.585 | 10.658 | 9.992 | 100.0% | 10 |
| nova.boot_server | 8.152 | 11.436 | 11.645 | 11.66 | 11.675 | 10.446 | 100.0% | 10 |
| nova.get_attached_security_groups | 0.145 | 0.154 | 0.17 | 0.185 | 0.2 | 0.158 | 100.0% | 10 |
| nova.delete_server | 2.412 | 4.581 | 4.637 | 4.667 | 4.696 | 3.741 | 100.0% | 10 |
| nova.delete_10_security_groups | 0.791 | 0.902 | 0.983 | 0.993 | 1.003 | 0.901 | 100.0% | 10 |
| total | 22.687 | 29.402 | 29.574 | 29.639 | 29.704 | 27.213 | 100.0% | 10 |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 81.6792809963
Full duration: 106.045881033
test scenario NovaServers.pause_and_unpause_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 9.557 | 11.959 | 12.616 | 12.617 | 12.618 | 11.399 | 100.0% | 10 |
| nova.pause_server | 2.3 | 2.488 | 2.647 | 2.73 | 2.813 | 2.485 | 100.0% | 10 |
| nova.unpause_server | 2.313 | 2.338 | 2.459 | 2.519 | 2.579 | 2.376 | 100.0% | 10 |
| nova.delete_server | 2.379 | 4.554 | 4.593 | 4.6 | 4.608 | 3.72 | 100.0% | 10 |
| total | 16.731 | 21.47 | 21.938 | 22.069 | 22.201 | 19.98 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 60.1143479347
Full duration: 84.1553788185
test scenario NovaServers.boot_server_from_volume
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.296 | 3.584 | 6.23 | 6.254 | 6.278 | 4.296 | 100.0% | 10 |
| nova.boot_server | 13.316 | 14.103 | 15.99 | 16.029 | 16.068 | 14.371 | 100.0% | 10 |
| total | 16.8 | 18.338 | 20.779 | 21.536 | 22.293 | 18.667 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 55.7340800762
Full duration: 89.9920220375
test scenario NovaServers.boot_and_list_server
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 8.714 | 10.615 | 12.468 | 12.501 | 12.535 | 10.613 | 100.0% | 10 |
| nova.list_servers | 0.14 | 0.241 | 0.434 | 0.454 | 0.474 | 0.274 | 100.0% | 10 |
| total | 8.854 | 10.943 | 12.715 | 12.756 | 12.798 | 10.887 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 30.5609071255
Full duration: 64.9602191448
run_rally - INFO - Test scenario: "nova" OK.
run_rally - INFO - Starting test scenario "quotas" ...
run_rally - INFO -
Preparing input task
Task 98d9ffba-dd50-429a-ab90-4549e00b19cf: started
Task 98d9ffba-dd50-429a-ab90-4549e00b19cf: finished
test scenario Quotas.cinder_update
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.58 | 0.646 | 0.661 | 0.671 | 0.682 | 0.636 | 100.0% | 10 |
| total | 0.58 | 0.646 | 0.661 | 0.671 | 0.682 | 0.636 | 100.0% | 10 |
+----------------------+------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.98423290253
Full duration: 7.3744559288
test scenario Quotas.neutron_update
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.232 | 0.251 | 0.276 | 0.281 | 0.286 | 0.254 | 100.0% | 10 |
| total | 0.295 | 0.324 | 0.348 | 0.352 | 0.355 | 0.325 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.987355947495
Full duration: 6.55621004105
test scenario Quotas.cinder_update_and_delete
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.609 | 0.648 | 0.736 | 0.755 | 0.775 | 0.663 | 100.0% | 10 |
| quotas.delete_quotas | 0.267 | 0.474 | 0.498 | 0.518 | 0.539 | 0.454 | 100.0% | 10 |
| total | 0.95 | 1.099 | 1.254 | 1.262 | 1.271 | 1.117 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.2654209137
Full duration: 8.84793901443
test scenario Quotas.nova_update_and_delete
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.319 | 0.353 | 0.393 | 0.4 | 0.408 | 0.358 | 100.0% | 8 |
| quotas.delete_quotas | 0.015 | 0.025 | 0.031 | 0.032 | 0.033 | 0.025 | 75.0% | 8 |
| total | 0.351 | 0.366 | 0.405 | 0.416 | 0.428 | 0.374 | 75.0% | 8 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.80732011795
Full duration: 6.24122095108
test scenario Quotas.nova_update
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.346 | 0.366 | 0.413 | 0.414 | 0.416 | 0.373 | 100.0% | 10 |
| total | 0.346 | 0.366 | 0.413 | 0.414 | 0.416 | 0.373 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.10930514336
Full duration: 6.21793103218
run_rally - INFO - Test scenario: "quotas" Failed.
run_rally - INFO - Starting test scenario "requests" ...
run_rally - INFO -
Preparing input task
Task 712d1722-52e2-4e3a-93dc-515e3fea5977: started
Task 712d1722-52e2-4e3a-93dc-515e3fea5977: finished
test scenario HttpRequests.check_random_request
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+------+---------+-------+
| requests.check_request | 5.462 | 5.488 | 5.976 | 5.991 | 6.006 | 5.59 | 100.0% | 10 |
| total | 5.462 | 5.488 | 5.976 | 5.991 | 6.006 | 5.59 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+------+---------+-------+
Load duration: 16.976375103
Full duration: 19.3119690418
test scenario HttpRequests.check_request
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| requests.check_request | 5.466 | 5.48 | 5.487 | 5.491 | 5.496 | 5.479 | 100.0% | 10 |
| total | 5.466 | 5.48 | 5.487 | 5.491 | 5.496 | 5.479 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 16.4575350285
Full duration: 18.7219369411
run_rally - INFO - Test scenario: "requests" OK.
run_rally - INFO -
Rally Summary Report
+===================+============+===============+===========+
| Module | Duration | nb. Test Run | Success |
+===================+============+===============+===========+
| authenticate | 00:17 | 10 | 100.00% |
+-------------------+------------+---------------+-----------+
| glance | 01:45 | 7 | 100.00% |
+-------------------+------------+---------------+-----------+
| cinder | 17:38 | 50 | 100.00% |
+-------------------+------------+---------------+-----------+
| heat | 06:53 | 32 | 92.31% |
+-------------------+------------+---------------+-----------+
| keystone | 01:07 | 29 | 100.00% |
+-------------------+------------+---------------+-----------+
| neutron | 04:41 | 31 | 100.00% |
+-------------------+------------+---------------+-----------+
| nova | 30:14 | 61 | 100.00% |
+-------------------+------------+---------------+-----------+
| quotas | 00:35 | 7 | 95.00% |
+-------------------+------------+---------------+-----------+
| requests | 00:38 | 2 | 100.00% |
+-------------------+------------+---------------+-----------+
+===================+============+===============+===========+
| TOTAL: | 01:03:52 | 229 | 98.59% |
+===================+============+===============+===========+
Feature tests¶
vIMS¶
FUNCTEST.info: Running vIMS test...
vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
vIMS - INFO - Update OpenStack creds informations
vIMS - INFO - Upload some OS images if it doesn't exist
vIMS - INFO - centos_7 image doesn't exist on glance repository.
Try downloading this image and upload on glance !
vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
Try downloading this image and upload on glance !
vIMS - INFO - Update security group quota for this tenant
vIMS - INFO - Update cinder quota for this tenant
vIMS - INFO - Collect flavor id for cloudify manager server
vIMS - INFO - Prepare virtualenv for cloudify-cli
vIMS - INFO - Downloading the cloudify manager server blueprint
vIMS - INFO - Cloudify deployment Start Time:'2016-02-23 04:47:07'
vIMS - INFO - Writing the inputs file
vIMS - INFO - Launching the cloudify-manager deployment
vIMS - INFO - Cloudify-manager server is UP !
vIMS - INFO - Cloudify deployment duration:'432.5'
vIMS - INFO - Collect flavor id for all clearwater vm
vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-23 04:54:20'
vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
vIMS - INFO - Writing the inputs file
vIMS - INFO - Launching the clearwater deployment
vIMS - INFO - The deployment of clearwater-opnfv is ended
vIMS - INFO - vIMS VNF deployment duration:'616.2'
vIMS - INFO - vIMS functional test Start Time:'2016-02-23 05:07:44'
vIMS - INFO - vIMS functional test duration:'3.5'
vIMS - INFO - Launching the clearwater-opnfv undeployment
vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; '
vIMS - INFO - Launching the cloudify-manager undeployment
vIMS - INFO - Cloudify-manager server has been successfully removed!
vIMS - INFO - Removing vIMS tenant ..
vIMS - INFO - Removing vIMS user ..
Detailed test results for apex-os-odl_l2-nofeature-ha¶
VIM¶
vping_ssh¶
FUNCTEST.info: Running vPing-SSH test...
vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
vPing_ssh- INFO - Creating neutron network vping-net...
vPing_ssh- INFO - Creating security group 'vPing-sg'...
vPing_ssh- INFO - Using existing Flavor 'm1.small'...
vPing_ssh- INFO - vPing Start Time:'2016-02-22 22:26:26'
vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
name=opnfv-vping-1
flavor=<Flavor: m1.small>
image=8588bf92-664e-46f0-ad4f-40347349b4db
network=1e07302c-1060-4862-ac96-81db4c46b173
vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
name=opnfv-vping-2
flavor=<Flavor: m1.small>
image=8588bf92-664e-46f0-ad4f-40347349b4db
network=1e07302c-1060-4862-ac96-81db4c46b173
vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
vPing_ssh- INFO - Floating IP created: '192.168.10.101'
vPing_ssh- INFO - Associating floating ip: '192.168.10.101' to VM 'opnfv-vping-2'
vPing_ssh- INFO - Trying to establish SSH connection to 192.168.10.101...
vPing_ssh- INFO - Waiting for ping...
vPing_ssh- INFO - vPing detected!
vPing_ssh- INFO - vPing duration:'26.0' s.
vPing_ssh- INFO - Cleaning up...
vPing_ssh- INFO - vPing OK
vping_userdata¶
FUNCTEST.info: Running vPing-userdata test...
vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
vPing_userdata- INFO - Creating neutron network vping-net...
vPing_userdata- INFO - Creating security group 'vPing-sg'...
vPing_userdata- INFO - Flavor found 'm1.small'
vPing_userdata- INFO - vPing Start Time:'2016-02-22 22:27:09'
vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
name=opnfv-vping-1
flavor=<Flavor: m1.small>
image=4e085313-471b-4846-96f8-d89c5fcdb453
network=f1c6e324-f469-4d43-a53e-3716a2075556
vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
name=opnfv-vping-2
flavor=<Flavor: m1.small>
image=4e085313-471b-4846-96f8-d89c5fcdb453
network=f1c6e324-f469-4d43-a53e-3716a2075556
userdata=
#!/bin/sh
while true; do
ping -c 1 192.168.130.3 2>&1 >/dev/null
RES=$?
if [ "Z$RES" = "Z0" ] ; then
echo 'vPing OK'
break
else
echo 'vPing KO'
fi
sleep 1
done
vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
vPing_userdata- INFO - Waiting for ping...
vPing_userdata- INFO - vPing detected!
vPing_userdata- INFO - vPing duration:'13.7'
vPing_userdata- INFO - vPing OK
vPing_userdata- INFO - Cleaning up...
vPing_userdata- INFO - Deleting network 'vping-net'...
Tempest¶
FUNCTEST.info: Running Tempest tests...
run_tempest - INFO - Creating tenant and user for Tempest suite
INFO rally.verification.tempest.tempest [-] Starting: Creating configuration file for Tempest.
INFO rally.verification.tempest.tempest [-] Completed: Creating configuration file for Tempest.
run_tempest - INFO - Starting Tempest test suite: '--tests-file /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/custom_tests/test_list.txt'.
Total results of verification:
+--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
| UUID | Deployment UUID | Set name | Tests | Failures | Created at | Status |
+--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
| 3275e5cd-a0cd-4961-95c8-11c5eceaa6a6 | 94d6d0c4-f111-4f1a-a9ee-dee149fe7ce1 | | 210 | 1 | 2016-02-22 22:27:42.722872 | finished |
+--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
Tests:
+------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
| name | time | status |
+------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
| tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor | 0.24365 | success |
| tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors | 0.06964 | success |
| tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image | 8.22175 | success |
| tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image | 10.97975 | success |
| tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name | 7.03882 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since | 0.06729 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name | 0.05931 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id | 0.06307 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref | 0.11320 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status | 0.06453 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type | 0.06586 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results | 0.06862 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since | 0.06207 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name | 0.05691 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref | 0.18730 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status | 0.07965 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type | 0.10485 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results | 0.06917 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image | 0.14038 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images | 0.10940 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail | 0.07005 | success |
| tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create | 0.52047 | success |
| tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list | 0.56007 | success |
| tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete | 1.36847 | success |
| tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip | 6.81057 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name | 2.10654 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers | 0.06566 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail | 0.16011 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus | 0.20656 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details | 0.00068 | success |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name | 69.80953 | success |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers | 0.07774 | success |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail | 0.17023 | success |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus | 0.14159 | success |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details | 0.00084 | success |
| tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action | 0.09269 | success |
| tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions | 5.41847 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor | 0.30351 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image | 0.24031 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name | 0.16460 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status | 0.23510 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results | 0.18628 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor | 0.07873 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image | 0.07850 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit | 0.05956 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name | 0.06586 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status | 0.09254 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip | 0.23073 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex | 0.00060 | skip |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard | 0.14221 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date | 0.05795 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date | 0.01868 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits | 0.06964 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.07267 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value | 0.01534 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string | 0.01306 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor | 0.03567 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image | 0.06330 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name | 0.05500 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted | 0.22976 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing | 0.01362 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server | 0.08669 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password | 0.00039 | skip |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output | 4.49759 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server | 10.29434 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard | 11.00534 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft | 0.31208 | skip |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server | 17.08686 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm | 12.94698 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert | 18.51575 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server | 7.22487 | success |
| tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses | 0.07714 | success |
| tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network | 0.15308 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item | 0.54182 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item | 0.31556 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata | 0.31066 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata | 0.53469 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item | 0.59802 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata | 0.53771 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password | 1.24685 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair | 17.18514 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name | 14.43669 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address | 6.66687 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name | 6.82712 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name | 0.87441 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit | 1.61025 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 | 0.77729 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor | 0.66808 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image | 0.66403 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid | 0.97748 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant | 0.53671 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit | 0.53750 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id | 0.48586 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server | 0.38319 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address | 1.47622 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server | 0.47227 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server | 0.53487 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor | 0.41419 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor | 0.37761 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank | 0.66937 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server | 0.40626 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server | 1.18956 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 | 0.41639 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant | 0.42068 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name | 0.32462 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant | 0.09822 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect | 0.01379 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image | 0.06999 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails | 0.01451 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails | 0.50159 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails | 0.06452 | success |
| tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas | 0.11341 | success |
| tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas | 0.05076 | success |
| tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume | 38.69512 | success |
| tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list | 0.21321 | success |
| tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details | 0.17329 | success |
| tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id | 0.18341 | success |
| tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id | 0.00759 | success |
| tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services | 0.24642 | success |
| tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user | 0.07626 | success |
| tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete | 0.08835 | success |
| tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists | 0.02633 | success |
| tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain | 0.37189 | success |
| tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint | 0.15162 | success |
| tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete | 0.86306 | success |
| tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy | 0.10101 | success |
| tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id | 0.12434 | success |
| tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list | 0.11215 | fail |
| tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service | 0.12074 | success |
| tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all | 0.86182 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.06049 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.01891 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.01815 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.02941 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.02461 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.03987 | success |
| tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params | 0.05957 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image | 0.26863 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file | 0.41872 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image | 0.46002 | success |
| tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions | 0.68221 | success |
| tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address | 1.77595 | success |
| tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip | 2.72713 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network | 0.59088 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port | 1.16562 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet | 3.93480 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network | 1.01314 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port | 1.66236 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet | 1.72675 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet | 1.39541 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility | 0.13054 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks | 0.03480 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets | 0.05462 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network | 0.03106 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet | 0.03278 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet | 1.42674 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility | 0.18894 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks | 0.08396 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets | 0.11331 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network | 0.06513 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet | 0.04251 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools | 1.36723 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups | 1.36291 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port | 0.73091 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports | 0.20694 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port | 0.15012 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools | 1.36701 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups | 1.50158 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port | 0.70437 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_list_ports | 0.07769 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_show_port | 0.06964 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces | 3.74936 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id | 1.65997 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id | 1.75798 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router | 1.38648 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces | 3.00947 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id | 1.91922 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id | 1.66228 | success |
| tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router | 1.09354 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group | 0.73626 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule | 0.59551 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups | 0.02945 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group | 0.47389 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule | 0.93740 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups | 0.02787 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list | 0.55494 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show | 6.50572 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template | 0.02163 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list | 0.82447 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata | 0.53325 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config | 0.38634 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate | 0.32465 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change | 0.55989 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change | 0.51489 | success |
| tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources | 3.86241 | success |
| tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds | 0.03735 | success |
| tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications | 11.17975 | success |
| tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications | 1.67439 | success |
| tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance | 2.39084 | success |
| tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance | 2.38683 | success |
| tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete | 12.07426 | success |
| tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image | 11.07575 | success |
| tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete | 11.26088 | success |
| tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image | 11.66599 | success |
| tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list | 0.41386 | success |
| tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list | 0.39419 | success |
| tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops | 27.45308 | success |
| tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops | 13.84478 | success |
| tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern | 85.32205 | success |
| tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern | 100.83926 | success |
+------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
run_tempest - INFO - Results: {'timestart': '2016-02-2222:27:42.722872', 'duration': 171, 'tests': 210, 'failures': 1}
run_tempest - INFO - Pushing results to DB: 'http://testresults.opnfv.org/testapi/results'.
run_tempest - INFO - Deleting tenant and user for Tempest suite)
Rally¶
FUNCTEST.info: Running Rally benchmark suite...
run_rally - INFO - Starting test scenario "authenticate" ...
run_rally - INFO -
Preparing input task
Task 8ccbcb5f-32ba-4621-be0d-09b54fb1c9ea: started
Task 8ccbcb5f-32ba-4621-be0d-09b54fb1c9ea: finished
test scenario Authenticate.validate_glance
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_glance | 0.112 | 0.132 | 0.201 | 0.201 | 0.201 | 0.143 | 100.0% | 10 |
| authenticate.validate_glance (2) | 0.039 | 0.046 | 0.107 | 0.111 | 0.115 | 0.063 | 100.0% | 10 |
| total | 0.226 | 0.257 | 0.386 | 0.389 | 0.391 | 0.286 | 100.0% | 10 |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.860725164413
Full duration: 3.2147500515
test scenario Authenticate.keystone
+-----------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
| total | 0.065 | 0.07 | 0.085 | 0.106 | 0.127 | 0.076 | 100.0% | 10 |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.236154079437
Full duration: 2.56328606606
test scenario Authenticate.validate_heat
+-----------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_heat | 0.106 | 0.121 | 0.259 | 0.268 | 0.277 | 0.148 | 100.0% | 10 |
| authenticate.validate_heat (2) | 0.022 | 0.028 | 0.122 | 0.18 | 0.237 | 0.065 | 100.0% | 10 |
| total | 0.212 | 0.25 | 0.426 | 0.429 | 0.431 | 0.294 | 100.0% | 10 |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.876858949661
Full duration: 3.099599123
test scenario Authenticate.validate_nova
+-----------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_nova | 0.108 | 0.125 | 0.144 | 0.144 | 0.144 | 0.126 | 100.0% | 10 |
| authenticate.validate_nova (2) | 0.025 | 0.034 | 0.039 | 0.04 | 0.04 | 0.034 | 100.0% | 10 |
| total | 0.214 | 0.242 | 0.258 | 0.263 | 0.268 | 0.239 | 100.0% | 10 |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.719485044479
Full duration: 2.89414715767
test scenario Authenticate.validate_cinder
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_cinder | 0.102 | 0.111 | 0.167 | 0.177 | 0.188 | 0.124 | 100.0% | 10 |
| authenticate.validate_cinder (2) | 0.014 | 0.075 | 0.098 | 0.147 | 0.195 | 0.07 | 100.0% | 10 |
| total | 0.197 | 0.261 | 0.37 | 0.39 | 0.41 | 0.281 | 100.0% | 10 |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.842756032944
Full duration: 3.36014580727
test scenario Authenticate.validate_neutron
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_neutron | 0.106 | 0.121 | 0.133 | 0.137 | 0.142 | 0.122 | 100.0% | 10 |
| authenticate.validate_neutron (2) | 0.029 | 0.088 | 0.109 | 0.11 | 0.111 | 0.087 | 100.0% | 10 |
| total | 0.218 | 0.286 | 0.32 | 0.324 | 0.328 | 0.281 | 100.0% | 10 |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.860924005508
Full duration: 3.14792895317
run_rally - INFO - Test scenario: "authenticate" OK.
run_rally - INFO - Starting test scenario "glance" ...
run_rally - INFO -
Preparing input task
Task e020cf98-caa0-4014-a28d-42748bf9dca3: started
Task e020cf98-caa0-4014-a28d-42748bf9dca3: finished
test scenario GlanceImages.list_images
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| glance.list_images | 0.193 | 0.22 | 0.23 | 0.234 | 0.238 | 0.217 | 100.0% | 10 |
| total | 0.193 | 0.22 | 0.23 | 0.234 | 0.238 | 0.217 | 100.0% | 10 |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.657658100128
Full duration: 3.69541883469
test scenario GlanceImages.create_image_and_boot_instances
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| glance.create_image | 2.85 | 3.139 | 3.39 | 3.41 | 3.43 | 3.133 | 100.0% | 10 |
| nova.boot_servers | 5.898 | 6.853 | 7.241 | 7.329 | 7.417 | 6.806 | 100.0% | 10 |
| total | 8.797 | 10.039 | 10.461 | 10.534 | 10.607 | 9.94 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 29.545609951
Full duration: 55.3799848557
test scenario GlanceImages.create_and_list_image
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| glance.create_image | 2.821 | 3.548 | 3.89 | 3.905 | 3.92 | 3.507 | 100.0% | 10 |
| glance.list_images | 0.04 | 0.045 | 0.053 | 0.054 | 0.056 | 0.046 | 100.0% | 10 |
| total | 2.873 | 3.599 | 3.934 | 3.948 | 3.962 | 3.553 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 10.4028940201
Full duration: 15.1872868538
test scenario GlanceImages.create_and_delete_image
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| glance.create_image | 2.876 | 3.678 | 3.734 | 3.742 | 3.75 | 3.507 | 100.0% | 10 |
| glance.delete_image | 0.141 | 0.148 | 0.209 | 0.217 | 0.226 | 0.162 | 100.0% | 10 |
| total | 3.036 | 3.822 | 3.893 | 3.934 | 3.976 | 3.669 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 10.7681660652
Full duration: 13.7783231735
run_rally - INFO - Test scenario: "glance" OK.
run_rally - INFO - Starting test scenario "cinder" ...
run_rally - INFO -
Preparing input task
Task d1dd9119-e59d-4e80-ad09-072f6300762b: started
Task d1dd9119-e59d-4e80-ad09-072f6300762b: finished
test scenario CinderVolumes.create_and_attach_volume
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 3.086 | 4.323 | 5.484 | 5.514 | 5.544 | 4.505 | 100.0% | 10 |
| cinder.create_volume | 2.703 | 2.882 | 2.961 | 2.969 | 2.978 | 2.865 | 100.0% | 10 |
| nova.attach_volume | 7.55 | 7.801 | 10.194 | 10.345 | 10.495 | 8.292 | 100.0% | 10 |
| nova.detach_volume | 2.967 | 5.217 | 5.602 | 5.694 | 5.786 | 4.468 | 100.0% | 10 |
| cinder.delete_volume | 2.393 | 2.51 | 2.562 | 2.572 | 2.582 | 2.497 | 100.0% | 10 |
| nova.delete_server | 2.375 | 2.429 | 2.554 | 2.595 | 2.637 | 2.46 | 100.0% | 10 |
| total | 21.586 | 25.034 | 28.962 | 29.376 | 29.79 | 25.088 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 74.0110630989
Full duration: 87.3835339546
test scenario CinderVolumes.create_and_list_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 5.186 | 5.298 | 5.406 | 5.44 | 5.474 | 5.311 | 100.0% | 10 |
| cinder.list_volumes | 0.11 | 0.134 | 0.147 | 0.148 | 0.15 | 0.133 | 100.0% | 10 |
| total | 5.336 | 5.425 | 5.529 | 5.575 | 5.62 | 5.444 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 16.3077280521
Full duration: 27.7325429916
test scenario CinderVolumes.create_and_list_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.841 | 2.921 | 3.157 | 3.158 | 3.158 | 2.951 | 100.0% | 10 |
| cinder.list_volumes | 0.067 | 0.12 | 0.18 | 0.18 | 0.18 | 0.127 | 100.0% | 10 |
| total | 2.954 | 3.036 | 3.281 | 3.282 | 3.283 | 3.078 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 9.12118315697
Full duration: 19.8639061451
test scenario CinderVolumes.create_and_list_snapshots
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_snapshot | 2.433 | 2.508 | 2.551 | 2.552 | 2.554 | 2.5 | 100.0% | 10 |
| cinder.list_snapshots | 0.018 | 0.082 | 0.103 | 0.111 | 0.119 | 0.069 | 100.0% | 10 |
| total | 2.523 | 2.561 | 2.612 | 2.627 | 2.641 | 2.57 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 7.76097297668
Full duration: 31.5859258175
test scenario CinderVolumes.create_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.795 | 2.848 | 2.943 | 2.955 | 2.968 | 2.867 | 100.0% | 10 |
| cinder.delete_volume | 2.446 | 2.499 | 2.595 | 2.669 | 2.744 | 2.524 | 100.0% | 10 |
| total | 5.295 | 5.374 | 5.521 | 5.53 | 5.539 | 5.391 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 16.1756019592
Full duration: 23.199131012
test scenario CinderVolumes.create_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 5.287 | 5.38 | 5.424 | 5.439 | 5.454 | 5.365 | 100.0% | 10 |
| cinder.delete_volume | 2.394 | 2.549 | 2.687 | 2.699 | 2.711 | 2.555 | 100.0% | 10 |
| total | 7.728 | 7.896 | 8.06 | 8.081 | 8.103 | 7.92 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 23.6543819904
Full duration: 30.6390721798
test scenario CinderVolumes.create_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.885 | 2.937 | 3.053 | 3.059 | 3.066 | 2.962 | 100.0% | 10 |
| cinder.delete_volume | 2.405 | 2.586 | 2.691 | 2.732 | 2.773 | 2.577 | 100.0% | 10 |
| total | 5.421 | 5.531 | 5.59 | 5.691 | 5.793 | 5.539 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 16.603798151
Full duration: 23.3788831234
test scenario CinderVolumes.create_and_upload_volume_to_image
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 2.792 | 2.951 | 3.369 | 3.545 | 3.721 | 3.036 | 100.0% | 10 |
| cinder.upload_volume_to_image | 26.207 | 65.967 | 78.731 | 83.94 | 89.149 | 62.382 | 100.0% | 10 |
| cinder.delete_volume | 2.469 | 2.587 | 2.777 | 2.908 | 3.038 | 2.617 | 100.0% | 10 |
| nova.delete_image | 0.306 | 0.602 | 1.075 | 1.085 | 1.095 | 0.679 | 100.0% | 10 |
| total | 32.909 | 73.046 | 84.953 | 90.036 | 95.118 | 68.714 | 100.0% | 10 |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 183.403058052
Full duration: 190.890599012
test scenario CinderVolumes.create_and_delete_snapshot
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_snapshot | 2.494 | 2.541 | 2.623 | 2.662 | 2.701 | 2.563 | 100.0% | 10 |
| cinder.delete_snapshot | 2.29 | 2.379 | 2.557 | 2.611 | 2.665 | 2.424 | 100.0% | 10 |
| total | 4.784 | 4.953 | 5.15 | 5.215 | 5.279 | 4.988 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 14.7655448914
Full duration: 33.6425430775
test scenario CinderVolumes.create_volume
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-----+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-----+-------+---------+-------+
| cinder.create_volume | 2.789 | 2.912 | 3.076 | 3.088 | 3.1 | 2.933 | 100.0% | 10 |
| total | 2.789 | 2.913 | 3.076 | 3.088 | 3.1 | 2.933 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-----+-------+---------+-------+
Load duration: 8.82123494148
Full duration: 18.1940879822
test scenario CinderVolumes.create_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.807 | 2.927 | 3.035 | 3.036 | 3.036 | 2.926 | 100.0% | 10 |
| total | 2.808 | 2.927 | 3.036 | 3.036 | 3.036 | 2.927 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 8.90417385101
Full duration: 20.1418190002
test scenario CinderVolumes.list_volumes
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.list_volumes | 0.226 | 0.251 | 0.27 | 0.282 | 0.293 | 0.253 | 100.0% | 10 |
| total | 0.226 | 0.251 | 0.27 | 0.282 | 0.293 | 0.253 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.773681879044
Full duration: 47.6445128918
test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 2.752 | 2.933 | 3.066 | 3.089 | 3.112 | 2.943 | 100.0% | 10 |
| cinder.create_snapshot | 2.319 | 2.388 | 2.432 | 2.437 | 2.441 | 2.387 | 100.0% | 10 |
| nova.attach_volume | 7.626 | 9.641 | 12.934 | 14.634 | 16.334 | 10.372 | 100.0% | 10 |
| nova.detach_volume | 3.067 | 5.326 | 5.451 | 5.507 | 5.563 | 4.908 | 100.0% | 10 |
| cinder.delete_snapshot | 2.261 | 2.317 | 2.419 | 2.448 | 2.476 | 2.333 | 100.0% | 10 |
| cinder.delete_volume | 2.339 | 2.491 | 2.583 | 2.615 | 2.647 | 2.486 | 100.0% | 10 |
| total | 21.617 | 24.353 | 28.724 | 30.338 | 31.953 | 25.746 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 72.4364318848
Full duration: 113.83590889
test scenario CinderVolumes.create_from_volume_and_delete_volume
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 9.733 | 14.37 | 14.917 | 16.883 | 18.848 | 13.936 | 100.0% | 10 |
| cinder.delete_volume | 2.357 | 2.482 | 2.618 | 2.619 | 2.619 | 2.497 | 100.0% | 10 |
| total | 12.277 | 16.823 | 17.514 | 19.491 | 21.468 | 16.433 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 46.032130003
Full duration: 65.3552489281
test scenario CinderVolumes.create_and_extend_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.81 | 2.879 | 3.049 | 3.065 | 3.082 | 2.923 | 100.0% | 10 |
| cinder.extend_volume | 2.584 | 2.789 | 2.943 | 2.951 | 2.958 | 2.782 | 100.0% | 10 |
| cinder.delete_volume | 2.402 | 2.564 | 2.615 | 2.633 | 2.65 | 2.54 | 100.0% | 10 |
| total | 8.046 | 8.216 | 8.376 | 8.506 | 8.636 | 8.246 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 24.652312994
Full duration: 31.6354629993
test scenario CinderVolumes.create_snapshot_and_attach_volume
+-----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 2.872 | 2.939 | 2.986 | 3.045 | 3.103 | 2.944 | 100.0% | 10 |
| cinder.create_snapshot | 2.312 | 2.389 | 2.452 | 2.499 | 2.546 | 2.395 | 100.0% | 10 |
| nova.attach_volume | 7.624 | 7.814 | 13.095 | 16.211 | 19.328 | 9.374 | 100.0% | 10 |
| nova.detach_volume | 2.991 | 4.159 | 5.336 | 5.399 | 5.461 | 4.171 | 100.0% | 10 |
| cinder.delete_snapshot | 2.186 | 2.277 | 2.41 | 2.418 | 2.426 | 2.296 | 100.0% | 10 |
| cinder.delete_volume | 2.431 | 2.498 | 2.589 | 2.595 | 2.601 | 2.51 | 100.0% | 10 |
| total | 21.28 | 23.314 | 26.739 | 29.882 | 33.025 | 24.004 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 68.312828064
Full duration: 112.127801895
test scenario CinderVolumes.create_snapshot_and_attach_volume
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 2.617 | 2.833 | 2.941 | 2.982 | 3.022 | 2.823 | 100.0% | 10 |
| cinder.create_snapshot | 2.282 | 2.375 | 2.445 | 2.47 | 2.494 | 2.384 | 100.0% | 10 |
| nova.attach_volume | 7.58 | 7.741 | 13.508 | 16.698 | 19.888 | 9.501 | 100.0% | 10 |
| nova.detach_volume | 3.07 | 5.287 | 5.408 | 5.463 | 5.518 | 4.882 | 100.0% | 10 |
| cinder.delete_snapshot | 2.254 | 2.326 | 2.432 | 2.435 | 2.438 | 2.343 | 100.0% | 10 |
| cinder.delete_volume | 2.339 | 2.475 | 2.593 | 2.625 | 2.656 | 2.483 | 100.0% | 10 |
| total | 21.236 | 23.663 | 29.169 | 32.362 | 35.555 | 24.955 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 71.8869941235
Full duration: 117.904321909
run_rally - INFO - Test scenario: "cinder" OK.
run_rally - INFO - Starting test scenario "heat" ...
run_rally - INFO -
Preparing input task
Task e23e2615-b959-461f-9e63-973b9de00f98: started
Task e23e2615-b959-461f-9e63-973b9de00f98: finished
test scenario HeatStacks.create_suspend_resume_delete_stack
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.856 | 3.146 | 3.227 | 3.244 | 3.262 | 3.087 | 100.0% | 10 |
| heat.suspend_stack | 0.525 | 1.615 | 1.756 | 1.822 | 1.888 | 1.284 | 100.0% | 10 |
| heat.resume_stack | 0.549 | 1.6 | 1.663 | 1.673 | 1.682 | 1.296 | 100.0% | 10 |
| heat.delete_stack | 1.312 | 1.491 | 1.655 | 1.659 | 1.662 | 1.501 | 100.0% | 10 |
| total | 5.641 | 7.374 | 8.053 | 8.167 | 8.281 | 7.168 | 100.0% | 10 |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 22.0507199764
Full duration: 25.5707690716
test scenario HeatStacks.create_and_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.923 | 3.085 | 3.286 | 3.309 | 3.331 | 3.115 | 100.0% | 10 |
| heat.delete_stack | 0.243 | 0.963 | 1.56 | 1.624 | 1.688 | 0.962 | 100.0% | 10 |
| total | 3.166 | 4.127 | 4.666 | 4.735 | 4.803 | 4.076 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 13.0132920742
Full duration: 16.5792620182
test scenario HeatStacks.create_and_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 9.979 | 11.338 | 13.752 | 13.849 | 13.946 | 11.536 | 100.0% | 10 |
| heat.delete_stack | 7.092 | 8.228 | 8.71 | 8.871 | 9.033 | 8.149 | 100.0% | 10 |
| total | 18.547 | 19.228 | 21.86 | 22.086 | 22.312 | 19.685 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 58.1043260098
Full duration: 61.6377520561
test scenario HeatStacks.create_and_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 11.918 | 13.906 | 16.154 | 16.286 | 16.418 | 13.895 | 100.0% | 10 |
| heat.delete_stack | 8.414 | 9.204 | 10.491 | 10.538 | 10.585 | 9.295 | 100.0% | 10 |
| total | 21.347 | 22.82 | 25.491 | 26.247 | 27.003 | 23.19 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 68.1649589539
Full duration: 71.9318380356
test scenario HeatStacks.list_stacks_and_resources
+------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.list_stacks | 0.233 | 0.257 | 0.318 | 0.436 | 0.555 | 0.286 | 100.0% | 10 |
| heat.list_resources_of_0_stacks | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
| total | 0.233 | 0.257 | 0.318 | 0.436 | 0.555 | 0.286 | 100.0% | 10 |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.829450845718
Full duration: 3.74743390083
test scenario HeatStacks.create_update_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.703 | 2.996 | 3.064 | 3.184 | 3.304 | 2.981 | 100.0% | 10 |
| heat.update_stack | 2.487 | 3.644 | 3.84 | 3.918 | 3.996 | 3.387 | 100.0% | 10 |
| heat.delete_stack | 0.52 | 1.473 | 1.686 | 1.691 | 1.697 | 1.413 | 100.0% | 10 |
| total | 6.639 | 8.102 | 8.301 | 8.486 | 8.671 | 7.781 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 23.5321931839
Full duration: 26.9891970158
test scenario HeatStacks.create_update_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.69 | 3.032 | 3.266 | 3.279 | 3.293 | 3.041 | 100.0% | 10 |
| heat.update_stack | 2.458 | 2.642 | 3.727 | 3.766 | 3.805 | 3.037 | 100.0% | 10 |
| heat.delete_stack | 0.556 | 1.511 | 1.586 | 1.632 | 1.678 | 1.419 | 100.0% | 10 |
| total | 6.957 | 7.396 | 8.15 | 8.18 | 8.21 | 7.497 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 22.4653220177
Full duration: 25.9613161087
test scenario HeatStacks.create_update_delete_stack
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 2.936 | 3.18 | 3.4 | 3.735 | 4.069 | 3.237 | 100.0% | 10 |
| heat.update_stack | 4.79 | 5.132 | 6.045 | 6.06 | 6.076 | 5.308 | 100.0% | 10 |
| heat.delete_stack | 1.518 | 2.424 | 2.589 | 2.618 | 2.647 | 2.182 | 100.0% | 10 |
| total | 9.624 | 10.703 | 11.721 | 11.781 | 11.842 | 10.727 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 31.7993149757
Full duration: 35.7221229076
test scenario HeatStacks.create_update_delete_stack
+-----------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----+--------+--------+--------+-----+-----+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------+-----+--------+--------+--------+-----+-----+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | 0.0% | 7 |
+--------+-----+--------+--------+--------+-----+-----+---------+-------+
Load duration: 6.70760798454
Full duration: 15.0584180355
test scenario HeatStacks.create_update_delete_stack
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+--------+---------+-------+
| heat.create_stack | 2.893 | 3.127 | 3.179 | 3.194 | 3.209 | 3.079 | 100.0% | 10 |
| heat.update_stack | 4.695 | 5.02 | 5.189 | 5.193 | 5.197 | 5.007 | 100.0% | 10 |
| heat.delete_stack | 1.51 | 2.454 | 2.786 | 2.821 | 2.855 | 2.302 | 100.0% | 10 |
| total | 9.334 | 10.621 | 10.981 | 10.985 | 10.99 | 10.388 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+--------+---------+-------+
Load duration: 31.2812139988
Full duration: 35.1641018391
test scenario HeatStacks.create_update_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.885 | 3.01 | 3.24 | 3.311 | 3.381 | 3.05 | 100.0% | 10 |
| heat.update_stack | 2.83 | 3.881 | 3.936 | 3.968 | 4.0 | 3.777 | 100.0% | 10 |
| heat.delete_stack | 1.307 | 1.567 | 1.645 | 1.79 | 1.935 | 1.543 | 100.0% | 10 |
| total | 7.316 | 8.436 | 8.859 | 8.868 | 8.876 | 8.37 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 24.9058198929
Full duration: 28.9196100235
test scenario HeatStacks.create_and_list_stack
+---------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+------+---------+-------+
| heat.create_stack | 2.882 | 3.04 | 3.213 | 3.318 | 3.423 | 3.07 | 100.0% | 10 |
| heat.list_stacks | 0.037 | 0.16 | 0.174 | 0.178 | 0.182 | 0.14 | 100.0% | 10 |
| total | 3.046 | 3.142 | 3.382 | 3.478 | 3.575 | 3.21 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+------+---------+-------+
Load duration: 9.64803004265
Full duration: 17.1896460056
test scenario HeatStacks.create_check_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.808 | 3.191 | 3.252 | 3.281 | 3.311 | 3.148 | 100.0% | 10 |
| heat.check_stack | 0.407 | 0.668 | 1.405 | 1.545 | 1.685 | 0.776 | 100.0% | 10 |
| heat.delete_stack | 0.678 | 1.561 | 1.687 | 1.707 | 1.726 | 1.474 | 100.0% | 10 |
| total | 4.931 | 5.317 | 5.757 | 5.974 | 6.192 | 5.398 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 16.0285110474
Full duration: 19.9199111462
run_rally - INFO - Test scenario: "heat" Failed.
run_rally - INFO - Starting test scenario "keystone" ...
run_rally - INFO -
Preparing input task
Task 08dbf827-7838-43b0-9cd2-3d48c9632781: started
Task 08dbf827-7838-43b0-9cd2-3d48c9632781: finished
test scenario KeystoneBasic.create_tenant_with_users
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.113 | 0.12 | 0.158 | 0.176 | 0.195 | 0.13 | 100.0% | 10 |
| keystone.create_users | 0.651 | 0.684 | 0.707 | 0.733 | 0.759 | 0.685 | 100.0% | 10 |
| total | 0.772 | 0.8 | 0.865 | 0.91 | 0.954 | 0.815 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.42733502388
Full duration: 12.6668281555
test scenario KeystoneBasic.create_add_and_list_user_roles
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.115 | 0.123 | 0.132 | 0.145 | 0.159 | 0.125 | 100.0% | 10 |
| keystone.add_role | 0.09 | 0.101 | 0.122 | 0.137 | 0.151 | 0.106 | 100.0% | 10 |
| keystone.list_roles | 0.049 | 0.057 | 0.062 | 0.065 | 0.067 | 0.057 | 100.0% | 10 |
| total | 0.26 | 0.282 | 0.328 | 0.329 | 0.33 | 0.288 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.850867986679
Full duration: 6.24242782593
test scenario KeystoneBasic.add_and_remove_user_role
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.118 | 0.172 | 0.235 | 0.244 | 0.254 | 0.177 | 100.0% | 10 |
| keystone.add_role | 0.095 | 0.115 | 0.16 | 0.162 | 0.165 | 0.122 | 100.0% | 10 |
| keystone.remove_role | 0.059 | 0.068 | 0.163 | 0.164 | 0.166 | 0.085 | 100.0% | 10 |
| total | 0.281 | 0.407 | 0.444 | 0.447 | 0.451 | 0.385 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.1720468998
Full duration: 6.63848996162
test scenario KeystoneBasic.create_update_and_delete_tenant
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.125 | 0.19 | 0.247 | 0.268 | 0.289 | 0.191 | 100.0% | 10 |
| keystone.update_tenant | 0.052 | 0.063 | 0.11 | 0.111 | 0.113 | 0.07 | 100.0% | 10 |
| keystone.delete_tenant | 0.12 | 0.141 | 0.192 | 0.227 | 0.261 | 0.153 | 100.0% | 10 |
| total | 0.331 | 0.418 | 0.486 | 0.502 | 0.517 | 0.415 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.27042984962
Full duration: 5.3805770874
test scenario KeystoneBasic.create_and_delete_service
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_service | 0.111 | 0.117 | 0.13 | 0.139 | 0.147 | 0.121 | 100.0% | 10 |
| keystone.delete_service | 0.055 | 0.067 | 0.096 | 0.097 | 0.097 | 0.071 | 100.0% | 10 |
| total | 0.176 | 0.189 | 0.212 | 0.215 | 0.218 | 0.192 | 100.0% | 10 |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.61040687561
Full duration: 4.58190393448
test scenario KeystoneBasic.create_tenant
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.114 | 0.128 | 0.136 | 0.16 | 0.183 | 0.131 | 100.0% | 10 |
| total | 0.114 | 0.128 | 0.137 | 0.16 | 0.183 | 0.131 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.400830030441
Full duration: 4.4062628746
test scenario KeystoneBasic.create_user
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_user | 0.124 | 0.137 | 0.146 | 0.163 | 0.179 | 0.138 | 100.0% | 10 |
| total | 0.125 | 0.137 | 0.146 | 0.163 | 0.179 | 0.138 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.42484498024
Full duration: 4.1389541626
test scenario KeystoneBasic.create_and_list_tenants
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.117 | 0.126 | 0.134 | 0.152 | 0.17 | 0.129 | 100.0% | 10 |
| keystone.list_tenants | 0.046 | 0.059 | 0.104 | 0.104 | 0.105 | 0.069 | 100.0% | 10 |
| total | 0.166 | 0.19 | 0.231 | 0.233 | 0.235 | 0.198 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.600751876831
Full duration: 6.1798210144
test scenario KeystoneBasic.create_and_delete_role
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.118 | 0.227 | 0.298 | 0.3 | 0.302 | 0.204 | 100.0% | 10 |
| keystone.delete_role | 0.105 | 0.13 | 0.271 | 0.29 | 0.309 | 0.157 | 100.0% | 10 |
| total | 0.238 | 0.346 | 0.573 | 0.59 | 0.607 | 0.362 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.21080708504
Full duration: 5.530189991
test scenario KeystoneBasic.get_entities
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.121 | 0.125 | 0.148 | 0.149 | 0.151 | 0.13 | 100.0% | 10 |
| keystone.create_user | 0.062 | 0.078 | 0.103 | 0.121 | 0.139 | 0.084 | 100.0% | 10 |
| keystone.create_role | 0.046 | 0.051 | 0.067 | 0.069 | 0.072 | 0.055 | 100.0% | 10 |
| keystone.get_tenant | 0.04 | 0.05 | 0.054 | 0.057 | 0.06 | 0.049 | 100.0% | 10 |
| keystone.get_user | 0.048 | 0.058 | 0.072 | 0.082 | 0.093 | 0.062 | 100.0% | 10 |
| keystone.get_role | 0.042 | 0.047 | 0.053 | 0.058 | 0.064 | 0.048 | 100.0% | 10 |
| keystone.service_list | 0.046 | 0.055 | 0.069 | 0.079 | 0.09 | 0.058 | 100.0% | 10 |
| keystone.get_service | 0.041 | 0.048 | 0.057 | 0.072 | 0.088 | 0.051 | 100.0% | 10 |
| total | 0.483 | 0.541 | 0.568 | 0.584 | 0.599 | 0.538 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.66359400749
Full duration: 10.0017409325
test scenario KeystoneBasic.create_and_list_users
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_user | 0.131 | 0.14 | 0.157 | 0.205 | 0.254 | 0.151 | 100.0% | 10 |
| keystone.list_users | 0.051 | 0.057 | 0.065 | 0.078 | 0.091 | 0.06 | 100.0% | 10 |
| total | 0.182 | 0.199 | 0.239 | 0.274 | 0.309 | 0.211 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.62369799614
Full duration: 4.64324808121
run_rally - INFO - Test scenario: "keystone" OK.
run_rally - INFO - Starting test scenario "neutron" ...
run_rally - INFO -
Preparing input task
Task 7a8d4b82-85d3-485c-996e-08dbd3787094: started
Task 7a8d4b82-85d3-485c-996e-08dbd3787094: finished
test scenario NeutronNetworks.create_and_delete_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.424 | 0.519 | 0.555 | 0.559 | 0.563 | 0.503 | 100.0% | 10 |
| neutron.delete_port | 0.148 | 0.283 | 0.32 | 0.339 | 0.358 | 0.259 | 100.0% | 10 |
| total | 0.584 | 0.797 | 0.849 | 0.859 | 0.87 | 0.762 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.3002948761
Full duration: 25.5696978569
test scenario NeutronNetworks.create_and_list_routers
+---------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.421 | 0.453 | 0.541 | 0.55 | 0.56 | 0.472 | 100.0% | 10 |
| neutron.create_router | 0.039 | 0.045 | 0.24 | 0.247 | 0.254 | 0.11 | 100.0% | 10 |
| neutron.add_interface_router | 0.28 | 0.297 | 0.417 | 0.427 | 0.438 | 0.32 | 100.0% | 10 |
| neutron.list_routers | 0.043 | 0.163 | 0.181 | 0.185 | 0.189 | 0.122 | 100.0% | 10 |
| total | 0.795 | 1.045 | 1.115 | 1.243 | 1.372 | 1.024 | 100.0% | 10 |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.85029602051
Full duration: 27.2547390461
test scenario NeutronNetworks.create_and_delete_routers
+------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.399 | 0.476 | 0.542 | 0.561 | 0.579 | 0.479 | 100.0% | 10 |
| neutron.create_router | 0.038 | 0.041 | 0.181 | 0.186 | 0.19 | 0.096 | 100.0% | 10 |
| neutron.add_interface_router | 0.272 | 0.306 | 0.421 | 0.426 | 0.43 | 0.34 | 100.0% | 10 |
| neutron.remove_interface_router | 0.228 | 0.311 | 0.514 | 0.518 | 0.521 | 0.338 | 100.0% | 10 |
| neutron.delete_router | 0.151 | 0.159 | 0.295 | 0.297 | 0.298 | 0.205 | 100.0% | 10 |
| total | 1.218 | 1.388 | 1.829 | 1.868 | 1.908 | 1.458 | 100.0% | 10 |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.20906496048
Full duration: 28.1987309456
test scenario NeutronNetworks.create_and_list_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.429 | 0.5 | 0.612 | 0.626 | 0.639 | 0.521 | 100.0% | 10 |
| neutron.list_ports | 0.108 | 0.282 | 0.352 | 0.372 | 0.392 | 0.262 | 100.0% | 10 |
| total | 0.594 | 0.761 | 0.957 | 0.957 | 0.957 | 0.783 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.34113693237
Full duration: 26.7457489967
test scenario NeutronNetworks.create_and_delete_subnets
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+------+-------+---------+-------+
| neutron.create_subnet | 0.402 | 0.436 | 0.542 | 0.566 | 0.59 | 0.463 | 100.0% | 10 |
| neutron.delete_subnet | 0.142 | 0.29 | 0.334 | 0.367 | 0.4 | 0.25 | 100.0% | 10 |
| total | 0.564 | 0.709 | 0.86 | 0.875 | 0.89 | 0.713 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+------+-------+---------+-------+
Load duration: 2.14902901649
Full duration: 25.5031478405
test scenario NeutronNetworks.create_and_delete_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.301 | 0.346 | 0.477 | 0.499 | 0.521 | 0.363 | 100.0% | 10 |
| neutron.delete_network | 0.105 | 0.112 | 0.289 | 0.29 | 0.291 | 0.161 | 100.0% | 10 |
| total | 0.411 | 0.457 | 0.766 | 0.789 | 0.812 | 0.524 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.52401685715
Full duration: 14.2058041096
test scenario NeutronNetworks.create_and_list_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.307 | 0.336 | 0.388 | 0.405 | 0.423 | 0.348 | 100.0% | 10 |
| neutron.list_networks | 0.043 | 0.172 | 0.242 | 0.279 | 0.316 | 0.147 | 100.0% | 10 |
| total | 0.36 | 0.503 | 0.621 | 0.622 | 0.623 | 0.495 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.58333802223
Full duration: 15.9647290707
test scenario NeutronNetworks.create_and_update_routers
+---------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.434 | 0.497 | 0.576 | 0.576 | 0.577 | 0.499 | 100.0% | 10 |
| neutron.create_router | 0.037 | 0.173 | 0.305 | 0.36 | 0.415 | 0.158 | 100.0% | 10 |
| neutron.add_interface_router | 0.294 | 0.439 | 0.504 | 0.513 | 0.522 | 0.404 | 100.0% | 10 |
| neutron.update_router | 0.131 | 0.272 | 0.316 | 0.359 | 0.402 | 0.263 | 100.0% | 10 |
| total | 0.93 | 1.355 | 1.47 | 1.584 | 1.698 | 1.324 | 100.0% | 10 |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.98894906044
Full duration: 29.5306479931
test scenario NeutronNetworks.create_and_update_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.317 | 0.356 | 0.487 | 0.489 | 0.491 | 0.377 | 100.0% | 10 |
| neutron.update_network | 0.103 | 0.277 | 0.309 | 0.316 | 0.322 | 0.22 | 100.0% | 10 |
| total | 0.421 | 0.626 | 0.787 | 0.79 | 0.793 | 0.598 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.78881001472
Full duration: 16.6285750866
test scenario NeutronNetworks.create_and_update_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.435 | 0.471 | 0.575 | 0.578 | 0.58 | 0.49 | 100.0% | 10 |
| neutron.update_port | 0.124 | 0.245 | 0.349 | 0.375 | 0.402 | 0.237 | 100.0% | 10 |
| total | 0.565 | 0.725 | 0.912 | 0.917 | 0.922 | 0.728 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.24334001541
Full duration: 26.9849171638
test scenario NeutronNetworks.create_and_list_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.428 | 0.456 | 0.539 | 0.544 | 0.549 | 0.476 | 100.0% | 10 |
| neutron.list_subnets | 0.061 | 0.192 | 0.234 | 0.25 | 0.265 | 0.157 | 100.0% | 10 |
| total | 0.498 | 0.642 | 0.77 | 0.786 | 0.803 | 0.633 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.8174021244
Full duration: 26.2954719067
test scenario NeutronNetworks.create_and_update_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.396 | 0.432 | 0.523 | 0.543 | 0.562 | 0.444 | 100.0% | 10 |
| neutron.update_subnet | 0.157 | 0.226 | 0.355 | 0.395 | 0.434 | 0.256 | 100.0% | 10 |
| total | 0.554 | 0.688 | 0.876 | 0.892 | 0.909 | 0.7 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.9577729702
Full duration: 25.9509670734
run_rally - INFO - Test scenario: "neutron" OK.
run_rally - INFO - Starting test scenario "nova" ...
run_rally - INFO -
Preparing input task
Task c520ad11-229c-433c-9fbb-2ddc8152c608: started
Task c520ad11-229c-433c-9fbb-2ddc8152c608: finished
test scenario NovaKeypair.create_and_delete_keypair
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.create_keypair | 0.423 | 0.517 | 0.708 | 1.052 | 1.396 | 0.61 | 100.0% | 10 |
| nova.delete_keypair | 0.013 | 0.018 | 0.02 | 0.023 | 0.025 | 0.018 | 100.0% | 10 |
| total | 0.442 | 0.534 | 0.722 | 1.068 | 1.415 | 0.627 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.91971611977
Full duration: 16.1851501465
test scenario NovaServers.snapshot_server
+----------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+---------+---------+---------+---------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+---------+---------+---------+---------+--------+---------+-------+
| nova.boot_server | 3.327 | 5.71 | 6.47 | 7.233 | 7.996 | 5.669 | 100.0% | 10 |
| nova.create_image | 35.707 | 57.482 | 68.949 | 70.89 | 72.832 | 55.735 | 100.0% | 10 |
| nova.delete_server | 2.417 | 2.639 | 3.37 | 4.016 | 4.662 | 2.931 | 100.0% | 10 |
| nova.boot_server (2) | 14.245 | 30.97 | 41.617 | 41.703 | 41.788 | 28.214 | 100.0% | 10 |
| nova.delete_server (2) | 2.702 | 4.558 | 6.714 | 6.78 | 6.847 | 4.351 | 100.0% | 10 |
| nova.delete_image | 0.222 | 0.481 | 0.801 | 0.912 | 1.024 | 0.514 | 100.0% | 10 |
| total | 61.815 | 104.063 | 118.678 | 119.932 | 121.185 | 97.414 | 100.0% | 10 |
+------------------------+--------+---------+---------+---------+---------+--------+---------+-------+
Load duration: 270.805267096
Full duration: 295.748194933
test scenario NovaKeypair.boot_and_delete_server_with_keypair
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| nova.create_keypair | 0.371 | 0.431 | 0.516 | 0.517 | 0.517 | 0.439 | 100.0% | 10 |
| nova.boot_server | 3.04 | 4.457 | 5.757 | 5.786 | 5.815 | 4.552 | 100.0% | 10 |
| nova.delete_server | 2.381 | 2.534 | 2.842 | 3.654 | 4.465 | 2.696 | 100.0% | 10 |
| nova.delete_keypair | 0.012 | 0.018 | 0.02 | 0.021 | 0.022 | 0.017 | 100.0% | 10 |
| total | 5.958 | 7.497 | 9.018 | 9.735 | 10.452 | 7.704 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 22.5302600861
Full duration: 46.1866869926
test scenario NovaKeypair.create_and_list_keypairs
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.create_keypair | 0.414 | 0.575 | 0.631 | 0.71 | 0.789 | 0.556 | 100.0% | 10 |
| nova.list_keypairs | 0.013 | 0.018 | 0.02 | 0.021 | 0.021 | 0.018 | 100.0% | 10 |
| total | 0.433 | 0.596 | 0.649 | 0.728 | 0.808 | 0.574 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.60233187675
Full duration: 16.7130730152
test scenario NovaServers.list_servers
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.list_servers | 0.587 | 0.606 | 0.69 | 0.722 | 0.755 | 0.631 | 100.0% | 10 |
| total | 0.587 | 0.606 | 0.69 | 0.722 | 0.755 | 0.631 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.8859231472
Full duration: 50.8739178181
test scenario NovaServers.resize_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 3.363 | 3.918 | 6.304 | 6.779 | 7.255 | 4.596 | 100.0% | 10 |
| nova.resize | 21.13 | 26.439 | 42.015 | 42.22 | 42.424 | 29.139 | 100.0% | 10 |
| nova.resize_confirm | 2.398 | 2.551 | 2.703 | 2.704 | 2.706 | 2.563 | 100.0% | 10 |
| nova.delete_server | 2.37 | 2.395 | 2.798 | 3.721 | 4.644 | 2.648 | 100.0% | 10 |
| total | 29.822 | 34.933 | 54.227 | 54.69 | 55.153 | 38.945 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 114.259507179
Full duration: 128.127579927
test scenario NovaServers.boot_server_from_volume_and_delete
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.235 | 5.567 | 6.045 | 6.052 | 6.06 | 4.919 | 100.0% | 10 |
| nova.boot_server | 8.307 | 9.5 | 12.422 | 13.056 | 13.69 | 9.862 | 100.0% | 10 |
| nova.delete_server | 4.461 | 4.62 | 4.671 | 4.692 | 4.714 | 4.589 | 100.0% | 10 |
| total | 16.186 | 19.059 | 22.977 | 23.551 | 24.126 | 19.371 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 56.1163849831
Full duration: 87.4642381668
test scenario NovaServers.boot_and_migrate_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 3.453 | 4.707 | 6.199 | 6.246 | 6.293 | 4.887 | 100.0% | 10 |
| nova.stop_server | 4.627 | 5.136 | 15.964 | 16.161 | 16.358 | 9.106 | 100.0% | 10 |
| nova.migrate | 14.455 | 16.394 | 25.486 | 26.426 | 27.366 | 18.474 | 100.0% | 10 |
| nova.resize_confirm | 2.376 | 2.404 | 2.575 | 2.612 | 2.649 | 2.458 | 100.0% | 10 |
| nova.delete_server | 2.351 | 2.377 | 2.42 | 2.479 | 2.538 | 2.394 | 100.0% | 10 |
| total | 29.051 | 37.529 | 44.149 | 47.114 | 50.08 | 37.32 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 101.067945957
Full duration: 115.384446144
test scenario NovaServers.boot_and_delete_server
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 3.655 | 6.711 | 7.36 | 7.385 | 7.41 | 6.243 | 100.0% | 10 |
| nova.delete_server | 2.362 | 4.587 | 4.739 | 4.809 | 4.879 | 4.013 | 100.0% | 10 |
| total | 6.017 | 10.937 | 11.962 | 12.02 | 12.078 | 10.256 | 100.0% | 10 |
+--------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 29.3568899632
Full duration: 52.9771959782
test scenario NovaServers.boot_and_rebuild_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 3.859 | 4.72 | 6.26 | 6.315 | 6.369 | 5.06 | 100.0% | 10 |
| nova.rebuild_server | 6.283 | 7.559 | 9.599 | 12.803 | 16.006 | 8.2 | 100.0% | 10 |
| nova.delete_server | 2.37 | 2.551 | 4.527 | 4.582 | 4.638 | 3.088 | 100.0% | 10 |
| total | 13.383 | 16.01 | 18.944 | 20.596 | 22.249 | 16.348 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 55.2873470783
Full duration: 79.1774559021
test scenario NovaSecGroup.create_and_list_secgroups
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 1.595 | 1.928 | 2.017 | 2.036 | 2.055 | 1.891 | 100.0% | 10 |
| nova.create_100_rules | 9.581 | 10.462 | 10.693 | 10.803 | 10.913 | 10.36 | 100.0% | 10 |
| nova.list_security_groups | 0.136 | 0.189 | 0.245 | 0.272 | 0.299 | 0.198 | 100.0% | 10 |
| total | 11.447 | 12.553 | 12.839 | 12.881 | 12.923 | 12.449 | 100.0% | 10 |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 36.6872730255
Full duration: 63.5205390453
test scenario NovaSecGroup.create_and_delete_secgroups
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 1.492 | 1.946 | 2.157 | 2.214 | 2.271 | 1.932 | 100.0% | 10 |
| nova.create_100_rules | 9.298 | 10.497 | 10.608 | 10.624 | 10.64 | 10.256 | 100.0% | 10 |
| nova.delete_10_security_groups | 0.783 | 1.061 | 1.126 | 1.132 | 1.138 | 1.005 | 100.0% | 10 |
| total | 11.788 | 13.418 | 13.784 | 13.788 | 13.793 | 13.194 | 100.0% | 10 |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 38.9264039993
Full duration: 53.6155569553
test scenario NovaServers.boot_and_bounce_server
+---------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+--------+--------+--------+---------+---------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------+--------+--------+--------+---------+---------+--------+---------+-------+
| nova.boot_server | 3.546 | 5.034 | 5.948 | 6.012 | 6.077 | 4.964 | 100.0% | 10 |
| nova.reboot_server | 2.449 | 4.78 | 6.939 | 6.961 | 6.984 | 5.332 | 100.0% | 10 |
| nova.soft_reboot_server | 6.583 | 6.718 | 18.85 | 72.219 | 125.589 | 18.596 | 100.0% | 10 |
| nova.stop_server | 4.622 | 4.796 | 15.736 | 15.861 | 15.986 | 6.96 | 100.0% | 10 |
| nova.start_server | 2.662 | 2.828 | 3.001 | 3.04 | 3.078 | 2.849 | 100.0% | 10 |
| nova.rescue_server | 6.77 | 15.566 | 17.493 | 17.544 | 17.595 | 12.874 | 100.0% | 10 |
| nova.unrescue_server | 2.291 | 4.444 | 4.571 | 4.583 | 4.596 | 3.643 | 100.0% | 10 |
| nova.delete_server | 2.372 | 2.397 | 2.507 | 2.528 | 2.55 | 2.424 | 100.0% | 10 |
| total | 35.205 | 49.523 | 70.623 | 110.831 | 151.04 | 57.653 | 100.0% | 10 |
+-------------------------+--------+--------+--------+---------+---------+--------+---------+-------+
Load duration: 193.802706003
Full duration: 217.975458145
test scenario NovaServers.boot_server
+--------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------+------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------+------+--------+--------+--------+-------+-------+---------+-------+
| nova.boot_server | 3.41 | 4.816 | 6.024 | 6.056 | 6.089 | 4.692 | 100.0% | 10 |
| total | 3.41 | 4.816 | 6.024 | 6.057 | 6.089 | 4.692 | 100.0% | 10 |
+------------------+------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 13.1493849754
Full duration: 37.5227308273
test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
+----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 1.487 | 1.851 | 2.252 | 2.299 | 2.345 | 1.876 | 100.0% | 10 |
| nova.create_100_rules | 9.079 | 10.618 | 10.831 | 10.864 | 10.897 | 10.241 | 100.0% | 10 |
| nova.boot_server | 4.315 | 4.525 | 5.609 | 5.629 | 5.649 | 4.901 | 100.0% | 10 |
| nova.get_attached_security_groups | 0.137 | 0.156 | 0.289 | 0.312 | 0.334 | 0.183 | 100.0% | 10 |
| nova.delete_server | 2.381 | 2.417 | 2.572 | 2.663 | 2.754 | 2.47 | 100.0% | 10 |
| nova.delete_10_security_groups | 0.844 | 1.033 | 1.131 | 1.171 | 1.212 | 1.021 | 100.0% | 10 |
| total | 18.91 | 21.054 | 21.677 | 21.936 | 22.195 | 20.692 | 100.0% | 10 |
+-----------------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 61.2168090343
Full duration: 85.7305738926
test scenario NovaServers.pause_and_unpause_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 3.337 | 5.865 | 6.135 | 6.166 | 6.198 | 5.184 | 100.0% | 10 |
| nova.pause_server | 2.311 | 2.468 | 2.511 | 2.528 | 2.545 | 2.422 | 100.0% | 10 |
| nova.unpause_server | 2.306 | 2.47 | 2.538 | 2.548 | 2.558 | 2.441 | 100.0% | 10 |
| nova.delete_server | 2.37 | 2.623 | 4.832 | 4.882 | 4.932 | 3.392 | 100.0% | 10 |
| total | 10.861 | 13.388 | 15.614 | 15.649 | 15.684 | 13.439 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 39.8893749714
Full duration: 65.2461550236
test scenario NovaServers.boot_server_from_volume
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.172 | 3.51 | 6.009 | 6.055 | 6.102 | 4.387 | 100.0% | 10 |
| nova.boot_server | 7.575 | 8.761 | 11.062 | 12.16 | 13.258 | 9.396 | 100.0% | 10 |
| total | 10.812 | 12.565 | 17.043 | 18.063 | 19.083 | 13.783 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 40.4101068974
Full duration: 76.4117758274
test scenario NovaServers.boot_and_list_server
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.boot_server | 3.891 | 4.847 | 6.169 | 6.267 | 6.365 | 5.093 | 100.0% | 10 |
| nova.list_servers | 0.163 | 0.201 | 0.418 | 0.475 | 0.533 | 0.268 | 100.0% | 10 |
| total | 4.296 | 5.066 | 6.393 | 6.646 | 6.899 | 5.361 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 15.2852530479
Full duration: 50.1823370457
run_rally - INFO - Test scenario: "nova" OK.
run_rally - INFO - Starting test scenario "quotas" ...
run_rally - INFO -
Preparing input task
Task 4d0fc176-8b72-4789-8249-7ca3ed815669: started
Task 4d0fc176-8b72-4789-8249-7ca3ed815669: finished
test scenario Quotas.cinder_update
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.591 | 0.621 | 0.669 | 0.672 | 0.674 | 0.626 | 100.0% | 10 |
| total | 0.591 | 0.621 | 0.669 | 0.672 | 0.674 | 0.626 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.86674189568
Full duration: 7.90543198586
test scenario Quotas.neutron_update
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.243 | 0.257 | 0.271 | 0.271 | 0.271 | 0.258 | 100.0% | 10 |
| total | 0.308 | 0.328 | 0.36 | 0.367 | 0.374 | 0.331 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.996067047119
Full duration: 6.61853408813
test scenario Quotas.cinder_update_and_delete
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.568 | 0.604 | 0.623 | 0.677 | 0.732 | 0.611 | 100.0% | 10 |
| quotas.delete_quotas | 0.415 | 0.442 | 0.477 | 0.501 | 0.526 | 0.449 | 100.0% | 10 |
| total | 0.992 | 1.049 | 1.142 | 1.165 | 1.188 | 1.06 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.19247508049
Full duration: 9.27472686768
test scenario Quotas.nova_update_and_delete
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.323 | 0.35 | 0.371 | 0.38 | 0.39 | 0.349 | 100.0% | 7 |
| quotas.delete_quotas | 0.02 | 0.021 | 0.023 | 0.024 | 0.025 | 0.022 | 71.4% | 7 |
| total | 0.344 | 0.369 | 0.378 | 0.378 | 0.379 | 0.363 | 71.4% | 7 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.752856969833
Full duration: 6.31551885605
test scenario Quotas.nova_update
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.307 | 0.354 | 0.396 | 0.43 | 0.463 | 0.361 | 100.0% | 10 |
| total | 0.307 | 0.354 | 0.396 | 0.43 | 0.463 | 0.361 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.06656098366
Full duration: 6.7101290226
run_rally - INFO - Test scenario: "quotas" Failed.
run_rally - INFO - Starting test scenario "requests" ...
run_rally - INFO -
Preparing input task
Task 16778409-ff5d-4254-aa3b-b80de677272e: started
Task 16778409-ff5d-4254-aa3b-b80de677272e: finished
test scenario HttpRequests.check_random_request
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| requests.check_request | 5.446 | 5.5 | 5.982 | 5.983 | 5.984 | 5.611 | 100.0% | 10 |
| total | 5.446 | 5.5 | 5.982 | 5.983 | 5.984 | 5.611 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 16.9417049885
Full duration: 19.4220340252
test scenario HttpRequests.check_request
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| requests.check_request | 5.459 | 5.479 | 5.494 | 5.501 | 5.508 | 5.478 | 100.0% | 10 |
| total | 5.459 | 5.479 | 5.494 | 5.501 | 5.508 | 5.478 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 16.4412920475
Full duration: 18.8327140808
run_rally - INFO - Test scenario: "requests" OK.
run_rally - INFO -
Rally Summary Report
+===================+============+===============+===========+
| Module | Duration | nb. Test Run | Success |
+===================+============+===============+===========+
| authenticate | 00:18 | 10 | 100.00% |
+-------------------+------------+---------------+-----------+
| glance | 01:28 | 7 | 100.00% |
+-------------------+------------+---------------+-----------+
| cinder | 16:35 | 50 | 100.00% |
+-------------------+------------+---------------+-----------+
| heat | 06:24 | 32 | 92.31% |
+-------------------+------------+---------------+-----------+
| keystone | 01:10 | 29 | 100.00% |
+-------------------+------------+---------------+-----------+
| neutron | 04:48 | 31 | 100.00% |
+-------------------+------------+---------------+-----------+
| nova | 25:39 | 61 | 100.00% |
+-------------------+------------+---------------+-----------+
| quotas | 00:36 | 7 | 94.28% |
+-------------------+------------+---------------+-----------+
| requests | 00:38 | 2 | 100.00% |
+-------------------+------------+---------------+-----------+
+===================+============+===============+===========+
| TOTAL: | 00:57:39 | 229 | 98.51% |
+===================+============+===============+===========+
SDN Controller¶
ODL¶
==============================================================================
Basic
==============================================================================
Basic.010 Restconf OK :: Test suite to verify Restconf is OK
==============================================================================
Get Controller Modules :: Get the controller modules via Restconf | PASS |
------------------------------------------------------------------------------
Basic.010 Restconf OK :: Test suite to verify Restconf is OK | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Basic | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Output: /home/opnfv/output.xml
Log: /home/opnfv/log.html
Report: /home/opnfv/report.html
==============================================================================
Neutron :: Test suite for Neutron Plugin
==============================================================================
Neutron.Networks :: Checking Network created in OpenStack are pushed to Ope...
==============================================================================
Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS |
------------------------------------------------------------------------------
Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS |
------------------------------------------------------------------------------
Create Network :: Create new network in OpenStack | PASS |
------------------------------------------------------------------------------
Check Network :: Check Network created in OpenDaylight | PASS |
------------------------------------------------------------------------------
Neutron.Networks :: Checking Network created in OpenStack are push... | PASS |
4 critical tests, 4 passed, 0 failed
4 tests total, 4 passed, 0 failed
==============================================================================
Neutron.Subnets :: Checking Subnets created in OpenStack are pushed to Open...
==============================================================================
Check OpenStack Subnets :: Checking OpenStack Neutron for known Su... | PASS |
------------------------------------------------------------------------------
Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS |
------------------------------------------------------------------------------
Create New subnet :: Create new subnet in OpenStack | PASS |
------------------------------------------------------------------------------
Check New subnet :: Check new subnet created in OpenDaylight | PASS |
------------------------------------------------------------------------------
Neutron.Subnets :: Checking Subnets created in OpenStack are pushe... | PASS |
4 critical tests, 4 passed, 0 failed
4 tests total, 4 passed, 0 failed
==============================================================================
Neutron.Ports :: Checking Port created in OpenStack are pushed to OpenDaylight
==============================================================================
Check OpenStack ports :: Checking OpenStack Neutron for known ports | PASS |
------------------------------------------------------------------------------
Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS |
------------------------------------------------------------------------------
Create New Port :: Create new port in OpenStack | PASS |
------------------------------------------------------------------------------
Check New Port :: Check new subnet created in OpenDaylight | PASS |
------------------------------------------------------------------------------
Neutron.Ports :: Checking Port created in OpenStack are pushed to ... | PASS |
4 critical tests, 4 passed, 0 failed
4 tests total, 4 passed, 0 failed
==============================================================================
Neutron.Delete Ports :: Checking Port deleted in OpenStack are deleted also...
==============================================================================
Delete New Port :: Delete previously created port in OpenStack | PASS |
------------------------------------------------------------------------------
Check Port Deleted :: Check port deleted in OpenDaylight | PASS |
------------------------------------------------------------------------------
Neutron.Delete Ports :: Checking Port deleted in OpenStack are del... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack are deleted...
==============================================================================
Delete New subnet :: Delete previously created subnet in OpenStack | PASS |
------------------------------------------------------------------------------
Check New subnet deleted :: Check subnet deleted in OpenDaylight | PASS |
------------------------------------------------------------------------------
Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack ar... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Neutron.Delete Networks :: Checking Network deleted in OpenStack are delete...
==============================================================================
Delete Network :: Delete network in OpenStack | PASS |
------------------------------------------------------------------------------
Check Network deleted :: Check Network deleted in OpenDaylight | PASS |
------------------------------------------------------------------------------
Neutron.Delete Networks :: Checking Network deleted in OpenStack a... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Neutron :: Test suite for Neutron Plugin | PASS |
18 critical tests, 18 passed, 0 failed
18 tests total, 18 passed, 0 failed
Feature tests¶
vIMS¶
FUNCTEST.info: Running vIMS test...
vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
vIMS - INFO - Update OpenStack creds informations
vIMS - INFO - Upload some OS images if it doesn't exist
vIMS - INFO - centos_7 image doesn't exist on glance repository.
Try downloading this image and upload on glance !
vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
Try downloading this image and upload on glance !
vIMS - INFO - Update security group quota for this tenant
vIMS - INFO - Update cinder quota for this tenant
vIMS - INFO - Collect flavor id for cloudify manager server
vIMS - INFO - Prepare virtualenv for cloudify-cli
vIMS - INFO - Downloading the cloudify manager server blueprint
vIMS - INFO - Cloudify deployment Start Time:'2016-02-22 22:37:41'
vIMS - INFO - Writing the inputs file
vIMS - INFO - Launching the cloudify-manager deployment
vIMS - INFO - Cloudify-manager server is UP !
vIMS - INFO - Cloudify deployment duration:'745.0'
vIMS - INFO - Collect flavor id for all clearwater vm
vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-22 22:50:07'
vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
vIMS - INFO - Writing the inputs file
vIMS - INFO - Launching the clearwater deployment
vIMS - INFO - The deployment of clearwater-opnfv is ended
vIMS - INFO - vIMS VNF deployment duration:'633.6'
vIMS - INFO - vIMS functional test Start Time:'2016-02-22 23:03:48'
vIMS - INFO - vIMS functional test duration:'4.1'
vIMS - INFO - Launching the clearwater-opnfv undeployment
vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; '
vIMS - INFO - Launching the cloudify-manager undeployment
vIMS - INFO - Cloudify-manager server has been successfully removed!
vIMS - INFO - Removing vIMS tenant ..
vIMS - INFO - Removing vIMS user ..
Detailed test results for compass-os-onos-nofeature-ha¶
VIM¶
vping_ssh¶
FUNCTEST.info: Running vPing-SSH test...
vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
vPing_ssh- INFO - Creating neutron network vping-net...
vPing_ssh- INFO - Creating security group 'vPing-sg'...
vPing_ssh- INFO - Using existing Flavor 'm1.small'...
vPing_ssh- INFO - vPing Start Time:'2016-02-22 16:24:22'
vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
name=opnfv-vping-1
flavor=<Flavor: m1.small>
image=defb6423-f831-4d2e-8a46-21171b471811
network=47a5262f-1252-4ceb-b054-4d81216c1510
vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
name=opnfv-vping-2
flavor=<Flavor: m1.small>
image=defb6423-f831-4d2e-8a46-21171b471811
network=47a5262f-1252-4ceb-b054-4d81216c1510
vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
vPing_ssh- INFO - Floating IP created: '192.168.10.102'
vPing_ssh- INFO - Associating floating ip: '192.168.10.102' to VM 'opnfv-vping-2'
vPing_ssh- INFO - Trying to establish SSH connection to 192.168.10.102...
vPing_ssh- INFO - Waiting for ping...
vPing_ssh- INFO - vPing detected!
vPing_ssh- INFO - vPing duration:'262.5' s.
vPing_ssh- INFO - Cleaning up...
vPing_ssh- INFO - vPing OK
Tempest¶
FUNCTEST.info: Running Tempest tests...
run_tempest - INFO - Creating tenant and user for Tempest suite
2016-02-22 16:28:55.743 23855 INFO rally.verification.tempest.tempest [-] Starting: Creating configuration file for Tempest.
2016-02-22 16:29:00.285 23855 INFO rally.verification.tempest.tempest [-] Completed: Creating configuration file for Tempest.
run_tempest - INFO - Starting Tempest test suite: '--tests-file /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/custom_tests/test_list.txt'.
Total results of verification:
+--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
| UUID | Deployment UUID | Set name | Tests | Failures | Created at | Status |
+--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
| ac98ac8a-e502-4828-ad00-5b6b9428c346 | 55a7fc58-ad0f-475c-88c7-369043ae2719 | | 210 | 11 | 2016-02-22 16:29:01.778060 | finished |
+--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
Tests:
+------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
| name | time | status |
+------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
| tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor | 0.38607 | success |
| tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors | 0.74194 | success |
| tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image | 8.91734 | success |
| tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image | 8.66925 | success |
| tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name | 10.63581 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since | 0.06276 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name | 0.05257 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id | 0.05940 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref | 0.12623 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status | 0.06809 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type | 0.09008 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results | 0.06098 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since | 0.07950 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name | 0.05546 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref | 0.12715 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status | 0.12835 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type | 0.10113 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results | 0.06587 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image | 0.17079 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images | 0.11263 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail | 0.06114 | success |
| tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create | 0.52524 | success |
| tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list | 0.45980 | success |
| tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete | 0.95973 | success |
| tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip | 7.95218 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name | 302.25007 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers | 0.10296 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail | 0.18670 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus | 342.44729 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details | 0.00068 | success |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name | 311.26623 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers | 0.11079 | success |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail | 0.20087 | success |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus | 342.41636 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details | 0.00101 | success |
| tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action | 0.07243 | success |
| tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions | 6.46736 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor | 0.16392 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image | 0.27404 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name | 0.17996 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status | 1.07085 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results | 0.17853 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor | 0.10615 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image | 0.09603 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit | 0.09373 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name | 0.09520 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status | 0.12248 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip | 0.51307 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex | 0.00065 | skip |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard | 0.14353 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date | 0.06854 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date | 0.01693 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits | 0.06418 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.06254 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value | 0.01346 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string | 0.01475 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor | 0.03419 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image | 0.06726 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name | 0.04958 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted | 0.26188 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing | 0.01624 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server | 0.06862 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password | 0.00048 | skip |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output | 7.97654 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server | 11.64967 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard | 310.79753 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft | 0.46854 | skip |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server | 326.22117 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm | 12.06790 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert | 19.04478 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server | 7.05743 | success |
| tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses | 0.07867 | success |
| tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network | 0.20214 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item | 0.59746 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item | 0.34277 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata | 0.33642 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata | 0.57047 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item | 0.60103 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata | 0.75531 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password | 2.75731 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair | 9.46973 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name | 13.28125 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address | 7.11541 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name | 7.96344 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name | 0.67669 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit | 1.77693 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 | 0.75065 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor | 1.78955 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image | 0.64498 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid | 1.71157 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant | 0.53460 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit | 0.49832 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id | 0.57201 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server | 0.46864 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address | 0.66619 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server | 0.72274 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server | 0.40295 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor | 0.58226 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor | 0.34041 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank | 0.75975 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server | 0.43415 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server | 0.42859 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 | 1.21474 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant | 1.25222 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name | 0.41021 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant | 0.09081 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect | 0.02184 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image | 0.96806 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails | 0.01307 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails | 0.46717 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails | 0.05568 | success |
| tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas | 0.09471 | success |
| tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas | 0.03604 | success |
| tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume | 340.34367 | fail |
| tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list | 0.43241 | success |
| tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details | 0.11064 | success |
| tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id | 0.11956 | success |
| tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id | 0.01137 | success |
| tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services | 0.16401 | success |
| tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user | 0.05961 | success |
| tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete | 0.10927 | success |
| tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists | 0.02540 | success |
| tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain | 0.28040 | success |
| tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint | 0.14755 | success |
| tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete | 0.77153 | success |
| tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy | 0.12106 | success |
| tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id | 0.08473 | success |
| tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list | 0.12668 | success |
| tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service | 0.14400 | success |
| tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all | 0.91996 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.05010 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.02297 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.04885 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.01587 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.01260 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.01445 | success |
| tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params | 0.04696 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image | 0.60138 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file | 0.21576 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image | 0.42759 | success |
| tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions | 0.49116 | success |
| tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address | 0.79505 | success |
| tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip | 0.70780 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network | 0.56456 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port | 1.10523 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet | 3.54869 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network | 0.83123 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port | 1.58383 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet | 1.36920 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet | 1.08591 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility | 0.19026 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks | 0.07493 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets | 0.06495 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network | 0.02942 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet | 0.03500 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet | 1.05982 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility | 0.15572 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks | 0.10990 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets | 0.09926 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network | 0.04061 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet | 0.03720 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools | 1.04510 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups | 1.34649 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port | 0.59530 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports | 0.05189 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port | 0.04790 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools | 1.14770 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups | 1.11571 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port | 0.75502 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_list_ports | 0.04674 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_show_port | 0.08023 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces | 3.25659 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id | 1.59393 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id | 1.18965 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router | 1.03248 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces | 2.64680 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id | 2.09130 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id | 1.43383 | success |
| tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router | 1.25843 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group | 0.66808 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule | 0.46888 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups | 0.03378 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group | 0.36912 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule | 0.76166 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups | 0.02877 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list | 0.36667 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show | 5.11422 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template | 0.02366 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list | 0.58931 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata | 0.43084 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config | 0.29860 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate | 0.48701 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change | 0.84124 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change | 0.35246 | success |
| tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources | 3.35082 | success |
| tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds | 0.02341 | success |
| tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications | 0.86551 | success |
| tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications | 1.65927 | success |
| tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance | 2.12480 | success |
| tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance | 2.76915 | success |
| tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete | 12.56546 | success |
| tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image | 9.57875 | success |
| tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete | 11.23806 | success |
| tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image | 11.53830 | success |
| tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list | 0.09463 | success |
| tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list | 0.38766 | success |
| tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops | 358.88405 | fail |
| tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops | 327.24468 | fail |
| tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern | 327.82000 | fail |
| tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern | 500.15877 | fail |
+------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
run_tempest - INFO - Results: {'timestart': '2016-02-2216:29:01.778060', 'duration': 1082, 'tests': 210, 'failures': 11}
run_tempest - INFO - Pushing results to DB: 'http://testresults.opnfv.org/testapi/results'.
run_tempest - INFO - Deleting tenant and user for Tempest suite)
Rally¶
FUNCTEST.info: Running Rally benchmark suite...
run_rally - INFO - Starting test scenario "authenticate" ...
run_rally - INFO -
Preparing input task
Task 2944fcc5-089f-4ed8-851f-446508c45024: started
Task 2944fcc5-089f-4ed8-851f-446508c45024: finished
test scenario Authenticate.validate_glance
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_glance | 0.122 | 0.162 | 0.216 | 0.225 | 0.234 | 0.169 | 100.0% | 10 |
| authenticate.validate_glance (2) | 0.039 | 0.042 | 0.052 | 0.072 | 0.092 | 0.047 | 100.0% | 10 |
| total | 0.258 | 0.3 | 0.34 | 0.34 | 0.341 | 0.299 | 100.0% | 10 |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.893048048019
Full duration: 3.09276199341
test scenario Authenticate.keystone
+-----------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
| total | 0.066 | 0.072 | 0.074 | 0.074 | 0.074 | 0.071 | 100.0% | 10 |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.233579874039
Full duration: 2.32735109329
test scenario Authenticate.validate_heat
+-----------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_heat | 0.113 | 0.133 | 0.255 | 0.267 | 0.28 | 0.161 | 100.0% | 10 |
| authenticate.validate_heat (2) | 0.021 | 0.09 | 0.147 | 0.163 | 0.179 | 0.085 | 100.0% | 10 |
| total | 0.254 | 0.338 | 0.389 | 0.402 | 0.415 | 0.327 | 100.0% | 10 |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.968546152115
Full duration: 3.10294985771
test scenario Authenticate.validate_nova
+-----------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_nova | 0.111 | 0.119 | 0.17 | 0.179 | 0.187 | 0.133 | 100.0% | 10 |
| authenticate.validate_nova (2) | 0.023 | 0.035 | 0.042 | 0.048 | 0.054 | 0.036 | 100.0% | 10 |
| total | 0.214 | 0.225 | 0.291 | 0.291 | 0.292 | 0.243 | 100.0% | 10 |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.725472211838
Full duration: 2.86061501503
test scenario Authenticate.validate_cinder
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_cinder | 0.098 | 0.112 | 0.138 | 0.14 | 0.143 | 0.118 | 100.0% | 10 |
| authenticate.validate_cinder (2) | 0.058 | 0.071 | 0.077 | 0.078 | 0.078 | 0.07 | 100.0% | 10 |
| total | 0.221 | 0.256 | 0.312 | 0.313 | 0.313 | 0.267 | 100.0% | 10 |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.797883033752
Full duration: 2.91927695274
test scenario Authenticate.validate_neutron
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_neutron | 0.108 | 0.124 | 0.192 | 0.195 | 0.198 | 0.138 | 100.0% | 10 |
| authenticate.validate_neutron (2) | 0.028 | 0.08 | 0.102 | 0.102 | 0.102 | 0.074 | 100.0% | 10 |
| total | 0.207 | 0.273 | 0.346 | 0.353 | 0.359 | 0.281 | 100.0% | 10 |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.847912073135
Full duration: 3.07389783859
run_rally - INFO - Test scenario: "authenticate" OK.
run_rally - INFO - Starting test scenario "glance" ...
run_rally - INFO -
Preparing input task
Task 2fff3869-9689-44d4-b372-dd41fa2a38ec: started
Task 2fff3869-9689-44d4-b372-dd41fa2a38ec: finished
test scenario GlanceImages.list_images
+---------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+-------+--------+--------+--------+-----+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+-------+--------+--------+--------+-----+-------+---------+-------+
| glance.list_images | 0.177 | 0.232 | 0.296 | 0.298 | 0.3 | 0.241 | 100.0% | 10 |
| total | 0.177 | 0.232 | 0.296 | 0.298 | 0.3 | 0.241 | 100.0% | 10 |
+--------------------+-------+--------+--------+--------+-----+-------+---------+-------+
Load duration: 0.697636127472
Full duration: 3.5939040184
test scenario GlanceImages.create_image_and_boot_instances
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| glance.create_image | 2.763 | 2.903 | 3.45 | 3.45 | 3.45 | 3.052 | 100.0% | 10 |
| nova.boot_servers | 4.51 | 6.909 | 7.772 | 7.907 | 8.042 | 6.735 | 100.0% | 10 |
| total | 7.273 | 10.244 | 10.662 | 10.752 | 10.842 | 9.787 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 28.153493166
Full duration: 53.9921939373
test scenario GlanceImages.create_and_list_image
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| glance.create_image | 3.066 | 3.262 | 3.685 | 3.718 | 3.751 | 3.328 | 100.0% | 10 |
| glance.list_images | 0.04 | 0.047 | 0.059 | 0.063 | 0.066 | 0.049 | 100.0% | 10 |
| total | 3.107 | 3.324 | 3.734 | 3.767 | 3.8 | 3.376 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 9.83786201477
Full duration: 14.2525467873
test scenario GlanceImages.create_and_delete_image
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| glance.create_image | 2.758 | 3.01 | 3.624 | 3.641 | 3.658 | 3.096 | 100.0% | 10 |
| glance.delete_image | 0.119 | 0.159 | 0.282 | 0.338 | 0.394 | 0.189 | 100.0% | 10 |
| total | 2.887 | 3.164 | 3.878 | 3.884 | 3.89 | 3.285 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 9.57883381844
Full duration: 12.357642889
run_rally - INFO - Test scenario: "glance" OK.
run_rally - INFO - Starting test scenario "cinder" ...
run_rally - INFO -
Preparing input task
Task 76a5a912-68db-4001-b4a1-9beac5ae37ea: started
Task 76a5a912-68db-4001-b4a1-9beac5ae37ea: finished
test scenario CinderVolumes.create_and_attach_volume
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+-------+---------+-------+
| nova.boot_server | 3.805 | 4.389 | 5.707 | 6.126 | 6.546 | 4.733 | 100.0% | 10 |
| cinder.create_volume | 2.687 | 2.841 | 2.929 | 2.954 | 2.978 | 2.833 | 100.0% | 10 |
| nova.attach_volume | 7.618 | 7.963 | 8.416 | 9.348 | 10.28 | 8.167 | 100.0% | 10 |
| nova.detach_volume | 2.997 | 3.285 | 5.265 | 5.314 | 5.362 | 3.992 | 100.0% | 10 |
| cinder.delete_volume | 2.425 | 2.506 | 2.557 | 2.658 | 2.759 | 2.516 | 100.0% | 10 |
| nova.delete_server | 2.379 | 2.447 | 2.618 | 2.639 | 2.659 | 2.478 | 100.0% | 10 |
| total | 23.106 | 25.014 | 25.886 | 26.355 | 26.825 | 24.72 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 75.3569400311
Full duration: 87.994022131
test scenario CinderVolumes.create_and_list_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 5.261 | 5.355 | 5.486 | 5.512 | 5.539 | 5.367 | 100.0% | 10 |
| cinder.list_volumes | 0.069 | 0.121 | 0.135 | 0.151 | 0.168 | 0.12 | 100.0% | 10 |
| total | 5.351 | 5.501 | 5.595 | 5.626 | 5.658 | 5.487 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 16.505685091
Full duration: 27.6703879833
test scenario CinderVolumes.create_and_list_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.758 | 2.928 | 3.178 | 3.185 | 3.192 | 2.955 | 100.0% | 10 |
| cinder.list_volumes | 0.11 | 0.124 | 0.158 | 0.159 | 0.161 | 0.128 | 100.0% | 10 |
| total | 2.878 | 3.071 | 3.319 | 3.327 | 3.334 | 3.084 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 9.14664101601
Full duration: 20.325412035
test scenario CinderVolumes.create_and_list_snapshots
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_snapshot | 2.401 | 2.521 | 2.599 | 2.615 | 2.632 | 2.517 | 100.0% | 10 |
| cinder.list_snapshots | 0.022 | 0.083 | 0.12 | 0.15 | 0.18 | 0.089 | 100.0% | 10 |
| total | 2.474 | 2.588 | 2.729 | 2.753 | 2.776 | 2.606 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 7.73569321632
Full duration: 31.2840220928
test scenario CinderVolumes.create_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.796 | 2.999 | 3.144 | 3.15 | 3.156 | 2.996 | 100.0% | 10 |
| cinder.delete_volume | 2.455 | 2.614 | 2.708 | 2.725 | 2.742 | 2.616 | 100.0% | 10 |
| total | 5.328 | 5.602 | 5.851 | 5.868 | 5.885 | 5.612 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 16.477782011
Full duration: 22.7058889866
test scenario CinderVolumes.create_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.919 | 5.48 | 5.628 | 5.639 | 5.649 | 5.227 | 100.0% | 10 |
| cinder.delete_volume | 2.526 | 2.693 | 2.72 | 2.755 | 2.79 | 2.663 | 100.0% | 10 |
| total | 5.62 | 8.087 | 8.341 | 8.375 | 8.409 | 7.89 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 24.1292200089
Full duration: 30.4960770607
test scenario CinderVolumes.create_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.85 | 2.948 | 3.049 | 3.07 | 3.09 | 2.953 | 100.0% | 10 |
| cinder.delete_volume | 2.464 | 2.529 | 2.614 | 2.615 | 2.615 | 2.54 | 100.0% | 10 |
| total | 5.325 | 5.506 | 5.652 | 5.656 | 5.661 | 5.493 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 16.3896708488
Full duration: 22.6766388416
test scenario CinderVolumes.create_and_upload_volume_to_image
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 2.872 | 3.051 | 3.667 | 3.678 | 3.688 | 3.15 | 100.0% | 10 |
| cinder.upload_volume_to_image | 28.915 | 62.489 | 77.495 | 77.616 | 77.736 | 60.612 | 100.0% | 10 |
| cinder.delete_volume | 2.362 | 2.491 | 2.538 | 2.611 | 2.684 | 2.494 | 100.0% | 10 |
| nova.delete_image | 0.209 | 0.455 | 0.893 | 0.906 | 0.919 | 0.514 | 100.0% | 10 |
| total | 35.229 | 68.483 | 83.109 | 83.228 | 83.346 | 66.77 | 100.0% | 10 |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 193.43104291
Full duration: 200.303003073
test scenario CinderVolumes.create_and_delete_snapshot
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_snapshot | 2.422 | 2.503 | 2.568 | 2.571 | 2.575 | 2.507 | 100.0% | 10 |
| cinder.delete_snapshot | 2.313 | 2.444 | 2.482 | 2.492 | 2.501 | 2.427 | 100.0% | 10 |
| total | 4.793 | 4.964 | 5.013 | 5.018 | 5.024 | 4.935 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 14.7233128548
Full duration: 33.1759068966
test scenario CinderVolumes.create_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.844 | 2.948 | 3.269 | 3.319 | 3.369 | 3.015 | 100.0% | 10 |
| total | 2.844 | 2.948 | 3.269 | 3.319 | 3.369 | 3.015 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 8.9167098999
Full duration: 18.3895540237
test scenario CinderVolumes.create_volume
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+------+---------+-------+
| cinder.create_volume | 2.854 | 2.953 | 3.096 | 3.121 | 3.146 | 2.98 | 100.0% | 10 |
| total | 2.854 | 2.953 | 3.096 | 3.121 | 3.146 | 2.98 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+------+---------+-------+
Load duration: 8.90475797653
Full duration: 20.1169910431
test scenario CinderVolumes.list_volumes
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.list_volumes | 0.228 | 0.266 | 0.286 | 0.317 | 0.348 | 0.268 | 100.0% | 10 |
| total | 0.228 | 0.266 | 0.287 | 0.317 | 0.348 | 0.268 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.792151927948
Full duration: 47.0951080322
test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 2.829 | 2.905 | 2.967 | 2.969 | 2.971 | 2.899 | 100.0% | 10 |
| cinder.create_snapshot | 2.302 | 2.402 | 2.432 | 2.455 | 2.478 | 2.392 | 100.0% | 10 |
| nova.attach_volume | 7.72 | 7.953 | 11.462 | 12.036 | 12.61 | 8.943 | 100.0% | 10 |
| nova.detach_volume | 2.903 | 4.153 | 5.343 | 5.534 | 5.724 | 4.179 | 100.0% | 10 |
| cinder.delete_snapshot | 2.258 | 2.311 | 2.403 | 2.446 | 2.49 | 2.331 | 100.0% | 10 |
| cinder.delete_volume | 2.387 | 2.497 | 2.6 | 2.623 | 2.647 | 2.496 | 100.0% | 10 |
| total | 21.145 | 23.329 | 26.38 | 26.678 | 26.977 | 23.543 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 68.2392091751
Full duration: 106.915300131
test scenario CinderVolumes.create_from_volume_and_delete_volume
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 7.712 | 12.285 | 17.231 | 18.187 | 19.144 | 12.995 | 100.0% | 10 |
| cinder.delete_volume | 2.494 | 2.633 | 4.76 | 4.808 | 4.856 | 3.025 | 100.0% | 10 |
| total | 10.216 | 16.032 | 19.868 | 20.756 | 21.645 | 16.019 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 44.5057139397
Full duration: 63.1546430588
test scenario CinderVolumes.create_and_extend_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.887 | 2.994 | 3.283 | 3.324 | 3.364 | 3.038 | 100.0% | 10 |
| cinder.extend_volume | 2.593 | 2.748 | 2.812 | 2.924 | 3.037 | 2.754 | 100.0% | 10 |
| cinder.delete_volume | 2.417 | 2.569 | 2.707 | 2.724 | 2.74 | 2.562 | 100.0% | 10 |
| total | 8.03 | 8.369 | 8.538 | 8.631 | 8.723 | 8.353 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 24.8781170845
Full duration: 31.6701009274
test scenario CinderVolumes.create_snapshot_and_attach_volume
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 2.736 | 2.972 | 3.155 | 3.173 | 3.19 | 2.98 | 100.0% | 10 |
| cinder.create_snapshot | 2.321 | 2.38 | 2.392 | 2.399 | 2.406 | 2.369 | 100.0% | 10 |
| nova.attach_volume | 7.503 | 7.861 | 12.563 | 13.795 | 15.028 | 9.196 | 100.0% | 10 |
| nova.detach_volume | 3.269 | 5.314 | 5.356 | 5.366 | 5.375 | 4.908 | 100.0% | 10 |
| cinder.delete_snapshot | 2.21 | 2.305 | 2.435 | 2.442 | 2.45 | 2.323 | 100.0% | 10 |
| cinder.delete_volume | 2.413 | 2.499 | 2.584 | 2.597 | 2.611 | 2.505 | 100.0% | 10 |
| total | 21.356 | 23.78 | 28.296 | 29.607 | 30.917 | 24.594 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 70.9472367764
Full duration: 114.492169142
test scenario CinderVolumes.create_snapshot_and_attach_volume
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 2.736 | 2.845 | 3.037 | 3.081 | 3.125 | 2.876 | 100.0% | 10 |
| cinder.create_snapshot | 2.343 | 2.399 | 2.462 | 2.479 | 2.495 | 2.405 | 100.0% | 10 |
| nova.attach_volume | 7.59 | 7.737 | 13.073 | 16.133 | 19.193 | 9.585 | 100.0% | 10 |
| nova.detach_volume | 2.916 | 5.205 | 5.382 | 5.39 | 5.397 | 4.608 | 100.0% | 10 |
| cinder.delete_snapshot | 2.203 | 2.364 | 2.427 | 2.455 | 2.483 | 2.347 | 100.0% | 10 |
| cinder.delete_volume | 2.421 | 2.547 | 2.613 | 2.662 | 2.71 | 2.55 | 100.0% | 10 |
| total | 21.034 | 23.722 | 27.391 | 31.314 | 35.237 | 24.898 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 73.5739891529
Full duration: 116.225493908
run_rally - INFO - Test scenario: "cinder" OK.
run_rally - INFO - Starting test scenario "heat" ...
run_rally - INFO -
Preparing input task
Task c9827201-74f8-41fc-8510-938cca773ec1: started
Task c9827201-74f8-41fc-8510-938cca773ec1: finished
test scenario HeatStacks.create_suspend_resume_delete_stack
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.872 | 3.106 | 3.406 | 3.484 | 3.562 | 3.155 | 100.0% | 10 |
| heat.suspend_stack | 0.442 | 0.625 | 1.717 | 1.738 | 1.759 | 0.931 | 100.0% | 10 |
| heat.resume_stack | 0.537 | 1.658 | 1.746 | 1.816 | 1.886 | 1.424 | 100.0% | 10 |
| heat.delete_stack | 0.502 | 1.432 | 1.591 | 1.6 | 1.609 | 1.362 | 100.0% | 10 |
| total | 5.462 | 6.793 | 8.103 | 8.346 | 8.589 | 6.872 | 100.0% | 10 |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 19.5646238327
Full duration: 22.7670919895
test scenario HeatStacks.create_and_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.903 | 3.075 | 3.47 | 3.485 | 3.501 | 3.168 | 100.0% | 10 |
| heat.delete_stack | 0.399 | 1.444 | 1.664 | 1.668 | 1.672 | 1.316 | 100.0% | 10 |
| total | 3.367 | 4.479 | 4.942 | 5.031 | 5.12 | 4.484 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 13.5260851383
Full duration: 16.6767499447
test scenario HeatStacks.create_and_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 10.422 | 12.344 | 12.812 | 13.47 | 14.128 | 12.097 | 100.0% | 10 |
| heat.delete_stack | 6.869 | 8.251 | 9.518 | 9.918 | 10.317 | 8.407 | 100.0% | 10 |
| total | 18.742 | 20.619 | 22.144 | 22.228 | 22.313 | 20.504 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 60.1647601128
Full duration: 63.2413249016
test scenario HeatStacks.create_and_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 12.861 | 14.13 | 16.111 | 16.328 | 16.545 | 14.294 | 100.0% | 10 |
| heat.delete_stack | 8.256 | 8.951 | 9.675 | 9.958 | 10.241 | 8.968 | 100.0% | 10 |
| total | 21.289 | 22.778 | 24.964 | 25.875 | 26.786 | 23.262 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 70.9971709251
Full duration: 74.4355139732
test scenario HeatStacks.list_stacks_and_resources
+-----------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------------+-------+--------+--------+--------+-------+------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------------------+-------+--------+--------+--------+-------+------+---------+-------+
| heat.list_stacks | 0.221 | 0.269 | 0.393 | 0.397 | 0.401 | 0.29 | 100.0% | 10 |
| heat.list_resources_of_0_stacks | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
| total | 0.221 | 0.269 | 0.393 | 0.397 | 0.401 | 0.29 | 100.0% | 10 |
+---------------------------------+-------+--------+--------+--------+-------+------+---------+-------+
Load duration: 0.845721006393
Full duration: 3.40288186073
test scenario HeatStacks.create_update_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.871 | 3.088 | 3.407 | 3.415 | 3.422 | 3.124 | 100.0% | 10 |
| heat.update_stack | 2.568 | 3.106 | 3.925 | 3.953 | 3.981 | 3.187 | 100.0% | 10 |
| heat.delete_stack | 1.369 | 1.555 | 1.647 | 1.686 | 1.724 | 1.55 | 100.0% | 10 |
| total | 7.072 | 7.871 | 8.535 | 8.749 | 8.963 | 7.861 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 24.2382650375
Full duration: 27.7685508728
test scenario HeatStacks.create_update_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.836 | 3.105 | 3.233 | 3.257 | 3.281 | 3.098 | 100.0% | 10 |
| heat.update_stack | 2.501 | 2.628 | 3.613 | 3.804 | 3.995 | 2.859 | 100.0% | 10 |
| heat.delete_stack | 0.298 | 0.994 | 1.511 | 1.565 | 1.62 | 1.001 | 100.0% | 10 |
| total | 5.886 | 6.758 | 8.232 | 8.564 | 8.895 | 6.957 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 20.5952920914
Full duration: 23.9688129425
test scenario HeatStacks.create_update_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.896 | 3.156 | 3.462 | 3.752 | 4.042 | 3.241 | 100.0% | 10 |
| heat.update_stack | 4.942 | 5.218 | 5.956 | 6.09 | 6.224 | 5.42 | 100.0% | 10 |
| heat.delete_stack | 1.551 | 1.665 | 2.721 | 2.788 | 2.856 | 2.038 | 100.0% | 10 |
| total | 9.408 | 10.658 | 11.602 | 11.761 | 11.92 | 10.7 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 31.6187429428
Full duration: 35.1271891594
test scenario HeatStacks.create_update_delete_stack
+-----------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----+--------+--------+--------+-----+-----+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------+-----+--------+--------+--------+-----+-----+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | 0.0% | 5 |
+--------+-----+--------+--------+--------+-----+-----+---------+-------+
Load duration: 6.39157295227
Full duration: 14.0238859653
test scenario HeatStacks.create_update_delete_stack
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+--------+---------+-------+
| heat.create_stack | 2.944 | 3.08 | 3.202 | 3.309 | 3.415 | 3.09 | 100.0% | 10 |
| heat.update_stack | 4.794 | 5.017 | 5.255 | 5.579 | 5.904 | 5.077 | 100.0% | 10 |
| heat.delete_stack | 1.435 | 1.866 | 2.632 | 2.657 | 2.682 | 1.998 | 100.0% | 10 |
| total | 9.394 | 10.052 | 10.876 | 10.903 | 10.93 | 10.165 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+--------+---------+-------+
Load duration: 30.0142600536
Full duration: 33.6354219913
test scenario HeatStacks.create_update_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.874 | 3.099 | 3.257 | 3.296 | 3.334 | 3.084 | 100.0% | 10 |
| heat.update_stack | 3.576 | 3.724 | 4.103 | 4.118 | 4.132 | 3.804 | 100.0% | 10 |
| heat.delete_stack | 0.597 | 1.497 | 1.641 | 1.685 | 1.73 | 1.368 | 100.0% | 10 |
| total | 7.498 | 8.373 | 8.618 | 8.72 | 8.823 | 8.256 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 24.9089329243
Full duration: 28.905012846
test scenario HeatStacks.create_and_list_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.986 | 3.186 | 3.26 | 3.309 | 3.358 | 3.166 | 100.0% | 10 |
| heat.list_stacks | 0.035 | 0.163 | 0.192 | 0.205 | 0.218 | 0.128 | 100.0% | 10 |
| total | 3.039 | 3.305 | 3.472 | 3.495 | 3.518 | 3.294 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 9.91034293175
Full duration: 16.8483679295
test scenario HeatStacks.create_check_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.822 | 3.0 | 3.403 | 3.446 | 3.489 | 3.098 | 100.0% | 10 |
| heat.check_stack | 0.309 | 0.676 | 0.899 | 0.908 | 0.917 | 0.632 | 100.0% | 10 |
| heat.delete_stack | 0.504 | 1.466 | 1.619 | 1.685 | 1.751 | 1.235 | 100.0% | 10 |
| total | 3.978 | 5.166 | 5.376 | 5.433 | 5.49 | 4.964 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 15.3095350266
Full duration: 19.0696201324
run_rally - INFO - Test scenario: "heat" Failed.
run_rally - INFO - Starting test scenario "keystone" ...
run_rally - INFO -
Preparing input task
Task b0246610-2dd7-4817-be66-9315ab169066: started
Task b0246610-2dd7-4817-be66-9315ab169066: finished
test scenario KeystoneBasic.create_tenant_with_users
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.11 | 0.13 | 0.144 | 0.153 | 0.161 | 0.131 | 100.0% | 10 |
| keystone.create_users | 0.628 | 0.692 | 0.803 | 0.847 | 0.89 | 0.717 | 100.0% | 10 |
| total | 0.755 | 0.826 | 0.934 | 0.979 | 1.025 | 0.849 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.49157500267
Full duration: 12.6573908329
test scenario KeystoneBasic.create_add_and_list_user_roles
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.11 | 0.114 | 0.125 | 0.127 | 0.129 | 0.117 | 100.0% | 10 |
| keystone.add_role | 0.087 | 0.099 | 0.117 | 0.134 | 0.152 | 0.105 | 100.0% | 10 |
| keystone.list_roles | 0.049 | 0.053 | 0.068 | 0.084 | 0.101 | 0.059 | 100.0% | 10 |
| total | 0.261 | 0.277 | 0.302 | 0.307 | 0.313 | 0.281 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.859135150909
Full duration: 5.88745498657
test scenario KeystoneBasic.add_and_remove_user_role
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.109 | 0.188 | 0.253 | 0.27 | 0.287 | 0.184 | 100.0% | 10 |
| keystone.add_role | 0.087 | 0.1 | 0.119 | 0.125 | 0.13 | 0.103 | 100.0% | 10 |
| keystone.remove_role | 0.06 | 0.069 | 0.173 | 0.196 | 0.218 | 0.102 | 100.0% | 10 |
| total | 0.263 | 0.393 | 0.518 | 0.556 | 0.594 | 0.39 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.32334089279
Full duration: 6.50031495094
test scenario KeystoneBasic.create_update_and_delete_tenant
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.108 | 0.217 | 0.267 | 0.272 | 0.277 | 0.192 | 100.0% | 10 |
| keystone.update_tenant | 0.05 | 0.057 | 0.062 | 0.068 | 0.074 | 0.058 | 100.0% | 10 |
| keystone.delete_tenant | 0.119 | 0.132 | 0.141 | 0.142 | 0.142 | 0.132 | 100.0% | 10 |
| total | 0.289 | 0.392 | 0.46 | 0.462 | 0.465 | 0.381 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.16795897484
Full duration: 5.16257286072
test scenario KeystoneBasic.create_and_delete_service
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_service | 0.105 | 0.121 | 0.153 | 0.169 | 0.185 | 0.13 | 100.0% | 10 |
| keystone.delete_service | 0.053 | 0.06 | 0.065 | 0.072 | 0.079 | 0.061 | 100.0% | 10 |
| total | 0.169 | 0.182 | 0.23 | 0.234 | 0.239 | 0.191 | 100.0% | 10 |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.56450510025
Full duration: 4.22321987152
test scenario KeystoneBasic.create_tenant
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+------+---------+-------+
| keystone.create_tenant | 0.112 | 0.138 | 0.161 | 0.165 | 0.168 | 0.14 | 100.0% | 10 |
| total | 0.112 | 0.138 | 0.161 | 0.165 | 0.168 | 0.14 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+------+---------+-------+
Load duration: 0.417885065079
Full duration: 4.0450899601
test scenario KeystoneBasic.create_user
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_user | 0.126 | 0.177 | 0.186 | 0.189 | 0.191 | 0.164 | 100.0% | 10 |
| total | 0.126 | 0.177 | 0.186 | 0.189 | 0.191 | 0.164 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.485447883606
Full duration: 4.35393500328
test scenario KeystoneBasic.create_and_list_tenants
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.117 | 0.13 | 0.139 | 0.139 | 0.14 | 0.129 | 100.0% | 10 |
| keystone.list_tenants | 0.047 | 0.053 | 0.094 | 0.107 | 0.121 | 0.063 | 100.0% | 10 |
| total | 0.167 | 0.186 | 0.212 | 0.233 | 0.253 | 0.192 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.566509962082
Full duration: 5.80973696709
test scenario KeystoneBasic.create_and_delete_role
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.109 | 0.227 | 0.291 | 0.3 | 0.308 | 0.205 | 100.0% | 10 |
| keystone.delete_role | 0.106 | 0.114 | 0.238 | 0.25 | 0.263 | 0.14 | 100.0% | 10 |
| total | 0.222 | 0.34 | 0.544 | 0.548 | 0.552 | 0.345 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.969199895859
Full duration: 5.0005710125
test scenario KeystoneBasic.get_entities
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.115 | 0.13 | 0.153 | 0.154 | 0.154 | 0.131 | 100.0% | 10 |
| keystone.create_user | 0.059 | 0.063 | 0.068 | 0.075 | 0.083 | 0.065 | 100.0% | 10 |
| keystone.create_role | 0.046 | 0.06 | 0.085 | 0.085 | 0.086 | 0.061 | 100.0% | 10 |
| keystone.get_tenant | 0.044 | 0.051 | 0.058 | 0.06 | 0.062 | 0.051 | 100.0% | 10 |
| keystone.get_user | 0.052 | 0.067 | 0.103 | 0.106 | 0.109 | 0.07 | 100.0% | 10 |
| keystone.get_role | 0.042 | 0.049 | 0.066 | 0.067 | 0.068 | 0.052 | 100.0% | 10 |
| keystone.service_list | 0.044 | 0.05 | 0.067 | 0.083 | 0.099 | 0.055 | 100.0% | 10 |
| keystone.get_service | 0.041 | 0.044 | 0.051 | 0.052 | 0.054 | 0.046 | 100.0% | 10 |
| total | 0.489 | 0.533 | 0.57 | 0.572 | 0.574 | 0.532 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.58059597015
Full duration: 9.58514809608
test scenario KeystoneBasic.create_and_list_users
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_user | 0.129 | 0.139 | 0.153 | 0.167 | 0.181 | 0.143 | 100.0% | 10 |
| keystone.list_users | 0.046 | 0.054 | 0.073 | 0.079 | 0.084 | 0.06 | 100.0% | 10 |
| total | 0.185 | 0.198 | 0.222 | 0.227 | 0.232 | 0.203 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.615728855133
Full duration: 4.46038007736
run_rally - INFO - Test scenario: "keystone" OK.
run_rally - INFO - Starting test scenario "neutron" ...
run_rally - INFO -
Preparing input task
Task 60b0f938-d4b3-4eae-9392-3ac4c8a6a4b7: started
Task 60b0f938-d4b3-4eae-9392-3ac4c8a6a4b7: finished
test scenario NeutronNetworks.create_and_delete_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.448 | 0.508 | 0.67 | 0.679 | 0.687 | 0.525 | 100.0% | 10 |
| neutron.delete_port | 0.152 | 0.299 | 0.373 | 0.376 | 0.378 | 0.301 | 100.0% | 10 |
| total | 0.6 | 0.817 | 0.958 | 0.977 | 0.995 | 0.826 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.44042801857
Full duration: 24.5799560547
test scenario NeutronNetworks.create_and_list_routers
+---------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.392 | 0.512 | 0.61 | 0.629 | 0.649 | 0.519 | 100.0% | 10 |
| neutron.create_router | 0.032 | 0.176 | 0.253 | 0.254 | 0.256 | 0.156 | 100.0% | 10 |
| neutron.add_interface_router | 0.227 | 0.375 | 0.444 | 0.468 | 0.492 | 0.366 | 100.0% | 10 |
| neutron.list_routers | 0.03 | 0.151 | 0.184 | 0.196 | 0.207 | 0.115 | 100.0% | 10 |
| total | 0.942 | 1.153 | 1.326 | 1.377 | 1.429 | 1.157 | 100.0% | 10 |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.41682577133
Full duration: 27.1603848934
test scenario NeutronNetworks.create_and_delete_routers
+------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.406 | 0.478 | 0.571 | 0.602 | 0.634 | 0.488 | 100.0% | 10 |
| neutron.create_router | 0.032 | 0.189 | 0.275 | 0.28 | 0.284 | 0.183 | 100.0% | 10 |
| neutron.add_interface_router | 0.232 | 0.326 | 0.474 | 0.479 | 0.484 | 0.337 | 100.0% | 10 |
| neutron.remove_interface_router | 0.163 | 0.25 | 0.492 | 0.5 | 0.508 | 0.288 | 100.0% | 10 |
| neutron.delete_router | 0.126 | 0.229 | 0.301 | 0.356 | 0.41 | 0.224 | 100.0% | 10 |
| total | 1.294 | 1.49 | 1.698 | 1.753 | 1.807 | 1.52 | 100.0% | 10 |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.38407206535
Full duration: 28.0664179325
test scenario NeutronNetworks.create_and_list_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.433 | 0.663 | 0.718 | 0.718 | 0.719 | 0.601 | 100.0% | 10 |
| neutron.list_ports | 0.089 | 0.231 | 0.345 | 0.385 | 0.425 | 0.243 | 100.0% | 10 |
| total | 0.524 | 0.843 | 1.028 | 1.072 | 1.117 | 0.844 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.59062600136
Full duration: 25.9457578659
test scenario NeutronNetworks.create_and_delete_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.387 | 0.429 | 0.52 | 0.533 | 0.545 | 0.452 | 100.0% | 10 |
| neutron.delete_subnet | 0.144 | 0.296 | 0.356 | 0.367 | 0.378 | 0.275 | 100.0% | 10 |
| total | 0.573 | 0.733 | 0.811 | 0.829 | 0.846 | 0.727 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.22101807594
Full duration: 24.9812419415
test scenario NeutronNetworks.create_and_delete_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.293 | 0.395 | 0.476 | 0.482 | 0.488 | 0.397 | 100.0% | 10 |
| neutron.delete_network | 0.103 | 0.24 | 0.332 | 0.344 | 0.357 | 0.228 | 100.0% | 10 |
| total | 0.471 | 0.585 | 0.766 | 0.798 | 0.829 | 0.625 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.84316086769
Full duration: 14.2107710838
test scenario NeutronNetworks.create_and_list_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.31 | 0.347 | 0.452 | 0.454 | 0.455 | 0.362 | 100.0% | 10 |
| neutron.list_networks | 0.042 | 0.111 | 0.199 | 0.24 | 0.281 | 0.124 | 100.0% | 10 |
| total | 0.358 | 0.493 | 0.603 | 0.624 | 0.644 | 0.486 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.45903801918
Full duration: 15.4646441936
test scenario NeutronNetworks.create_and_update_routers
+---------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.382 | 0.419 | 0.612 | 0.613 | 0.614 | 0.478 | 100.0% | 10 |
| neutron.create_router | 0.033 | 0.176 | 0.22 | 0.239 | 0.258 | 0.149 | 100.0% | 10 |
| neutron.add_interface_router | 0.229 | 0.272 | 0.394 | 0.458 | 0.522 | 0.307 | 100.0% | 10 |
| neutron.update_router | 0.091 | 0.252 | 0.307 | 0.324 | 0.342 | 0.221 | 100.0% | 10 |
| total | 0.938 | 1.105 | 1.328 | 1.406 | 1.484 | 1.156 | 100.0% | 10 |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.27084898949
Full duration: 27.761991024
test scenario NeutronNetworks.create_and_update_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.306 | 0.356 | 0.425 | 0.429 | 0.433 | 0.366 | 100.0% | 10 |
| neutron.update_network | 0.113 | 0.27 | 0.33 | 0.337 | 0.343 | 0.24 | 100.0% | 10 |
| total | 0.423 | 0.611 | 0.763 | 0.763 | 0.764 | 0.606 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.81449484825
Full duration: 15.7938911915
test scenario NeutronNetworks.create_and_update_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.431 | 0.488 | 0.702 | 0.707 | 0.711 | 0.521 | 100.0% | 10 |
| neutron.update_port | 0.11 | 0.256 | 0.37 | 0.39 | 0.409 | 0.23 | 100.0% | 10 |
| total | 0.541 | 0.758 | 0.865 | 0.987 | 1.11 | 0.752 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.09433794022
Full duration: 26.3668129444
test scenario NeutronNetworks.create_and_list_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.391 | 0.421 | 0.542 | 0.558 | 0.574 | 0.449 | 100.0% | 10 |
| neutron.list_subnets | 0.059 | 0.135 | 0.295 | 0.332 | 0.37 | 0.163 | 100.0% | 10 |
| total | 0.45 | 0.631 | 0.736 | 0.752 | 0.769 | 0.612 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.75437092781
Full duration: 25.2292289734
test scenario NeutronNetworks.create_and_update_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.4 | 0.45 | 0.535 | 0.536 | 0.537 | 0.462 | 100.0% | 10 |
| neutron.update_subnet | 0.158 | 0.306 | 0.397 | 0.412 | 0.427 | 0.3 | 100.0% | 10 |
| total | 0.564 | 0.773 | 0.88 | 0.904 | 0.929 | 0.763 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.266477108
Full duration: 25.2276790142
run_rally - INFO - Test scenario: "neutron" OK.
run_rally - INFO - Starting test scenario "nova" ...
run_rally - INFO -
Preparing input task
Task 51b9485f-50cd-43c0-89c7-901e4b55ffa4: started
Task 51b9485f-50cd-43c0-89c7-901e4b55ffa4: finished
test scenario NovaKeypair.create_and_delete_keypair
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.create_keypair | 0.378 | 0.469 | 0.572 | 0.585 | 0.599 | 0.487 | 100.0% | 10 |
| nova.delete_keypair | 0.018 | 0.021 | 0.031 | 0.032 | 0.032 | 0.023 | 100.0% | 10 |
| total | 0.41 | 0.487 | 0.592 | 0.607 | 0.621 | 0.51 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.44199299812
Full duration: 14.8640050888
test scenario NovaServers.snapshot_server
+---------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+---------+---------+---------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+---------+---------+---------+--------+---------+-------+
| nova.boot_server | 3.252 | 5.309 | 6.304 | 6.39 | 6.476 | 5.049 | 100.0% | 10 |
| nova.create_image | 27.858 | 48.811 | 65.726 | 65.73 | 65.734 | 47.725 | 100.0% | 10 |
| nova.delete_server | 2.519 | 2.96 | 5.038 | 5.043 | 5.047 | 3.302 | 100.0% | 10 |
| nova.boot_server (2) | 14.132 | 28.496 | 38.684 | 44.307 | 49.929 | 28.943 | 100.0% | 10 |
| nova.delete_server (2) | 2.39 | 4.627 | 7.042 | 7.135 | 7.229 | 4.368 | 100.0% | 10 |
| nova.delete_image | 0.317 | 0.482 | 1.285 | 1.976 | 2.667 | 0.749 | 100.0% | 10 |
| total | 61.01 | 97.217 | 121.154 | 121.205 | 121.255 | 90.137 | 100.0% | 10 |
+------------------------+--------+--------+---------+---------+---------+--------+---------+-------+
Load duration: 248.724915028
Full duration: 271.744755983
test scenario NovaKeypair.boot_and_delete_server_with_keypair
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| nova.create_keypair | 0.436 | 0.508 | 0.611 | 0.618 | 0.624 | 0.52 | 100.0% | 10 |
| nova.boot_server | 3.084 | 4.238 | 6.002 | 6.114 | 6.226 | 4.436 | 100.0% | 10 |
| nova.delete_server | 2.385 | 2.558 | 3.021 | 3.844 | 4.667 | 2.752 | 100.0% | 10 |
| nova.delete_keypair | 0.015 | 0.02 | 0.024 | 0.024 | 0.025 | 0.02 | 100.0% | 10 |
| total | 5.997 | 7.197 | 9.438 | 10.178 | 10.917 | 7.728 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 22.9343290329
Full duration: 44.7740108967
test scenario NovaKeypair.create_and_list_keypairs
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.create_keypair | 0.367 | 0.477 | 0.546 | 0.584 | 0.622 | 0.473 | 100.0% | 10 |
| nova.list_keypairs | 0.014 | 0.019 | 0.025 | 0.028 | 0.03 | 0.021 | 100.0% | 10 |
| total | 0.384 | 0.501 | 0.565 | 0.601 | 0.636 | 0.494 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.53178596497
Full duration: 16.4732458591
test scenario NovaServers.list_servers
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.list_servers | 0.588 | 0.656 | 0.754 | 0.774 | 0.795 | 0.663 | 100.0% | 10 |
| total | 0.589 | 0.656 | 0.754 | 0.775 | 0.795 | 0.663 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.98694491386
Full duration: 47.495290041
test scenario NovaServers.resize_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 3.412 | 4.572 | 6.064 | 6.069 | 6.073 | 4.644 | 100.0% | 10 |
| nova.resize | 21.205 | 34.251 | 42.136 | 42.238 | 42.34 | 31.684 | 100.0% | 10 |
| nova.resize_confirm | 2.364 | 2.437 | 2.588 | 2.638 | 2.688 | 2.479 | 100.0% | 10 |
| nova.delete_server | 2.38 | 2.427 | 2.64 | 2.727 | 2.814 | 2.475 | 100.0% | 10 |
| total | 29.399 | 43.496 | 53.296 | 53.299 | 53.302 | 41.282 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 112.265089989
Full duration: 126.299309015
test scenario NovaServers.boot_server_from_volume_and_delete
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.376 | 4.574 | 6.275 | 6.295 | 6.315 | 4.705 | 100.0% | 10 |
| nova.boot_server | 8.443 | 9.25 | 11.22 | 11.494 | 11.768 | 9.658 | 100.0% | 10 |
| nova.delete_server | 4.478 | 4.614 | 4.912 | 5.81 | 6.708 | 4.799 | 100.0% | 10 |
| total | 16.358 | 19.136 | 21.665 | 22.113 | 22.56 | 19.163 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 56.0801298618
Full duration: 85.6200530529
test scenario NovaServers.boot_and_migrate_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 3.498 | 4.001 | 5.998 | 6.132 | 6.267 | 4.49 | 100.0% | 10 |
| nova.stop_server | 4.649 | 13.73 | 15.606 | 15.699 | 15.791 | 11.515 | 100.0% | 10 |
| nova.migrate | 15.233 | 21.214 | 29.778 | 29.939 | 30.099 | 22.004 | 100.0% | 10 |
| nova.resize_confirm | 2.366 | 2.398 | 2.559 | 2.699 | 2.838 | 2.451 | 100.0% | 10 |
| nova.delete_server | 2.384 | 2.428 | 2.527 | 2.567 | 2.606 | 2.444 | 100.0% | 10 |
| total | 35.813 | 43.101 | 49.38 | 49.998 | 50.616 | 42.904 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 121.644474983
Full duration: 135.548355818
test scenario NovaServers.boot_and_delete_server
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| nova.boot_server | 3.484 | 6.119 | 7.588 | 7.617 | 7.647 | 5.778 | 100.0% | 10 |
| nova.delete_server | 2.393 | 2.758 | 4.763 | 4.817 | 4.872 | 3.438 | 100.0% | 10 |
| total | 5.885 | 8.701 | 12.336 | 12.358 | 12.379 | 9.216 | 100.0% | 10 |
+--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 26.0077610016
Full duration: 48.9747579098
test scenario NovaServers.boot_and_rebuild_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 3.5 | 4.786 | 6.225 | 6.257 | 6.289 | 4.859 | 100.0% | 10 |
| nova.rebuild_server | 6.349 | 11.303 | 17.156 | 17.218 | 17.279 | 11.611 | 100.0% | 10 |
| nova.delete_server | 2.381 | 2.441 | 2.549 | 2.55 | 2.552 | 2.464 | 100.0% | 10 |
| total | 13.553 | 18.971 | 23.648 | 24.245 | 24.842 | 18.934 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 52.6579520702
Full duration: 75.2351601124
test scenario NovaSecGroup.create_and_list_secgroups
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 1.386 | 2.017 | 2.077 | 2.091 | 2.106 | 1.84 | 100.0% | 10 |
| nova.create_100_rules | 8.891 | 10.215 | 10.514 | 10.722 | 10.929 | 10.096 | 100.0% | 10 |
| nova.list_security_groups | 0.107 | 0.152 | 0.269 | 0.288 | 0.307 | 0.171 | 100.0% | 10 |
| total | 10.858 | 12.348 | 12.575 | 12.61 | 12.645 | 12.108 | 100.0% | 10 |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 35.6299619675
Full duration: 63.5884320736
test scenario NovaSecGroup.create_and_delete_secgroups
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 1.387 | 1.712 | 2.11 | 2.114 | 2.118 | 1.782 | 100.0% | 10 |
| nova.create_100_rules | 8.912 | 9.991 | 10.333 | 10.39 | 10.447 | 9.849 | 100.0% | 10 |
| nova.delete_10_security_groups | 0.735 | 0.953 | 1.042 | 1.101 | 1.161 | 0.955 | 100.0% | 10 |
| total | 11.2 | 12.869 | 13.019 | 13.049 | 13.079 | 12.586 | 100.0% | 10 |
+--------------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 37.0498371124
Full duration: 51.703150034
test scenario NovaServers.boot_and_bounce_server
+---------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+--------+--------+--------+---------+---------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------+--------+--------+--------+---------+---------+--------+---------+-------+
| nova.boot_server | 3.232 | 4.745 | 6.322 | 6.339 | 6.356 | 4.884 | 100.0% | 10 |
| nova.reboot_server | 4.43 | 4.579 | 4.667 | 4.687 | 4.707 | 4.59 | 100.0% | 10 |
| nova.soft_reboot_server | 4.722 | 6.782 | 18.815 | 72.233 | 125.65 | 18.46 | 100.0% | 10 |
| nova.stop_server | 4.631 | 4.711 | 6.14 | 10.834 | 15.527 | 5.852 | 100.0% | 10 |
| nova.start_server | 2.625 | 2.712 | 3.141 | 3.595 | 4.048 | 2.891 | 100.0% | 10 |
| nova.rescue_server | 6.624 | 11.131 | 17.578 | 17.69 | 17.803 | 11.544 | 100.0% | 10 |
| nova.unrescue_server | 2.293 | 4.467 | 4.631 | 4.634 | 4.636 | 3.681 | 100.0% | 10 |
| nova.delete_server | 2.346 | 2.407 | 2.563 | 2.572 | 2.581 | 2.442 | 100.0% | 10 |
| total | 35.909 | 44.054 | 60.343 | 108.964 | 157.584 | 54.354 | 100.0% | 10 |
+-------------------------+--------+--------+--------+---------+---------+--------+---------+-------+
Load duration: 157.603001118
Full duration: 179.857326031
test scenario NovaServers.boot_server
+---------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.boot_server | 3.435 | 4.325 | 6.075 | 6.183 | 6.292 | 4.629 | 100.0% | 10 |
| total | 3.435 | 4.325 | 6.075 | 6.183 | 6.292 | 4.629 | 100.0% | 10 |
+------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 13.5383079052
Full duration: 36.4747169018
test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 1.622 | 1.87 | 1.968 | 2.066 | 2.163 | 1.846 | 100.0% | 10 |
| nova.create_100_rules | 8.778 | 9.885 | 10.429 | 10.484 | 10.538 | 9.786 | 100.0% | 10 |
| nova.boot_server | 4.372 | 5.705 | 6.744 | 6.784 | 6.825 | 5.534 | 100.0% | 10 |
| nova.get_attached_security_groups | 0.145 | 0.15 | 0.163 | 0.171 | 0.179 | 0.154 | 100.0% | 10 |
| nova.delete_server | 2.392 | 2.532 | 4.639 | 4.677 | 4.715 | 3.324 | 100.0% | 10 |
| nova.delete_10_security_groups | 0.762 | 0.811 | 1.001 | 1.056 | 1.112 | 0.864 | 100.0% | 10 |
| total | 18.434 | 20.813 | 24.815 | 24.847 | 24.879 | 21.508 | 100.0% | 10 |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 64.179831028
Full duration: 87.2896039486
test scenario NovaServers.pause_and_unpause_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 3.419 | 4.899 | 6.417 | 6.437 | 6.457 | 4.897 | 100.0% | 10 |
| nova.pause_server | 2.319 | 2.452 | 2.541 | 2.574 | 2.607 | 2.443 | 100.0% | 10 |
| nova.unpause_server | 2.291 | 2.397 | 2.512 | 2.565 | 2.619 | 2.409 | 100.0% | 10 |
| nova.delete_server | 2.36 | 2.542 | 3.024 | 3.769 | 4.514 | 2.719 | 100.0% | 10 |
| total | 10.572 | 12.299 | 14.07 | 14.773 | 15.475 | 12.469 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 36.6686770916
Full duration: 59.3664259911
test scenario NovaServers.boot_server_from_volume
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.258 | 3.501 | 5.924 | 5.949 | 5.974 | 4.155 | 100.0% | 10 |
| nova.boot_server | 7.572 | 8.821 | 12.368 | 12.983 | 13.598 | 9.51 | 100.0% | 10 |
| total | 11.135 | 12.15 | 18.14 | 18.856 | 19.572 | 13.665 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 38.717217207
Full duration: 73.4654810429
test scenario NovaServers.boot_and_list_server
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.boot_server | 3.569 | 4.788 | 6.354 | 6.43 | 6.506 | 4.924 | 100.0% | 10 |
| nova.list_servers | 0.189 | 0.37 | 0.447 | 0.453 | 0.46 | 0.346 | 100.0% | 10 |
| total | 3.757 | 5.231 | 6.727 | 6.745 | 6.763 | 5.27 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 14.4698469639
Full duration: 47.3727209568
run_rally - INFO - Test scenario: "nova" OK.
run_rally - INFO - Starting test scenario "quotas" ...
run_rally - INFO -
Preparing input task
Task 9226e59f-9bfb-44aa-8641-99f492cd92a9: started
Task 9226e59f-9bfb-44aa-8641-99f492cd92a9: finished
test scenario Quotas.cinder_update
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-----+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-----+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.6 | 0.64 | 0.688 | 0.721 | 0.754 | 0.649 | 100.0% | 10 |
| total | 0.6 | 0.64 | 0.688 | 0.721 | 0.754 | 0.649 | 100.0% | 10 |
+----------------------+-----+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.92687010765
Full duration: 7.31987595558
test scenario Quotas.neutron_update
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.217 | 0.255 | 0.377 | 0.401 | 0.424 | 0.28 | 100.0% | 10 |
| total | 0.28 | 0.325 | 0.445 | 0.469 | 0.492 | 0.346 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.03654098511
Full duration: 6.59040594101
test scenario Quotas.cinder_update_and_delete
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.588 | 0.651 | 0.699 | 0.702 | 0.705 | 0.652 | 100.0% | 10 |
| quotas.delete_quotas | 0.389 | 0.434 | 0.5 | 0.527 | 0.554 | 0.449 | 100.0% | 10 |
| total | 1.011 | 1.097 | 1.176 | 1.179 | 1.182 | 1.101 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.32944512367
Full duration: 8.96466994286
test scenario Quotas.nova_update_and_delete
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.322 | 0.358 | 0.54 | 0.633 | 0.726 | 0.407 | 100.0% | 10 |
| quotas.delete_quotas | 0.016 | 0.022 | 0.028 | 0.029 | 0.03 | 0.022 | 100.0% | 10 |
| total | 0.344 | 0.383 | 0.557 | 0.652 | 0.747 | 0.429 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.20111894608
Full duration: 6.32782506943
test scenario Quotas.nova_update
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+------+--------+--------+--------+-------+------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+------+--------+--------+--------+-------+------+---------+-------+
| quotas.update_quotas | 0.32 | 0.373 | 0.485 | 0.499 | 0.513 | 0.39 | 100.0% | 10 |
| total | 0.32 | 0.373 | 0.485 | 0.499 | 0.513 | 0.39 | 100.0% | 10 |
+----------------------+------+--------+--------+--------+-------+------+---------+-------+
Load duration: 1.11949706078
Full duration: 6.58456206322
run_rally - INFO - Test scenario: "quotas" OK.
run_rally - INFO - Starting test scenario "requests" ...
run_rally - INFO -
Preparing input task
Task 2e77e5dd-e2ca-466a-9edb-4f5f741dd55b: started
Task 2e77e5dd-e2ca-466a-9edb-4f5f741dd55b: finished
test scenario HttpRequests.check_random_request
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| requests.check_request | 0.462 | 0.483 | 1.478 | 3.509 | 5.541 | 1.102 | 100.0% | 10 |
| total | 0.462 | 0.483 | 1.478 | 3.509 | 5.541 | 1.102 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 6.3974840641
Full duration: 8.66475987434
test scenario HttpRequests.check_request
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| requests.check_request | 0.453 | 0.458 | 0.477 | 0.494 | 0.511 | 0.465 | 100.0% | 10 |
| total | 0.453 | 0.458 | 0.477 | 0.494 | 0.512 | 0.465 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.39966082573
Full duration: 3.74285912514
run_rally - INFO - Test scenario: "requests" OK.
run_rally - INFO -
Rally Summary Report
+===================+============+===============+===========+
| Module | Duration | nb. Test Run | Success |
+===================+============+===============+===========+
| authenticate | 00:17 | 10 | 100.00% |
+-------------------+------------+---------------+-----------+
| glance | 01:24 | 7 | 100.00% |
+-------------------+------------+---------------+-----------+
| cinder | 16:34 | 50 | 100.00% |
+-------------------+------------+---------------+-----------+
| heat | 06:19 | 32 | 92.31% |
+-------------------+------------+---------------+-----------+
| keystone | 01:07 | 29 | 100.00% |
+-------------------+------------+---------------+-----------+
| neutron | 04:40 | 31 | 100.00% |
+-------------------+------------+---------------+-----------+
| nova | 24:26 | 61 | 100.00% |
+-------------------+------------+---------------+-----------+
| quotas | 00:35 | 7 | 100.00% |
+-------------------+------------+---------------+-----------+
| requests | 00:12 | 2 | 100.00% |
+-------------------+------------+---------------+-----------+
+===================+============+===============+===========+
| TOTAL: | 00:55:38 | 229 | 99.15% |
+===================+============+===============+===========+
SDN Controller¶
ONOS¶
FUNCTEST.info: Running ONOS test case...
Cloning into '/home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest'...
FUNCvirNetNB - INFO - Creating component Handle: ONOSrest
+----------------+
------------------------------ { Script And Files } ------------------------------
+----------------+
Script Log File : /home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/logs/FUNCvirNetNB_22_Feb_2016_16_47_23/FUNCvirNetNB_22_Feb_2016_16_47_23.log
Report Log File : /home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/logs/FUNCvirNetNB_22_Feb_2016_16_47_23/FUNCvirNetNB_22_Feb_2016_16_47_23.rpt
ONOSrest Session Log : /home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/logs/FUNCvirNetNB_22_Feb_2016_16_47_23/ONOSrest.session
Test Script :/home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/Tests/FUNCvirNetNB.py
Test Params : /home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/Tests/FUNCvirNetNB.params
Topology : /home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/Tests/FUNCvirNetNB.topo
+------------------+
--------------------------- { Script Exec Params } ---------------------------
+------------------+
'MININET':
'switch': '7'
'links': '20'
'GIT':
'pull': 'False'
'branch': 'master'
'HTTP':
'path': '/onos/vtn/'
'port': '8181'
'CTRL':
'ip1': 'OC1'
'port1': '6633'
'testcases': '2
3
4
5
6
7
8
9
10'
'SLEEP':
'startup': '15'
'ENV':
'cellApps': 'drivers
openflow
proxyarp
mobility'
'cellName': 'singlenode'
+---------------+
----------------------------- { Components Used } -----------------------------
+---------------+
ONOSrest
+--------+
---------------------------- { Topology } ----------------------------
+--------+
'ONOSrest':
'connect_order': '4'
'host': 'OC1'
'user': 'root'
'COMPONENTS': ''
'password': 'r00tme'
'type': 'OnosRestDriver'
------------------------------------------------------------
******************************
CASE INIT
******************************
['ONOSrest']
******************************
Result summary for Testcase2
******************************
Network Post
2.1: Generate Post Data
2.2: Post Data via HTTP
2.3: Get Data via HTTP
2.4: Compare Send Id and Get Id
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase3
******************************
Network Update
3.1: Generate Post Data
3.2: Post Data via HTTP
3.3: Update Data via HTTP
3.4: Get Data via HTTP
3.5: Compare Update data.
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase4
******************************
Network Delete
4.1: Generate Post Data
4.2: Post Data via HTTP
4.3: Delete Data via HTTP
4.4: Get Data is NULL
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase5
******************************
Subnet Post
5.1: Generate Post Data
5.2: Post Network Data via HTTP(Post Subnet need post network)
5.3: Post Subnet Data via HTTP
5.4: Get Subnet Data via HTTP
5.5: Compare Post Subnet Data via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase6
******************************
Subnet Update
6.1: Generate Post Data
6.2: Post Network Data via HTTP(Post Subnet need post network)
6.3: Post Subnet Data via HTTP
6.4: Update Subnet Data via HTTP
6.5: Get Subnet Data via HTTP
6.6: Compare Subnet Data
6.7: Delete Subnet via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase7
******************************
Subnet Delete
7.1: Generate Post Data
7.2: Post Network Data via HTTP(Post Subnet need post network)
7.3: Post Subnet Data via HTTP
7.4: Delete Subnet Data via HTTP
7.5: Get Subnet Data is NULL
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase8
******************************
Port Post
8.1: Generate Post Data
8.2: Post Network Data via HTTP(Post port need post network)
8.3: Post Subnet Data via HTTP(Post port need post subnet)
8.4: Post Port Data via HTTP
8.5: Get Port Data via HTTP
8.6: Compare Post Port Data
8.7: Clean Data via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase9
******************************
Port Update
9.1: Generate Post Data
9.2: Post Network Data via HTTP(Post port need post network)
9.3: Post Subnet Data via HTTP(Post port need post subnet)
9.4: Post Port Data via HTTP
9.5: Update Port Data via HTTP
9.6: Get Port Data via HTTP
9.7: Compare Update Port Data
9.8: Clean Data via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase10
******************************
Port Delete
10.1: Generate Post Data
10.2: Post Network Data via HTTP(Post port need post network)
10.3: Post Subnet Data via HTTP(Post port need post subnet)
10.4: Post Port Data via HTTP
10.5: Delete Port Data via HTTP
10.6: Get Port Data is NULL
10.7: Clean Data via HTTP
*****************************
Result: Pass
*****************************
*************************************
Test Execution Summary
*************************************
Test Start : 22 Feb 2016 16:47:23
Test End : 22 Feb 2016 16:47:39
Execution Time : 0:00:15.597834
Total tests planned : 9
Total tests RUN : 9
Total Pass : 9
Total Fail : 0
Total No Result : 0
Success Percentage : 100%
Execution Result : 100%
Disconnecting from ONOSrest: <drivers.common.api.controller.onosrestdriver.OnosRestDriver object at 0x7f848e052a50>
FUNCvirNetNBL3 - INFO - Creating component Handle: ONOSrest
+----------------+
------------------------------ { Script And Files } ------------------------------
+----------------+
Script Log File : /home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/logs/FUNCvirNetNBL3_22_Feb_2016_16_47_39/FUNCvirNetNBL3_22_Feb_2016_16_47_39.log
Report Log File : /home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/logs/FUNCvirNetNBL3_22_Feb_2016_16_47_39/FUNCvirNetNBL3_22_Feb_2016_16_47_39.rpt
ONOSrest Session Log : /home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/logs/FUNCvirNetNBL3_22_Feb_2016_16_47_39/ONOSrest.session
Test Script :/home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/Tests/FUNCvirNetNBL3.py
Test Params : /home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/Tests/FUNCvirNetNBL3.params
Topology : /home/opnfv/repos/functest/testcases/Controllers/ONOS/Teston/CI/OnosSystemTest/TestON/Tests/FUNCvirNetNBL3.topo
+------------------+
--------------------------- { Script Exec Params } ---------------------------
+------------------+
'MININET':
'switch': '7'
'links': '20'
'GIT':
'pull': 'False'
'branch': 'master'
'HTTP':
'path': '/onos/vtn/'
'port': '8181'
'CTRL':
'ip1': 'OC1'
'port1': '6653'
'testcases': '2
3
4
5
6
7
8
9
10
11
12'
'SLEEP':
'startup': '15'
'ENV':
'cellApps': 'drivers
openflow
proxyarp
mobility'
'cellName': 'singlenode'
+---------------+
----------------------------- { Components Used } -----------------------------
+---------------+
ONOSrest
+--------+
---------------------------- { Topology } ----------------------------
+--------+
'ONOSrest':
'connect_order': '4'
'host': 'OC1'
'user': 'root'
'COMPONENTS': ''
'password': 'root'
'type': 'OnosRestDriver'
------------------------------------------------------------
******************************
CASE INIT
******************************
['ONOSrest']
******************************
Result summary for Testcase2
******************************
Router Post
2.1: Post Network Data via HTTP(Post Router need post network)
2.2: Post Router Data via HTTP
2.3: Get Router Data via HTTP
2.4: Compare Post Router Data via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase3
******************************
Router Update
3.1: Post Network Data via HTTP(Post Router need post network)
3.2: Post Router Data via HTTP
3.3: Update Router Data via HTTP
3.4: Get Router Data via HTTP
3.5: Compare Router Data
3.6: Delete Router via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase4
******************************
Router Delete
4.1: Post Network Data via HTTP(Post Router need post network)
4.2: Post Router Data via HTTP
4.3: Delete Router Data via HTTP
4.4: Get Router Data is NULL
Verify the Router status
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase5
******************************
RouterInterface Post
5.1: Post Network Data via HTTP(Post port need post network)
5.2: Post Subnet Data via HTTP(Post port need post subnet)
5.3: Post Port Data via HTTP
5.4: Post Router Data via HTTP
5.5: Put RouterInterface Data via HTTP
5.6: Get RouterInterface Data via HTTP
5.7: Compare Post Port Data
5.8: Del RouterInterface Data via HTTP
5.9: Clean Data via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase6
******************************
RouterInterface Delete
6.1: Post Network Data via HTTP(Post port need post network)
6.2: Post Subnet Data via HTTP(Post port need post subnet)
6.3: Post Port Data via HTTP
6.4: Post Router Data via HTTP
6.5: Post RouterInterface Data via HTTP
6.6: Del RouterInterface Data via HTTP
6.7: Delete Port Data via HTTP
6.8: Get Port Data is NULL
6.9: Clean Data via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase7
******************************
FloatingIp Post
7.1: Post Network Data via HTTP(Post port need post network)
7.2: Post Subnet Data via HTTP(Post port need post subnet)
7.3: Post Port Data via HTTP
7.4: Post Router Data via HTTP
7.5: Get Port Data via HTTP
7.6: Post FloatingIp Data via HTTP
7.7: Get Port Data via HTTP
7.8: Get FloatingIp Data via HTTP
7.9: Get FloatingIp Data via HTTP
7.10: Compare Post FloatingIp Data
7.11: Post FloatingIp Clean Data via HTTP
7.12: Clean Data via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase8
******************************
FloatingIp Update
8.1: Post Network Data via HTTP(Post port need post network)
8.2: Post Subnet Data via HTTP(Post port need post subnet)
8.3: Post Port Data via HTTP
8.4: Post Router Data via HTTP
8.5: Post FloatingIp Data via HTTP
8.6: Post Delete Data via HTTP
8.7: Post NewPort Data via HTTP
8.8: Post NewFloatingIp Data via HTTP
8.9: Get NewFloatingIp Data via HTTP
8.10: Compare Post FloatingIp Data
8.11: Post FloatingIp Clean Data via HTTP
8.12: Clean Data via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase9
******************************
FloatingIp Delete
9.1: Post Network Data via HTTP(Post port need post network)
9.2: Post Subnet Data via HTTP(Post port need post subnet)
9.3: Post Port Data via HTTP
9.4: Post Router Data via HTTP
9.5: Post FloatingIp Data via HTTP
9.6: Post FloatingIp Clean Data via HTTP
9.7: Get FloatingIp Data is NULL
9.8: Clean Data via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase10
******************************
Gateway Post
10.1: Post Network Data via HTTP(Post port need post network)
10.2: Post Subnet Data via HTTP(Post port need post subnet)
10.3: Post Port Data via HTTP
10.4: Post Router Data via HTTP
10.5: Get Gateway Data via HTTP
10.6: Compare Post Gateway Data
10.7: Clean Data via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase11
******************************
Gateway Update
11.1: Post Network Data via HTTP(Post port need post network)
11.2: Post Subnet Data via HTTP(Post port need post subnet)
11.3: Post Port Data via HTTP
11.4: Post Router Data via HTTP
11.5: Post New Router Data via HTTP
11.6: Get Gateway Data via HTTP
11.7: Compare Post Gateway Data
11.8: Clean Data via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase12
******************************
Gateway Delete
12.1: Post Network Data via HTTP(Post port need post network)
12.2: Post Subnet Data via HTTP(Post port need post subnet)
12.3: Post Port Data via HTTP
12.4: Post Router Data via HTTP
12.5: Post Del Gateway Data via HTTP
12.6: Get Gateway Data via HTTP
12.7: If Gateway Data is NULL
12.8: Clean Data via HTTP
*****************************
Result: Pass
*****************************
*************************************
Test Execution Summary
*************************************
Test Start : 22 Feb 2016 16:47:39
Test End : 22 Feb 2016 16:47:59
Execution Time : 0:00:20.564415
Total tests planned : 11
Total tests RUN : 11
Total Pass : 11
Total Fail : 0
Total No Result : 0
Success Percentage : 100%
Execution Result : 100%
Disconnecting from ONOSrest: <drivers.common.api.controller.onosrestdriver.OnosRestDriver object at 0x7fcc82fc7ad0>
Detailed test results for fuel-os-nosdn-nofeature-ha¶
VIM¶
vping_ssh¶
FUNCTEST.info: Running vPing-SSH test...
vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
vPing_ssh- INFO - Creating neutron network vping-net...
vPing_ssh- INFO - Creating security group 'vPing-sg'...
vPing_ssh- INFO - Using existing Flavor 'm1.small'...
vPing_ssh- INFO - vPing Start Time:'2016-02-18 13:27:35'
vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
name=opnfv-vping-1
flavor=<Flavor: m1.small>
image=fff41d5d-579a-4c26-844d-4e86700c44f6
network=a5137d46-dea8-4f85-8872-08c4a5927182
vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
name=opnfv-vping-2
flavor=<Flavor: m1.small>
image=fff41d5d-579a-4c26-844d-4e86700c44f6
network=a5137d46-dea8-4f85-8872-08c4a5927182
vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
vPing_ssh- INFO - Floating IP created: '10.118.101.200'
vPing_ssh- INFO - Associating floating ip: '10.118.101.200' to VM 'opnfv-vping-2'
vPing_ssh- INFO - Trying to establish SSH connection to 10.118.101.200...
vPing_ssh- INFO - Waiting for ping...
vPing_ssh- INFO - vPing detected!
vPing_ssh- INFO - vPing duration:'42.1' s.
vPing_ssh- INFO - Cleaning up...
vPing_ssh- INFO - vPing OK
vping_userdata¶
FUNCTEST.info: Running vPing-userdata test...
vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
vPing_userdata- INFO - Creating neutron network vping-net...
vPing_userdata- INFO - Creating security group 'vPing-sg'...
vPing_userdata- INFO - Flavor found 'm1.small'
vPing_userdata- INFO - vPing Start Time:'2016-02-18 13:29:00'
vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
name=opnfv-vping-1
flavor=<Flavor: m1.small>
image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
network=a1efb318-1338-436f-8f26-3a1bacab0538
vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
name=opnfv-vping-2
flavor=<Flavor: m1.small>
image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
network=a1efb318-1338-436f-8f26-3a1bacab0538
userdata=
#!/bin/sh
while true; do
ping -c 1 192.168.130.4 2>&1 >/dev/null
RES=$?
if [ "Z$RES" = "Z0" ] ; then
echo 'vPing OK'
break
else
echo 'vPing KO'
fi
sleep 1
done
vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
vPing_userdata- INFO - Waiting for ping...
vPing_userdata- INFO - vPing detected!
vPing_userdata- INFO - vPing duration:'28.6'
vPing_userdata- INFO - vPing OK
vPing_userdata- INFO - Cleaning up...
vPing_userdata- INFO - Deleting network 'vping-net'...
Tempest¶
+------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
| name | time | status |
+------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
| tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor | 0.29312 | success |
| tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors | 0.12976 | success |
| tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image | 23.95577 | success |
| tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image | 32.53650 | success |
| tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name | 22.68958 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since | 0.54691 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name | 0.30066 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id | 0.57103 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref | 0.97553 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status | 0.37256 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type | 0.33110 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results | 0.34175 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since | 0.35964 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name | 0.62128 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref | 0.88552 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status | 0.35258 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type | 1.14056 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results | 0.64330 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image | 1.59904 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images | 0.85262 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail | 0.89806 | success |
| tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create | 1.43298 | success |
| tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list | 2.74835 | success |
| tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete | 7.51973 | success |
| tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip | 17.31905 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details | 0.0 | fail |
| tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action | 0.11526 | success |
| tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions | 4.43153 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor | 0.49287 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image | 0.32071 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name | 0.24839 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status | 0.62886 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results | 0.45498 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor | 0.11221 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image | 0.07743 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit | 0.07866 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name | 0.08414 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status | 0.09610 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip | 0.87584 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex | 0.00178 | skip |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard | 0.18671 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date | 0.07254 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date | 0.02355 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits | 0.09336 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.08789 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value | 0.02832 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string | 0.01969 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor | 0.05608 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image | 0.09405 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name | 0.07124 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted | 1.09862 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing | 0.02806 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server | 0.10085 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password | 0.00074 | skip |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output | 7.05293 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server | 12.83974 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard | 75.96327 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft | 0.89960 | skip |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server | 86.10969 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm | 14.36274 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert | 25.20801 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server | 9.79668 | success |
| tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses | 0.10422 | success |
| tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network | 0.45171 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item | 0.71962 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item | 0.37393 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata | 0.39671 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata | 0.67878 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item | 0.96139 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata | 0.70247 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password | 5.01425 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair | 21.66147 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name | 29.15375 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address | 17.01011 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name | 15.12162 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name | 2.32047 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit | 2.43351 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 | 3.54755 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor | 3.49832 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image | 1.66971 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid | 2.67563 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant | 1.52468 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit | 2.11125 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id | 1.11519 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server | 1.59954 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address | 2.71532 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server | 0.67781 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server | 0.80861 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor | 1.12394 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor | 0.98070 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank | 1.95038 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server | 0.58962 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server | 1.76753 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 | 0.92874 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant | 1.98170 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name | 1.09696 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant | 0.23813 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect | 0.02568 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image | 0.73035 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails | 0.03287 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails | 0.61622 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails | 0.10251 | success |
| tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas | 0.32244 | success |
| tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas | 0.05310 | success |
| tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume | 46.35639 | success |
| tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list | 1.19554 | success |
| tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details | 0.13783 | success |
| tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id | 0.28038 | success |
| tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id | 0.02405 | success |
| tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services | 0.0 | fail |
| tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user | 0.0 | fail |
| tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete | 0.0 | fail |
| tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists | 0.0 | fail |
| tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain | 1.06799 | success |
| tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint | 0.70652 | success |
| tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete | 0.0 | fail |
| tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy | 0.56777 | success |
| tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id | 0.34317 | success |
| tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list | 0.61946 | success |
| tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service | 0.0 | fail |
| tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all | 2.55157 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.10777 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.09198 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.08536 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.12301 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.19557 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.11454 | success |
| tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params | 0.58158 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image | 1.96230 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file | 3.11881 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image | 31.78599 | success |
| tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions | 6.18197 | success |
| tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address | 0.36573 | fail |
| tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip | 4.19923 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network | 2.05001 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port | 2.85155 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet | 4.85758 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network | 2.47936 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port | 4.29082 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet | 4.14373 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet | 2.85702 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility | 0.63578 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks | 0.44139 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets | 0.31069 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network | 0.31575 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet | 0.34149 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet | 2.96967 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility | 0.61978 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks | 0.30406 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets | 0.29284 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network | 0.07605 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet | 0.28866 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools | 3.34364 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups | 2.65709 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port | 1.51327 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports | 0.34515 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port | 0.34468 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools | 3.78910 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups | 3.78827 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port | 2.58076 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_list_ports | 0.35346 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_show_port | 0.38372 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces | 8.02302 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id | 5.55884 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id | 4.89503 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router | 3.13616 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces | 7.91220 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id | 4.35397 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id | 4.24212 | success |
| tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router | 3.20634 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group | 2.00386 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule | 3.26379 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups | 0.29497 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group | 2.34355 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule | 3.27875 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups | 0.05434 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list | 0.63001 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show | 7.10424 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template | 0.06177 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list | 0.0 | fail |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata | 0.0 | fail |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config | 0.0 | fail |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate | 0.0 | fail |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change | 0.0 | fail |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change | 0.0 | fail |
| tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources | 3.98140 | success |
| tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds | 0.05857 | success |
| tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications | 19.61269 | success |
| tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications | 4.21790 | success |
| tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance | 2.96832 | success |
| tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance | 2.59962 | success |
| tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete | 14.77900 | success |
| tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image | 19.28760 | success |
| tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete | 14.36310 | success |
| tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image | 24.02107 | success |
| tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list | 0.05931 | success |
| tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list | 0.31742 | success |
| tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops | 54.55460 | success |
| tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops | 41.67013 | fail |
| tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern | 109.37734 | success |
| tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern | 61.05784 | fail |
+------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
run_tempest - INFO - Results: {'timestart': '2016-02-1813:29:52.500975', 'duration': 416, 'tests': 210, 'failures': 25}
Rally¶
FUNCTEST.info: Running Rally benchmark suite...
run_rally - INFO - Starting test scenario "authenticate" ...
run_rally - INFO -
Preparing input task
Task 2ff4981a-75d9-4de4-a111-3194115c4a00: started
Task 2ff4981a-75d9-4de4-a111-3194115c4a00: finished
test scenario Authenticate.validate_glance
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_glance | 0.534 | 0.569 | 0.722 | 0.818 | 0.914 | 0.618 | 100.0% | 10 |
| authenticate.validate_glance (2) | 0.512 | 0.609 | 0.713 | 0.766 | 0.818 | 0.631 | 100.0% | 10 |
| total | 1.257 | 1.358 | 1.703 | 1.715 | 1.726 | 1.418 | 100.0% | 10 |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.01803302765
Full duration: 11.7534348965
test scenario Authenticate.keystone
+-----------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
| total | 0.132 | 0.154 | 0.172 | 0.172 | 0.173 | 0.155 | 100.0% | 10 |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.491301059723
Full duration: 8.25924301147
test scenario Authenticate.validate_heat
+-----------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_heat | 0.297 | 0.32 | 0.355 | 0.359 | 0.363 | 0.324 | 100.0% | 10 |
| authenticate.validate_heat (2) | 0.043 | 0.056 | 0.302 | 0.304 | 0.307 | 0.127 | 100.0% | 10 |
| total | 0.499 | 0.607 | 0.769 | 0.82 | 0.87 | 0.629 | 100.0% | 10 |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.91573691368
Full duration: 10.0396120548
test scenario Authenticate.validate_nova
+-----------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_nova | 0.306 | 0.35 | 0.534 | 0.554 | 0.574 | 0.407 | 100.0% | 10 |
| authenticate.validate_nova (2) | 0.037 | 0.059 | 0.07 | 0.081 | 0.092 | 0.059 | 100.0% | 10 |
| total | 0.526 | 0.596 | 0.771 | 0.782 | 0.792 | 0.639 | 100.0% | 10 |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.9150788784
Full duration: 9.77701401711
test scenario Authenticate.validate_cinder
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_cinder | 0.268 | 0.315 | 0.353 | 0.475 | 0.596 | 0.334 | 100.0% | 10 |
| authenticate.validate_cinder (2) | 0.025 | 0.282 | 0.314 | 0.323 | 0.331 | 0.264 | 100.0% | 10 |
| total | 0.721 | 0.78 | 0.827 | 0.837 | 0.847 | 0.779 | 100.0% | 10 |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.34766292572
Full duration: 10.0672118664
test scenario Authenticate.validate_neutron
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_neutron | 0.266 | 0.305 | 0.386 | 0.399 | 0.411 | 0.319 | 100.0% | 10 |
| authenticate.validate_neutron (2) | 0.043 | 0.291 | 0.375 | 0.403 | 0.432 | 0.241 | 100.0% | 10 |
| total | 0.483 | 0.76 | 0.908 | 0.914 | 0.92 | 0.729 | 100.0% | 10 |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.25539779663
Full duration: 9.62706780434
run_rally - INFO - Test scenario: "authenticate" OK.
run_rally - INFO - Starting test scenario "glance" ...
run_rally - INFO -
Preparing input task
Task 9fb726cd-f20e-4f95-b32f-5928c72cf58d: started
Task 9fb726cd-f20e-4f95-b32f-5928c72cf58d: finished
test scenario GlanceImages.list_images
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| glance.list_images | 0.72 | 0.85 | 0.942 | 0.947 | 0.951 | 0.833 | 100.0% | 10 |
| total | 0.721 | 0.85 | 0.943 | 0.947 | 0.951 | 0.834 | 100.0% | 10 |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.45959687233
Full duration: 12.9740490913
test scenario GlanceImages.create_image_and_boot_instances
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| glance.create_image | 7.498 | 7.743 | 17.964 | 19.73 | 21.495 | 10.171 | 100.0% | 10 |
| nova.boot_servers | 13.174 | 14.424 | 15.318 | 15.539 | 15.76 | 14.34 | 100.0% | 10 |
| total | 20.863 | 22.368 | 32.383 | 33.741 | 35.099 | 24.511 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 68.7006659508
Full duration: 127.436779022
test scenario GlanceImages.create_and_list_image
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| glance.create_image | 7.303 | 7.684 | 7.837 | 7.911 | 7.984 | 7.63 | 100.0% | 10 |
| glance.list_images | 0.328 | 0.583 | 0.697 | 0.698 | 0.699 | 0.574 | 100.0% | 10 |
| total | 7.862 | 8.283 | 8.38 | 8.472 | 8.564 | 8.205 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 24.5710179806
Full duration: 37.9533209801
test scenario GlanceImages.create_and_delete_image
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| glance.create_image | 7.448 | 7.605 | 7.805 | 7.817 | 7.829 | 7.617 | 100.0% | 10 |
| glance.delete_image | 2.01 | 2.372 | 2.628 | 2.686 | 2.743 | 2.393 | 100.0% | 10 |
| total | 9.506 | 9.976 | 10.387 | 10.466 | 10.545 | 10.01 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 30.0124220848
Full duration: 40.2773120403
run_rally - INFO - Test scenario: "glance" OK.
run_rally - INFO - Starting test scenario "cinder" ...
run_rally - INFO -
Preparing input task
Task a724f287-e014-40ef-8e87-173e5eb2b0a2: started
Task a724f287-e014-40ef-8e87-173e5eb2b0a2: finished
test scenario CinderVolumes.create_and_attach_volume
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 10.889 | 13.965 | 14.695 | 14.724 | 14.752 | 13.234 | 100.0% | 10 |
| cinder.create_volume | 3.218 | 3.812 | 4.128 | 4.214 | 4.3 | 3.776 | 100.0% | 10 |
| nova.attach_volume | 3.737 | 4.69 | 4.963 | 5.092 | 5.222 | 4.612 | 100.0% | 10 |
| nova.detach_volume | 3.18 | 3.917 | 4.273 | 4.325 | 4.377 | 3.867 | 100.0% | 10 |
| cinder.delete_volume | 0.489 | 2.54 | 2.801 | 2.886 | 2.972 | 2.261 | 100.0% | 10 |
| nova.delete_server | 2.527 | 2.94 | 3.218 | 3.228 | 3.239 | 2.926 | 100.0% | 10 |
| total | 26.351 | 30.9 | 32.731 | 33.273 | 33.815 | 30.677 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 91.1857719421
Full duration: 133.454293013
test scenario CinderVolumes.create_and_list_volume
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| cinder.create_volume | 7.415 | 9.652 | 10.383 | 10.548 | 10.713 | 9.48 | 100.0% | 10 |
| cinder.list_volumes | 0.072 | 0.328 | 0.4 | 0.407 | 0.415 | 0.295 | 100.0% | 10 |
| total | 7.76 | 10.022 | 10.706 | 10.88 | 11.054 | 9.775 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 28.0870580673
Full duration: 51.2606179714
test scenario CinderVolumes.create_and_list_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.521 | 4.03 | 4.785 | 4.869 | 4.953 | 4.19 | 100.0% | 10 |
| cinder.list_volumes | 0.062 | 0.347 | 0.411 | 0.426 | 0.44 | 0.308 | 100.0% | 10 |
| total | 3.852 | 4.421 | 5.139 | 5.227 | 5.315 | 4.499 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 13.1967639923
Full duration: 35.2137930393
test scenario CinderVolumes.create_and_list_snapshots
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_snapshot | 2.957 | 3.349 | 5.449 | 5.627 | 5.805 | 3.738 | 100.0% | 10 |
| cinder.list_snapshots | 0.028 | 0.304 | 0.348 | 0.382 | 0.416 | 0.213 | 100.0% | 10 |
| total | 3.259 | 3.42 | 5.776 | 5.945 | 6.113 | 3.952 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 10.5537779331
Full duration: 49.7043690681
test scenario CinderVolumes.create_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.281 | 3.907 | 4.106 | 4.128 | 4.15 | 3.806 | 100.0% | 10 |
| cinder.delete_volume | 0.788 | 2.667 | 3.082 | 3.16 | 3.239 | 2.256 | 100.0% | 10 |
| total | 4.617 | 6.29 | 6.997 | 7.066 | 7.135 | 6.063 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 18.3220980167
Full duration: 36.1331720352
test scenario CinderVolumes.create_and_delete_volume
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 8.901 | 9.932 | 10.338 | 10.395 | 10.452 | 9.781 | 100.0% | 10 |
| cinder.delete_volume | 0.579 | 1.672 | 2.856 | 2.952 | 3.049 | 1.773 | 100.0% | 10 |
| total | 9.725 | 11.645 | 12.996 | 13.017 | 13.039 | 11.554 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 35.517152071
Full duration: 54.0071978569
test scenario CinderVolumes.create_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.596 | 3.887 | 4.71 | 4.712 | 4.715 | 4.08 | 100.0% | 10 |
| cinder.delete_volume | 0.512 | 0.923 | 1.297 | 2.319 | 3.341 | 1.114 | 100.0% | 10 |
| total | 4.381 | 4.91 | 5.923 | 6.573 | 7.223 | 5.195 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 15.0102190971
Full duration: 33.4934709072
test scenario CinderVolumes.create_and_upload_volume_to_image
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.512 | 3.838 | 4.155 | 4.202 | 4.249 | 3.861 | 100.0% | 10 |
| cinder.upload_volume_to_image | 16.283 | 24.737 | 33.632 | 38.034 | 42.436 | 26.102 | 100.0% | 10 |
| cinder.delete_volume | 0.583 | 1.719 | 3.056 | 3.165 | 3.274 | 1.853 | 100.0% | 10 |
| nova.delete_image | 2.514 | 2.856 | 13.194 | 14.749 | 16.305 | 5.182 | 100.0% | 10 |
| total | 23.887 | 34.293 | 49.972 | 51.48 | 52.988 | 36.998 | 100.0% | 10 |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 107.503821135
Full duration: 129.166619062
test scenario CinderVolumes.create_and_delete_snapshot
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_snapshot | 3.064 | 3.257 | 3.408 | 3.415 | 3.422 | 3.261 | 100.0% | 10 |
| cinder.delete_snapshot | 2.586 | 2.915 | 3.148 | 3.165 | 3.181 | 2.938 | 100.0% | 10 |
| total | 5.837 | 6.18 | 6.465 | 6.534 | 6.603 | 6.199 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 18.601981163
Full duration: 53.3941659927
test scenario CinderVolumes.create_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.424 | 3.854 | 4.025 | 4.05 | 4.075 | 3.808 | 100.0% | 10 |
| total | 3.424 | 3.854 | 4.025 | 4.05 | 4.075 | 3.808 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 11.3824880123
Full duration: 30.7913680077
test scenario CinderVolumes.create_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.391 | 3.979 | 4.585 | 4.6 | 4.616 | 3.999 | 100.0% | 10 |
| total | 3.391 | 3.979 | 4.585 | 4.601 | 4.616 | 3.999 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 12.107943058
Full duration: 36.5596921444
test scenario CinderVolumes.list_volumes
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.list_volumes | 0.478 | 0.562 | 0.711 | 0.746 | 0.781 | 0.587 | 100.0% | 10 |
| total | 0.479 | 0.562 | 0.711 | 0.746 | 0.781 | 0.587 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.79518508911
Full duration: 65.9313700199
test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
+-----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.557 | 3.914 | 4.206 | 4.213 | 4.22 | 3.884 | 100.0% | 10 |
| cinder.create_snapshot | 2.701 | 3.063 | 3.248 | 3.251 | 3.254 | 3.06 | 100.0% | 10 |
| nova.attach_volume | 3.75 | 4.986 | 6.112 | 6.385 | 6.658 | 5.059 | 100.0% | 10 |
| nova.detach_volume | 3.149 | 3.81 | 4.11 | 4.168 | 4.225 | 3.762 | 100.0% | 10 |
| cinder.delete_snapshot | 2.241 | 2.766 | 3.077 | 3.102 | 3.128 | 2.725 | 100.0% | 10 |
| cinder.delete_volume | 0.748 | 2.428 | 2.712 | 2.772 | 2.831 | 1.912 | 100.0% | 10 |
| total | 19.22 | 21.354 | 24.347 | 24.725 | 25.102 | 21.684 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 64.028840065
Full duration: 186.598311901
test scenario CinderVolumes.create_from_volume_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.539 | 4.149 | 4.62 | 4.622 | 4.623 | 4.106 | 100.0% | 10 |
| cinder.delete_volume | 2.844 | 3.223 | 3.604 | 3.609 | 3.614 | 3.235 | 100.0% | 10 |
| total | 6.383 | 7.559 | 7.85 | 7.868 | 7.886 | 7.341 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 21.6859838963
Full duration: 55.5635709763
test scenario CinderVolumes.create_and_extend_volume
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| cinder.create_volume | 3.434 | 3.852 | 3.99 | 4.004 | 4.018 | 3.842 | 100.0% | 10 |
| cinder.extend_volume | 0.955 | 2.236 | 3.552 | 3.564 | 3.576 | 2.281 | 100.0% | 10 |
| cinder.delete_volume | 0.868 | 3.015 | 3.332 | 3.398 | 3.465 | 2.861 | 100.0% | 10 |
| total | 5.962 | 9.186 | 10.497 | 10.52 | 10.544 | 8.984 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 28.1479110718
Full duration: 47.0005409718
test scenario CinderVolumes.create_snapshot_and_attach_volume
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.595 | 3.868 | 4.206 | 4.208 | 4.211 | 3.886 | 100.0% | 10 |
| cinder.create_snapshot | 2.595 | 3.131 | 3.249 | 3.258 | 3.267 | 3.037 | 100.0% | 10 |
| nova.attach_volume | 4.101 | 4.563 | 5.363 | 7.225 | 9.087 | 4.928 | 100.0% | 10 |
| nova.detach_volume | 3.299 | 3.896 | 4.226 | 4.274 | 4.323 | 3.816 | 100.0% | 10 |
| cinder.delete_snapshot | 2.27 | 2.573 | 2.884 | 3.105 | 3.325 | 2.635 | 100.0% | 10 |
| cinder.delete_volume | 0.611 | 2.479 | 2.742 | 2.863 | 2.983 | 2.239 | 100.0% | 10 |
| total | 19.728 | 21.533 | 22.719 | 24.643 | 26.568 | 21.737 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 62.6771988869
Full duration: 187.817504883
test scenario CinderVolumes.create_snapshot_and_attach_volume
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.255 | 3.476 | 4.793 | 4.86 | 4.926 | 3.766 | 100.0% | 10 |
| cinder.create_snapshot | 2.387 | 2.868 | 3.304 | 3.311 | 3.318 | 2.906 | 100.0% | 10 |
| nova.attach_volume | 3.864 | 4.167 | 4.94 | 5.864 | 6.787 | 4.392 | 100.0% | 10 |
| nova.detach_volume | 3.699 | 4.047 | 4.388 | 4.408 | 4.428 | 4.066 | 100.0% | 10 |
| cinder.delete_snapshot | 2.492 | 2.621 | 2.825 | 2.828 | 2.831 | 2.651 | 100.0% | 10 |
| cinder.delete_volume | 0.65 | 2.735 | 3.048 | 3.123 | 3.198 | 2.567 | 100.0% | 10 |
| total | 18.915 | 21.629 | 24.215 | 25.025 | 25.835 | 22.025 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 64.388502121
Full duration: 192.928286076
run_rally - INFO - Test scenario: "cinder" OK.
run_rally - INFO - Starting test scenario "heat" ...
run_rally - INFO -
Preparing input task
Task 44fe34e1-bd7f-47f7-b4e9-ca32c892d8b5: started
Task 44fe34e1-bd7f-47f7-b4e9-ca32c892d8b5: finished
test scenario HeatStacks.create_suspend_resume_delete_stack
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| heat.create_stack | 4.131 | 4.448 | 4.579 | 4.616 | 4.652 | 4.417 | 100.0% | 10 |
| heat.suspend_stack | 1.521 | 1.721 | 1.772 | 1.792 | 1.812 | 1.701 | 100.0% | 10 |
| heat.resume_stack | 1.454 | 1.625 | 1.703 | 1.708 | 1.713 | 1.63 | 100.0% | 10 |
| heat.delete_stack | 1.387 | 1.57 | 2.717 | 2.724 | 2.731 | 1.88 | 100.0% | 10 |
| total | 8.994 | 9.448 | 10.723 | 10.75 | 10.777 | 9.627 | 100.0% | 10 |
+--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 28.125330925
Full duration: 37.9011991024
test scenario HeatStacks.create_and_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 4.098 | 4.267 | 4.383 | 4.452 | 4.52 | 4.266 | 100.0% | 10 |
| heat.delete_stack | 1.423 | 1.468 | 1.536 | 1.679 | 1.822 | 1.505 | 100.0% | 10 |
| total | 5.574 | 5.769 | 5.922 | 5.933 | 5.944 | 5.77 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 17.2579169273
Full duration: 27.4368560314
test scenario HeatStacks.create_and_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 25.037 | 28.231 | 29.801 | 29.828 | 29.856 | 27.99 | 100.0% | 10 |
| heat.delete_stack | 10.707 | 11.831 | 13.046 | 13.573 | 14.099 | 12.249 | 100.0% | 10 |
| total | 36.902 | 40.321 | 42.736 | 42.79 | 42.844 | 40.24 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 119.344232082
Full duration: 129.710185051
test scenario HeatStacks.create_and_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 21.352 | 24.853 | 26.526 | 26.562 | 26.598 | 24.433 | 100.0% | 10 |
| heat.delete_stack | 9.51 | 10.67 | 10.95 | 11.42 | 11.889 | 10.684 | 100.0% | 10 |
| total | 31.928 | 35.457 | 37.299 | 37.449 | 37.598 | 35.117 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 106.840685844
Full duration: 117.40921998
test scenario HeatStacks.list_stacks_and_resources
+------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.list_stacks | 0.488 | 0.522 | 0.539 | 0.54 | 0.54 | 0.522 | 100.0% | 10 |
| heat.list_resources_of_0_stacks | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
| total | 0.488 | 0.522 | 0.539 | 0.54 | 0.541 | 0.522 | 100.0% | 10 |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.59450078011
Full duration: 9.86936807632
test scenario HeatStacks.create_update_delete_stack
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 3.845 | 4.214 | 4.356 | 4.377 | 4.397 | 4.193 | 100.0% | 10 |
| heat.update_stack | 3.558 | 3.774 | 3.853 | 3.855 | 3.857 | 3.726 | 100.0% | 10 |
| heat.delete_stack | 1.56 | 2.57 | 2.756 | 2.776 | 2.797 | 2.512 | 100.0% | 10 |
| total | 9.445 | 10.455 | 10.866 | 10.915 | 10.963 | 10.431 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 31.3620579243
Full duration: 42.2799968719
test scenario HeatStacks.create_update_delete_stack
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| heat.create_stack | 4.133 | 4.157 | 4.354 | 4.413 | 4.472 | 4.209 | 100.0% | 10 |
| heat.update_stack | 3.534 | 3.713 | 3.821 | 3.958 | 4.096 | 3.717 | 100.0% | 10 |
| heat.delete_stack | 1.383 | 1.402 | 1.736 | 2.156 | 2.575 | 1.556 | 100.0% | 10 |
| total | 9.126 | 9.41 | 9.772 | 10.018 | 10.263 | 9.482 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 29.0769648552
Full duration: 39.4647920132
test scenario HeatStacks.create_update_delete_stack
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
| heat.create_stack | 4.275 | 4.465 | 4.666 | 4.855 | 5.044 | 4.509 | 100.0% | 10 |
| heat.update_stack | 5.801 | 5.876 | 6.0 | 6.166 | 6.332 | 5.928 | 100.0% | 10 |
| heat.delete_stack | 2.525 | 2.564 | 3.649 | 3.683 | 3.717 | 2.793 | 100.0% | 10 |
| total | 12.743 | 13.005 | 13.996 | 14.01 | 14.023 | 13.23 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 39.5067877769
Full duration: 50.3663468361
test scenario HeatStacks.create_update_delete_stack
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
| heat.create_stack | 4.517 | 5.462 | 5.602 | 5.608 | 5.614 | 5.389 | 100.0% | 10 |
| heat.update_stack | 8.345 | 9.324 | 9.403 | 9.411 | 9.42 | 9.245 | 100.0% | 10 |
| heat.delete_stack | 3.69 | 3.723 | 3.746 | 3.755 | 3.763 | 3.725 | 100.0% | 10 |
| total | 17.515 | 18.525 | 18.645 | 18.683 | 18.722 | 18.36 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 54.7039349079
Full duration: 65.6854679585
test scenario HeatStacks.create_update_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 4.122 | 4.348 | 4.549 | 4.597 | 4.645 | 4.358 | 100.0% | 10 |
| heat.update_stack | 5.791 | 5.87 | 5.92 | 5.932 | 5.944 | 5.864 | 100.0% | 10 |
| heat.delete_stack | 2.506 | 2.55 | 3.704 | 3.778 | 3.853 | 2.791 | 100.0% | 10 |
| total | 12.485 | 12.814 | 13.98 | 14.075 | 14.169 | 13.013 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 38.5906641483
Full duration: 49.8386061192
test scenario HeatStacks.create_update_delete_stack
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| heat.create_stack | 4.062 | 4.33 | 4.493 | 4.501 | 4.508 | 4.317 | 100.0% | 10 |
| heat.update_stack | 3.553 | 3.585 | 3.783 | 3.936 | 4.088 | 3.648 | 100.0% | 10 |
| heat.delete_stack | 1.376 | 1.418 | 2.552 | 2.555 | 2.558 | 1.856 | 100.0% | 10 |
| total | 9.179 | 9.535 | 10.607 | 10.678 | 10.749 | 9.822 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 29.5593960285
Full duration: 40.873290062
test scenario HeatStacks.create_and_list_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 4.105 | 4.264 | 4.394 | 4.43 | 4.466 | 4.276 | 100.0% | 10 |
| heat.list_stacks | 0.062 | 0.103 | 0.113 | 0.116 | 0.119 | 0.096 | 100.0% | 10 |
| total | 4.18 | 4.373 | 4.501 | 4.531 | 4.561 | 4.371 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 13.1703698635
Full duration: 29.690456152
test scenario HeatStacks.create_check_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 4.194 | 4.357 | 4.595 | 4.64 | 4.684 | 4.393 | 100.0% | 10 |
| heat.check_stack | 1.511 | 1.542 | 1.627 | 1.753 | 1.88 | 1.58 | 100.0% | 10 |
| heat.delete_stack | 1.402 | 2.55 | 2.707 | 2.749 | 2.791 | 2.257 | 100.0% | 10 |
| total | 7.411 | 8.429 | 8.66 | 8.745 | 8.829 | 8.23 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 24.4679090977
Full duration: 35.6907479763
run_rally - INFO - Test scenario: "heat" OK.
run_rally - INFO - Starting test scenario "keystone" ...
run_rally - INFO -
Preparing input task
Task 416065d0-3811-4bee-9b53-37743e1f179c: started
Task 416065d0-3811-4bee-9b53-37743e1f179c: finished
test scenario KeystoneBasic.create_tenant_with_users
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.285 | 0.297 | 0.328 | 0.336 | 0.343 | 0.305 | 100.0% | 10 |
| keystone.create_users | 1.651 | 1.673 | 1.73 | 1.749 | 1.768 | 1.688 | 100.0% | 10 |
| total | 1.952 | 1.986 | 2.027 | 2.061 | 2.095 | 1.993 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 5.98874807358
Full duration: 22.4405510426
test scenario KeystoneBasic.create_add_and_list_user_roles
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.287 | 0.308 | 0.404 | 0.428 | 0.452 | 0.331 | 100.0% | 10 |
| keystone.add_role | 0.276 | 0.31 | 0.371 | 0.379 | 0.388 | 0.319 | 100.0% | 10 |
| keystone.list_roles | 0.137 | 0.151 | 0.175 | 0.207 | 0.239 | 0.16 | 100.0% | 10 |
| total | 0.732 | 0.775 | 0.951 | 0.962 | 0.972 | 0.809 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.38230800629
Full duration: 15.068157196
test scenario KeystoneBasic.add_and_remove_user_role
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.263 | 0.3 | 0.41 | 0.455 | 0.499 | 0.336 | 100.0% | 10 |
| keystone.add_role | 0.265 | 0.28 | 0.342 | 0.405 | 0.468 | 0.302 | 100.0% | 10 |
| keystone.remove_role | 0.151 | 0.182 | 0.347 | 0.35 | 0.354 | 0.226 | 100.0% | 10 |
| total | 0.713 | 0.844 | 1.002 | 1.019 | 1.036 | 0.864 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.52822303772
Full duration: 15.38514781
test scenario KeystoneBasic.create_update_and_delete_tenant
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.267 | 0.354 | 0.411 | 0.421 | 0.432 | 0.346 | 100.0% | 10 |
| keystone.update_tenant | 0.139 | 0.15 | 0.185 | 0.223 | 0.262 | 0.164 | 100.0% | 10 |
| keystone.delete_tenant | 0.302 | 0.333 | 0.418 | 0.448 | 0.477 | 0.35 | 100.0% | 10 |
| total | 0.738 | 0.879 | 0.917 | 0.961 | 1.006 | 0.86 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.55070900917
Full duration: 14.2816069126
test scenario KeystoneBasic.create_and_delete_service
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_service | 0.279 | 0.303 | 0.408 | 0.41 | 0.412 | 0.322 | 100.0% | 10 |
| keystone.delete_service | 0.15 | 0.168 | 0.188 | 0.192 | 0.196 | 0.169 | 100.0% | 10 |
| total | 0.443 | 0.471 | 0.584 | 0.594 | 0.604 | 0.491 | 100.0% | 10 |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.47291088104
Full duration: 12.6235470772
test scenario KeystoneBasic.create_tenant
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.274 | 0.302 | 0.315 | 0.324 | 0.334 | 0.301 | 100.0% | 10 |
| total | 0.274 | 0.302 | 0.315 | 0.325 | 0.334 | 0.301 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.926929950714
Full duration: 9.11541318893
test scenario KeystoneBasic.create_user
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_user | 0.285 | 0.312 | 0.353 | 0.392 | 0.431 | 0.323 | 100.0% | 10 |
| total | 0.285 | 0.313 | 0.353 | 0.392 | 0.431 | 0.323 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.09427213669
Full duration: 9.44248485565
test scenario KeystoneBasic.create_and_list_tenants
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.276 | 0.302 | 0.312 | 0.315 | 0.318 | 0.299 | 100.0% | 10 |
| keystone.list_tenants | 0.133 | 0.141 | 0.147 | 0.149 | 0.15 | 0.141 | 100.0% | 10 |
| total | 0.416 | 0.441 | 0.462 | 0.463 | 0.463 | 0.44 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.356580019
Full duration: 14.5843369961
test scenario KeystoneBasic.create_and_delete_role
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.271 | 0.306 | 0.517 | 0.532 | 0.547 | 0.37 | 100.0% | 10 |
| keystone.delete_role | 0.295 | 0.305 | 0.621 | 0.655 | 0.689 | 0.401 | 100.0% | 10 |
| total | 0.572 | 0.743 | 0.991 | 1.076 | 1.16 | 0.771 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.24743795395
Full duration: 14.336769104
test scenario KeystoneBasic.get_entities
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.284 | 0.313 | 0.395 | 0.4 | 0.405 | 0.328 | 100.0% | 10 |
| keystone.create_user | 0.141 | 0.155 | 0.176 | 0.176 | 0.177 | 0.159 | 100.0% | 10 |
| keystone.create_role | 0.136 | 0.155 | 0.173 | 0.209 | 0.245 | 0.16 | 100.0% | 10 |
| keystone.get_tenant | 0.124 | 0.132 | 0.143 | 0.144 | 0.144 | 0.133 | 100.0% | 10 |
| keystone.get_user | 0.124 | 0.141 | 0.232 | 0.234 | 0.237 | 0.158 | 100.0% | 10 |
| keystone.get_role | 0.122 | 0.125 | 0.142 | 0.144 | 0.147 | 0.129 | 100.0% | 10 |
| keystone.service_list | 0.121 | 0.13 | 0.138 | 0.139 | 0.139 | 0.13 | 100.0% | 10 |
| keystone.get_service | 0.118 | 0.132 | 0.158 | 0.16 | 0.161 | 0.136 | 100.0% | 10 |
| total | 1.253 | 1.315 | 1.403 | 1.449 | 1.495 | 1.334 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.18330001831
Full duration: 21.2465929985
test scenario KeystoneBasic.create_and_list_users
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_user | 0.27 | 0.324 | 0.381 | 0.409 | 0.436 | 0.33 | 100.0% | 10 |
| keystone.list_users | 0.125 | 0.142 | 0.183 | 0.233 | 0.283 | 0.157 | 100.0% | 10 |
| total | 0.409 | 0.47 | 0.53 | 0.625 | 0.719 | 0.487 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.41358304024
Full duration: 9.46058607101
run_rally - INFO - Test scenario: "keystone" OK.
run_rally - INFO - Starting test scenario "neutron" ...
run_rally - INFO -
Preparing input task
Task 66bee4c3-3b3f-4215-9910-63425b400d9a: started
Task 66bee4c3-3b3f-4215-9910-63425b400d9a: finished
test scenario NeutronNetworks.create_and_delete_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.762 | 0.83 | 0.953 | 0.983 | 1.014 | 0.858 | 100.0% | 10 |
| neutron.delete_port | 0.224 | 0.62 | 0.763 | 0.78 | 0.797 | 0.582 | 100.0% | 10 |
| total | 1.011 | 1.549 | 1.599 | 1.603 | 1.607 | 1.441 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.14246201515
Full duration: 53.9938690662
test scenario NeutronNetworks.create_and_list_routers
+---------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.718 | 0.792 | 0.884 | 0.89 | 0.895 | 0.801 | 100.0% | 10 |
| neutron.create_router | 0.435 | 0.451 | 0.555 | 0.56 | 0.565 | 0.474 | 100.0% | 10 |
| neutron.add_interface_router | 0.341 | 0.776 | 1.004 | 1.11 | 1.215 | 0.789 | 100.0% | 10 |
| neutron.list_routers | 0.066 | 0.42 | 0.477 | 0.491 | 0.505 | 0.367 | 100.0% | 10 |
| total | 1.661 | 2.48 | 2.738 | 2.797 | 2.855 | 2.431 | 100.0% | 10 |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 7.12932991982
Full duration: 59.6318800449
test scenario NeutronNetworks.create_and_delete_routers
+------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.739 | 0.812 | 0.936 | 0.949 | 0.963 | 0.833 | 100.0% | 10 |
| neutron.create_router | 0.073 | 0.467 | 0.548 | 0.564 | 0.58 | 0.447 | 100.0% | 10 |
| neutron.add_interface_router | 0.32 | 0.758 | 0.881 | 0.901 | 0.92 | 0.737 | 100.0% | 10 |
| neutron.remove_interface_router | 0.632 | 0.723 | 0.767 | 0.788 | 0.808 | 0.719 | 100.0% | 10 |
| neutron.delete_router | 0.575 | 0.622 | 0.72 | 0.74 | 0.759 | 0.639 | 100.0% | 10 |
| total | 2.939 | 3.398 | 3.635 | 3.725 | 3.814 | 3.375 | 100.0% | 10 |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 10.4781250954
Full duration: 61.2645328045
test scenario NeutronNetworks.create_and_list_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.728 | 0.859 | 0.909 | 0.944 | 0.978 | 0.857 | 100.0% | 10 |
| neutron.list_ports | 0.52 | 0.599 | 0.71 | 0.735 | 0.76 | 0.618 | 100.0% | 10 |
| total | 1.37 | 1.459 | 1.597 | 1.611 | 1.624 | 1.475 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.50073218346
Full duration: 55.2021510601
test scenario NeutronNetworks.create_and_delete_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.749 | 0.788 | 0.939 | 0.956 | 0.972 | 0.824 | 100.0% | 10 |
| neutron.delete_subnet | 0.556 | 0.673 | 0.778 | 0.819 | 0.859 | 0.687 | 100.0% | 10 |
| total | 1.361 | 1.521 | 1.693 | 1.697 | 1.702 | 1.511 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.66956591606
Full duration: 54.1284301281
test scenario NeutronNetworks.create_and_delete_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.62 | 0.643 | 0.756 | 0.784 | 0.812 | 0.672 | 100.0% | 10 |
| neutron.delete_network | 0.481 | 0.54 | 0.616 | 0.686 | 0.756 | 0.558 | 100.0% | 10 |
| total | 1.101 | 1.206 | 1.363 | 1.377 | 1.391 | 1.23 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.73822879791
Full duration: 33.2811751366
test scenario NeutronNetworks.create_and_list_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.583 | 0.675 | 0.782 | 0.782 | 0.783 | 0.691 | 100.0% | 10 |
| neutron.list_networks | 0.058 | 0.395 | 0.517 | 0.522 | 0.528 | 0.364 | 100.0% | 10 |
| total | 0.834 | 1.066 | 1.187 | 1.242 | 1.298 | 1.055 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.09279990196
Full duration: 33.633177042
test scenario NeutronNetworks.create_and_update_routers
+---------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.713 | 0.8 | 0.903 | 0.913 | 0.922 | 0.811 | 100.0% | 10 |
| neutron.create_router | 0.434 | 0.449 | 0.476 | 0.497 | 0.519 | 0.458 | 100.0% | 10 |
| neutron.add_interface_router | 0.666 | 0.749 | 0.912 | 0.954 | 0.996 | 0.791 | 100.0% | 10 |
| neutron.update_router | 0.222 | 0.579 | 0.659 | 0.678 | 0.697 | 0.556 | 100.0% | 10 |
| total | 2.156 | 2.643 | 2.768 | 2.799 | 2.83 | 2.617 | 100.0% | 10 |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 7.76268601418
Full duration: 57.6214001179
test scenario NeutronNetworks.create_and_update_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.606 | 0.672 | 0.761 | 0.785 | 0.81 | 0.681 | 100.0% | 10 |
| neutron.update_network | 0.137 | 0.518 | 0.538 | 0.542 | 0.547 | 0.482 | 100.0% | 10 |
| total | 0.893 | 1.183 | 1.261 | 1.288 | 1.315 | 1.164 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.59189605713
Full duration: 34.8437690735
test scenario NeutronNetworks.create_and_update_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.738 | 0.792 | 0.889 | 0.921 | 0.952 | 0.815 | 100.0% | 10 |
| neutron.update_port | 0.161 | 0.551 | 0.596 | 0.6 | 0.605 | 0.516 | 100.0% | 10 |
| total | 1.044 | 1.339 | 1.429 | 1.482 | 1.536 | 1.331 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.11195087433
Full duration: 53.0145220757
test scenario NeutronNetworks.create_and_list_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.703 | 0.748 | 0.832 | 0.861 | 0.89 | 0.764 | 100.0% | 10 |
| neutron.list_subnets | 0.054 | 0.396 | 0.445 | 0.479 | 0.513 | 0.374 | 100.0% | 10 |
| total | 0.757 | 1.159 | 1.256 | 1.272 | 1.287 | 1.138 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.5137629509
Full duration: 52.7622568607
test scenario NeutronNetworks.create_and_update_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.742 | 0.813 | 0.947 | 0.948 | 0.949 | 0.838 | 100.0% | 10 |
| neutron.update_subnet | 0.234 | 0.583 | 0.695 | 0.696 | 0.696 | 0.58 | 100.0% | 10 |
| total | 1.043 | 1.427 | 1.587 | 1.596 | 1.604 | 1.418 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.36762094498
Full duration: 54.1341950893
run_rally - INFO - Test scenario: "neutron" OK.
run_rally - INFO - Starting test scenario "nova" ...
run_rally - INFO -
Preparing input task
Task c631be68-64eb-462f-af72-0946f649719e: started
Task c631be68-64eb-462f-af72-0946f649719e: finished
test scenario NovaKeypair.create_and_delete_keypair
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.create_keypair | 0.689 | 0.825 | 1.389 | 1.414 | 1.439 | 0.956 | 100.0% | 10 |
| nova.delete_keypair | 0.034 | 0.045 | 0.058 | 0.058 | 0.059 | 0.046 | 100.0% | 10 |
| total | 0.734 | 0.868 | 1.43 | 1.458 | 1.487 | 1.002 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.95623397827
Full duration: 43.0288610458
test scenario NovaServers.snapshot_server
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 13.069 | 14.075 | 14.775 | 15.063 | 15.35 | 14.118 | 100.0% | 10 |
| nova.create_image | 10.992 | 11.363 | 11.948 | 12.03 | 12.112 | 11.402 | 100.0% | 10 |
| nova.delete_server | 2.878 | 3.026 | 3.413 | 3.454 | 3.495 | 3.121 | 100.0% | 10 |
| nova.boot_server (2) | 10.807 | 12.891 | 14.009 | 14.098 | 14.188 | 12.932 | 100.0% | 10 |
| nova.delete_server (2) | 2.914 | 3.356 | 4.738 | 4.974 | 5.21 | 3.557 | 100.0% | 10 |
| nova.delete_image | 2.769 | 3.227 | 3.659 | 3.685 | 3.711 | 3.238 | 100.0% | 10 |
| total | 44.842 | 48.482 | 49.94 | 50.257 | 50.573 | 48.369 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 145.116047144
Full duration: 218.130707026
test scenario NovaKeypair.boot_and_delete_server_with_keypair
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_keypair | 0.67 | 0.815 | 1.452 | 1.483 | 1.515 | 0.945 | 100.0% | 10 |
| nova.boot_server | 11.229 | 12.914 | 14.714 | 15.148 | 15.581 | 13.075 | 100.0% | 10 |
| nova.delete_server | 2.87 | 3.313 | 3.4 | 3.451 | 3.502 | 3.214 | 100.0% | 10 |
| nova.delete_keypair | 0.034 | 0.048 | 0.056 | 0.056 | 0.057 | 0.046 | 100.0% | 10 |
| total | 15.3 | 17.062 | 18.916 | 19.109 | 19.302 | 17.281 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 51.5624389648
Full duration: 121.866284132
test scenario NovaKeypair.create_and_list_keypairs
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.create_keypair | 0.681 | 0.825 | 1.368 | 1.468 | 1.568 | 0.975 | 100.0% | 10 |
| nova.list_keypairs | 0.021 | 0.027 | 0.038 | 0.038 | 0.039 | 0.03 | 100.0% | 10 |
| total | 0.715 | 0.855 | 1.394 | 1.494 | 1.593 | 1.005 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.00225996971
Full duration: 44.8396139145
test scenario NovaServers.list_servers
+---------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+------+---------+-------+
| nova.list_servers | 1.385 | 1.648 | 1.794 | 1.8 | 1.806 | 1.64 | 100.0% | 10 |
| total | 1.386 | 1.648 | 1.794 | 1.8 | 1.807 | 1.64 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+------+---------+-------+
Load duration: 4.86725592613
Full duration: 144.563478947
test scenario NovaServers.resize_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 11.794 | 13.235 | 14.683 | 15.23 | 15.778 | 13.569 | 100.0% | 10 |
| nova.resize | 40.775 | 43.909 | 47.803 | 47.888 | 47.973 | 44.294 | 100.0% | 10 |
| nova.resize_confirm | 2.664 | 3.406 | 5.701 | 5.894 | 6.087 | 3.777 | 100.0% | 10 |
| nova.delete_server | 2.831 | 2.964 | 3.671 | 4.355 | 5.038 | 3.264 | 100.0% | 10 |
| total | 59.51 | 64.72 | 68.963 | 69.477 | 69.991 | 64.905 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 193.15106678
Full duration: 234.439800978
test scenario NovaServers.boot_server_from_volume_and_delete
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 9.703 | 10.351 | 11.374 | 12.306 | 13.237 | 10.631 | 100.0% | 10 |
| nova.boot_server | 13.02 | 14.474 | 15.965 | 16.121 | 16.276 | 14.667 | 100.0% | 10 |
| nova.delete_server | 3.826 | 5.813 | 5.967 | 6.081 | 6.196 | 5.561 | 100.0% | 10 |
| total | 27.612 | 30.787 | 32.582 | 32.736 | 32.891 | 30.859 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 92.1244728565
Full duration: 176.439888954
test scenario NovaServers.boot_and_migrate_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 12.068 | 13.808 | 14.866 | 14.966 | 15.067 | 13.788 | 100.0% | 10 |
| nova.stop_server | 4.417 | 6.774 | 7.032 | 7.224 | 7.416 | 6.512 | 100.0% | 10 |
| nova.migrate | 10.786 | 11.454 | 11.957 | 11.999 | 12.04 | 11.487 | 100.0% | 10 |
| nova.resize_confirm | 3.328 | 3.614 | 3.822 | 3.905 | 3.988 | 3.621 | 100.0% | 10 |
| nova.delete_server | 2.862 | 3.057 | 3.364 | 3.454 | 3.544 | 3.116 | 100.0% | 10 |
| total | 34.85 | 38.711 | 40.179 | 40.344 | 40.508 | 38.525 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 115.221567869
Full duration: 156.790792227
test scenario NovaServers.boot_and_delete_server
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 12.492 | 13.618 | 14.995 | 15.0 | 15.004 | 13.701 | 100.0% | 10 |
| nova.delete_server | 2.88 | 3.033 | 3.371 | 3.49 | 3.61 | 3.125 | 100.0% | 10 |
| total | 15.773 | 16.838 | 17.914 | 18.089 | 18.264 | 16.827 | 100.0% | 10 |
+--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 50.1218390465
Full duration: 119.306482077
test scenario NovaServers.boot_and_rebuild_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 12.196 | 13.798 | 15.074 | 15.293 | 15.511 | 13.812 | 100.0% | 10 |
| nova.rebuild_server | 12.036 | 13.891 | 15.523 | 15.599 | 15.676 | 13.972 | 100.0% | 10 |
| nova.delete_server | 2.645 | 3.268 | 3.55 | 3.589 | 3.628 | 3.208 | 100.0% | 10 |
| total | 28.349 | 31.175 | 32.771 | 33.141 | 33.511 | 30.993 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 92.8703818321
Full duration: 164.587569952
test scenario NovaSecGroup.create_and_list_secgroups
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 4.388 | 5.032 | 5.224 | 5.25 | 5.277 | 4.975 | 100.0% | 10 |
| nova.create_100_rules | 42.993 | 44.613 | 45.762 | 45.785 | 45.808 | 44.39 | 100.0% | 10 |
| nova.list_security_groups | 0.153 | 0.195 | 0.36 | 0.486 | 0.613 | 0.251 | 100.0% | 10 |
| total | 48.225 | 50.01 | 50.441 | 50.635 | 50.83 | 49.616 | 100.0% | 10 |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 149.417917013
Full duration: 217.353839159
test scenario NovaSecGroup.create_and_delete_secgroups
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 4.382 | 5.191 | 5.496 | 5.608 | 5.72 | 5.12 | 100.0% | 10 |
| nova.create_100_rules | 43.059 | 44.368 | 45.778 | 46.029 | 46.28 | 44.458 | 100.0% | 10 |
| nova.delete_10_security_groups | 1.662 | 2.265 | 2.495 | 2.664 | 2.832 | 2.215 | 100.0% | 10 |
| total | 50.772 | 51.601 | 53.26 | 53.294 | 53.327 | 51.794 | 100.0% | 10 |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 156.369856119
Full duration: 199.137834787
test scenario NovaServers.boot_and_bounce_server
+-------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 12.013 | 14.52 | 15.332 | 15.8 | 16.267 | 14.249 | 100.0% | 10 |
| nova.reboot_server | 5.223 | 6.071 | 6.385 | 6.462 | 6.539 | 5.987 | 100.0% | 10 |
| nova.soft_reboot_server | 5.766 | 8.423 | 8.806 | 9.002 | 9.198 | 8.214 | 100.0% | 10 |
| nova.stop_server | 3.892 | 6.503 | 7.587 | 10.894 | 14.201 | 6.898 | 100.0% | 10 |
| nova.start_server | 3.432 | 4.687 | 5.177 | 5.424 | 5.672 | 4.587 | 100.0% | 10 |
| nova.rescue_server | 7.9 | 8.519 | 9.688 | 10.196 | 10.703 | 8.724 | 100.0% | 10 |
| nova.unrescue_server | 5.091 | 5.518 | 5.836 | 6.131 | 6.426 | 5.577 | 100.0% | 10 |
| nova.delete_server | 2.495 | 2.921 | 3.469 | 3.516 | 3.563 | 2.974 | 100.0% | 10 |
| total | 53.649 | 57.305 | 59.111 | 60.626 | 62.142 | 57.23 | 100.0% | 10 |
+-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 174.621170044
Full duration: 245.828352928
test scenario NovaServers.boot_server
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 13.233 | 14.359 | 15.326 | 15.425 | 15.523 | 14.261 | 100.0% | 10 |
| total | 13.234 | 14.359 | 15.326 | 15.425 | 15.523 | 14.261 | 100.0% | 10 |
+------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 42.6567699909
Full duration: 99.771146059
test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 4.306 | 4.999 | 5.282 | 5.289 | 5.296 | 4.937 | 100.0% | 10 |
| nova.create_100_rules | 41.795 | 43.955 | 45.983 | 46.201 | 46.418 | 44.135 | 100.0% | 10 |
| nova.boot_server | 10.075 | 11.651 | 12.302 | 13.061 | 13.82 | 11.534 | 100.0% | 10 |
| nova.get_attached_security_groups | 0.217 | 0.249 | 0.568 | 0.572 | 0.577 | 0.338 | 100.0% | 10 |
| nova.delete_server | 2.469 | 2.619 | 2.937 | 3.034 | 3.131 | 2.712 | 100.0% | 10 |
| nova.delete_10_security_groups | 1.574 | 1.878 | 2.55 | 2.704 | 2.858 | 2.053 | 100.0% | 10 |
| total | 63.097 | 65.905 | 66.858 | 67.329 | 67.8 | 65.71 | 100.0% | 10 |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 195.037164927
Full duration: 263.490648985
test scenario NovaServers.pause_and_unpause_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 12.325 | 13.238 | 14.398 | 14.542 | 14.687 | 13.373 | 100.0% | 10 |
| nova.pause_server | 2.412 | 2.986 | 3.177 | 3.205 | 3.233 | 2.946 | 100.0% | 10 |
| nova.unpause_server | 2.824 | 3.169 | 3.325 | 3.392 | 3.459 | 3.13 | 100.0% | 10 |
| nova.delete_server | 2.501 | 3.244 | 3.557 | 3.634 | 3.71 | 3.233 | 100.0% | 10 |
| total | 21.499 | 22.307 | 24.0 | 24.022 | 24.043 | 22.682 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 67.2968730927
Full duration: 134.783083916
test scenario NovaServers.boot_server_from_volume
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 9.885 | 10.866 | 11.617 | 11.636 | 11.655 | 10.841 | 100.0% | 10 |
| nova.boot_server | 13.236 | 14.774 | 15.766 | 16.126 | 16.486 | 14.693 | 100.0% | 10 |
| total | 23.437 | 25.64 | 27.197 | 27.213 | 27.23 | 25.534 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 78.3072631359
Full duration: 145.979751825
test scenario NovaServers.boot_and_list_server
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 12.745 | 14.15 | 15.755 | 15.872 | 15.99 | 14.143 | 100.0% | 10 |
| nova.list_servers | 0.579 | 0.977 | 1.114 | 1.158 | 1.203 | 0.926 | 100.0% | 10 |
| total | 13.49 | 14.979 | 16.933 | 16.94 | 16.947 | 15.07 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 46.7471969128
Full duration: 130.989289045
run_rally - INFO - Test scenario: "nova" OK.
run_rally - INFO - Starting test scenario "quotas" ...
run_rally - INFO -
Preparing input task
Task 09c70711-40eb-4c85-8b87-c0c081222b0d: started
Task 09c70711-40eb-4c85-8b87-c0c081222b0d: finished
test scenario Quotas.cinder_update
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+------+---------+-------+
| quotas.update_quotas | 1.123 | 1.192 | 1.297 | 1.331 | 1.365 | 1.21 | 100.0% | 10 |
| total | 1.123 | 1.192 | 1.297 | 1.331 | 1.365 | 1.21 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+------+---------+-------+
Load duration: 3.62791609764
Full duration: 16.2237439156
test scenario Quotas.neutron_update
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.396 | 0.426 | 0.572 | 0.581 | 0.591 | 0.464 | 100.0% | 10 |
| total | 0.553 | 0.575 | 0.773 | 0.834 | 0.896 | 0.64 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.80940699577
Full duration: 13.0895729065
test scenario Quotas.cinder_update_and_delete
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 1.145 | 1.182 | 1.365 | 1.407 | 1.449 | 1.234 | 100.0% | 10 |
| quotas.delete_quotas | 0.543 | 0.933 | 1.011 | 1.032 | 1.053 | 0.873 | 100.0% | 10 |
| total | 1.723 | 2.095 | 2.413 | 2.435 | 2.456 | 2.107 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 6.34634900093
Full duration: 18.2702391148
test scenario Quotas.nova_update_and_delete
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.544 | 0.621 | 0.695 | 0.705 | 0.716 | 0.619 | 100.0% | 10 |
| quotas.delete_quotas | 0.017 | 0.023 | 0.028 | 0.028 | 0.029 | 0.024 | 100.0% | 10 |
| total | 0.569 | 0.642 | 0.713 | 0.726 | 0.739 | 0.643 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.95026016235
Full duration: 13.2278659344
test scenario Quotas.nova_update
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.571 | 0.647 | 0.664 | 0.692 | 0.719 | 0.643 | 100.0% | 10 |
| total | 0.571 | 0.647 | 0.664 | 0.692 | 0.719 | 0.644 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.94177007675
Full duration: 13.6731410027
run_rally - INFO - Test scenario: "quotas" OK.
run_rally - INFO - Starting test scenario "requests" ...
run_rally - INFO -
Preparing input task
Task ee8c572e-1240-4996-a06f-801592da0277: started
Task ee8c572e-1240-4996-a06f-801592da0277: finished
test scenario HttpRequests.check_random_request
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| requests.check_request | 0.047 | 0.201 | 0.383 | 0.384 | 0.386 | 0.214 | 100.0% | 10 |
| total | 0.047 | 0.201 | 0.383 | 0.384 | 0.386 | 0.214 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.791751146317
Full duration: 5.66926693916
test scenario HttpRequests.check_request
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| requests.check_request | 0.044 | 0.046 | 0.052 | 0.052 | 0.053 | 0.048 | 100.0% | 10 |
| total | 0.044 | 0.046 | 0.052 | 0.052 | 0.053 | 0.048 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.181750059128
Full duration: 5.16227507591
run_rally - INFO - Test scenario: "requests" OK.
run_rally - INFO -
Rally Summary Report
+===================+============+===============+===========+
| Module | Duration | nb. Test Run | Success |
+===================+============+===============+===========+
| authenticate | 00:59 | 10 | 100.00% |
+-------------------+------------+---------------+-----------+
| glance | 03:38 | 7 | 100.00% |
+-------------------+------------+---------------+-----------+
| cinder | 22:59 | 50 | 100.00% |
+-------------------+------------+---------------+-----------+
| heat | 11:16 | 35 | 100.00% |
+-------------------+------------+---------------+-----------+
| keystone | 02:37 | 29 | 100.00% |
+-------------------+------------+---------------+-----------+
| neutron | 10:03 | 31 | 100.00% |
+-------------------+------------+---------------+-----------+
| nova | 47:41 | 61 | 100.00% |
+-------------------+------------+---------------+-----------+
| quotas | 01:14 | 7 | 100.00% |
+-------------------+------------+---------------+-----------+
| requests | 00:10 | 2 | 100.00% |
+-------------------+------------+---------------+-----------+
+===================+============+===============+===========+
| TOTAL: | 01:40:41 | 232 | 100.00% |
+===================+============+===============+===========+
Feature tests¶
vIMS¶
FUNCTEST.info: Running vIMS test...
vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
vIMS - INFO - Update OpenStack creds informations
vIMS - INFO - Upload some OS images if it doesn't exist
vIMS - INFO - centos_7 image doesn't exist on glance repository.
Try downloading this image and upload on glance !
vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
Try downloading this image and upload on glance !
vIMS - INFO - Update security group quota for this tenant
vIMS - INFO - Update cinder quota for this tenant
vIMS - INFO - Collect flavor id for cloudify manager server
vIMS - INFO - Prepare virtualenv for cloudify-cli
vIMS - INFO - Downloading the cloudify manager server blueprint
vIMS - INFO - Cloudify deployment Start Time:'2016-02-19 05:44:47'
vIMS - INFO - Writing the inputs file
vIMS - INFO - Launching the cloudify-manager deployment
vIMS - INFO - Cloudify-manager server is UP !
vIMS - INFO - Cloudify deployment duration:'1149.9'
vIMS - INFO - Collect flavor id for all clearwater vm
vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-19 06:04:00'
vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
vIMS - INFO - Writing the inputs file
vIMS - INFO - Launching the clearwater deployment
vIMS - INFO - The deployment of clearwater-opnfv is ended
vIMS - INFO - vIMS VNF deployment duration:'1133.8'
vIMS - INFO - vIMS functional test Start Time:'2016-02-19 06:25:59'
vIMS - INFO - vIMS functional test duration:'2.9'
vIMS - INFO - Launching the clearwater-opnfv undeployment
vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; '
vIMS - INFO - Launching the cloudify-manager undeployment
vIMS - INFO - Cloudify-manager server has been successfully removed!
vIMS - INFO - Removing vIMS tenant ..
vIMS - INFO - Removing vIMS user ..
Promise¶
FUNCTEST.info: Running PROMISE test case...
Promise- INFO - Creating tenant 'promise'...
Promise- INFO - Adding role '9d0a0a36d3d54cdcb4cd3c29c5f79a28' to tenant 'promise'...
Promise- INFO - Creating user 'promiser'...
Promise- INFO - Updating OpenStack credentials...
Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
Promise- INFO - Creating flavor 'promise-flavor'...
Promise- INFO - Exporting environment variables...
Promise- INFO - Running command: npm run -s test -- --reporter json
Promise- INFO - The test succeeded.
Promise- DEBUG -
{
"stats": {
"suites": 23,
"tests": 33,
"passes": 33,
"pending": 0,
"failures": 0,
"start": "2016-02-18T13:37:06.661Z",
"end": "2016-02-18T13:37:12.962Z",
"duration": 5524
},
"tests": [
{
"title": "should add a new OpenStack provider without error",
"fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
"duration": 1217,
"err": {}
},
{
"title": "should update promise.providers with a new entry",
"fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
"duration": 10,
"err": {}
},
{
"title": "should contain a new ResourceProvider record in the store",
"fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
"duration": 0,
"err": {}
},
{
"title": "should add more capacity to the reservation service without error",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
"duration": 25,
"err": {}
},
{
"title": "should update promise.pools with a new entry",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
"duration": 1,
"err": {}
},
{
"title": "should contain a ResourcePool record in the store",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
"duration": 0,
"err": {}
},
{
"title": "should report total collections and utilizations",
"fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
"duration": 18,
"err": {}
},
{
"title": "should contain newly added capacity pool",
"fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
"duration": 8,
"err": {}
},
{
"title": "should create a new server in target provider without error",
"fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
"duration": 1768,
"err": {}
},
{
"title": "should update promise.allocations with a new entry",
"fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
"duration": 2,
"err": {}
},
{
"title": "should contain a new ResourceAllocation record in the store",
"fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should reference the created server ID from the provider",
"fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
"duration": 1,
"err": {}
},
{
"title": "should have low priority state",
"fullTitle": "promise allocation without reservation create-instance should have low priority state",
"duration": 0,
"err": {}
},
{
"title": "should create reservation record (no start/end) without error",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
"duration": 41,
"err": {}
},
{
"title": "should update promise.reservations with a new entry",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
"duration": 7,
"err": {}
},
{
"title": "should contain a new ResourceReservation record in the store",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should create a new server in target provider (with reservation) without error",
"fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
"duration": 1617,
"err": {}
},
{
"title": "should contain a new ResourceAllocation record in the store",
"fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
"duration": 1,
"err": {}
},
{
"title": "should be referenced in the reservation record",
"fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
"duration": 7,
"err": {}
},
{
"title": "should have high priority state",
"fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
"duration": 0,
"err": {}
},
{
"title": "should create reservation record (for future) without error",
"fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
"duration": 75,
"err": {}
},
{
"title": "should update promise.reservations with a new entry",
"fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
"duration": 17,
"err": {}
},
{
"title": "should contain a new ResourceReservation record in the store",
"fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should contain newly created future reservation",
"fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
"duration": 61,
"err": {}
},
{
"title": "should modify existing reservation without error",
"fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
"duration": 65,
"err": {}
},
{
"title": "should modify existing reservation without error",
"fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
"duration": 17,
"err": {}
},
{
"title": "should no longer contain record of the deleted reservation",
"fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
"duration": 0,
"err": {}
},
{
"title": "should decrease available capacity from a provider in the future",
"fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
"duration": 15,
"err": {}
},
{
"title": "should increase available capacity from a provider in the future",
"fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
"duration": 11,
"err": {}
},
{
"title": "should report available collections and utilizations",
"fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
"duration": 56,
"err": {}
},
{
"title": "should fail to create immediate reservation record with proper error",
"fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
"duration": 60,
"err": {}
},
{
"title": "should fail to create future reservation record with proper error",
"fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
"duration": 38,
"err": {}
},
{
"title": "should successfully destroy all allocations",
"fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
"duration": 361,
"err": {}
}
],
"pending": [],
"failures": [],
"passes": [
{
"title": "should add a new OpenStack provider without error",
"fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
"duration": 1217,
"err": {}
},
{
"title": "should update promise.providers with a new entry",
"fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
"duration": 10,
"err": {}
},
{
"title": "should contain a new ResourceProvider record in the store",
"fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
"duration": 0,
"err": {}
},
{
"title": "should add more capacity to the reservation service without error",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
"duration": 25,
"err": {}
},
{
"title": "should update promise.pools with a new entry",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
"duration": 1,
"err": {}
},
{
"title": "should contain a ResourcePool record in the store",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
"duration": 0,
"err": {}
},
{
"title": "should report total collections and utilizations",
"fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
"duration": 18,
"err": {}
},
{
"title": "should contain newly added capacity pool",
"fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
"duration": 8,
"err": {}
},
{
"title": "should create a new server in target provider without error",
"fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
"duration": 1768,
"err": {}
},
{
"title": "should update promise.allocations with a new entry",
"fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
"duration": 2,
"err": {}
},
{
"title": "should contain a new ResourceAllocation record in the store",
"fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should reference the created server ID from the provider",
"fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
"duration": 1,
"err": {}
},
{
"title": "should have low priority state",
"fullTitle": "promise allocation without reservation create-instance should have low priority state",
"duration": 0,
"err": {}
},
{
"title": "should create reservation record (no start/end) without error",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
"duration": 41,
"err": {}
},
{
"title": "should update promise.reservations with a new entry",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
"duration": 7,
"err": {}
},
{
"title": "should contain a new ResourceReservation record in the store",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should create a new server in target provider (with reservation) without error",
"fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
"duration": 1617,
"err": {}
},
{
"title": "should contain a new ResourceAllocation record in the store",
"fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
"duration": 1,
"err": {}
},
{
"title": "should be referenced in the reservation record",
"fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
"duration": 7,
"err": {}
},
{
"title": "should have high priority state",
"fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
"duration": 0,
"err": {}
},
{
"title": "should create reservation record (for future) without error",
"fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
"duration": 75,
"err": {}
},
{
"title": "should update promise.reservations with a new entry",
"fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
"duration": 17,
"err": {}
},
{
"title": "should contain a new ResourceReservation record in the store",
"fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should contain newly created future reservation",
"fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
"duration": 61,
"err": {}
},
{
"title": "should modify existing reservation without error",
"fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
"duration": 65,
"err": {}
},
{
"title": "should modify existing reservation without error",
"fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
"duration": 17,
"err": {}
},
{
"title": "should no longer contain record of the deleted reservation",
"fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
"duration": 0,
"err": {}
},
{
"title": "should decrease available capacity from a provider in the future",
"fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
"duration": 15,
"err": {}
},
{
"title": "should increase available capacity from a provider in the future",
"fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
"duration": 11,
"err": {}
},
{
"title": "should report available collections and utilizations",
"fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
"duration": 56,
"err": {}
},
{
"title": "should fail to create immediate reservation record with proper error",
"fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
"duration": 60,
"err": {}
},
{
"title": "should fail to create future reservation record with proper error",
"fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
"duration": 38,
"err": {}
},
{
"title": "should successfully destroy all allocations",
"fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
"duration": 361,
"err": {}
}
]
}
Promise- INFO -
****************************************
Promise test report
****************************************
Suites: 23
Tests: 33
Passes: 33
Pending: 0
Failures: 0
Start: 2016-02-18T13:37:06.661Z
End: 2016-02-18T13:37:12.962Z
Duration: 6.301
****************************************
Detailed test results for fuel-os-nosdn-ovs-ha¶
VIM¶
vping_ssh¶
FUNCTEST.info: Running vPing-SSH test...
vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
vPing_ssh- INFO - Creating neutron network vping-net...
vPing_ssh- INFO - Creating security group 'vPing-sg'...
vPing_ssh- INFO - Using existing Flavor 'm1.small'...
vPing_ssh- INFO - vPing Start Time:'2016-02-18 13:27:35'
vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
name=opnfv-vping-1
flavor=<Flavor: m1.small>
image=fff41d5d-579a-4c26-844d-4e86700c44f6
network=a5137d46-dea8-4f85-8872-08c4a5927182
vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
name=opnfv-vping-2
flavor=<Flavor: m1.small>
image=fff41d5d-579a-4c26-844d-4e86700c44f6
network=a5137d46-dea8-4f85-8872-08c4a5927182
vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
vPing_ssh- INFO - Floating IP created: '10.118.101.200'
vPing_ssh- INFO - Associating floating ip: '10.118.101.200' to VM 'opnfv-vping-2'
vPing_ssh- INFO - Trying to establish SSH connection to 10.118.101.200...
vPing_ssh- INFO - Waiting for ping...
vPing_ssh- INFO - vPing detected!
vPing_ssh- INFO - vPing duration:'42.1' s.
vPing_ssh- INFO - Cleaning up...
vPing_ssh- INFO - vPing OK
vping_userdata¶
FUNCTEST.info: Running vPing-userdata test...
vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
vPing_userdata- INFO - Creating neutron network vping-net...
vPing_userdata- INFO - Creating security group 'vPing-sg'...
vPing_userdata- INFO - Flavor found 'm1.small'
vPing_userdata- INFO - vPing Start Time:'2016-02-18 13:29:00'
vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
name=opnfv-vping-1
flavor=<Flavor: m1.small>
image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
network=a1efb318-1338-436f-8f26-3a1bacab0538
vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
name=opnfv-vping-2
flavor=<Flavor: m1.small>
image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
network=a1efb318-1338-436f-8f26-3a1bacab0538
userdata=
#!/bin/sh
while true; do
ping -c 1 192.168.130.4 2>&1 >/dev/null
RES=$?
if [ "Z$RES" = "Z0" ] ; then
echo 'vPing OK'
break
else
echo 'vPing KO'
fi
sleep 1
done
vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
vPing_userdata- INFO - Waiting for ping...
vPing_userdata- INFO - vPing detected!
vPing_userdata- INFO - vPing duration:'28.6'
vPing_userdata- INFO - vPing OK
vPing_userdata- INFO - Cleaning up...
vPing_userdata- INFO - Deleting network 'vping-net'...
Tempest¶
+------------------------------------------------------------------------------------------------------------------------------------------+----------+---------+
| name | time | status |
+------------------------------------------------------------------------------------------------------------------------------------------+----------+---------+
| tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor | 0.42319 | success |
| tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors | 0.10399 | success |
| tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image | 21.61136 | success |
| tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image | 24.17689 | success |
| tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name | 44.97306 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since | 0.61967 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name | 0.61148 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id | 0.36880 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref | 0.97375 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status | 0.39432 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type | 0.62328 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results | 0.37363 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since | 0.61586 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name | 0.35380 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref | 0.67239 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status | 0.38634 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type | 1.05724 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results | 0.53191 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image | 1.18318 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images | 1.22600 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail | 1.02248 | success |
| tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create | 2.15108 | success |
| tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list | 3.32340 | success |
| tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete | 5.71240 | success |
| tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip | 16.19396 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details | 0.0 | fail |
| tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action | 0.08151 | success |
| tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions | 5.38225 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor | 0.30658 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image | 1.03364 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name | 0.55185 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status | 0.60722 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results | 0.61518 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor | 0.10976 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image | 0.10289 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit | 0.10607 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name | 0.09006 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status | 0.39571 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip | 0.55219 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex | 0.00134 | skip |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard | 0.20517 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date | 0.08353 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date | 0.01952 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits | 0.07490 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.11856 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value | 0.03290 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string | 0.04317 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor | 0.04307 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image | 0.08060 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name | 0.09867 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted | 0.31911 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing | 0.03124 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server | 0.10668 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server | 0.0 | fail |
| tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses | 0.11260 | success |
| tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network | 0.20834 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item | 0.75046 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item | 0.37893 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata | 0.36982 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata | 0.68314 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item | 0.57271 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata | 0.64458 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password | 4.92495 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair | 22.44224 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name | 30.13484 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address | 15.86074 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name | 12.98275 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name | 2.59054 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit | 3.72221 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 | 2.78814 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor | 1.60414 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image | 3.08274 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid | 2.16235 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant | 2.57737 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit | 1.46117 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id | 1.22501 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server | 1.11043 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address | 2.71277 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server | 1.10491 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server | 1.50933 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor | 0.94894 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor | 1.36216 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank | 1.57821 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server | 0.85906 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server | 1.81229 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 | 1.26423 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant | 1.39718 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name | 1.00093 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant | 0.29322 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect | 0.02099 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image | 0.64378 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails | 0.06226 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails | 0.83135 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails | 0.08382 | success |
| tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas | 0.30164 | success |
| tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas | 0.04541 | success |
| tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume | 0.0 | fail |
| tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list | 0.97480 | success |
| tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details | 1.05415 | success |
| tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id | 0.26485 | success |
| tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id | 0.02006 | success |
| tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services | 0.84845 | success |
| tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user | 0.0 | fail |
| tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete | 0.0 | fail |
| tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists | 0.10464 | success |
| tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain | 1.02679 | success |
| tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint | 0.64732 | success |
| tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete | 2.79302 | success |
| tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy | 0.0 | fail |
| tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id | 0.38635 | success |
| tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list | 0.0 | fail |
| tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service | 0.67061 | success |
| tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all | 2.34593 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.09899 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.08376 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.07817 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.10831 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.09626 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.09352 | success |
| tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params | 0.57765 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image | 1.66822 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file | 3.06984 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image | 3.62527 | success |
| tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions | 6.08457 | success |
| tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address | 2.35650 | success |
| tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip | 2.99120 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network | 1.72175 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port | 3.61046 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet | 4.54154 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network | 2.24168 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port | 3.49353 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet | 3.50686 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet | 3.20151 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility | 0.69691 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks | 0.39375 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets | 0.38459 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network | 0.29588 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet | 0.51586 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet | 2.70137 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility | 0.60901 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks | 0.31436 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets | 0.32710 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network | 0.05551 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet | 0.45609 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools | 3.05677 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups | 2.98082 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port | 1.63311 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports | 0.09653 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port | 0.35475 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools | 2.90406 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups | 3.62630 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port | 2.17609 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_list_ports | 0.37848 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_show_port | 0.09860 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces | 7.70778 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id | 4.78033 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id | 4.62080 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router | 3.61729 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces | 7.56892 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id | 4.67551 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id | 3.90091 | success |
| tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router | 2.96428 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group | 1.98439 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule | 3.83806 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups | 0.29228 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group | 2.05162 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule | 3.96419 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups | 0.36613 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list | 0.64793 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show | 6.64806 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template | 0.04923 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list | 1.42249 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata | 0.61494 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config | 0.64431 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate | 0.61515 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change | 0.79836 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change | 0.84027 | success |
| tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources | 3.71970 | success |
| tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds | 0.06703 | success |
| tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications | 15.64501 | success |
| tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications | 3.81335 | success |
| tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance | 3.28514 | success |
| tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance | 3.08361 | success |
| tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete | 13.04419 | success |
| tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image | 17.72121 | success |
| tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete | 15.46298 | success |
| tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image | 19.52032 | success |
| tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list | 0.06039 | success |
| tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list | 0.07579 | success |
| tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops | 56.52179 | success |
| tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops | 42.52437 | success |
| tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern | 81.46846 | fail |
| tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern | 72.34328 | fail |
+------------------------------------------------------------------------------------------------------------------------------------------+----------+---------+
run_tempest - INFO - Results: {'timestart': '2016-02-1602:24:40.738841', 'duration': 234, 'tests': 210, 'failures': 26}
Rally¶
FUNCTEST.info: Running Rally benchmark suite...
run_rally - INFO - Starting test scenario "authenticate" ...
run_rally - INFO -
Preparing input task
Task 3074958f-9ce1-47bc-9d9d-e78bc2233a68: started
Task 3074958f-9ce1-47bc-9d9d-e78bc2233a68: finished
test scenario Authenticate.validate_glance
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_glance | 0.519 | 0.582 | 0.614 | 0.616 | 0.619 | 0.577 | 100.0% | 10 |
| authenticate.validate_glance (2) | 0.318 | 0.548 | 0.621 | 0.699 | 0.777 | 0.557 | 100.0% | 10 |
| total | 1.086 | 1.305 | 1.37 | 1.467 | 1.563 | 1.307 | 100.0% | 10 |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.99583816528
Full duration: 11.4604001045
test scenario Authenticate.keystone
+-----------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
| total | 0.139 | 0.157 | 0.174 | 0.175 | 0.175 | 0.158 | 100.0% | 10 |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.509595870972
Full duration: 8.08681082726
test scenario Authenticate.validate_heat
+-----------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_heat | 0.281 | 0.3 | 0.407 | 0.408 | 0.409 | 0.322 | 100.0% | 10 |
| authenticate.validate_heat (2) | 0.049 | 0.288 | 0.309 | 0.343 | 0.377 | 0.254 | 100.0% | 10 |
| total | 0.474 | 0.756 | 0.876 | 0.883 | 0.89 | 0.748 | 100.0% | 10 |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.13345599174
Full duration: 9.90360093117
test scenario Authenticate.validate_nova
+-----------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_nova | 0.263 | 0.305 | 0.334 | 0.394 | 0.454 | 0.313 | 100.0% | 10 |
| authenticate.validate_nova (2) | 0.031 | 0.045 | 0.061 | 0.07 | 0.079 | 0.048 | 100.0% | 10 |
| total | 0.456 | 0.517 | 0.555 | 0.62 | 0.686 | 0.525 | 100.0% | 10 |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.58427906036
Full duration: 9.08766698837
test scenario Authenticate.validate_cinder
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_cinder | 0.279 | 0.31 | 0.336 | 0.384 | 0.433 | 0.316 | 100.0% | 10 |
| authenticate.validate_cinder (2) | 0.023 | 0.284 | 0.356 | 0.475 | 0.594 | 0.244 | 100.0% | 10 |
| total | 0.44 | 0.784 | 0.989 | 1.066 | 1.142 | 0.75 | 100.0% | 10 |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.06888413429
Full duration: 9.67203593254
test scenario Authenticate.validate_neutron
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_neutron | 0.279 | 0.333 | 0.347 | 0.348 | 0.348 | 0.328 | 100.0% | 10 |
| authenticate.validate_neutron (2) | 0.042 | 0.302 | 0.341 | 0.374 | 0.407 | 0.263 | 100.0% | 10 |
| total | 0.467 | 0.804 | 0.848 | 0.869 | 0.89 | 0.757 | 100.0% | 10 |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.20722603798
Full duration: 10.0450489521
run_rally - INFO - Test scenario: "authenticate" OK.
run_rally - INFO - Starting test scenario "glance" ...
run_rally - INFO -
Preparing input task
Task 2d256e70-85ea-4394-a6ef-c1bb7f56a349: started
Task 2d256e70-85ea-4394-a6ef-c1bb7f56a349: finished
test scenario GlanceImages.list_images
+---------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+------+--------+--------+--------+------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+------+--------+--------+--------+------+-------+---------+-------+
| glance.list_images | 0.69 | 0.754 | 0.845 | 0.853 | 0.86 | 0.771 | 100.0% | 10 |
| total | 0.69 | 0.754 | 0.845 | 0.853 | 0.86 | 0.771 | 100.0% | 10 |
+--------------------+------+--------+--------+--------+------+-------+---------+-------+
Load duration: 2.37443709373
Full duration: 12.192773819
test scenario GlanceImages.create_image_and_boot_instances
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| glance.create_image | 7.016 | 7.626 | 8.071 | 8.175 | 8.28 | 7.656 | 100.0% | 10 |
| nova.boot_servers | 14.247 | 15.398 | 16.507 | 16.622 | 16.737 | 15.457 | 100.0% | 10 |
| total | 21.583 | 22.978 | 23.909 | 24.335 | 24.761 | 23.114 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 68.0709619522
Full duration: 125.822338104
test scenario GlanceImages.create_and_list_image
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| glance.create_image | 7.021 | 7.699 | 9.045 | 14.322 | 19.599 | 8.763 | 100.0% | 10 |
| glance.list_images | 0.334 | 0.602 | 0.657 | 0.684 | 0.71 | 0.593 | 100.0% | 10 |
| total | 7.61 | 8.326 | 9.638 | 14.906 | 20.173 | 9.356 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 28.350317955
Full duration: 54.6049070358
test scenario GlanceImages.create_and_delete_image
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| glance.create_image | 7.113 | 7.689 | 7.945 | 7.946 | 7.948 | 7.622 | 100.0% | 10 |
| glance.delete_image | 1.846 | 2.236 | 3.676 | 9.026 | 14.377 | 3.407 | 100.0% | 10 |
| total | 9.452 | 9.823 | 11.494 | 16.81 | 22.126 | 11.029 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 31.6257281303
Full duration: 42.0794751644
run_rally - INFO - Test scenario: "glance" OK.
run_rally - INFO - Starting test scenario "cinder" ...
run_rally - INFO -
Preparing input task
Task 9f092186-5955-4467-948a-16d0404a8c2f: started
Task 9f092186-5955-4467-948a-16d0404a8c2f: finished
test scenario CinderVolumes.create_and_attach_volume
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 10.268 | 12.476 | 13.344 | 13.444 | 13.544 | 12.273 | 100.0% | 10 |
| cinder.create_volume | 3.181 | 3.689 | 3.924 | 4.051 | 4.178 | 3.675 | 100.0% | 10 |
| nova.attach_volume | 3.763 | 4.185 | 6.83 | 6.904 | 6.978 | 4.705 | 100.0% | 10 |
| nova.detach_volume | 3.274 | 3.884 | 4.469 | 4.48 | 4.491 | 3.865 | 100.0% | 10 |
| cinder.delete_volume | 0.598 | 2.89 | 3.108 | 3.229 | 3.351 | 2.513 | 100.0% | 10 |
| nova.delete_server | 2.824 | 3.112 | 3.135 | 3.142 | 3.15 | 3.06 | 100.0% | 10 |
| total | 28.505 | 29.774 | 31.521 | 31.648 | 31.774 | 30.091 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 89.9433991909
Full duration: 132.382716179
test scenario CinderVolumes.create_and_list_volume
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| cinder.create_volume | 9.263 | 9.593 | 10.234 | 10.313 | 10.391 | 9.735 | 100.0% | 10 |
| cinder.list_volumes | 0.073 | 0.334 | 0.502 | 0.51 | 0.517 | 0.325 | 100.0% | 10 |
| total | 9.347 | 9.982 | 10.562 | 10.633 | 10.704 | 10.06 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 30.0611338615
Full duration: 53.2253141403
test scenario CinderVolumes.create_and_list_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.693 | 3.995 | 4.393 | 4.446 | 4.498 | 4.011 | 100.0% | 10 |
| cinder.list_volumes | 0.073 | 0.365 | 0.473 | 0.503 | 0.532 | 0.334 | 100.0% | 10 |
| total | 3.792 | 4.367 | 4.739 | 4.852 | 4.964 | 4.345 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 13.0783438683
Full duration: 34.8268380165
test scenario CinderVolumes.create_and_list_snapshots
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_snapshot | 3.034 | 3.324 | 3.749 | 4.714 | 5.679 | 3.488 | 100.0% | 10 |
| cinder.list_snapshots | 0.027 | 0.306 | 0.324 | 0.326 | 0.329 | 0.227 | 100.0% | 10 |
| total | 3.132 | 3.417 | 4.072 | 5.033 | 5.994 | 3.715 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 10.4324269295
Full duration: 51.1932430267
test scenario CinderVolumes.create_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.495 | 3.952 | 4.201 | 4.213 | 4.224 | 3.929 | 100.0% | 10 |
| cinder.delete_volume | 0.559 | 2.729 | 3.265 | 3.327 | 3.389 | 2.111 | 100.0% | 10 |
| total | 4.352 | 6.379 | 7.367 | 7.421 | 7.476 | 6.04 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 18.7915260792
Full duration: 37.4740400314
test scenario CinderVolumes.create_and_delete_volume
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 9.153 | 9.894 | 10.152 | 10.17 | 10.189 | 9.798 | 100.0% | 10 |
| cinder.delete_volume | 0.563 | 0.972 | 3.341 | 3.425 | 3.51 | 1.572 | 100.0% | 10 |
| total | 9.717 | 10.853 | 13.493 | 13.596 | 13.699 | 11.371 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 31.9503250122
Full duration: 51.7525529861
test scenario CinderVolumes.create_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.461 | 3.688 | 4.442 | 4.444 | 4.447 | 3.838 | 100.0% | 10 |
| cinder.delete_volume | 0.493 | 0.917 | 3.039 | 3.183 | 3.328 | 1.504 | 100.0% | 10 |
| total | 4.048 | 4.704 | 7.416 | 7.425 | 7.434 | 5.343 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 16.7748939991
Full duration: 35.0109767914
test scenario CinderVolumes.create_and_upload_volume_to_image
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.474 | 3.728 | 4.034 | 4.158 | 4.283 | 3.802 | 100.0% | 10 |
| cinder.upload_volume_to_image | 16.739 | 27.612 | 32.627 | 32.648 | 32.669 | 26.268 | 100.0% | 10 |
| cinder.delete_volume | 0.914 | 2.817 | 3.041 | 3.073 | 3.105 | 2.347 | 100.0% | 10 |
| nova.delete_image | 2.403 | 2.717 | 2.8 | 2.899 | 2.999 | 2.685 | 100.0% | 10 |
| total | 26.184 | 36.276 | 42.076 | 42.091 | 42.105 | 35.103 | 100.0% | 10 |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 100.882842064
Full duration: 122.017296791
test scenario CinderVolumes.create_and_delete_snapshot
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_snapshot | 2.994 | 3.448 | 3.79 | 4.429 | 5.067 | 3.513 | 100.0% | 10 |
| cinder.delete_snapshot | 2.529 | 2.878 | 3.135 | 3.14 | 3.144 | 2.867 | 100.0% | 10 |
| total | 5.551 | 6.333 | 6.766 | 7.484 | 8.202 | 6.38 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 20.3024630547
Full duration: 53.5971570015
test scenario CinderVolumes.create_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.445 | 3.759 | 3.809 | 3.811 | 3.814 | 3.703 | 100.0% | 10 |
| total | 3.445 | 3.759 | 3.809 | 3.812 | 3.814 | 3.703 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 11.0321419239
Full duration: 28.9824199677
test scenario CinderVolumes.create_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.698 | 3.935 | 4.094 | 4.163 | 4.233 | 3.919 | 100.0% | 10 |
| total | 3.699 | 3.935 | 4.094 | 4.163 | 4.233 | 3.919 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 11.7128379345
Full duration: 34.5113909245
test scenario CinderVolumes.list_volumes
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.list_volumes | 0.491 | 0.525 | 0.554 | 0.555 | 0.556 | 0.529 | 100.0% | 10 |
| total | 0.491 | 0.525 | 0.554 | 0.555 | 0.556 | 0.529 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.63166594505
Full duration: 66.0012481213
test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.397 | 3.887 | 4.192 | 4.206 | 4.22 | 3.861 | 100.0% | 10 |
| cinder.create_snapshot | 2.867 | 3.153 | 3.188 | 3.25 | 3.311 | 3.111 | 100.0% | 10 |
| nova.attach_volume | 3.869 | 5.36 | 10.321 | 11.444 | 12.567 | 6.387 | 100.0% | 10 |
| nova.detach_volume | 3.309 | 3.955 | 4.207 | 4.268 | 4.33 | 3.843 | 100.0% | 10 |
| cinder.delete_snapshot | 2.26 | 2.629 | 2.904 | 3.051 | 3.199 | 2.668 | 100.0% | 10 |
| cinder.delete_volume | 0.553 | 2.446 | 2.844 | 2.938 | 3.033 | 1.903 | 100.0% | 10 |
| total | 18.664 | 22.016 | 27.546 | 29.149 | 30.752 | 22.899 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 67.0612659454
Full duration: 183.666878939
test scenario CinderVolumes.create_from_volume_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.553 | 3.919 | 4.193 | 4.206 | 4.219 | 3.896 | 100.0% | 10 |
| cinder.delete_volume | 2.698 | 3.101 | 3.447 | 3.564 | 3.682 | 3.136 | 100.0% | 10 |
| total | 6.251 | 7.071 | 7.484 | 7.564 | 7.645 | 7.032 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 21.0021979809
Full duration: 55.9390618801
test scenario CinderVolumes.create_and_extend_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.435 | 4.074 | 4.424 | 4.424 | 4.425 | 4.026 | 100.0% | 10 |
| cinder.extend_volume | 0.707 | 1.246 | 3.299 | 3.344 | 3.389 | 1.877 | 100.0% | 10 |
| cinder.delete_volume | 0.692 | 1.948 | 3.07 | 3.114 | 3.157 | 1.937 | 100.0% | 10 |
| total | 5.944 | 8.052 | 8.803 | 9.273 | 9.743 | 7.84 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 23.8975720406
Full duration: 43.0286390781
test scenario CinderVolumes.create_snapshot_and_attach_volume
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.311 | 3.828 | 3.963 | 3.983 | 4.004 | 3.796 | 100.0% | 10 |
| cinder.create_snapshot | 2.536 | 2.956 | 3.228 | 3.282 | 3.336 | 2.967 | 100.0% | 10 |
| nova.attach_volume | 3.854 | 4.422 | 6.403 | 6.702 | 7.002 | 4.856 | 100.0% | 10 |
| nova.detach_volume | 3.28 | 3.968 | 4.168 | 4.23 | 4.291 | 3.861 | 100.0% | 10 |
| cinder.delete_snapshot | 2.409 | 2.566 | 2.92 | 2.931 | 2.943 | 2.652 | 100.0% | 10 |
| cinder.delete_volume | 0.616 | 2.517 | 2.894 | 3.087 | 3.279 | 2.098 | 100.0% | 10 |
| total | 19.096 | 21.622 | 23.818 | 24.006 | 24.195 | 21.486 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 61.8816320896
Full duration: 192.880079985
test scenario CinderVolumes.create_snapshot_and_attach_volume
+-----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.008 | 3.875 | 4.246 | 4.262 | 4.278 | 3.77 | 100.0% | 10 |
| cinder.create_snapshot | 2.518 | 3.123 | 3.599 | 3.708 | 3.818 | 3.136 | 100.0% | 10 |
| nova.attach_volume | 3.945 | 5.453 | 7.683 | 8.854 | 10.024 | 5.87 | 100.0% | 10 |
| nova.detach_volume | 3.292 | 3.879 | 4.458 | 4.792 | 5.127 | 3.95 | 100.0% | 10 |
| cinder.delete_snapshot | 0.527 | 2.572 | 2.804 | 2.854 | 2.904 | 2.393 | 100.0% | 10 |
| cinder.delete_volume | 0.894 | 2.839 | 3.023 | 3.037 | 3.052 | 2.513 | 100.0% | 10 |
| total | 20.01 | 23.245 | 26.325 | 27.177 | 28.028 | 23.414 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 71.9912419319
Full duration: 203.27274704
run_rally - INFO - Test scenario: "cinder" OK.
run_rally - INFO - Starting test scenario "heat" ...
run_rally - INFO -
Preparing input task
Task f964ffc4-416b-4d44-b65d-29baeaea8bec: started
Task f964ffc4-416b-4d44-b65d-29baeaea8bec: finished
test scenario HeatStacks.create_suspend_resume_delete_stack
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 3.969 | 4.357 | 4.55 | 4.551 | 4.551 | 4.324 | 100.0% | 10 |
| heat.suspend_stack | 1.657 | 1.711 | 1.822 | 1.868 | 1.915 | 1.731 | 100.0% | 10 |
| heat.resume_stack | 1.437 | 1.616 | 1.637 | 1.648 | 1.658 | 1.574 | 100.0% | 10 |
| heat.delete_stack | 1.403 | 1.555 | 1.702 | 2.211 | 2.721 | 1.658 | 100.0% | 10 |
| total | 8.875 | 9.374 | 9.503 | 9.735 | 9.967 | 9.288 | 100.0% | 10 |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 27.5499420166
Full duration: 37.6667420864
test scenario HeatStacks.create_and_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 3.985 | 4.305 | 4.343 | 4.374 | 4.405 | 4.237 | 100.0% | 10 |
| heat.delete_stack | 1.379 | 1.455 | 1.484 | 1.487 | 1.489 | 1.447 | 100.0% | 10 |
| total | 5.451 | 5.729 | 5.798 | 5.812 | 5.826 | 5.683 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 17.0478360653
Full duration: 27.8095588684
test scenario HeatStacks.create_and_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 26.314 | 28.232 | 29.851 | 29.855 | 29.859 | 28.255 | 100.0% | 10 |
| heat.delete_stack | 10.7 | 11.864 | 12.929 | 12.939 | 12.949 | 12.051 | 100.0% | 10 |
| total | 38.29 | 40.481 | 41.719 | 41.722 | 41.725 | 40.306 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 120.330497026
Full duration: 130.361554861
test scenario HeatStacks.create_and_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 22.65 | 24.176 | 25.608 | 26.138 | 26.667 | 24.433 | 100.0% | 10 |
| heat.delete_stack | 10.59 | 11.212 | 11.949 | 12.486 | 13.022 | 11.332 | 100.0% | 10 |
| total | 33.338 | 36.173 | 37.277 | 37.282 | 37.287 | 35.765 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 105.698035955
Full duration: 115.92205596
test scenario HeatStacks.list_stacks_and_resources
+------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.list_stacks | 0.513 | 0.529 | 0.55 | 0.555 | 0.559 | 0.532 | 100.0% | 10 |
| heat.list_resources_of_0_stacks | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
| total | 0.513 | 0.529 | 0.55 | 0.555 | 0.56 | 0.532 | 100.0% | 10 |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.66571998596
Full duration: 10.2634401321
test scenario HeatStacks.create_update_delete_stack
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+--------+---------+-------+
| heat.create_stack | 3.891 | 4.318 | 4.491 | 4.525 | 4.559 | 4.283 | 100.0% | 10 |
| heat.update_stack | 3.532 | 3.653 | 3.805 | 3.849 | 3.893 | 3.669 | 100.0% | 10 |
| heat.delete_stack | 1.517 | 2.659 | 2.766 | 2.767 | 2.768 | 2.555 | 100.0% | 10 |
| total | 9.434 | 10.591 | 10.815 | 10.957 | 11.1 | 10.507 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+--------+---------+-------+
Load duration: 31.6606299877
Full duration: 41.6391699314
test scenario HeatStacks.create_update_delete_stack
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| heat.create_stack | 3.815 | 4.241 | 4.394 | 4.403 | 4.411 | 4.206 | 100.0% | 10 |
| heat.update_stack | 3.536 | 3.637 | 3.758 | 3.809 | 3.86 | 3.655 | 100.0% | 10 |
| heat.delete_stack | 1.359 | 1.407 | 1.693 | 2.128 | 2.563 | 1.55 | 100.0% | 10 |
| total | 9.067 | 9.301 | 9.655 | 10.15 | 10.645 | 9.412 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 27.7025399208
Full duration: 38.6538958549
test scenario HeatStacks.create_update_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 3.845 | 4.648 | 5.545 | 5.549 | 5.552 | 4.702 | 100.0% | 10 |
| heat.update_stack | 5.818 | 5.896 | 6.239 | 6.242 | 6.246 | 5.982 | 100.0% | 10 |
| heat.delete_stack | 2.479 | 2.526 | 2.59 | 2.606 | 2.623 | 2.537 | 100.0% | 10 |
| total | 12.651 | 13.069 | 13.902 | 13.942 | 13.981 | 13.221 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 39.0307080746
Full duration: 49.9186120033
test scenario HeatStacks.create_update_delete_stack
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
| heat.create_stack | 5.244 | 5.361 | 5.485 | 5.498 | 5.511 | 5.375 | 100.0% | 10 |
| heat.update_stack | 9.239 | 9.295 | 9.34 | 9.346 | 9.353 | 9.298 | 100.0% | 10 |
| heat.delete_stack | 3.643 | 3.694 | 3.736 | 3.74 | 3.745 | 3.697 | 100.0% | 10 |
| total | 18.262 | 18.349 | 18.503 | 18.508 | 18.514 | 18.37 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 55.1248130798
Full duration: 66.4681949615
test scenario HeatStacks.create_update_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 4.185 | 4.4 | 4.476 | 4.481 | 4.486 | 4.371 | 100.0% | 10 |
| heat.update_stack | 5.806 | 5.891 | 5.921 | 5.933 | 5.946 | 5.879 | 100.0% | 10 |
| heat.delete_stack | 2.512 | 2.569 | 2.622 | 2.626 | 2.629 | 2.572 | 100.0% | 10 |
| total | 12.536 | 12.853 | 12.946 | 12.953 | 12.959 | 12.821 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 38.3984200954
Full duration: 49.409635067
test scenario HeatStacks.create_update_delete_stack
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 3.99 | 4.405 | 4.621 | 4.622 | 4.623 | 4.393 | 100.0% | 10 |
| heat.update_stack | 3.536 | 3.563 | 3.779 | 3.832 | 3.885 | 3.624 | 100.0% | 10 |
| heat.delete_stack | 1.335 | 2.488 | 2.546 | 2.555 | 2.564 | 2.09 | 100.0% | 10 |
| total | 9.272 | 10.325 | 10.734 | 10.81 | 10.886 | 10.107 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 30.7103030682
Full duration: 41.7412381172
test scenario HeatStacks.create_and_list_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 4.146 | 4.271 | 4.393 | 4.448 | 4.504 | 4.284 | 100.0% | 10 |
| heat.list_stacks | 0.072 | 0.1 | 0.111 | 0.115 | 0.119 | 0.097 | 100.0% | 10 |
| total | 4.254 | 4.376 | 4.494 | 4.541 | 4.588 | 4.382 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 13.1074800491
Full duration: 29.5266339779
test scenario HeatStacks.create_check_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 3.907 | 4.192 | 4.293 | 4.364 | 4.435 | 4.155 | 100.0% | 10 |
| heat.check_stack | 0.745 | 1.525 | 1.901 | 1.922 | 1.944 | 1.529 | 100.0% | 10 |
| heat.delete_stack | 1.391 | 2.514 | 2.598 | 2.642 | 2.685 | 2.316 | 100.0% | 10 |
| total | 7.026 | 8.237 | 8.42 | 8.494 | 8.569 | 8.0 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 23.9746980667
Full duration: 35.3819260597
run_rally - INFO - Test scenario: "heat" OK.
run_rally - INFO - Starting test scenario "keystone" ...
run_rally - INFO -
Preparing input task
Task 66a8f673-a0ba-4559-8d8e-34457024edd9: started
Task 66a8f673-a0ba-4559-8d8e-34457024edd9: finished
test scenario KeystoneBasic.create_tenant_with_users
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.269 | 0.303 | 0.372 | 0.379 | 0.386 | 0.315 | 100.0% | 10 |
| keystone.create_users | 1.601 | 1.647 | 1.771 | 1.776 | 1.78 | 1.67 | 100.0% | 10 |
| total | 1.871 | 1.96 | 2.095 | 2.101 | 2.107 | 1.985 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 5.90541005135
Full duration: 21.2136161327
test scenario KeystoneBasic.create_add_and_list_user_roles
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.274 | 0.295 | 0.314 | 0.347 | 0.379 | 0.299 | 100.0% | 10 |
| keystone.add_role | 0.254 | 0.271 | 0.354 | 0.378 | 0.401 | 0.289 | 100.0% | 10 |
| keystone.list_roles | 0.133 | 0.141 | 0.154 | 0.155 | 0.155 | 0.142 | 100.0% | 10 |
| total | 0.673 | 0.705 | 0.811 | 0.828 | 0.844 | 0.73 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.21612095833
Full duration: 15.3072237968
test scenario KeystoneBasic.add_and_remove_user_role
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.278 | 0.365 | 0.443 | 0.457 | 0.472 | 0.359 | 100.0% | 10 |
| keystone.add_role | 0.262 | 0.275 | 0.348 | 0.352 | 0.356 | 0.291 | 100.0% | 10 |
| keystone.remove_role | 0.153 | 0.168 | 0.178 | 0.18 | 0.182 | 0.167 | 100.0% | 10 |
| total | 0.723 | 0.83 | 0.906 | 0.91 | 0.915 | 0.817 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.51204109192
Full duration: 15.9939908981
test scenario KeystoneBasic.create_update_and_delete_tenant
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.283 | 0.313 | 0.4 | 0.402 | 0.403 | 0.333 | 100.0% | 10 |
| keystone.update_tenant | 0.128 | 0.156 | 0.251 | 0.251 | 0.251 | 0.178 | 100.0% | 10 |
| keystone.delete_tenant | 0.307 | 0.356 | 0.433 | 0.451 | 0.469 | 0.365 | 100.0% | 10 |
| total | 0.775 | 0.886 | 0.937 | 0.975 | 1.013 | 0.876 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.67470407486
Full duration: 14.5480179787
test scenario KeystoneBasic.create_and_delete_service
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_service | 0.262 | 0.301 | 0.324 | 0.35 | 0.375 | 0.301 | 100.0% | 10 |
| keystone.delete_service | 0.136 | 0.163 | 0.181 | 0.209 | 0.236 | 0.165 | 100.0% | 10 |
| total | 0.413 | 0.47 | 0.521 | 0.522 | 0.524 | 0.467 | 100.0% | 10 |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.38856720924
Full duration: 12.6957240105
test scenario KeystoneBasic.create_tenant
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.275 | 0.301 | 0.313 | 0.324 | 0.335 | 0.299 | 100.0% | 10 |
| total | 0.276 | 0.301 | 0.313 | 0.324 | 0.335 | 0.299 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.917107105255
Full duration: 8.57450699806
test scenario KeystoneBasic.create_user
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_user | 0.287 | 0.309 | 0.394 | 0.408 | 0.422 | 0.331 | 100.0% | 10 |
| total | 0.287 | 0.31 | 0.394 | 0.408 | 0.422 | 0.331 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.01195383072
Full duration: 9.76411700249
test scenario KeystoneBasic.create_and_list_tenants
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.29 | 0.31 | 0.33 | 0.331 | 0.332 | 0.311 | 100.0% | 10 |
| keystone.list_tenants | 0.122 | 0.138 | 0.16 | 0.194 | 0.229 | 0.146 | 100.0% | 10 |
| total | 0.422 | 0.451 | 0.492 | 0.525 | 0.558 | 0.457 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.38993692398
Full duration: 15.0407979488
test scenario KeystoneBasic.create_and_delete_role
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.29 | 0.367 | 0.474 | 0.501 | 0.528 | 0.374 | 100.0% | 10 |
| keystone.delete_role | 0.276 | 0.317 | 0.52 | 0.54 | 0.561 | 0.362 | 100.0% | 10 |
| total | 0.572 | 0.704 | 0.994 | 1.042 | 1.089 | 0.737 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.35643291473
Full duration: 13.3514738083
test scenario KeystoneBasic.get_entities
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.266 | 0.31 | 0.344 | 0.369 | 0.393 | 0.313 | 100.0% | 10 |
| keystone.create_user | 0.137 | 0.157 | 0.169 | 0.174 | 0.179 | 0.158 | 100.0% | 10 |
| keystone.create_role | 0.124 | 0.142 | 0.164 | 0.199 | 0.234 | 0.151 | 100.0% | 10 |
| keystone.get_tenant | 0.112 | 0.129 | 0.147 | 0.149 | 0.15 | 0.13 | 100.0% | 10 |
| keystone.get_user | 0.126 | 0.135 | 0.148 | 0.15 | 0.153 | 0.137 | 100.0% | 10 |
| keystone.get_role | 0.116 | 0.127 | 0.143 | 0.156 | 0.169 | 0.131 | 100.0% | 10 |
| keystone.service_list | 0.117 | 0.135 | 0.218 | 0.224 | 0.23 | 0.152 | 100.0% | 10 |
| keystone.get_service | 0.12 | 0.13 | 0.172 | 0.197 | 0.221 | 0.141 | 100.0% | 10 |
| total | 1.204 | 1.319 | 1.391 | 1.394 | 1.398 | 1.315 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.94662213326
Full duration: 21.1036419868
test scenario KeystoneBasic.create_and_list_users
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_user | 0.28 | 0.313 | 0.343 | 0.364 | 0.385 | 0.32 | 100.0% | 10 |
| keystone.list_users | 0.123 | 0.141 | 0.158 | 0.197 | 0.235 | 0.148 | 100.0% | 10 |
| total | 0.43 | 0.461 | 0.516 | 0.53 | 0.545 | 0.468 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.41474604607
Full duration: 9.85008382797
run_rally - INFO - Test scenario: "keystone" OK.
run_rally - INFO - Starting test scenario "neutron" ...
run_rally - INFO -
Preparing input task
Task 2ead843e-f4d1-4ee2-a635-0d37175e3c39: started
Task 2ead843e-f4d1-4ee2-a635-0d37175e3c39: finished
test scenario NeutronNetworks.create_and_delete_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.788 | 0.834 | 0.941 | 0.962 | 0.984 | 0.854 | 100.0% | 10 |
| neutron.delete_port | 0.229 | 0.625 | 0.757 | 0.814 | 0.871 | 0.637 | 100.0% | 10 |
| total | 1.057 | 1.507 | 1.702 | 1.707 | 1.712 | 1.492 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.537129879
Full duration: 55.4609839916
test scenario NeutronNetworks.create_and_list_routers
+---------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.706 | 0.789 | 0.991 | 0.992 | 0.992 | 0.825 | 100.0% | 10 |
| neutron.create_router | 0.068 | 0.482 | 0.587 | 0.666 | 0.746 | 0.47 | 100.0% | 10 |
| neutron.add_interface_router | 0.711 | 0.784 | 0.907 | 1.031 | 1.155 | 0.817 | 100.0% | 10 |
| neutron.list_routers | 0.417 | 0.467 | 0.513 | 0.54 | 0.567 | 0.474 | 100.0% | 10 |
| total | 2.404 | 2.525 | 2.859 | 2.897 | 2.934 | 2.587 | 100.0% | 10 |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 7.67870306969
Full duration: 58.1500780582
test scenario NeutronNetworks.create_and_delete_routers
+------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.749 | 0.813 | 0.872 | 0.875 | 0.878 | 0.816 | 100.0% | 10 |
| neutron.create_router | 0.06 | 0.463 | 0.517 | 0.53 | 0.544 | 0.435 | 100.0% | 10 |
| neutron.add_interface_router | 0.335 | 0.772 | 0.867 | 0.868 | 0.869 | 0.707 | 100.0% | 10 |
| neutron.remove_interface_router | 0.341 | 0.691 | 0.901 | 0.916 | 0.93 | 0.69 | 100.0% | 10 |
| neutron.delete_router | 0.553 | 0.682 | 0.838 | 0.854 | 0.87 | 0.686 | 100.0% | 10 |
| total | 2.946 | 3.271 | 3.758 | 3.795 | 3.832 | 3.335 | 100.0% | 10 |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 9.81285190582
Full duration: 60.2574419975
test scenario NeutronNetworks.create_and_list_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.81 | 0.883 | 0.976 | 0.981 | 0.987 | 0.89 | 100.0% | 10 |
| neutron.list_ports | 0.563 | 0.626 | 0.776 | 0.827 | 0.877 | 0.652 | 100.0% | 10 |
| total | 1.398 | 1.535 | 1.661 | 1.723 | 1.785 | 1.542 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.79494190216
Full duration: 57.4564638138
test scenario NeutronNetworks.create_and_delete_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.782 | 0.868 | 0.944 | 0.944 | 0.945 | 0.867 | 100.0% | 10 |
| neutron.delete_subnet | 0.579 | 0.66 | 0.806 | 0.813 | 0.82 | 0.679 | 100.0% | 10 |
| total | 1.374 | 1.515 | 1.721 | 1.735 | 1.75 | 1.546 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.67370796204
Full duration: 54.8155629635
test scenario NeutronNetworks.create_and_delete_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.617 | 0.701 | 0.786 | 0.79 | 0.794 | 0.702 | 100.0% | 10 |
| neutron.delete_network | 0.516 | 0.595 | 0.635 | 0.66 | 0.685 | 0.592 | 100.0% | 10 |
| total | 1.156 | 1.302 | 1.382 | 1.392 | 1.401 | 1.294 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.91053414345
Full duration: 34.4190309048
test scenario NeutronNetworks.create_and_list_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.605 | 0.698 | 0.893 | 0.897 | 0.901 | 0.723 | 100.0% | 10 |
| neutron.list_networks | 0.403 | 0.422 | 0.518 | 0.522 | 0.526 | 0.44 | 100.0% | 10 |
| total | 1.013 | 1.156 | 1.315 | 1.315 | 1.315 | 1.163 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.48294115067
Full duration: 36.022400856
test scenario NeutronNetworks.create_and_update_routers
+---------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.749 | 0.82 | 0.85 | 0.884 | 0.919 | 0.816 | 100.0% | 10 |
| neutron.create_router | 0.077 | 0.47 | 0.6 | 0.73 | 0.861 | 0.482 | 100.0% | 10 |
| neutron.add_interface_router | 0.362 | 0.752 | 0.811 | 0.858 | 0.904 | 0.692 | 100.0% | 10 |
| neutron.update_router | 0.206 | 0.635 | 0.668 | 0.68 | 0.691 | 0.554 | 100.0% | 10 |
| total | 1.848 | 2.659 | 2.876 | 3.008 | 3.14 | 2.544 | 100.0% | 10 |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 7.22650980949
Full duration: 60.5388588905
test scenario NeutronNetworks.create_and_update_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.654 | 0.724 | 0.888 | 0.911 | 0.934 | 0.756 | 100.0% | 10 |
| neutron.update_network | 0.145 | 0.545 | 0.569 | 0.59 | 0.611 | 0.502 | 100.0% | 10 |
| total | 1.018 | 1.265 | 1.427 | 1.431 | 1.436 | 1.258 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.75120806694
Full duration: 35.950884819
test scenario NeutronNetworks.create_and_update_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.814 | 0.896 | 0.995 | 1.01 | 1.024 | 0.896 | 100.0% | 10 |
| neutron.update_port | 0.181 | 0.562 | 0.612 | 0.65 | 0.689 | 0.537 | 100.0% | 10 |
| total | 0.995 | 1.461 | 1.585 | 1.597 | 1.608 | 1.433 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.42992901802
Full duration: 55.774241209
test scenario NeutronNetworks.create_and_list_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.726 | 0.805 | 1.041 | 1.045 | 1.049 | 0.845 | 100.0% | 10 |
| neutron.list_subnets | 0.053 | 0.422 | 0.446 | 0.446 | 0.446 | 0.353 | 100.0% | 10 |
| total | 0.861 | 1.221 | 1.458 | 1.458 | 1.458 | 1.199 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.38276219368
Full duration: 55.0756671429
test scenario NeutronNetworks.create_and_update_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.731 | 0.802 | 0.891 | 0.923 | 0.954 | 0.814 | 100.0% | 10 |
| neutron.update_subnet | 0.186 | 0.573 | 0.629 | 0.662 | 0.694 | 0.455 | 100.0% | 10 |
| total | 0.962 | 1.374 | 1.524 | 1.533 | 1.543 | 1.27 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.90665698051
Full duration: 56.0127599239
run_rally - INFO - Test scenario: "neutron" OK.
run_rally - INFO - Starting test scenario "nova" ...
run_rally - INFO -
Preparing input task
Task 63203b68-fb0f-4190-b881-339d49343b7e: started
Task 63203b68-fb0f-4190-b881-339d49343b7e: finished
test scenario NovaKeypair.create_and_delete_keypair
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.create_keypair | 0.701 | 0.818 | 0.937 | 1.171 | 1.406 | 0.867 | 100.0% | 10 |
| nova.delete_keypair | 0.032 | 0.044 | 0.06 | 0.062 | 0.065 | 0.046 | 100.0% | 10 |
| total | 0.733 | 0.862 | 0.986 | 1.228 | 1.471 | 0.913 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.58676719666
Full duration: 44.6176929474
test scenario NovaServers.snapshot_server
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 13.231 | 15.082 | 16.288 | 16.485 | 16.681 | 15.005 | 100.0% | 10 |
| nova.create_image | 11.557 | 12.205 | 14.231 | 14.559 | 14.887 | 12.815 | 100.0% | 10 |
| nova.delete_server | 2.824 | 3.432 | 3.623 | 3.636 | 3.649 | 3.306 | 100.0% | 10 |
| nova.boot_server (2) | 11.125 | 13.278 | 14.799 | 15.311 | 15.823 | 13.287 | 100.0% | 10 |
| nova.delete_server (2) | 2.504 | 2.94 | 3.422 | 3.44 | 3.457 | 3.055 | 100.0% | 10 |
| nova.delete_image | 2.668 | 3.276 | 3.598 | 3.634 | 3.669 | 3.259 | 100.0% | 10 |
| total | 47.925 | 50.051 | 54.553 | 54.844 | 55.135 | 50.728 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 149.159065008
Full duration: 223.027470827
test scenario NovaKeypair.boot_and_delete_server_with_keypair
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_keypair | 0.681 | 0.807 | 0.953 | 1.005 | 1.056 | 0.813 | 100.0% | 10 |
| nova.boot_server | 12.625 | 13.795 | 14.626 | 14.992 | 15.358 | 13.92 | 100.0% | 10 |
| nova.delete_server | 2.895 | 3.252 | 3.838 | 4.433 | 5.028 | 3.378 | 100.0% | 10 |
| nova.delete_keypair | 0.041 | 0.049 | 0.084 | 0.2 | 0.316 | 0.076 | 100.0% | 10 |
| total | 16.437 | 18.013 | 19.364 | 19.978 | 20.591 | 18.187 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 54.020512104
Full duration: 122.761439085
test scenario NovaKeypair.create_and_list_keypairs
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.create_keypair | 0.633 | 0.811 | 0.88 | 0.945 | 1.01 | 0.797 | 100.0% | 10 |
| nova.list_keypairs | 0.019 | 0.032 | 0.048 | 0.057 | 0.065 | 0.034 | 100.0% | 10 |
| total | 0.663 | 0.833 | 0.925 | 0.988 | 1.051 | 0.831 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.51079297066
Full duration: 45.2959558964
test scenario NovaServers.list_servers
+---------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+------+-------+---------+-------+
| nova.list_servers | 1.153 | 1.561 | 1.667 | 1.699 | 1.73 | 1.534 | 100.0% | 10 |
| total | 1.153 | 1.562 | 1.667 | 1.699 | 1.73 | 1.534 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+------+-------+---------+-------+
Load duration: 4.51852703094
Full duration: 136.974627972
test scenario NovaServers.resize_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 12.504 | 13.59 | 14.825 | 15.228 | 15.63 | 13.671 | 100.0% | 10 |
| nova.resize | 41.099 | 42.204 | 47.49 | 47.556 | 47.621 | 44.023 | 100.0% | 10 |
| nova.resize_confirm | 2.651 | 3.698 | 3.805 | 4.059 | 4.314 | 3.556 | 100.0% | 10 |
| nova.delete_server | 2.631 | 3.022 | 3.411 | 4.443 | 5.475 | 3.21 | 100.0% | 10 |
| total | 60.59 | 62.713 | 69.597 | 69.873 | 70.149 | 64.46 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 192.511741161
Full duration: 232.632377863
test scenario NovaServers.boot_server_from_volume_and_delete
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 9.605 | 10.39 | 10.671 | 10.678 | 10.685 | 10.283 | 100.0% | 10 |
| nova.boot_server | 13.194 | 15.101 | 15.844 | 16.008 | 16.171 | 15.084 | 100.0% | 10 |
| nova.delete_server | 5.067 | 5.835 | 6.025 | 6.147 | 6.269 | 5.704 | 100.0% | 10 |
| total | 29.712 | 31.089 | 31.863 | 32.17 | 32.477 | 31.072 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 93.8591198921
Full duration: 176.781407833
test scenario NovaServers.boot_and_migrate_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 12.007 | 12.628 | 15.251 | 15.726 | 16.2 | 13.337 | 100.0% | 10 |
| nova.stop_server | 5.734 | 6.679 | 7.157 | 7.198 | 7.239 | 6.643 | 100.0% | 10 |
| nova.migrate | 11.005 | 12.115 | 12.764 | 12.898 | 13.031 | 12.041 | 100.0% | 10 |
| nova.resize_confirm | 2.991 | 3.639 | 4.391 | 5.442 | 6.493 | 3.866 | 100.0% | 10 |
| nova.delete_server | 2.512 | 2.889 | 3.089 | 3.162 | 3.235 | 2.846 | 100.0% | 10 |
| total | 36.009 | 38.096 | 41.114 | 42.08 | 43.046 | 38.733 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 117.547358036
Full duration: 158.547077894
test scenario NovaServers.boot_and_delete_server
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 12.11 | 12.864 | 14.437 | 14.962 | 15.486 | 13.148 | 100.0% | 10 |
| nova.delete_server | 2.855 | 3.146 | 3.605 | 3.624 | 3.644 | 3.198 | 100.0% | 10 |
| total | 15.189 | 15.944 | 18.012 | 18.222 | 18.433 | 16.346 | 100.0% | 10 |
+--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 47.4842679501
Full duration: 115.855407953
test scenario NovaServers.boot_and_rebuild_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 11.096 | 13.966 | 14.767 | 14.775 | 14.783 | 13.664 | 100.0% | 10 |
| nova.rebuild_server | 12.012 | 14.475 | 15.049 | 15.15 | 15.252 | 14.233 | 100.0% | 10 |
| nova.delete_server | 2.573 | 2.99 | 3.499 | 4.34 | 5.181 | 3.213 | 100.0% | 10 |
| total | 28.419 | 30.951 | 32.946 | 34.081 | 35.216 | 31.111 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 91.1762368679
Full duration: 160.48626709
test scenario NovaSecGroup.create_and_list_secgroups
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 4.384 | 5.131 | 5.534 | 5.638 | 5.741 | 5.066 | 100.0% | 10 |
| nova.create_100_rules | 42.262 | 43.319 | 44.707 | 45.482 | 46.258 | 43.582 | 100.0% | 10 |
| nova.list_security_groups | 0.18 | 0.248 | 0.52 | 0.602 | 0.685 | 0.299 | 100.0% | 10 |
| total | 47.342 | 48.922 | 49.657 | 50.789 | 51.921 | 48.948 | 100.0% | 10 |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 145.205770016
Full duration: 212.670469999
test scenario NovaSecGroup.create_and_delete_secgroups
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 3.797 | 4.842 | 5.428 | 5.548 | 5.668 | 4.805 | 100.0% | 10 |
| nova.create_100_rules | 42.897 | 43.258 | 45.74 | 45.781 | 45.822 | 43.845 | 100.0% | 10 |
| nova.delete_10_security_groups | 1.712 | 2.272 | 2.576 | 2.63 | 2.685 | 2.249 | 100.0% | 10 |
| total | 49.862 | 50.866 | 51.896 | 52.159 | 52.422 | 50.9 | 100.0% | 10 |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 153.145931959
Full duration: 195.681600094
test scenario NovaServers.boot_and_bounce_server
+-------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 12.233 | 14.014 | 14.779 | 15.28 | 15.781 | 13.878 | 100.0% | 10 |
| nova.reboot_server | 5.429 | 5.857 | 6.286 | 6.298 | 6.31 | 5.906 | 100.0% | 10 |
| nova.soft_reboot_server | 7.965 | 8.388 | 8.771 | 8.786 | 8.801 | 8.365 | 100.0% | 10 |
| nova.stop_server | 4.492 | 6.237 | 6.84 | 6.896 | 6.952 | 6.14 | 100.0% | 10 |
| nova.start_server | 3.528 | 4.271 | 5.459 | 5.844 | 6.229 | 4.465 | 100.0% | 10 |
| nova.rescue_server | 7.297 | 8.174 | 10.803 | 11.337 | 11.872 | 8.852 | 100.0% | 10 |
| nova.unrescue_server | 5.397 | 5.465 | 5.755 | 5.956 | 6.158 | 5.563 | 100.0% | 10 |
| nova.delete_server | 2.694 | 2.967 | 3.17 | 3.266 | 3.362 | 2.999 | 100.0% | 10 |
| total | 53.124 | 55.752 | 58.931 | 59.472 | 60.013 | 56.189 | 100.0% | 10 |
+-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 166.732338905
Full duration: 235.669921875
test scenario NovaServers.boot_server
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------+--------+--------+--------+--------+------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------+--------+--------+--------+--------+------+--------+---------+-------+
| nova.boot_server | 12.435 | 13.902 | 14.341 | 14.37 | 14.4 | 13.679 | 100.0% | 10 |
| total | 12.435 | 13.903 | 14.341 | 14.37 | 14.4 | 13.679 | 100.0% | 10 |
+------------------+--------+--------+--------+--------+------+--------+---------+-------+
Load duration: 40.4824538231
Full duration: 98.6827569008
test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 4.34 | 5.246 | 5.496 | 5.585 | 5.675 | 5.171 | 100.0% | 10 |
| nova.create_100_rules | 41.95 | 43.077 | 44.37 | 44.812 | 45.253 | 43.236 | 100.0% | 10 |
| nova.boot_server | 10.869 | 11.908 | 13.524 | 13.633 | 13.742 | 12.265 | 100.0% | 10 |
| nova.get_attached_security_groups | 0.224 | 0.267 | 0.504 | 0.555 | 0.607 | 0.332 | 100.0% | 10 |
| nova.delete_server | 2.533 | 2.618 | 3.078 | 3.091 | 3.103 | 2.742 | 100.0% | 10 |
| nova.delete_10_security_groups | 1.637 | 1.754 | 2.383 | 2.591 | 2.798 | 1.972 | 100.0% | 10 |
| total | 64.243 | 65.856 | 66.932 | 67.145 | 67.358 | 65.721 | 100.0% | 10 |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 197.864094019
Full duration: 266.162395
test scenario NovaServers.pause_and_unpause_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 12.223 | 14.903 | 15.571 | 15.708 | 15.844 | 14.546 | 100.0% | 10 |
| nova.pause_server | 2.791 | 3.173 | 3.334 | 3.379 | 3.424 | 3.141 | 100.0% | 10 |
| nova.unpause_server | 2.459 | 2.849 | 3.186 | 3.266 | 3.346 | 2.907 | 100.0% | 10 |
| nova.delete_server | 2.863 | 3.13 | 3.335 | 3.403 | 3.47 | 3.121 | 100.0% | 10 |
| total | 20.391 | 24.232 | 24.74 | 24.758 | 24.775 | 23.717 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 72.4143497944
Full duration: 139.801489115
test scenario NovaServers.boot_server_from_volume
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 9.672 | 10.675 | 10.972 | 11.222 | 11.472 | 10.543 | 100.0% | 10 |
| nova.boot_server | 14.233 | 16.466 | 17.095 | 17.399 | 17.704 | 16.109 | 100.0% | 10 |
| total | 23.906 | 27.176 | 27.879 | 28.21 | 28.54 | 26.653 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 79.5798490047
Full duration: 145.711636782
test scenario NovaServers.boot_and_list_server
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 12.064 | 14.109 | 15.049 | 15.436 | 15.823 | 13.885 | 100.0% | 10 |
| nova.list_servers | 0.612 | 0.992 | 1.197 | 1.199 | 1.201 | 0.948 | 100.0% | 10 |
| total | 13.261 | 15.082 | 15.982 | 16.209 | 16.435 | 14.833 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 43.442057848
Full duration: 128.433704138
run_rally - INFO - Test scenario: "nova" OK.
run_rally - INFO - Starting test scenario "quotas" ...
run_rally - INFO -
Preparing input task
Task f60014e7-4880-41c6-afbc-ea7d18ef56e0: started
Task f60014e7-4880-41c6-afbc-ea7d18ef56e0: finished
test scenario Quotas.cinder_update
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 1.111 | 1.203 | 1.671 | 1.682 | 1.692 | 1.279 | 100.0% | 10 |
| total | 1.111 | 1.203 | 1.671 | 1.682 | 1.692 | 1.279 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.63238286972
Full duration: 15.5500700474
test scenario Quotas.neutron_update
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.392 | 0.43 | 0.632 | 0.65 | 0.667 | 0.482 | 100.0% | 10 |
| total | 0.555 | 0.597 | 0.799 | 0.808 | 0.816 | 0.64 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.90143704414
Full duration: 12.9954409599
test scenario Quotas.cinder_update_and_delete
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 1.086 | 1.207 | 1.358 | 1.436 | 1.513 | 1.228 | 100.0% | 10 |
| quotas.delete_quotas | 0.549 | 0.88 | 0.94 | 0.951 | 0.963 | 0.839 | 100.0% | 10 |
| total | 1.654 | 2.078 | 2.316 | 2.37 | 2.424 | 2.067 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 6.08279585838
Full duration: 18.0140779018
test scenario Quotas.nova_update_and_delete
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.573 | 0.62 | 0.652 | 0.658 | 0.664 | 0.619 | 100.0% | 10 |
| quotas.delete_quotas | 0.016 | 0.025 | 0.028 | 0.032 | 0.036 | 0.024 | 100.0% | 10 |
| total | 0.599 | 0.642 | 0.678 | 0.68 | 0.681 | 0.643 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.95340800285
Full duration: 13.6638329029
test scenario Quotas.nova_update
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.575 | 0.616 | 0.669 | 0.681 | 0.692 | 0.622 | 100.0% | 10 |
| total | 0.575 | 0.616 | 0.669 | 0.681 | 0.692 | 0.622 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.90668487549
Full duration: 13.5694701672
run_rally - INFO - Test scenario: "quotas" OK.
run_rally - INFO - Starting test scenario "requests" ...
run_rally - INFO -
Preparing input task
Task 3835bbc7-faf5-4671-9261-aa07c1d6a1e2: started
Task 3835bbc7-faf5-4671-9261-aa07c1d6a1e2: finished
test scenario HttpRequests.check_random_request
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| requests.check_request | 5.049 | 5.088 | 5.34 | 5.361 | 5.381 | 5.151 | 100.0% | 10 |
| total | 5.049 | 5.088 | 5.34 | 5.361 | 5.381 | 5.151 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 15.4988431931
Full duration: 20.5546550751
test scenario HttpRequests.check_request
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| requests.check_request | 5.048 | 5.052 | 5.057 | 5.058 | 5.058 | 5.053 | 100.0% | 10 |
| total | 5.048 | 5.052 | 5.057 | 5.058 | 5.058 | 5.053 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 15.2044279575
Full duration: 20.1352801323
run_rally - INFO - Test scenario: "requests" OK.
run_rally - INFO -
Rally Summary Report
+===================+============+===============+===========+
| Module | Duration | nb. Test Run | Success |
+===================+============+===============+===========+
| authenticate | 00:58 | 10 | 100.00% |
+-------------------+------------+---------------+-----------+
| glance | 03:54 | 7 | 100.00% |
+-------------------+------------+---------------+-----------+
| cinder | 22:59 | 50 | 100.00% |
+-------------------+------------+---------------+-----------+
| heat | 11:14 | 35 | 100.00% |
+-------------------+------------+---------------+-----------+
| keystone | 02:37 | 29 | 100.00% |
+-------------------+------------+---------------+-----------+
| neutron | 10:19 | 31 | 100.00% |
+-------------------+------------+---------------+-----------+
| nova | 47:19 | 61 | 100.00% |
+-------------------+------------+---------------+-----------+
| quotas | 01:13 | 7 | 100.00% |
+-------------------+------------+---------------+-----------+
| requests | 00:40 | 2 | 100.00% |
+-------------------+------------+---------------+-----------+
+===================+============+===============+===========+
| TOTAL: | 01:41:19 | 232 | 100.00% |
+===================+============+===============+===========+
Feature tests¶
vIMS¶
FUNCTEST.info: Running vIMS test...
vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
vIMS - INFO - Update OpenStack creds informations
vIMS - INFO - Upload some OS images if it doesn't exist
vIMS - INFO - centos_7 image doesn't exist on glance repository.
Try downloading this image and upload on glance !
vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
Try downloading this image and upload on glance !
vIMS - INFO - Update security group quota for this tenant
vIMS - INFO - Update cinder quota for this tenant
vIMS - INFO - Collect flavor id for cloudify manager server
vIMS - INFO - Prepare virtualenv for cloudify-cli
vIMS - INFO - Downloading the cloudify manager server blueprint
vIMS - INFO - Cloudify deployment Start Time:'2016-02-19 05:44:47'
vIMS - INFO - Writing the inputs file
vIMS - INFO - Launching the cloudify-manager deployment
vIMS - INFO - Cloudify-manager server is UP !
vIMS - INFO - Cloudify deployment duration:'1149.9'
vIMS - INFO - Collect flavor id for all clearwater vm
vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-19 06:04:00'
vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
vIMS - INFO - Writing the inputs file
vIMS - INFO - Launching the clearwater deployment
vIMS - INFO - The deployment of clearwater-opnfv is ended
vIMS - INFO - vIMS VNF deployment duration:'1133.8'
vIMS - INFO - vIMS functional test Start Time:'2016-02-19 06:25:59'
vIMS - INFO - vIMS functional test duration:'2.9'
vIMS - INFO - Launching the clearwater-opnfv undeployment
vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; '
vIMS - INFO - Launching the cloudify-manager undeployment
vIMS - INFO - Cloudify-manager server has been successfully removed!
vIMS - INFO - Removing vIMS tenant ..
vIMS - INFO - Removing vIMS user ..
Promise¶
FUNCTEST.info: Running PROMISE test case...
Promise- INFO - Creating tenant 'promise'...
Promise- INFO - Adding role '9d0a0a36d3d54cdcb4cd3c29c5f79a28' to tenant 'promise'...
Promise- INFO - Creating user 'promiser'...
Promise- INFO - Updating OpenStack credentials...
Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
Promise- INFO - Creating flavor 'promise-flavor'...
Promise- INFO - Exporting environment variables...
Promise- INFO - Running command: npm run -s test -- --reporter json
Promise- INFO - The test succeeded.
Promise- DEBUG -
{
"stats": {
"suites": 23,
"tests": 33,
"passes": 33,
"pending": 0,
"failures": 0,
"start": "2016-02-23T02:24:39.314Z",
"end": "2016-02-23T02:24:44.838Z",
"duration": 5524
},
"tests": [
{
"title": "should add a new OpenStack provider without error",
"fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
"duration": 1217,
"err": {}
},
{
"title": "should update promise.providers with a new entry",
"fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
"duration": 10,
"err": {}
},
{
"title": "should contain a new ResourceProvider record in the store",
"fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
"duration": 0,
"err": {}
},
{
"title": "should add more capacity to the reservation service without error",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
"duration": 25,
"err": {}
},
{
"title": "should update promise.pools with a new entry",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
"duration": 1,
"err": {}
},
{
"title": "should contain a ResourcePool record in the store",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
"duration": 0,
"err": {}
},
{
"title": "should report total collections and utilizations",
"fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
"duration": 18,
"err": {}
},
{
"title": "should contain newly added capacity pool",
"fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
"duration": 8,
"err": {}
},
{
"title": "should create a new server in target provider without error",
"fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
"duration": 1768,
"err": {}
},
{
"title": "should update promise.allocations with a new entry",
"fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
"duration": 2,
"err": {}
},
{
"title": "should contain a new ResourceAllocation record in the store",
"fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should reference the created server ID from the provider",
"fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
"duration": 1,
"err": {}
},
{
"title": "should have low priority state",
"fullTitle": "promise allocation without reservation create-instance should have low priority state",
"duration": 0,
"err": {}
},
{
"title": "should create reservation record (no start/end) without error",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
"duration": 41,
"err": {}
},
{
"title": "should update promise.reservations with a new entry",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
"duration": 7,
"err": {}
},
{
"title": "should contain a new ResourceReservation record in the store",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should create a new server in target provider (with reservation) without error",
"fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
"duration": 1617,
"err": {}
},
{
"title": "should contain a new ResourceAllocation record in the store",
"fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
"duration": 1,
"err": {}
},
{
"title": "should be referenced in the reservation record",
"fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
"duration": 7,
"err": {}
},
{
"title": "should have high priority state",
"fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
"duration": 0,
"err": {}
},
{
"title": "should create reservation record (for future) without error",
"fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
"duration": 75,
"err": {}
},
{
"title": "should update promise.reservations with a new entry",
"fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
"duration": 17,
"err": {}
},
{
"title": "should contain a new ResourceReservation record in the store",
"fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should contain newly created future reservation",
"fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
"duration": 61,
"err": {}
},
{
"title": "should modify existing reservation without error",
"fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
"duration": 65,
"err": {}
},
{
"title": "should modify existing reservation without error",
"fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
"duration": 17,
"err": {}
},
{
"title": "should no longer contain record of the deleted reservation",
"fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
"duration": 0,
"err": {}
},
{
"title": "should decrease available capacity from a provider in the future",
"fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
"duration": 15,
"err": {}
},
{
"title": "should increase available capacity from a provider in the future",
"fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
"duration": 11,
"err": {}
},
{
"title": "should report available collections and utilizations",
"fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
"duration": 56,
"err": {}
},
{
"title": "should fail to create immediate reservation record with proper error",
"fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
"duration": 60,
"err": {}
},
{
"title": "should fail to create future reservation record with proper error",
"fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
"duration": 38,
"err": {}
},
{
"title": "should successfully destroy all allocations",
"fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
"duration": 361,
"err": {}
}
],
"pending": [],
"failures": [],
"passes": [
{
"title": "should add a new OpenStack provider without error",
"fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
"duration": 1217,
"err": {}
},
{
"title": "should update promise.providers with a new entry",
"fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
"duration": 10,
"err": {}
},
{
"title": "should contain a new ResourceProvider record in the store",
"fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
"duration": 0,
"err": {}
},
{
"title": "should add more capacity to the reservation service without error",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
"duration": 25,
"err": {}
},
{
"title": "should update promise.pools with a new entry",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
"duration": 1,
"err": {}
},
{
"title": "should contain a ResourcePool record in the store",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
"duration": 0,
"err": {}
},
{
"title": "should report total collections and utilizations",
"fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
"duration": 18,
"err": {}
},
{
"title": "should contain newly added capacity pool",
"fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
"duration": 8,
"err": {}
},
{
"title": "should create a new server in target provider without error",
"fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
"duration": 1768,
"err": {}
},
{
"title": "should update promise.allocations with a new entry",
"fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
"duration": 2,
"err": {}
},
{
"title": "should contain a new ResourceAllocation record in the store",
"fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should reference the created server ID from the provider",
"fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
"duration": 1,
"err": {}
},
{
"title": "should have low priority state",
"fullTitle": "promise allocation without reservation create-instance should have low priority state",
"duration": 0,
"err": {}
},
{
"title": "should create reservation record (no start/end) without error",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
"duration": 41,
"err": {}
},
{
"title": "should update promise.reservations with a new entry",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
"duration": 7,
"err": {}
},
{
"title": "should contain a new ResourceReservation record in the store",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should create a new server in target provider (with reservation) without error",
"fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
"duration": 1617,
"err": {}
},
{
"title": "should contain a new ResourceAllocation record in the store",
"fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
"duration": 1,
"err": {}
},
{
"title": "should be referenced in the reservation record",
"fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
"duration": 7,
"err": {}
},
{
"title": "should have high priority state",
"fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
"duration": 0,
"err": {}
},
{
"title": "should create reservation record (for future) without error",
"fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
"duration": 75,
"err": {}
},
{
"title": "should update promise.reservations with a new entry",
"fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
"duration": 17,
"err": {}
},
{
"title": "should contain a new ResourceReservation record in the store",
"fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should contain newly created future reservation",
"fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
"duration": 61,
"err": {}
},
{
"title": "should modify existing reservation without error",
"fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
"duration": 65,
"err": {}
},
{
"title": "should modify existing reservation without error",
"fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
"duration": 17,
"err": {}
},
{
"title": "should no longer contain record of the deleted reservation",
"fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
"duration": 0,
"err": {}
},
{
"title": "should decrease available capacity from a provider in the future",
"fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
"duration": 15,
"err": {}
},
{
"title": "should increase available capacity from a provider in the future",
"fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
"duration": 11,
"err": {}
},
{
"title": "should report available collections and utilizations",
"fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
"duration": 56,
"err": {}
},
{
"title": "should fail to create immediate reservation record with proper error",
"fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
"duration": 60,
"err": {}
},
{
"title": "should fail to create future reservation record with proper error",
"fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
"duration": 38,
"err": {}
},
{
"title": "should successfully destroy all allocations",
"fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
"duration": 361,
"err": {}
}
]
}
Promise- INFO -
****************************************
Promise test report
****************************************
Suites: 23
Tests: 33
Passes: 33
Pending: 0
Failures: 0
Start: 2016-02-18T13:37:06.661Z
End: 2016-02-18T13:37:12.962Z
Duration: 6.301
****************************************
Detailed test results for fuel-os-odl_l2-nofeature-ha¶
VIM¶
vping_ssh¶
FUNCTEST.info: Running vPing-SSH test...
vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
vPing_ssh- INFO - Creating neutron network vping-net...
vPing_ssh- INFO - Creating security group 'vPing-sg'...
vPing_ssh- INFO - Using existing Flavor 'm1.small'...
vPing_ssh- INFO - vPing Start Time:'2016-02-18 13:27:35'
vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
name=opnfv-vping-1
flavor=<Flavor: m1.small>
image=fff41d5d-579a-4c26-844d-4e86700c44f6
network=a5137d46-dea8-4f85-8872-08c4a5927182
vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
name=opnfv-vping-2
flavor=<Flavor: m1.small>
image=fff41d5d-579a-4c26-844d-4e86700c44f6
network=a5137d46-dea8-4f85-8872-08c4a5927182
vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
vPing_ssh- INFO - Floating IP created: '10.118.101.200'
vPing_ssh- INFO - Associating floating ip: '10.118.101.200' to VM 'opnfv-vping-2'
vPing_ssh- INFO - Trying to establish SSH connection to 10.118.101.200...
vPing_ssh- INFO - Waiting for ping...
vPing_ssh- INFO - vPing detected!
vPing_ssh- INFO - vPing duration:'42.1' s.
vPing_ssh- INFO - Cleaning up...
vPing_ssh- INFO - vPing OK
vping_userdata¶
FUNCTEST.info: Running vPing-userdata test...
vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
vPing_userdata- INFO - Creating neutron network vping-net...
vPing_userdata- INFO - Creating security group 'vPing-sg'...
vPing_userdata- INFO - Flavor found 'm1.small'
vPing_userdata- INFO - vPing Start Time:'2016-02-18 13:29:00'
vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
name=opnfv-vping-1
flavor=<Flavor: m1.small>
image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
network=a1efb318-1338-436f-8f26-3a1bacab0538
vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
name=opnfv-vping-2
flavor=<Flavor: m1.small>
image=5e34c73d-91d0-4852-a407-5a4b4c1932c6
network=a1efb318-1338-436f-8f26-3a1bacab0538
userdata=
#!/bin/sh
while true; do
ping -c 1 192.168.130.4 2>&1 >/dev/null
RES=$?
if [ "Z$RES" = "Z0" ] ; then
echo 'vPing OK'
break
else
echo 'vPing KO'
fi
sleep 1
done
vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
vPing_userdata- INFO - Waiting for ping...
vPing_userdata- INFO - vPing detected!
vPing_userdata- INFO - vPing duration:'28.6'
vPing_userdata- INFO - vPing OK
vPing_userdata- INFO - Cleaning up...
vPing_userdata- INFO - Deleting network 'vping-net'...
Tempest¶
+------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
| name | time | status |
+------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
| tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor | 0.49156 | success |
| tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors | 0.10940 | success |
| tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image | 15.01623 | success |
| tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image | 29.41033 | success |
| tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name | 13.86580 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since | 0.60879 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name | 0.34531 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id | 0.33518 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref | 0.96138 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status | 0.90751 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type | 0.62183 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results | 0.62195 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since | 0.33497 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name | 0.64235 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref | 1.23145 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status | 0.83801 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type | 1.18842 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results | 0.35784 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image | 1.09813 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images | 0.88696 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail | 0.84049 | success |
| tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create | 1.52238 | success |
| tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list | 3.63444 | success |
| tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete | 6.75102 | success |
| tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip | 14.44295 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name | 316.24706 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers | 0.34052 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail | 0.75888 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus | 316.38576 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details | 0.00196 | success |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details | 0.0 | fail |
| tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action | 0.10067 | success |
| tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions | 4.93829 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor | 0.78542 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image | 0.64749 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name | 0.89411 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status | 0.32315 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results | 0.91146 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor | 0.13496 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image | 0.11222 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit | 0.11119 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name | 0.09119 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status | 0.10776 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip | 0.57188 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex | 0.00131 | skip |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard | 0.20660 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date | 0.08830 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date | 0.02378 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits | 0.33571 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.10769 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value | 0.02694 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string | 0.02251 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor | 0.04963 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image | 0.07987 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name | 0.08196 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted | 0.92759 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing | 0.03606 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server | 0.09925 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server | 0.0 | fail |
| tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses | 0.10704 | success |
| tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network | 0.20889 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item | 0.78463 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item | 0.44852 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata | 0.37770 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata | 0.72001 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item | 0.74485 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata | 0.67380 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password | 4.65947 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair | 19.27912 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name | 22.83188 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address | 13.05190 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name | 10.22705 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name | 3.02970 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit | 4.04190 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 | 2.67671 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor | 3.10372 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image | 3.80641 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid | 2.05689 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant | 1.62404 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit | 1.47470 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id | 1.21997 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server | 2.20741 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address | 3.12907 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server | 1.56617 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server | 1.38405 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor | 1.74547 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor | 0.94955 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank | 1.62631 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server | 1.24089 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server | 1.28176 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 | 1.39299 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant | 0.59369 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name | 1.00537 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant | 0.35547 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect | 0.02691 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image | 0.77671 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails | 0.03595 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails | 0.67764 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails | 0.12390 | success |
| tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas | 0.35252 | success |
| tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas | 0.05395 | success |
| tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume | 343.72467 | fail |
| tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list | 0.95003 | success |
| tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details | 0.99399 | success |
| tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id | 0.31689 | success |
| tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id | 0.02590 | success |
| tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services | 0.0 | fail |
| tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user | 0.0 | fail |
| tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete | 0.0 | fail |
| tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists | 0.09974 | success |
| tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain | 1.21063 | success |
| tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint | 0.0 | fail |
| tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete | 0.0 | fail |
| tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy | 0.0 | fail |
| tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id | 0.0 | fail |
| tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list | 0.77355 | success |
| tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service | 0.0 | fail |
| tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all | 2.63115 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.10751 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.08180 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.11419 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.09997 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.15346 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.10901 | success |
| tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params | 0.26936 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image | 1.78244 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file | 2.75904 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image | 3.58070 | success |
| tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions | 6.97865 | success |
| tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address | 0.0 | fail |
| tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip | 0.0 | fail |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network | 2.19846 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port | 3.01338 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet | 5.65439 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network | 5.23138 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port | 4.63026 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet | 4.20924 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet | 3.23093 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility | 0.72657 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks | 0.45440 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets | 0.37147 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network | 0.35779 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet | 0.30639 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet | 3.21748 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility | 0.64248 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks | 0.30977 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets | 0.03731 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network | 0.49862 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet | 0.26355 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools | 3.12061 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups | 3.35577 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port | 1.94748 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports | 0.39794 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port | 0.33413 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools | 3.39562 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups | 5.89837 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port | 2.99973 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_list_ports | 0.58956 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_show_port | 0.48395 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces | 10.99445 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id | 6.94692 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id | 4.69234 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router | 0.56033 | fail |
| tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces | 8.28629 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id | 4.94750 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id | 4.97154 | success |
| tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router | 3.42252 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group | 2.06578 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule | 3.53065 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups | 0.29313 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group | 2.98492 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule | 3.10014 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups | 0.39465 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list | 0.76994 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show | 7.29710 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template | 0.05370 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list | 0.0 | fail |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata | 0.0 | fail |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config | 0.0 | fail |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate | 0.0 | fail |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change | 0.0 | fail |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change | 0.0 | fail |
| tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources | 0.0 | fail |
| tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds | 0.0 | fail |
| tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications | 20.70674 | success |
| tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications | 12.57512 | success |
| tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance | 2.94613 | success |
| tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance | 3.13954 | success |
| tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete | 15.28613 | success |
| tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image | 17.92871 | success |
| tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete | 15.55119 | success |
| tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image | 19.10263 | success |
| tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list | 0.07108 | success |
| tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list | 0.37294 | success |
| tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops | 25.63959 | fail |
| tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops | 16.24070 | fail |
| tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern | 343.58312 | fail |
| tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern | 356.71394 | fail |
+------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
run_tempest - INFO - Results: {'timestart': '2016-02-1905:28:37.031139', 'duration': 730, 'tests': 210, 'failures': 40}
Rally¶
FUNCTEST.info: Running Rally benchmark suite...
run_rally - INFO - Starting test scenario "authenticate" ...
run_rally - INFO -
Preparing input task
Task c7f4e0fd-a882-4e14-ba02-553118d0cb77: started
Task c7f4e0fd-a882-4e14-ba02-553118d0cb77: finished
test scenario Authenticate.validate_glance
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_glance | 0.535 | 0.78 | 0.847 | 0.86 | 0.874 | 0.74 | 100.0% | 10 |
| authenticate.validate_glance (2) | 0.667 | 0.689 | 0.793 | 0.807 | 0.821 | 0.717 | 100.0% | 10 |
| total | 1.381 | 1.677 | 1.718 | 1.735 | 1.752 | 1.625 | 100.0% | 10 |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.80417394638
Full duration: 12.8028140068
test scenario Authenticate.keystone
+-----------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
| total | 0.121 | 0.149 | 0.163 | 0.164 | 0.166 | 0.149 | 100.0% | 10 |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.489310979843
Full duration: 7.96697187424
test scenario Authenticate.validate_heat
+-----------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_heat | 0.259 | 0.318 | 0.482 | 0.511 | 0.539 | 0.371 | 100.0% | 10 |
| authenticate.validate_heat (2) | 0.051 | 0.287 | 0.385 | 0.386 | 0.387 | 0.24 | 100.0% | 10 |
| total | 0.512 | 0.771 | 0.957 | 0.996 | 1.035 | 0.776 | 100.0% | 10 |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.53649091721
Full duration: 10.2540290356
test scenario Authenticate.validate_nova
+-----------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_nova | 0.3 | 0.332 | 0.474 | 0.482 | 0.489 | 0.368 | 100.0% | 10 |
| authenticate.validate_nova (2) | 0.034 | 0.049 | 0.059 | 0.065 | 0.07 | 0.05 | 100.0% | 10 |
| total | 0.499 | 0.564 | 0.716 | 0.722 | 0.727 | 0.586 | 100.0% | 10 |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.84303689003
Full duration: 9.65319395065
test scenario Authenticate.validate_cinder
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_cinder | 0.274 | 0.428 | 0.475 | 0.509 | 0.543 | 0.405 | 100.0% | 10 |
| authenticate.validate_cinder (2) | 0.025 | 0.424 | 0.455 | 0.456 | 0.458 | 0.376 | 100.0% | 10 |
| total | 0.469 | 1.071 | 1.131 | 1.141 | 1.151 | 0.964 | 100.0% | 10 |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.72650790215
Full duration: 10.753674984
test scenario Authenticate.validate_neutron
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_neutron | 0.28 | 0.302 | 0.32 | 0.326 | 0.333 | 0.303 | 100.0% | 10 |
| authenticate.validate_neutron (2) | 0.046 | 0.31 | 0.334 | 0.34 | 0.346 | 0.262 | 100.0% | 10 |
| total | 0.467 | 0.764 | 0.81 | 0.838 | 0.866 | 0.728 | 100.0% | 10 |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.37260484695
Full duration: 9.99744796753
run_rally - INFO - Test scenario: "authenticate" OK.
run_rally - INFO - Starting test scenario "glance" ...
run_rally - INFO -
Preparing input task
Task d54fa25b-b992-4b4e-bef2-14425b86329c: started
Task d54fa25b-b992-4b4e-bef2-14425b86329c: finished
test scenario GlanceImages.list_images
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| glance.list_images | 0.877 | 0.902 | 0.997 | 0.998 | 0.999 | 0.932 | 100.0% | 10 |
| total | 0.877 | 0.902 | 0.997 | 0.998 | 0.999 | 0.932 | 100.0% | 10 |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.92263484001
Full duration: 13.4585630894
test scenario GlanceImages.create_image_and_boot_instances
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+-------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+-------+--------+---------+-------+
| glance.create_image | 7.386 | 7.929 | 8.381 | 8.481 | 8.581 | 7.97 | 100.0% | 10 |
| nova.boot_servers | 8.641 | 10.384 | 10.714 | 11.007 | 11.3 | 10.241 | 100.0% | 10 |
| total | 16.702 | 18.427 | 18.943 | 19.047 | 19.15 | 18.211 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+-------+--------+---------+-------+
Load duration: 54.6946680546
Full duration: 110.071588039
test scenario GlanceImages.create_and_list_image
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| glance.create_image | 7.081 | 7.618 | 8.085 | 8.19 | 8.296 | 7.689 | 100.0% | 10 |
| glance.list_images | 0.324 | 0.573 | 0.642 | 0.714 | 0.786 | 0.573 | 100.0% | 10 |
| total | 7.612 | 8.241 | 8.722 | 8.902 | 9.082 | 8.262 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 24.6801600456
Full duration: 39.2870121002
test scenario GlanceImages.create_and_delete_image
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| glance.create_image | 7.449 | 7.593 | 7.856 | 8.073 | 8.289 | 7.673 | 100.0% | 10 |
| glance.delete_image | 2.001 | 2.442 | 12.75 | 13.42 | 14.089 | 5.507 | 100.0% | 10 |
| total | 9.487 | 10.064 | 20.503 | 21.441 | 22.378 | 13.18 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 40.0675120354
Full duration: 50.2370131016
run_rally - INFO - Test scenario: "glance" OK.
run_rally - INFO - Starting test scenario "cinder" ...
run_rally - INFO -
Preparing input task
Task 6b2be534-fd42-4a5f-be0e-9a789027d4b3: started
Task 6b2be534-fd42-4a5f-be0e-9a789027d4b3: finished
test scenario CinderVolumes.create_and_attach_volume
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 7.135 | 7.936 | 8.663 | 8.672 | 8.68 | 7.941 | 100.0% | 10 |
| cinder.create_volume | 3.274 | 3.507 | 4.072 | 4.096 | 4.12 | 3.616 | 100.0% | 10 |
| nova.attach_volume | 4.012 | 4.845 | 6.553 | 6.624 | 6.694 | 5.31 | 100.0% | 10 |
| nova.detach_volume | 3.256 | 3.739 | 3.938 | 4.096 | 4.253 | 3.716 | 100.0% | 10 |
| cinder.delete_volume | 0.464 | 2.707 | 2.98 | 3.154 | 3.328 | 1.98 | 100.0% | 10 |
| nova.delete_server | 2.784 | 3.059 | 3.15 | 3.19 | 3.23 | 3.04 | 100.0% | 10 |
| total | 22.316 | 26.079 | 27.631 | 28.362 | 29.094 | 25.604 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 73.9451169968
Full duration: 116.516190052
test scenario CinderVolumes.create_and_list_volume
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| cinder.create_volume | 9.065 | 9.591 | 9.94 | 9.943 | 9.945 | 9.554 | 100.0% | 10 |
| cinder.list_volumes | 0.048 | 0.346 | 0.386 | 0.394 | 0.402 | 0.301 | 100.0% | 10 |
| total | 9.138 | 9.94 | 10.313 | 10.324 | 10.335 | 9.855 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 28.8989629745
Full duration: 51.7012848854
test scenario CinderVolumes.create_and_list_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.251 | 3.883 | 4.897 | 4.899 | 4.901 | 4.006 | 100.0% | 10 |
| cinder.list_volumes | 0.055 | 0.072 | 0.333 | 0.334 | 0.334 | 0.145 | 100.0% | 10 |
| total | 3.313 | 3.952 | 5.212 | 5.223 | 5.234 | 4.151 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 11.7280011177
Full duration: 34.1200621128
test scenario CinderVolumes.create_and_list_snapshots
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_snapshot | 2.973 | 3.289 | 5.554 | 5.57 | 5.585 | 3.702 | 100.0% | 10 |
| cinder.list_snapshots | 0.027 | 0.162 | 0.313 | 0.32 | 0.326 | 0.168 | 100.0% | 10 |
| total | 3.001 | 3.593 | 5.586 | 5.601 | 5.616 | 3.871 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 10.6676809788
Full duration: 51.8370318413
test scenario CinderVolumes.create_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.324 | 3.69 | 4.382 | 4.392 | 4.403 | 3.828 | 100.0% | 10 |
| cinder.delete_volume | 0.625 | 2.781 | 3.053 | 3.199 | 3.345 | 2.086 | 100.0% | 10 |
| total | 4.288 | 6.438 | 7.073 | 7.173 | 7.273 | 5.914 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 18.0577061176
Full duration: 35.664162159
test scenario CinderVolumes.create_and_delete_volume
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 7.41 | 9.74 | 10.091 | 10.094 | 10.097 | 9.522 | 100.0% | 10 |
| cinder.delete_volume | 0.54 | 0.965 | 3.092 | 3.097 | 3.103 | 1.691 | 100.0% | 10 |
| total | 7.95 | 10.903 | 12.9 | 12.964 | 13.029 | 11.214 | 100.0% | 10 |
+----------------------+------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 33.3823940754
Full duration: 52.0277431011
test scenario CinderVolumes.create_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.681 | 3.946 | 4.01 | 4.051 | 4.092 | 3.903 | 100.0% | 10 |
| cinder.delete_volume | 0.506 | 2.848 | 3.217 | 3.222 | 3.228 | 2.122 | 100.0% | 10 |
| total | 4.188 | 6.787 | 7.161 | 7.175 | 7.189 | 6.026 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 18.0166649818
Full duration: 35.4839038849
test scenario CinderVolumes.create_and_upload_volume_to_image
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.672 | 4.074 | 4.522 | 4.546 | 4.57 | 4.114 | 100.0% | 10 |
| cinder.upload_volume_to_image | 21.673 | 31.257 | 31.931 | 31.979 | 32.027 | 29.253 | 100.0% | 10 |
| cinder.delete_volume | 0.56 | 2.568 | 3.011 | 3.067 | 3.123 | 2.293 | 100.0% | 10 |
| nova.delete_image | 2.137 | 2.51 | 2.606 | 2.681 | 2.756 | 2.451 | 100.0% | 10 |
| total | 28.587 | 39.952 | 40.849 | 41.35 | 41.852 | 38.112 | 100.0% | 10 |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 110.444069147
Full duration: 131.52224803
test scenario CinderVolumes.create_and_delete_snapshot
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_snapshot | 3.208 | 3.343 | 5.587 | 5.628 | 5.669 | 3.788 | 100.0% | 10 |
| cinder.delete_snapshot | 2.503 | 2.86 | 3.196 | 3.217 | 3.239 | 2.893 | 100.0% | 10 |
| total | 5.787 | 6.422 | 8.296 | 8.392 | 8.488 | 6.681 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 18.7773430347
Full duration: 53.0582361221
test scenario CinderVolumes.create_volume
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.52 | 3.822 | 4.222 | 4.228 | 4.233 | 3.852 | 100.0% | 10 |
| total | 3.52 | 3.822 | 4.223 | 4.228 | 4.233 | 3.852 | 100.0% | 10 |
+----------------------+------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 11.2881109715
Full duration: 29.6710369587
test scenario CinderVolumes.create_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.248 | 3.651 | 3.891 | 3.988 | 4.084 | 3.645 | 100.0% | 10 |
| total | 3.249 | 3.652 | 3.891 | 3.988 | 4.084 | 3.645 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 10.7785470486
Full duration: 32.9540159702
test scenario CinderVolumes.list_volumes
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.list_volumes | 0.499 | 0.52 | 0.539 | 0.55 | 0.561 | 0.522 | 100.0% | 10 |
| total | 0.499 | 0.52 | 0.539 | 0.55 | 0.561 | 0.523 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.60948395729
Full duration: 65.5444660187
test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.547 | 3.82 | 3.891 | 3.927 | 3.962 | 3.787 | 100.0% | 10 |
| cinder.create_snapshot | 2.552 | 2.875 | 3.173 | 3.215 | 3.257 | 2.931 | 100.0% | 10 |
| nova.attach_volume | 3.633 | 5.774 | 8.279 | 8.853 | 9.427 | 6.038 | 100.0% | 10 |
| nova.detach_volume | 3.599 | 3.826 | 4.233 | 4.444 | 4.655 | 3.905 | 100.0% | 10 |
| cinder.delete_snapshot | 2.22 | 2.537 | 2.852 | 2.971 | 3.09 | 2.577 | 100.0% | 10 |
| cinder.delete_volume | 0.648 | 2.735 | 2.845 | 2.892 | 2.939 | 2.321 | 100.0% | 10 |
| total | 18.538 | 22.642 | 25.806 | 26.204 | 26.601 | 22.745 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 66.8299760818
Full duration: 173.895985842
test scenario CinderVolumes.create_from_volume_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.481 | 3.953 | 4.613 | 5.302 | 5.991 | 4.167 | 100.0% | 10 |
| cinder.delete_volume | 1.163 | 3.065 | 3.469 | 3.474 | 3.479 | 2.919 | 100.0% | 10 |
| total | 5.012 | 7.114 | 7.89 | 8.462 | 9.034 | 7.087 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 20.8082921505
Full duration: 55.4062600136
test scenario CinderVolumes.create_and_extend_volume
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| cinder.create_volume | 3.417 | 3.839 | 3.908 | 3.925 | 3.941 | 3.742 | 100.0% | 10 |
| cinder.extend_volume | 0.938 | 2.978 | 3.574 | 3.713 | 3.853 | 2.396 | 100.0% | 10 |
| cinder.delete_volume | 0.577 | 1.808 | 3.066 | 3.146 | 3.225 | 1.858 | 100.0% | 10 |
| total | 5.44 | 8.275 | 9.921 | 10.095 | 10.269 | 7.997 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 23.5873560905
Full duration: 41.9279878139
test scenario CinderVolumes.create_snapshot_and_attach_volume
+-----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.668 | 3.89 | 4.255 | 4.266 | 4.277 | 3.937 | 100.0% | 10 |
| cinder.create_snapshot | 2.268 | 2.949 | 3.306 | 3.36 | 3.414 | 2.903 | 100.0% | 10 |
| nova.attach_volume | 3.471 | 4.393 | 7.358 | 8.251 | 9.145 | 5.113 | 100.0% | 10 |
| nova.detach_volume | 3.277 | 3.925 | 4.509 | 4.566 | 4.622 | 3.926 | 100.0% | 10 |
| cinder.delete_snapshot | 2.286 | 2.607 | 2.849 | 2.862 | 2.875 | 2.614 | 100.0% | 10 |
| cinder.delete_volume | 0.591 | 2.677 | 2.96 | 3.019 | 3.078 | 2.352 | 100.0% | 10 |
| total | 18.8 | 21.654 | 23.365 | 25.201 | 27.038 | 21.974 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 65.2181398869
Full duration: 179.069041967
test scenario CinderVolumes.create_snapshot_and_attach_volume
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.22 | 3.682 | 4.259 | 4.27 | 4.281 | 3.723 | 100.0% | 10 |
| cinder.create_snapshot | 2.292 | 3.051 | 3.199 | 3.232 | 3.265 | 2.991 | 100.0% | 10 |
| nova.attach_volume | 3.891 | 4.365 | 6.53 | 6.577 | 6.625 | 4.971 | 100.0% | 10 |
| nova.detach_volume | 3.248 | 3.565 | 3.767 | 4.044 | 4.321 | 3.568 | 100.0% | 10 |
| cinder.delete_snapshot | 2.258 | 2.551 | 2.836 | 2.87 | 2.904 | 2.609 | 100.0% | 10 |
| cinder.delete_volume | 0.883 | 2.687 | 3.02 | 3.224 | 3.427 | 2.286 | 100.0% | 10 |
| total | 19.132 | 21.712 | 23.229 | 23.566 | 23.904 | 21.677 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 64.7866289616
Full duration: 180.275881052
run_rally - INFO - Test scenario: "cinder" OK.
run_rally - INFO - Starting test scenario "heat" ...
run_rally - INFO -
Preparing input task
Task 51925ef8-a527-44d2-8df3-6164af0ec62a: started
Task 51925ef8-a527-44d2-8df3-6164af0ec62a: finished
test scenario HeatStacks.create_suspend_resume_delete_stack
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 4.245 | 4.317 | 4.434 | 4.474 | 4.514 | 4.348 | 100.0% | 10 |
| heat.suspend_stack | 1.497 | 1.713 | 1.747 | 1.75 | 1.753 | 1.7 | 100.0% | 10 |
| heat.resume_stack | 1.42 | 1.621 | 1.668 | 1.67 | 1.671 | 1.562 | 100.0% | 10 |
| heat.delete_stack | 1.377 | 1.573 | 1.716 | 2.249 | 2.782 | 1.675 | 100.0% | 10 |
| total | 8.851 | 9.198 | 9.402 | 9.981 | 10.56 | 9.285 | 100.0% | 10 |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 27.3572640419
Full duration: 37.0984110832
test scenario HeatStacks.create_and_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 3.911 | 4.181 | 4.323 | 4.325 | 4.327 | 4.149 | 100.0% | 10 |
| heat.delete_stack | 1.392 | 1.426 | 1.744 | 1.776 | 1.808 | 1.491 | 100.0% | 10 |
| total | 5.311 | 5.631 | 5.774 | 5.775 | 5.776 | 5.64 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 16.9275529385
Full duration: 26.8473479748
test scenario HeatStacks.create_and_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 20.192 | 23.206 | 23.805 | 23.826 | 23.847 | 22.465 | 100.0% | 10 |
| heat.delete_stack | 11.755 | 11.868 | 12.963 | 13.0 | 13.036 | 12.282 | 100.0% | 10 |
| total | 32.02 | 35.613 | 36.714 | 36.721 | 36.729 | 34.747 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 102.752908945
Full duration: 112.369065046
test scenario HeatStacks.create_and_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 16.808 | 18.33 | 20.748 | 20.751 | 20.755 | 18.654 | 100.0% | 10 |
| heat.delete_stack | 9.404 | 10.582 | 10.788 | 10.803 | 10.818 | 10.313 | 100.0% | 10 |
| total | 26.212 | 28.318 | 31.532 | 31.553 | 31.574 | 28.967 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 85.8598790169
Full duration: 95.2520959377
test scenario HeatStacks.list_stacks_and_resources
+-----------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------------+------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------------------+------+--------+--------+--------+-------+-------+---------+-------+
| heat.list_stacks | 0.45 | 0.485 | 0.512 | 0.512 | 0.512 | 0.487 | 100.0% | 10 |
| heat.list_resources_of_0_stacks | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
| total | 0.45 | 0.485 | 0.512 | 0.512 | 0.512 | 0.487 | 100.0% | 10 |
+---------------------------------+------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.48300600052
Full duration: 9.57427692413
test scenario HeatStacks.create_update_delete_stack
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 3.727 | 4.075 | 4.288 | 4.337 | 4.386 | 4.085 | 100.0% | 10 |
| heat.update_stack | 3.549 | 3.676 | 3.903 | 3.972 | 4.042 | 3.704 | 100.0% | 10 |
| heat.delete_stack | 1.405 | 2.619 | 2.76 | 2.774 | 2.789 | 2.212 | 100.0% | 10 |
| total | 9.105 | 10.287 | 10.719 | 10.741 | 10.763 | 10.001 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 29.4346759319
Full duration: 39.5471699238
test scenario HeatStacks.create_update_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 3.915 | 4.067 | 4.171 | 4.199 | 4.227 | 4.052 | 100.0% | 10 |
| heat.update_stack | 3.521 | 3.661 | 3.773 | 3.791 | 3.81 | 3.658 | 100.0% | 10 |
| heat.delete_stack | 1.38 | 1.477 | 1.612 | 1.618 | 1.624 | 1.492 | 100.0% | 10 |
| total | 8.916 | 9.128 | 9.484 | 9.493 | 9.503 | 9.203 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 27.5511319637
Full duration: 37.5252559185
test scenario HeatStacks.create_update_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 4.023 | 4.301 | 4.59 | 5.029 | 5.468 | 4.38 | 100.0% | 10 |
| heat.update_stack | 5.783 | 5.888 | 6.061 | 6.08 | 6.1 | 5.912 | 100.0% | 10 |
| heat.delete_stack | 2.475 | 2.546 | 2.705 | 3.2 | 3.694 | 2.65 | 100.0% | 10 |
| total | 12.613 | 12.74 | 13.76 | 13.912 | 14.064 | 12.942 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 38.1860618591
Full duration: 48.4381308556
test scenario HeatStacks.create_update_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 4.094 | 5.24 | 5.479 | 5.528 | 5.577 | 5.17 | 100.0% | 10 |
| heat.update_stack | 8.178 | 9.243 | 9.316 | 9.324 | 9.332 | 8.862 | 100.0% | 10 |
| heat.delete_stack | 3.63 | 3.68 | 3.714 | 3.714 | 3.715 | 3.68 | 100.0% | 10 |
| total | 16.974 | 17.76 | 18.444 | 18.466 | 18.488 | 17.713 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 52.4500279427
Full duration: 63.0265882015
test scenario HeatStacks.create_update_delete_stack
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 4.113 | 4.273 | 4.647 | 4.934 | 5.22 | 4.362 | 100.0% | 10 |
| heat.update_stack | 5.809 | 5.888 | 5.941 | 6.056 | 6.17 | 5.907 | 100.0% | 10 |
| heat.delete_stack | 2.513 | 2.561 | 3.694 | 3.7 | 3.706 | 2.891 | 100.0% | 10 |
| total | 12.55 | 12.759 | 14.013 | 14.546 | 15.079 | 13.161 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 39.0816349983
Full duration: 49.7756490707
test scenario HeatStacks.create_update_delete_stack
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| heat.create_stack | 3.762 | 4.115 | 4.19 | 4.27 | 4.35 | 4.062 | 100.0% | 10 |
| heat.update_stack | 3.543 | 3.63 | 3.844 | 3.977 | 4.11 | 3.69 | 100.0% | 10 |
| heat.delete_stack | 1.383 | 1.499 | 2.506 | 2.528 | 2.549 | 1.677 | 100.0% | 10 |
| total | 8.868 | 9.275 | 10.208 | 10.225 | 10.242 | 9.429 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 27.9543409348
Full duration: 38.8234701157
test scenario HeatStacks.create_and_list_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 4.005 | 4.128 | 4.199 | 4.234 | 4.27 | 4.127 | 100.0% | 10 |
| heat.list_stacks | 0.075 | 0.094 | 0.108 | 0.112 | 0.117 | 0.094 | 100.0% | 10 |
| total | 4.112 | 4.226 | 4.281 | 4.313 | 4.345 | 4.221 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 12.6059498787
Full duration: 27.8848700523
test scenario HeatStacks.create_check_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 4.084 | 4.153 | 4.178 | 4.217 | 4.256 | 4.153 | 100.0% | 10 |
| heat.check_stack | 0.706 | 1.53 | 1.571 | 1.586 | 1.6 | 1.459 | 100.0% | 10 |
| heat.delete_stack | 1.375 | 1.432 | 2.542 | 2.546 | 2.55 | 1.763 | 100.0% | 10 |
| total | 7.01 | 7.159 | 8.25 | 8.279 | 8.309 | 7.375 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 22.5798799992
Full duration: 33.7318949699
run_rally - INFO - Test scenario: "heat" OK.
run_rally - INFO - Starting test scenario "keystone" ...
run_rally - INFO -
Preparing input task
Task 98c40f01-0adc-48ce-91ca-105f22e60ec9: started
Task 98c40f01-0adc-48ce-91ca-105f22e60ec9: finished
test scenario KeystoneBasic.create_tenant_with_users
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.263 | 0.291 | 0.401 | 0.408 | 0.415 | 0.322 | 100.0% | 10 |
| keystone.create_users | 1.508 | 1.599 | 1.672 | 1.733 | 1.793 | 1.601 | 100.0% | 10 |
| total | 1.782 | 1.949 | 2.051 | 2.066 | 2.081 | 1.923 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 5.82497000694
Full duration: 20.636977911
test scenario KeystoneBasic.create_add_and_list_user_roles
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.256 | 0.273 | 0.292 | 0.296 | 0.3 | 0.274 | 100.0% | 10 |
| keystone.add_role | 0.24 | 0.262 | 0.297 | 0.319 | 0.341 | 0.267 | 100.0% | 10 |
| keystone.list_roles | 0.131 | 0.146 | 0.226 | 0.237 | 0.248 | 0.16 | 100.0% | 10 |
| total | 0.636 | 0.682 | 0.774 | 0.78 | 0.786 | 0.702 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.11375284195
Full duration: 14.9668319225
test scenario KeystoneBasic.add_and_remove_user_role
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.267 | 0.326 | 0.368 | 0.376 | 0.383 | 0.322 | 100.0% | 10 |
| keystone.add_role | 0.244 | 0.255 | 0.278 | 0.302 | 0.326 | 0.263 | 100.0% | 10 |
| keystone.remove_role | 0.149 | 0.163 | 0.191 | 0.244 | 0.296 | 0.177 | 100.0% | 10 |
| total | 0.681 | 0.765 | 0.834 | 0.84 | 0.846 | 0.762 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.33364892006
Full duration: 14.8711419106
test scenario KeystoneBasic.create_update_and_delete_tenant
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.272 | 0.316 | 0.391 | 0.394 | 0.396 | 0.327 | 100.0% | 10 |
| keystone.update_tenant | 0.125 | 0.141 | 0.169 | 0.215 | 0.261 | 0.152 | 100.0% | 10 |
| keystone.delete_tenant | 0.299 | 0.321 | 0.379 | 0.394 | 0.408 | 0.333 | 100.0% | 10 |
| total | 0.745 | 0.81 | 0.859 | 0.915 | 0.971 | 0.812 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.46658396721
Full duration: 13.4442551136
test scenario KeystoneBasic.create_and_delete_service
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_service | 0.258 | 0.271 | 0.303 | 0.308 | 0.314 | 0.278 | 100.0% | 10 |
| keystone.delete_service | 0.146 | 0.158 | 0.181 | 0.203 | 0.226 | 0.164 | 100.0% | 10 |
| total | 0.408 | 0.442 | 0.464 | 0.475 | 0.487 | 0.442 | 100.0% | 10 |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.34449720383
Full duration: 12.1886069775
test scenario KeystoneBasic.create_tenant
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.253 | 0.302 | 0.319 | 0.324 | 0.328 | 0.297 | 100.0% | 10 |
| total | 0.253 | 0.302 | 0.319 | 0.324 | 0.329 | 0.298 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.912425994873
Full duration: 8.74173903465
test scenario KeystoneBasic.create_user
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_user | 0.262 | 0.303 | 0.319 | 0.319 | 0.319 | 0.296 | 100.0% | 10 |
| total | 0.262 | 0.303 | 0.319 | 0.319 | 0.32 | 0.296 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.953788042068
Full duration: 8.72430300713
test scenario KeystoneBasic.create_and_list_tenants
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.247 | 0.28 | 0.302 | 0.304 | 0.307 | 0.281 | 100.0% | 10 |
| keystone.list_tenants | 0.121 | 0.129 | 0.224 | 0.225 | 0.225 | 0.147 | 100.0% | 10 |
| total | 0.392 | 0.42 | 0.476 | 0.493 | 0.511 | 0.428 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.32897400856
Full duration: 13.584346056
test scenario KeystoneBasic.create_and_delete_role
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.286 | 0.324 | 0.395 | 0.47 | 0.545 | 0.347 | 100.0% | 10 |
| keystone.delete_role | 0.25 | 0.32 | 0.487 | 0.522 | 0.557 | 0.344 | 100.0% | 10 |
| total | 0.546 | 0.62 | 0.889 | 0.913 | 0.936 | 0.691 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.18193697929
Full duration: 12.766493082
test scenario KeystoneBasic.get_entities
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.271 | 0.283 | 0.299 | 0.311 | 0.322 | 0.287 | 100.0% | 10 |
| keystone.create_user | 0.145 | 0.156 | 0.162 | 0.165 | 0.167 | 0.155 | 100.0% | 10 |
| keystone.create_role | 0.122 | 0.133 | 0.155 | 0.183 | 0.211 | 0.141 | 100.0% | 10 |
| keystone.get_tenant | 0.109 | 0.126 | 0.145 | 0.178 | 0.211 | 0.133 | 100.0% | 10 |
| keystone.get_user | 0.12 | 0.133 | 0.2 | 0.205 | 0.21 | 0.148 | 100.0% | 10 |
| keystone.get_role | 0.106 | 0.12 | 0.137 | 0.155 | 0.172 | 0.126 | 100.0% | 10 |
| keystone.service_list | 0.112 | 0.126 | 0.144 | 0.178 | 0.212 | 0.134 | 100.0% | 10 |
| keystone.get_service | 0.104 | 0.125 | 0.131 | 0.134 | 0.136 | 0.123 | 100.0% | 10 |
| total | 1.177 | 1.23 | 1.321 | 1.328 | 1.334 | 1.248 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.83582210541
Full duration: 20.6130208969
test scenario KeystoneBasic.create_and_list_users
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_user | 0.295 | 0.312 | 0.374 | 0.386 | 0.399 | 0.326 | 100.0% | 10 |
| keystone.list_users | 0.114 | 0.129 | 0.148 | 0.148 | 0.149 | 0.133 | 100.0% | 10 |
| total | 0.419 | 0.442 | 0.521 | 0.535 | 0.549 | 0.458 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.37977695465
Full duration: 9.29229903221
run_rally - INFO - Test scenario: "keystone" OK.
run_rally - INFO - Starting test scenario "neutron" ...
run_rally - INFO -
Preparing input task
Task 0a18c72f-b575-481a-8997-6d3d52130ede: started
Task 0a18c72f-b575-481a-8997-6d3d52130ede: finished
test scenario NeutronNetworks.create_and_delete_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.758 | 0.851 | 1.15 | 1.23 | 1.309 | 0.925 | 100.0% | 10 |
| neutron.delete_port | 0.241 | 0.578 | 0.611 | 0.618 | 0.625 | 0.488 | 100.0% | 10 |
| total | 0.998 | 1.415 | 1.73 | 1.808 | 1.886 | 1.414 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.22447299957
Full duration: 51.8464670181
test scenario NeutronNetworks.create_and_list_routers
+---------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.768 | 0.804 | 0.942 | 1.007 | 1.073 | 0.852 | 100.0% | 10 |
| neutron.create_router | 0.08 | 0.425 | 0.456 | 0.469 | 0.482 | 0.394 | 100.0% | 10 |
| neutron.add_interface_router | 0.371 | 0.741 | 1.213 | 1.526 | 1.84 | 0.855 | 100.0% | 10 |
| neutron.list_routers | 0.048 | 0.405 | 0.478 | 0.502 | 0.527 | 0.286 | 100.0% | 10 |
| total | 1.684 | 2.22 | 3.085 | 3.308 | 3.53 | 2.388 | 100.0% | 10 |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 7.42530488968
Full duration: 57.8292651176
test scenario NeutronNetworks.create_and_delete_routers
+------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.689 | 0.768 | 0.931 | 0.941 | 0.95 | 0.811 | 100.0% | 10 |
| neutron.create_router | 0.408 | 0.421 | 0.457 | 0.547 | 0.636 | 0.441 | 100.0% | 10 |
| neutron.add_interface_router | 0.363 | 0.702 | 0.802 | 0.807 | 0.813 | 0.653 | 100.0% | 10 |
| neutron.remove_interface_router | 0.273 | 0.662 | 0.823 | 0.847 | 0.872 | 0.65 | 100.0% | 10 |
| neutron.delete_router | 0.178 | 0.557 | 0.661 | 0.665 | 0.669 | 0.541 | 100.0% | 10 |
| total | 2.291 | 3.046 | 3.598 | 3.647 | 3.695 | 3.096 | 100.0% | 10 |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 9.11136102676
Full duration: 56.6760940552
test scenario NeutronNetworks.create_and_list_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.746 | 0.824 | 0.923 | 0.946 | 0.968 | 0.846 | 100.0% | 10 |
| neutron.list_ports | 0.157 | 0.57 | 0.629 | 0.663 | 0.697 | 0.481 | 100.0% | 10 |
| total | 1.065 | 1.343 | 1.476 | 1.493 | 1.51 | 1.327 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.94901585579
Full duration: 52.597589016
test scenario NeutronNetworks.create_and_delete_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.701 | 0.757 | 1.049 | 1.144 | 1.238 | 0.835 | 100.0% | 10 |
| neutron.delete_subnet | 0.196 | 0.565 | 0.691 | 0.725 | 0.759 | 0.531 | 100.0% | 10 |
| total | 0.939 | 1.384 | 1.496 | 1.595 | 1.694 | 1.366 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.35806703568
Full duration: 51.0885548592
test scenario NeutronNetworks.create_and_delete_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.614 | 0.675 | 0.811 | 0.817 | 0.823 | 0.692 | 100.0% | 10 |
| neutron.delete_network | 0.491 | 0.545 | 0.62 | 0.624 | 0.628 | 0.554 | 100.0% | 10 |
| total | 1.133 | 1.231 | 1.388 | 1.415 | 1.443 | 1.246 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.68652009964
Full duration: 30.7036879063
test scenario NeutronNetworks.create_and_list_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.556 | 0.652 | 0.754 | 0.757 | 0.759 | 0.665 | 100.0% | 10 |
| neutron.list_networks | 0.361 | 0.383 | 0.478 | 0.503 | 0.528 | 0.403 | 100.0% | 10 |
| total | 0.917 | 1.027 | 1.231 | 1.252 | 1.273 | 1.068 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.11869502068
Full duration: 33.6655409336
test scenario NeutronNetworks.create_and_update_routers
+---------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.718 | 0.757 | 0.921 | 0.922 | 0.923 | 0.795 | 100.0% | 10 |
| neutron.create_router | 0.073 | 0.405 | 0.44 | 0.448 | 0.455 | 0.38 | 100.0% | 10 |
| neutron.add_interface_router | 0.65 | 0.699 | 0.805 | 0.827 | 0.849 | 0.717 | 100.0% | 10 |
| neutron.update_router | 0.228 | 0.537 | 0.661 | 0.677 | 0.693 | 0.53 | 100.0% | 10 |
| total | 2.134 | 2.511 | 2.583 | 2.583 | 2.583 | 2.422 | 100.0% | 10 |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 7.21204185486
Full duration: 58.3329060078
test scenario NeutronNetworks.create_and_update_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.59 | 0.678 | 0.77 | 0.785 | 0.8 | 0.684 | 100.0% | 10 |
| neutron.update_network | 0.452 | 0.51 | 0.55 | 0.569 | 0.587 | 0.514 | 100.0% | 10 |
| total | 1.054 | 1.188 | 1.314 | 1.319 | 1.323 | 1.198 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.48062801361
Full duration: 33.7373108864
test scenario NeutronNetworks.create_and_update_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.724 | 0.911 | 1.036 | 1.046 | 1.055 | 0.915 | 100.0% | 10 |
| neutron.update_port | 0.332 | 0.55 | 0.569 | 0.573 | 0.578 | 0.53 | 100.0% | 10 |
| total | 1.173 | 1.466 | 1.591 | 1.607 | 1.623 | 1.445 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.40219402313
Full duration: 52.9743890762
test scenario NeutronNetworks.create_and_list_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.768 | 0.823 | 0.981 | 1.001 | 1.02 | 0.857 | 100.0% | 10 |
| neutron.list_subnets | 0.053 | 0.403 | 0.472 | 0.483 | 0.495 | 0.316 | 100.0% | 10 |
| total | 0.821 | 1.249 | 1.342 | 1.384 | 1.426 | 1.173 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.63253998756
Full duration: 52.0335438251
test scenario NeutronNetworks.create_and_update_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.721 | 0.797 | 0.952 | 0.953 | 0.954 | 0.82 | 100.0% | 10 |
| neutron.update_subnet | 0.233 | 0.605 | 0.745 | 0.753 | 0.761 | 0.589 | 100.0% | 10 |
| total | 1.002 | 1.432 | 1.561 | 1.638 | 1.715 | 1.409 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.58866596222
Full duration: 52.8035202026
run_rally - INFO - Test scenario: "neutron" OK.
run_rally - INFO - Starting test scenario "nova" ...
run_rally - INFO -
Preparing input task
Task 7bc9f24e-75ad-4e01-afd5-3647398a073e: started
Task 7bc9f24e-75ad-4e01-afd5-3647398a073e: finished
test scenario NovaKeypair.create_and_delete_keypair
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.create_keypair | 0.705 | 0.755 | 0.85 | 1.155 | 1.459 | 0.818 | 100.0% | 10 |
| nova.delete_keypair | 0.032 | 0.046 | 0.063 | 0.064 | 0.064 | 0.046 | 100.0% | 10 |
| total | 0.744 | 0.804 | 0.895 | 1.21 | 1.524 | 0.864 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.08747410774
Full duration: 41.9948050976
test scenario NovaServers.snapshot_server
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 8.021 | 10.195 | 10.572 | 10.642 | 10.713 | 9.936 | 100.0% | 10 |
| nova.create_image | 10.782 | 11.261 | 11.548 | 11.631 | 11.715 | 11.242 | 100.0% | 10 |
| nova.delete_server | 2.821 | 3.28 | 3.4 | 3.426 | 3.452 | 3.222 | 100.0% | 10 |
| nova.boot_server (2) | 6.39 | 8.069 | 9.073 | 9.382 | 9.691 | 7.984 | 100.0% | 10 |
| nova.delete_server (2) | 2.855 | 2.91 | 3.425 | 3.429 | 3.434 | 3.04 | 100.0% | 10 |
| nova.delete_image | 2.558 | 2.911 | 3.161 | 3.22 | 3.279 | 2.887 | 100.0% | 10 |
| total | 35.039 | 38.279 | 39.897 | 40.21 | 40.523 | 38.314 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 115.44729495
Full duration: 188.161262035
test scenario NovaKeypair.boot_and_delete_server_with_keypair
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_keypair | 0.64 | 0.869 | 1.365 | 1.399 | 1.433 | 0.948 | 100.0% | 10 |
| nova.boot_server | 7.047 | 8.139 | 10.062 | 10.11 | 10.159 | 8.606 | 100.0% | 10 |
| nova.delete_server | 2.522 | 3.1 | 3.242 | 3.267 | 3.292 | 3.041 | 100.0% | 10 |
| nova.delete_keypair | 0.042 | 0.051 | 0.061 | 0.068 | 0.075 | 0.052 | 100.0% | 10 |
| total | 11.115 | 12.323 | 14.176 | 14.258 | 14.341 | 12.648 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 39.1623878479
Full duration: 108.56980896
test scenario NovaKeypair.create_and_list_keypairs
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.create_keypair | 0.734 | 0.87 | 0.947 | 0.982 | 1.018 | 0.859 | 100.0% | 10 |
| nova.list_keypairs | 0.022 | 0.034 | 0.042 | 0.044 | 0.046 | 0.033 | 100.0% | 10 |
| total | 0.769 | 0.903 | 0.981 | 1.02 | 1.059 | 0.892 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.59114599228
Full duration: 44.6869869232
test scenario NovaServers.list_servers
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.list_servers | 1.436 | 1.556 | 1.653 | 1.689 | 1.725 | 1.565 | 100.0% | 10 |
| total | 1.436 | 1.557 | 1.653 | 1.689 | 1.726 | 1.565 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.71795606613
Full duration: 123.497851133
test scenario NovaServers.resize_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 8.388 | 9.39 | 10.016 | 10.105 | 10.194 | 9.406 | 100.0% | 10 |
| nova.resize | 40.666 | 42.089 | 46.186 | 46.669 | 47.151 | 42.721 | 100.0% | 10 |
| nova.resize_confirm | 3.322 | 3.648 | 4.206 | 5.097 | 5.989 | 3.842 | 100.0% | 10 |
| nova.delete_server | 2.499 | 2.977 | 3.32 | 3.383 | 3.446 | 3.012 | 100.0% | 10 |
| total | 56.246 | 58.698 | 61.838 | 62.514 | 63.19 | 58.982 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 180.054177999
Full duration: 221.624077082
test scenario NovaServers.boot_server_from_volume_and_delete
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 9.965 | 10.647 | 11.15 | 11.275 | 11.4 | 10.648 | 100.0% | 10 |
| nova.boot_server | 8.986 | 10.62 | 12.102 | 12.345 | 12.587 | 10.685 | 100.0% | 10 |
| nova.delete_server | 3.355 | 5.419 | 5.857 | 5.908 | 5.96 | 5.311 | 100.0% | 10 |
| total | 23.598 | 26.481 | 28.991 | 29.016 | 29.041 | 26.644 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 79.5105199814
Full duration: 161.905633926
test scenario NovaServers.boot_and_migrate_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 8.833 | 10.242 | 11.298 | 11.673 | 12.049 | 10.106 | 100.0% | 10 |
| nova.stop_server | 3.821 | 6.772 | 7.286 | 7.317 | 7.349 | 6.484 | 100.0% | 10 |
| nova.migrate | 8.569 | 12.084 | 12.564 | 12.67 | 12.776 | 11.309 | 100.0% | 10 |
| nova.resize_confirm | 2.922 | 3.398 | 4.001 | 4.054 | 4.107 | 3.49 | 100.0% | 10 |
| nova.delete_server | 2.522 | 2.922 | 3.396 | 3.406 | 3.416 | 2.976 | 100.0% | 10 |
| total | 29.694 | 34.582 | 36.24 | 36.517 | 36.795 | 34.367 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 100.483532906
Full duration: 141.506958961
test scenario NovaServers.boot_and_delete_server
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 8.586 | 9.397 | 10.198 | 10.288 | 10.378 | 9.508 | 100.0% | 10 |
| nova.delete_server | 2.497 | 3.108 | 3.472 | 3.478 | 3.485 | 3.09 | 100.0% | 10 |
| total | 11.39 | 12.555 | 13.374 | 13.612 | 13.849 | 12.598 | 100.0% | 10 |
+--------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 38.4852130413
Full duration: 106.844094992
test scenario NovaServers.boot_and_rebuild_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 8.193 | 9.878 | 10.329 | 10.703 | 11.078 | 9.597 | 100.0% | 10 |
| nova.rebuild_server | 8.434 | 9.946 | 10.942 | 11.066 | 11.191 | 9.967 | 100.0% | 10 |
| nova.delete_server | 2.887 | 3.097 | 3.934 | 4.794 | 5.654 | 3.399 | 100.0% | 10 |
| total | 20.573 | 22.393 | 25.427 | 25.892 | 26.357 | 22.963 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 68.7611658573
Full duration: 138.198104143
test scenario NovaSecGroup.create_and_list_secgroups
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 4.914 | 5.073 | 5.815 | 5.965 | 6.116 | 5.288 | 100.0% | 10 |
| nova.create_100_rules | 41.66 | 44.384 | 45.431 | 45.816 | 46.201 | 44.305 | 100.0% | 10 |
| nova.list_security_groups | 0.152 | 0.533 | 0.902 | 0.96 | 1.018 | 0.5 | 100.0% | 10 |
| total | 47.592 | 50.13 | 51.2 | 51.527 | 51.854 | 50.094 | 100.0% | 10 |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 149.717460871
Full duration: 216.41701889
test scenario NovaSecGroup.create_and_delete_secgroups
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 4.565 | 5.19 | 5.563 | 5.615 | 5.668 | 5.131 | 100.0% | 10 |
| nova.create_100_rules | 41.981 | 43.448 | 44.817 | 44.926 | 45.034 | 43.666 | 100.0% | 10 |
| nova.delete_10_security_groups | 2.07 | 2.522 | 2.976 | 3.171 | 3.366 | 2.551 | 100.0% | 10 |
| total | 49.35 | 51.576 | 51.781 | 52.087 | 52.394 | 51.349 | 100.0% | 10 |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 154.714606047
Full duration: 196.745972872
test scenario NovaServers.boot_and_bounce_server
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 8.097 | 9.924 | 11.182 | 11.428 | 11.673 | 10.029 | 100.0% | 10 |
| nova.reboot_server | 5.363 | 6.246 | 8.84 | 8.907 | 8.973 | 7.049 | 100.0% | 10 |
| nova.soft_reboot_server | 8.452 | 8.823 | 9.184 | 9.291 | 9.398 | 8.83 | 100.0% | 10 |
| nova.stop_server | 3.808 | 6.394 | 7.284 | 7.3 | 7.316 | 6.358 | 100.0% | 10 |
| nova.start_server | 3.677 | 5.011 | 5.706 | 5.852 | 5.997 | 4.954 | 100.0% | 10 |
| nova.rescue_server | 7.752 | 8.674 | 11.07 | 11.07 | 11.071 | 9.269 | 100.0% | 10 |
| nova.unrescue_server | 5.065 | 5.536 | 5.762 | 5.781 | 5.8 | 5.532 | 100.0% | 10 |
| nova.delete_server | 2.485 | 2.546 | 3.501 | 4.347 | 5.194 | 2.952 | 100.0% | 10 |
| total | 50.79 | 54.629 | 59.2 | 59.748 | 60.297 | 54.995 | 100.0% | 10 |
+-------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 166.248807907
Full duration: 235.770923853
test scenario NovaServers.boot_server
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| nova.boot_server | 6.916 | 9.539 | 12.275 | 12.369 | 12.464 | 9.975 | 100.0% | 10 |
| total | 6.916 | 9.54 | 12.275 | 12.37 | 12.464 | 9.976 | 100.0% | 10 |
+------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 29.8727550507
Full duration: 87.0325229168
test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 5.065 | 5.392 | 5.642 | 5.731 | 5.819 | 5.4 | 100.0% | 10 |
| nova.create_100_rules | 42.116 | 43.904 | 45.452 | 45.794 | 46.137 | 44.057 | 100.0% | 10 |
| nova.boot_server | 6.906 | 7.809 | 8.73 | 8.911 | 9.092 | 7.954 | 100.0% | 10 |
| nova.get_attached_security_groups | 0.209 | 0.264 | 0.361 | 0.463 | 0.565 | 0.289 | 100.0% | 10 |
| nova.delete_server | 2.508 | 2.562 | 2.7 | 2.829 | 2.959 | 2.607 | 100.0% | 10 |
| nova.delete_10_security_groups | 1.784 | 2.564 | 3.087 | 3.153 | 3.218 | 2.561 | 100.0% | 10 |
| total | 60.06 | 63.125 | 63.757 | 63.889 | 64.021 | 62.869 | 100.0% | 10 |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 188.221204996
Full duration: 257.303071976
test scenario NovaServers.pause_and_unpause_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 7.896 | 9.252 | 10.006 | 10.25 | 10.494 | 9.303 | 100.0% | 10 |
| nova.pause_server | 2.784 | 3.19 | 3.465 | 3.487 | 3.509 | 3.226 | 100.0% | 10 |
| nova.unpause_server | 2.782 | 3.172 | 3.226 | 3.258 | 3.29 | 3.105 | 100.0% | 10 |
| nova.delete_server | 2.553 | 3.301 | 3.545 | 3.619 | 3.693 | 3.248 | 100.0% | 10 |
| total | 17.692 | 19.035 | 19.794 | 19.85 | 19.905 | 18.883 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 56.6791820526
Full duration: 126.811426163
test scenario NovaServers.boot_server_from_volume
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 9.412 | 10.207 | 10.376 | 10.441 | 10.505 | 10.131 | 100.0% | 10 |
| nova.boot_server | 8.849 | 10.342 | 11.591 | 11.741 | 11.892 | 10.423 | 100.0% | 10 |
| total | 18.922 | 20.498 | 21.854 | 21.976 | 22.099 | 20.555 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 60.9860489368
Full duration: 126.851632118
test scenario NovaServers.boot_and_list_server
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 8.227 | 8.931 | 10.864 | 10.959 | 11.054 | 9.41 | 100.0% | 10 |
| nova.list_servers | 0.624 | 1.017 | 1.144 | 1.153 | 1.163 | 0.949 | 100.0% | 10 |
| total | 8.969 | 9.945 | 11.851 | 11.89 | 11.928 | 10.359 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 30.9555499554
Full duration: 111.845392942
run_rally - INFO - Test scenario: "nova" OK.
run_rally - INFO - Starting test scenario "quotas" ...
run_rally - INFO -
Preparing input task
Task 1b950d54-5c1a-4680-9d86-cbebdb0d1b72: started
Task 1b950d54-5c1a-4680-9d86-cbebdb0d1b72: finished
test scenario Quotas.cinder_update
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 1.138 | 1.278 | 1.336 | 1.347 | 1.357 | 1.267 | 100.0% | 10 |
| total | 1.138 | 1.278 | 1.336 | 1.347 | 1.357 | 1.267 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.75106191635
Full duration: 16.480301857
test scenario Quotas.neutron_update
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.406 | 0.441 | 0.5 | 0.501 | 0.502 | 0.454 | 100.0% | 10 |
| total | 0.546 | 0.618 | 0.666 | 0.67 | 0.674 | 0.616 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.8795170784
Full duration: 13.8104491234
test scenario Quotas.cinder_update_and_delete
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 1.178 | 1.264 | 1.311 | 1.344 | 1.378 | 1.26 | 100.0% | 10 |
| quotas.delete_quotas | 0.89 | 0.996 | 1.091 | 1.115 | 1.138 | 1.003 | 100.0% | 10 |
| total | 2.155 | 2.273 | 2.366 | 2.404 | 2.442 | 2.264 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 6.68874502182
Full duration: 18.7547061443
test scenario Quotas.nova_update_and_delete
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.559 | 0.615 | 0.666 | 0.669 | 0.671 | 0.616 | 100.0% | 10 |
| quotas.delete_quotas | 0.013 | 0.022 | 0.026 | 0.028 | 0.029 | 0.022 | 100.0% | 10 |
| total | 0.585 | 0.641 | 0.68 | 0.687 | 0.693 | 0.638 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.9670290947
Full duration: 13.6480379105
test scenario Quotas.nova_update
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.587 | 0.621 | 0.738 | 0.758 | 0.777 | 0.646 | 100.0% | 10 |
| total | 0.587 | 0.621 | 0.738 | 0.758 | 0.777 | 0.647 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.87492918968
Full duration: 13.4147770405
run_rally - INFO - Test scenario: "quotas" OK.
run_rally - INFO - Starting test scenario "requests" ...
run_rally - INFO -
Preparing input task
Task 21739b85-984f-45b9-ae85-066dbd1adce3: started
Task 21739b85-984f-45b9-ae85-066dbd1adce3: finished
test scenario HttpRequests.check_random_request
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| requests.check_request | 5.047 | 5.181 | 5.389 | 5.395 | 5.401 | 5.204 | 100.0% | 10 |
| total | 5.047 | 5.181 | 5.39 | 5.395 | 5.401 | 5.205 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 15.7369980812
Full duration: 20.6335179806
test scenario HttpRequests.check_request
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| requests.check_request | 5.048 | 5.052 | 5.058 | 5.058 | 5.058 | 5.053 | 100.0% | 10 |
| total | 5.049 | 5.052 | 5.058 | 5.058 | 5.058 | 5.053 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 15.2042939663
Full duration: 20.2779421806
run_rally - INFO - Test scenario: "requests" OK.
run_rally - INFO -
Rally Summary Report
+===================+============+===============+===========+
| Module | Duration | nb. Test Run | Success |
+===================+============+===============+===========+
| authenticate | 01:01 | 10 | 100.00% |
+-------------------+------------+---------------+-----------+
| glance | 03:33 | 7 | 100.00% |
+-------------------+------------+---------------+-----------+
| cinder | 22:00 | 50 | 100.00% |
+-------------------+------------+---------------+-----------+
| heat | 10:19 | 35 | 100.00% |
+-------------------+------------+---------------+-----------+
| keystone | 02:29 | 29 | 100.00% |
+-------------------+------------+---------------+-----------+
| neutron | 09:44 | 31 | 100.00% |
+-------------------+------------+---------------+-----------+
| nova | 43:55 | 61 | 100.00% |
+-------------------+------------+---------------+-----------+
| quotas | 01:16 | 7 | 100.00% |
+-------------------+------------+---------------+-----------+
| requests | 00:40 | 2 | 100.00% |
+-------------------+------------+---------------+-----------+
+===================+============+===============+===========+
| TOTAL: | 01:35:01 | 232 | 100.00% |
+===================+============+===============+===========+
SDN Controller¶
ODL¶
==============================================================================
Basic
==============================================================================
Basic.010 Restconf OK :: Test suite to verify Restconf is OK
==============================================================================
Get Controller Modules :: Get the controller modules via Restconf | PASS |
------------------------------------------------------------------------------
Basic.010 Restconf OK :: Test suite to verify Restconf is OK | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Basic | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Output: /home/opnfv/repos/functest/output.xml
Log: /home/opnfv/repos/functest/log.html
Report: /home/opnfv/repos/functest/report.html
[1;32mStarting test: test/csit/suites/openstack/neutron/ [0m
==============================================================================
Neutron :: Test suite for Neutron Plugin
==============================================================================
Neutron.Networks :: Checking Network created in OpenStack are pushed to Ope...
==============================================================================
Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS |
------------------------------------------------------------------------------
Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS |
------------------------------------------------------------------------------
Create Network :: Create new network in OpenStack | PASS |
------------------------------------------------------------------------------
Check Network :: Check Network created in OpenDaylight | PASS |
------------------------------------------------------------------------------
Neutron.Networks :: Checking Network created in OpenStack are push... | PASS |
4 critical tests, 4 passed, 0 failed
4 tests total, 4 passed, 0 failed
==============================================================================
Neutron.Subnets :: Checking Subnets created in OpenStack are pushed to Open...
==============================================================================
Check OpenStack Subnets :: Checking OpenStack Neutron for known Su... | PASS |
------------------------------------------------------------------------------
Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS |
------------------------------------------------------------------------------
Create New subnet :: Create new subnet in OpenStack | PASS |
------------------------------------------------------------------------------
Check New subnet :: Check new subnet created in OpenDaylight | PASS |
------------------------------------------------------------------------------
Neutron.Subnets :: Checking Subnets created in OpenStack are pushe... | PASS |
4 critical tests, 4 passed, 0 failed
4 tests total, 4 passed, 0 failed
==============================================================================
Neutron.Ports :: Checking Port created in OpenStack are pushed to OpenDaylight
==============================================================================
Check OpenStack ports :: Checking OpenStack Neutron for known ports | PASS |
------------------------------------------------------------------------------
Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS |
------------------------------------------------------------------------------
Create New Port :: Create new port in OpenStack | PASS |
------------------------------------------------------------------------------
Check New Port :: Check new subnet created in OpenDaylight | PASS |
------------------------------------------------------------------------------
Neutron.Ports :: Checking Port created in OpenStack are pushed to ... | PASS |
4 critical tests, 4 passed, 0 failed
4 tests total, 4 passed, 0 failed
==============================================================================
Neutron.Delete Ports :: Checking Port deleted in OpenStack are deleted also...
==============================================================================
Delete New Port :: Delete previously created port in OpenStack | PASS |
------------------------------------------------------------------------------
Check Port Deleted :: Check port deleted in OpenDaylight | PASS |
------------------------------------------------------------------------------
Neutron.Delete Ports :: Checking Port deleted in OpenStack are del... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack are deleted...
==============================================================================
Delete New subnet :: Delete previously created subnet in OpenStack | PASS |
------------------------------------------------------------------------------
Check New subnet deleted :: Check subnet deleted in OpenDaylight | PASS |
------------------------------------------------------------------------------
Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack ar... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Neutron.Delete Networks :: Checking Network deleted in OpenStack are delete...
==============================================================================
Delete Network :: Delete network in OpenStack | PASS |
------------------------------------------------------------------------------
Check Network deleted :: Check Network deleted in OpenDaylight | PASS |
------------------------------------------------------------------------------
Neutron.Delete Networks :: Checking Network deleted in OpenStack a... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Neutron :: Test suite for Neutron Plugin | PASS |
18 critical tests, 18 passed, 0 failed
18 tests total, 18 passed, 0 failed
==============================================================================
Output: /home/opnfv/repos/functest/output.xml
Log: /home/opnfv/repos/functest/log.html
Report: /home/opnfv/repos/functest/report.html
[0;32mFinal report is located:[0m
Log: /home/opnfv/repos/functest/log.html
Report: /home/opnfv/repos/functest/report.html
Feature tests¶
vIMS¶
FUNCTEST.info: Running vIMS test...
vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
vIMS - INFO - Update OpenStack creds informations
vIMS - INFO - Upload some OS images if it doesn't exist
vIMS - INFO - centos_7 image doesn't exist on glance repository.
Try downloading this image and upload on glance !
vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
Try downloading this image and upload on glance !
vIMS - INFO - Update security group quota for this tenant
vIMS - INFO - Update cinder quota for this tenant
vIMS - INFO - Collect flavor id for cloudify manager server
vIMS - INFO - Prepare virtualenv for cloudify-cli
vIMS - INFO - Downloading the cloudify manager server blueprint
vIMS - INFO - Cloudify deployment Start Time:'2016-02-19 05:44:47'
vIMS - INFO - Writing the inputs file
vIMS - INFO - Launching the cloudify-manager deployment
vIMS - INFO - Cloudify-manager server is UP !
vIMS - INFO - Cloudify deployment duration:'1149.9'
vIMS - INFO - Collect flavor id for all clearwater vm
vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-19 06:04:00'
vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
vIMS - INFO - Writing the inputs file
vIMS - INFO - Launching the clearwater deployment
vIMS - INFO - The deployment of clearwater-opnfv is ended
vIMS - INFO - vIMS VNF deployment duration:'1133.8'
vIMS - INFO - vIMS functional test Start Time:'2016-02-19 06:25:59'
vIMS - INFO - vIMS functional test duration:'2.9'
vIMS - INFO - Launching the clearwater-opnfv undeployment
vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; '
vIMS - INFO - Launching the cloudify-manager undeployment
vIMS - INFO - Cloudify-manager server has been successfully removed!
vIMS - INFO - Removing vIMS tenant ..
vIMS - INFO - Removing vIMS user ..
Promise¶
FUNCTEST.info: Running PROMISE test case...
Promise- INFO - Creating tenant 'promise'...
Promise- INFO - Adding role '9d0a0a36d3d54cdcb4cd3c29c5f79a28' to tenant 'promise'...
Promise- INFO - Creating user 'promiser'...
Promise- INFO - Updating OpenStack credentials...
Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
Promise- INFO - Creating flavor 'promise-flavor'...
Promise- INFO - Exporting environment variables...
Promise- INFO - Running command: npm run -s test -- --reporter json
Promise- INFO - The test succeeded.
Promise- DEBUG -
{
"stats": {
"suites": 23,
"tests": 33,
"passes": 33,
"pending": 0,
"failures": 0,
"start": "2016-02-19T05:41:25.739Z",
"end": "2016-02-19T05:41:31.140Z",
"duration": 5524
},
"tests": [
{
"title": "should add a new OpenStack provider without error",
"fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
"duration": 1217,
"err": {}
},
{
"title": "should update promise.providers with a new entry",
"fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
"duration": 10,
"err": {}
},
{
"title": "should contain a new ResourceProvider record in the store",
"fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
"duration": 0,
"err": {}
},
{
"title": "should add more capacity to the reservation service without error",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
"duration": 25,
"err": {}
},
{
"title": "should update promise.pools with a new entry",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
"duration": 1,
"err": {}
},
{
"title": "should contain a ResourcePool record in the store",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
"duration": 0,
"err": {}
},
{
"title": "should report total collections and utilizations",
"fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
"duration": 18,
"err": {}
},
{
"title": "should contain newly added capacity pool",
"fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
"duration": 8,
"err": {}
},
{
"title": "should create a new server in target provider without error",
"fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
"duration": 1768,
"err": {}
},
{
"title": "should update promise.allocations with a new entry",
"fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
"duration": 2,
"err": {}
},
{
"title": "should contain a new ResourceAllocation record in the store",
"fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should reference the created server ID from the provider",
"fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
"duration": 1,
"err": {}
},
{
"title": "should have low priority state",
"fullTitle": "promise allocation without reservation create-instance should have low priority state",
"duration": 0,
"err": {}
},
{
"title": "should create reservation record (no start/end) without error",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
"duration": 41,
"err": {}
},
{
"title": "should update promise.reservations with a new entry",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
"duration": 7,
"err": {}
},
{
"title": "should contain a new ResourceReservation record in the store",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should create a new server in target provider (with reservation) without error",
"fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
"duration": 1617,
"err": {}
},
{
"title": "should contain a new ResourceAllocation record in the store",
"fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
"duration": 1,
"err": {}
},
{
"title": "should be referenced in the reservation record",
"fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
"duration": 7,
"err": {}
},
{
"title": "should have high priority state",
"fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
"duration": 0,
"err": {}
},
{
"title": "should create reservation record (for future) without error",
"fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
"duration": 75,
"err": {}
},
{
"title": "should update promise.reservations with a new entry",
"fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
"duration": 17,
"err": {}
},
{
"title": "should contain a new ResourceReservation record in the store",
"fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should contain newly created future reservation",
"fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
"duration": 61,
"err": {}
},
{
"title": "should modify existing reservation without error",
"fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
"duration": 65,
"err": {}
},
{
"title": "should modify existing reservation without error",
"fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
"duration": 17,
"err": {}
},
{
"title": "should no longer contain record of the deleted reservation",
"fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
"duration": 0,
"err": {}
},
{
"title": "should decrease available capacity from a provider in the future",
"fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
"duration": 15,
"err": {}
},
{
"title": "should increase available capacity from a provider in the future",
"fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
"duration": 11,
"err": {}
},
{
"title": "should report available collections and utilizations",
"fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
"duration": 56,
"err": {}
},
{
"title": "should fail to create immediate reservation record with proper error",
"fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
"duration": 60,
"err": {}
},
{
"title": "should fail to create future reservation record with proper error",
"fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
"duration": 38,
"err": {}
},
{
"title": "should successfully destroy all allocations",
"fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
"duration": 361,
"err": {}
}
],
"pending": [],
"failures": [],
"passes": [
{
"title": "should add a new OpenStack provider without error",
"fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
"duration": 1217,
"err": {}
},
{
"title": "should update promise.providers with a new entry",
"fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
"duration": 10,
"err": {}
},
{
"title": "should contain a new ResourceProvider record in the store",
"fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
"duration": 0,
"err": {}
},
{
"title": "should add more capacity to the reservation service without error",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
"duration": 25,
"err": {}
},
{
"title": "should update promise.pools with a new entry",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
"duration": 1,
"err": {}
},
{
"title": "should contain a ResourcePool record in the store",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
"duration": 0,
"err": {}
},
{
"title": "should report total collections and utilizations",
"fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
"duration": 18,
"err": {}
},
{
"title": "should contain newly added capacity pool",
"fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
"duration": 8,
"err": {}
},
{
"title": "should create a new server in target provider without error",
"fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
"duration": 1768,
"err": {}
},
{
"title": "should update promise.allocations with a new entry",
"fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
"duration": 2,
"err": {}
},
{
"title": "should contain a new ResourceAllocation record in the store",
"fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should reference the created server ID from the provider",
"fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
"duration": 1,
"err": {}
},
{
"title": "should have low priority state",
"fullTitle": "promise allocation without reservation create-instance should have low priority state",
"duration": 0,
"err": {}
},
{
"title": "should create reservation record (no start/end) without error",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
"duration": 41,
"err": {}
},
{
"title": "should update promise.reservations with a new entry",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
"duration": 7,
"err": {}
},
{
"title": "should contain a new ResourceReservation record in the store",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should create a new server in target provider (with reservation) without error",
"fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
"duration": 1617,
"err": {}
},
{
"title": "should contain a new ResourceAllocation record in the store",
"fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
"duration": 1,
"err": {}
},
{
"title": "should be referenced in the reservation record",
"fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
"duration": 7,
"err": {}
},
{
"title": "should have high priority state",
"fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
"duration": 0,
"err": {}
},
{
"title": "should create reservation record (for future) without error",
"fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
"duration": 75,
"err": {}
},
{
"title": "should update promise.reservations with a new entry",
"fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
"duration": 17,
"err": {}
},
{
"title": "should contain a new ResourceReservation record in the store",
"fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should contain newly created future reservation",
"fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
"duration": 61,
"err": {}
},
{
"title": "should modify existing reservation without error",
"fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
"duration": 65,
"err": {}
},
{
"title": "should modify existing reservation without error",
"fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
"duration": 17,
"err": {}
},
{
"title": "should no longer contain record of the deleted reservation",
"fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
"duration": 0,
"err": {}
},
{
"title": "should decrease available capacity from a provider in the future",
"fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
"duration": 15,
"err": {}
},
{
"title": "should increase available capacity from a provider in the future",
"fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
"duration": 11,
"err": {}
},
{
"title": "should report available collections and utilizations",
"fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
"duration": 56,
"err": {}
},
{
"title": "should fail to create immediate reservation record with proper error",
"fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
"duration": 60,
"err": {}
},
{
"title": "should fail to create future reservation record with proper error",
"fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
"duration": 38,
"err": {}
},
{
"title": "should successfully destroy all allocations",
"fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
"duration": 361,
"err": {}
}
]
}
Promise- INFO -
****************************************
Promise test report
****************************************
Suites: 23
Tests: 33
Passes: 33
Pending: 0
Failures: 0
Start: 2016-02-19T05:41:25.739Z
End: 2016-02-19T05:41:31.140Z
Duration: 6.301
****************************************
Detailed test results for fuel-os-onos-nofeature-ha¶
VIM¶
vping_ssh¶
FUNCTEST.info: Running vPing-SSH test...
vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
vPing_ssh- INFO - Creating neutron network vping-net...
vPing_ssh- INFO - Creating security group 'vPing-sg'...
vPing_ssh- INFO - Using existing Flavor 'm1.small'...
vPing_ssh- INFO - vPing Start Time:'2016-02-21 09:42:15'
vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
name=opnfv-vping-1
flavor=<Flavor: m1.small>
image=c921bde1-b564-4670-9801-7607bb7dd5f9
network=ddbf909c-8936-4d5a-b499-ae5bc6e4981f
vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
name=opnfv-vping-2
flavor=<Flavor: m1.small>
image=c921bde1-b564-4670-9801-7607bb7dd5f9
network=ddbf909c-8936-4d5a-b499-ae5bc6e4981f
vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
vPing_ssh- INFO - Floating IP created: '10.118.101.200'
vPing_ssh- INFO - Associating floating ip: '10.118.101.200' to VM 'opnfv-vping-2'
vPing_ssh- INFO - Trying to establish SSH connection to 10.118.101.200...
vPing_ssh- INFO - Waiting for ping...
vPing_ssh- INFO - vPing detected!
vPing_ssh- INFO - vPing duration:'267.2' s.
vPing_ssh- INFO - Cleaning up...
vPing_ssh- INFO - vPing OK
Tempest¶
+------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
| name | time | status |
+------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
| tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor | 0.33888 | success |
| tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors | 0.10971 | success |
| tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image | 15.11040 | success |
| tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image | 30.42278 | success |
| tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name | 13.85713 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since | 0.32690 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name | 0.34397 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id | 0.37412 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref | 1.53125 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status | 0.34050 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type | 0.55659 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results | 0.33680 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since | 0.57251 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name | 0.33960 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref | 0.69068 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status | 0.33768 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type | 0.67793 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results | 0.33491 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image | 1.60438 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images | 1.39355 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail | 1.24188 | success |
| tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create | 1.85431 | success |
| tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list | 2.83096 | success |
| tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete | 6.66403 | success |
| tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip | 13.11276 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus | 0.0 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details | 0.0 | fail |
| tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action | 0.11312 | success |
| tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions | 4.98764 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor | 0.62118 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image | 1.01188 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name | 0.73001 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status | 1.04071 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results | 0.53598 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor | 0.12633 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image | 0.13548 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit | 0.08098 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name | 0.08810 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status | 0.10130 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip | 0.63997 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex | 0.00129 | skip |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard | 0.20987 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date | 0.10442 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date | 0.02285 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits | 0.10168 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.08641 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value | 0.03051 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string | 0.02042 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor | 0.08087 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image | 0.06620 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name | 0.07583 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted | 1.02614 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing | 0.03649 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server | 0.10806 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert | 0.0 | fail |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server | 0.0 | fail |
| tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses | 0.09498 | success |
| tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network | 0.15150 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item | 0.76964 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item | 0.40090 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata | 0.38359 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata | 0.65971 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item | 0.66699 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata | 0.63491 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password | 5.25088 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair | 16.25121 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name | 22.90196 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address | 11.28175 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name | 12.26759 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name | 2.49600 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit | 2.57009 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 | 3.21321 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor | 3.04861 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image | 3.93770 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid | 2.76115 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant | 1.71809 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit | 1.21977 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id | 0.91452 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server | 0.95440 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address | 3.16889 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server | 1.57679 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server | 1.42447 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor | 1.46180 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor | 1.15287 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank | 1.87581 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server | 0.99209 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server | 0.58096 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 | 1.07971 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant | 1.73518 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name | 1.51942 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant | 0.32883 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect | 0.01961 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image | 1.56142 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails | 0.03891 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails | 0.62077 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails | 0.07524 | success |
| tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas | 0.29801 | success |
| tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas | 0.07714 | success |
| tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume | 0.0 | fail |
| tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list | 1.06122 | success |
| tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details | 1.10604 | success |
| tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id | 0.41781 | success |
| tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id | 0.03176 | success |
| tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services | 0.0 | fail |
| tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user | 0.34417 | success |
| tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete | 0.0 | fail |
| tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists | 0.0 | fail |
| tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain | 1.00125 | success |
| tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint | 0.64367 | success |
| tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete | 0.0 | fail |
| tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy | 0.0 | fail |
| tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id | 0.38885 | success |
| tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list | 0.0 | fail |
| tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service | 0.0 | fail |
| tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all | 2.52793 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.11210 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.08846 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.10244 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.10511 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.10566 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.14063 | success |
| tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params | 0.57457 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image | 1.72677 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file | 15.66304 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image | 3.84418 | success |
| tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions | 5.53626 | success |
| tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address | 2.54078 | success |
| tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip | 4.09094 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network | 1.98866 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port | 2.87451 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet | 5.20792 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network | 2.28358 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port | 4.49162 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet | 3.79765 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet | 2.99403 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility | 0.66099 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks | 0.29854 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets | 0.32442 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network | 0.04955 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet | 0.33630 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet | 2.80651 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility | 0.65929 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks | 0.36943 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets | 0.38991 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network | 0.31486 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet | 0.30617 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools | 2.96002 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups | 3.15725 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port | 1.88622 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports | 0.32563 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port | 0.37153 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools | 3.19676 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups | 2.65017 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port | 2.26448 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_list_ports | 0.38004 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_show_port | 0.32783 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces | 8.61053 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id | 5.36523 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id | 3.30263 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router | 2.90758 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces | 7.98249 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id | 4.15672 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id | 4.09748 | success |
| tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router | 3.08662 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group | 1.74965 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule | 3.81896 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups | 0.31019 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group | 2.07790 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule | 3.59873 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups | 0.33280 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list | 0.62361 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show | 6.93849 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template | 0.07141 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list | 1.31814 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata | 0.61532 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config | 0.61600 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate | 0.59934 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change | 0.81253 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change | 0.84469 | success |
| tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources | 3.72972 | success |
| tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds | 0.06791 | success |
| tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications | 19.60479 | success |
| tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications | 3.74694 | success |
| tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance | 3.11182 | success |
| tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance | 3.04832 | success |
| tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete | 10.66890 | success |
| tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image | 18.01898 | success |
| tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete | 16.52370 | success |
| tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image | 17.05563 | success |
| tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list | 0.08365 | success |
| tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list | 0.05607 | success |
| tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops | 374.04656 | fail |
| tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops | 340.58084 | fail |
| tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern | 349.05347 | fail |
| tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern | 338.91569 | fail |
+------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
run_tempest - INFO - Results: {'timestart': '2016-02-2109:47:08.529077', 'duration': 512, 'tests': 210, 'failures': 31}
Rally¶
FUNCTEST.info: Running Rally benchmark suite...
run_rally - INFO - Starting test scenario "authenticate" ...
run_rally - INFO -
Preparing input task
Task 938ee7f4-76f5-42f3-a908-9eb3557dac60: started
Task 938ee7f4-76f5-42f3-a908-9eb3557dac60: finished
test scenario Authenticate.validate_glance
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_glance | 0.528 | 0.563 | 0.576 | 0.577 | 0.578 | 0.558 | 100.0% | 10 |
| authenticate.validate_glance (2) | 0.524 | 0.536 | 0.584 | 0.646 | 0.707 | 0.556 | 100.0% | 10 |
| total | 1.209 | 1.274 | 1.348 | 1.391 | 1.434 | 1.285 | 100.0% | 10 |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.82395505905
Full duration: 11.5060088634
test scenario Authenticate.keystone
+----------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-------+--------+--------+--------+------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------+-------+--------+--------+--------+------+-------+---------+-------+
| total | 0.145 | 0.166 | 0.262 | 0.271 | 0.28 | 0.193 | 100.0% | 10 |
+--------+-------+--------+--------+--------+------+-------+---------+-------+
Load duration: 0.597311973572
Full duration: 8.39117598534
test scenario Authenticate.validate_heat
+-----------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_heat | 0.289 | 0.308 | 0.338 | 0.34 | 0.342 | 0.312 | 100.0% | 10 |
| authenticate.validate_heat (2) | 0.054 | 0.289 | 0.31 | 0.318 | 0.327 | 0.27 | 100.0% | 10 |
| total | 0.575 | 0.782 | 0.858 | 0.862 | 0.865 | 0.773 | 100.0% | 10 |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.38020992279
Full duration: 10.2995789051
test scenario Authenticate.validate_nova
+-----------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_nova | 0.279 | 0.311 | 0.459 | 0.464 | 0.468 | 0.352 | 100.0% | 10 |
| authenticate.validate_nova (2) | 0.033 | 0.056 | 0.061 | 0.063 | 0.065 | 0.053 | 100.0% | 10 |
| total | 0.477 | 0.53 | 0.699 | 0.711 | 0.723 | 0.569 | 100.0% | 10 |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.69243693352
Full duration: 9.33592200279
test scenario Authenticate.validate_cinder
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_cinder | 0.276 | 0.29 | 0.335 | 0.335 | 0.335 | 0.302 | 100.0% | 10 |
| authenticate.validate_cinder (2) | 0.257 | 0.29 | 0.318 | 0.346 | 0.374 | 0.297 | 100.0% | 10 |
| total | 0.719 | 0.773 | 0.853 | 0.863 | 0.873 | 0.781 | 100.0% | 10 |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.3241250515
Full duration: 9.87282705307
test scenario Authenticate.validate_neutron
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_neutron | 0.289 | 0.309 | 0.329 | 0.334 | 0.34 | 0.31 | 100.0% | 10 |
| authenticate.validate_neutron (2) | 0.044 | 0.294 | 0.324 | 0.365 | 0.406 | 0.265 | 100.0% | 10 |
| total | 0.533 | 0.752 | 0.809 | 0.831 | 0.854 | 0.734 | 100.0% | 10 |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.165102005
Full duration: 9.4830288887
run_rally - INFO - Test scenario: "authenticate" OK.
run_rally - INFO - Starting test scenario "glance" ...
run_rally - INFO -
Preparing input task
Task 158cf9e7-5336-4cfc-be40-3e75d061e99a: started
Task 158cf9e7-5336-4cfc-be40-3e75d061e99a: finished
test scenario GlanceImages.list_images
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| glance.list_images | 0.726 | 0.781 | 0.882 | 0.891 | 0.899 | 0.807 | 100.0% | 10 |
| total | 0.726 | 0.783 | 0.882 | 0.891 | 0.899 | 0.807 | 100.0% | 10 |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.53244495392
Full duration: 12.5428349972
test scenario GlanceImages.create_image_and_boot_instances
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| glance.create_image | 6.979 | 7.618 | 7.794 | 7.829 | 7.863 | 7.563 | 100.0% | 10 |
| nova.boot_servers | 8.651 | 10.765 | 11.756 | 11.781 | 11.807 | 10.556 | 100.0% | 10 |
| total | 15.879 | 18.421 | 19.261 | 19.311 | 19.36 | 18.119 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 53.8314111233
Full duration: 120.073235035
test scenario GlanceImages.create_and_list_image
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| glance.create_image | 7.329 | 7.6 | 7.99 | 8.113 | 8.236 | 7.653 | 100.0% | 10 |
| glance.list_images | 0.333 | 0.582 | 0.613 | 0.646 | 0.679 | 0.566 | 100.0% | 10 |
| total | 7.902 | 8.164 | 8.547 | 8.674 | 8.802 | 8.219 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 24.6576690674
Full duration: 38.7420179844
test scenario GlanceImages.create_and_delete_image
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| glance.create_image | 7.217 | 7.695 | 7.985 | 8.039 | 8.092 | 7.694 | 100.0% | 10 |
| glance.delete_image | 1.995 | 2.137 | 2.493 | 2.608 | 2.722 | 2.22 | 100.0% | 10 |
| total | 9.374 | 10.024 | 10.211 | 10.289 | 10.367 | 9.914 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 29.6123759747
Full duration: 39.9493000507
run_rally - INFO - Test scenario: "glance" OK.
run_rally - INFO - Starting test scenario "cinder" ...
run_rally - INFO -
Preparing input task
Task b1aa2d13-0f7a-4bff-8331-81336fed8893: started
Task b1aa2d13-0f7a-4bff-8331-81336fed8893: finished
test scenario CinderVolumes.create_and_attach_volume
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 6.503 | 8.078 | 8.609 | 8.703 | 8.796 | 7.961 | 100.0% | 10 |
| cinder.create_volume | 3.188 | 3.68 | 3.956 | 3.978 | 4.0 | 3.679 | 100.0% | 10 |
| nova.attach_volume | 3.64 | 4.357 | 6.302 | 6.474 | 6.646 | 4.857 | 100.0% | 10 |
| nova.detach_volume | 3.578 | 3.916 | 4.783 | 4.818 | 4.854 | 4.034 | 100.0% | 10 |
| cinder.delete_volume | 0.561 | 1.816 | 3.1 | 3.132 | 3.165 | 1.823 | 100.0% | 10 |
| nova.delete_server | 2.774 | 2.91 | 3.153 | 3.263 | 3.373 | 2.961 | 100.0% | 10 |
| total | 22.849 | 25.428 | 26.942 | 27.99 | 29.037 | 25.315 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 75.149212122
Full duration: 118.157259941
test scenario CinderVolumes.create_and_list_volume
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 7.83 | 9.929 | 10.531 | 10.536 | 10.541 | 9.772 | 100.0% | 10 |
| cinder.list_volumes | 0.08 | 0.374 | 0.44 | 0.453 | 0.465 | 0.361 | 100.0% | 10 |
| total | 8.172 | 10.346 | 10.952 | 10.96 | 10.967 | 10.134 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 29.4478600025
Full duration: 52.5886940956
test scenario CinderVolumes.create_and_list_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.301 | 3.843 | 4.226 | 4.357 | 4.488 | 3.882 | 100.0% | 10 |
| cinder.list_volumes | 0.053 | 0.331 | 0.398 | 0.398 | 0.398 | 0.273 | 100.0% | 10 |
| total | 3.637 | 4.144 | 4.619 | 4.733 | 4.847 | 4.156 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 12.4273290634
Full duration: 34.9144048691
test scenario CinderVolumes.create_and_list_snapshots
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_snapshot | 2.946 | 3.307 | 3.538 | 3.549 | 3.56 | 3.273 | 100.0% | 10 |
| cinder.list_snapshots | 0.028 | 0.295 | 0.328 | 0.338 | 0.348 | 0.201 | 100.0% | 10 |
| total | 3.176 | 3.555 | 3.638 | 3.662 | 3.686 | 3.474 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 10.5382380486
Full duration: 51.362334013
test scenario CinderVolumes.create_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.624 | 3.895 | 4.231 | 4.281 | 4.331 | 3.947 | 100.0% | 10 |
| cinder.delete_volume | 0.812 | 1.949 | 3.114 | 3.122 | 3.131 | 1.972 | 100.0% | 10 |
| total | 4.618 | 5.84 | 7.204 | 7.278 | 7.351 | 5.92 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 16.7822580338
Full duration: 34.5782420635
test scenario CinderVolumes.create_and_delete_volume
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 9.294 | 9.687 | 9.755 | 9.776 | 9.798 | 9.602 | 100.0% | 10 |
| cinder.delete_volume | 0.832 | 2.037 | 2.912 | 3.099 | 3.287 | 1.974 | 100.0% | 10 |
| total | 10.153 | 11.549 | 12.579 | 12.706 | 12.832 | 11.576 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 33.8279159069
Full duration: 52.5032699108
test scenario CinderVolumes.create_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.531 | 3.917 | 4.114 | 4.116 | 4.119 | 3.89 | 100.0% | 10 |
| cinder.delete_volume | 0.795 | 0.992 | 3.094 | 3.232 | 3.371 | 1.405 | 100.0% | 10 |
| total | 4.55 | 4.893 | 6.895 | 7.065 | 7.235 | 5.295 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 14.6577680111
Full duration: 32.7706868649
test scenario CinderVolumes.create_and_upload_volume_to_image
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.529 | 3.821 | 4.216 | 4.22 | 4.223 | 3.861 | 100.0% | 10 |
| cinder.upload_volume_to_image | 19.02 | 29.858 | 31.714 | 31.91 | 32.105 | 28.579 | 100.0% | 10 |
| cinder.delete_volume | 0.778 | 2.823 | 3.199 | 3.243 | 3.288 | 2.495 | 100.0% | 10 |
| nova.delete_image | 2.394 | 2.794 | 4.071 | 9.486 | 14.9 | 3.949 | 100.0% | 10 |
| total | 28.359 | 39.027 | 42.376 | 45.938 | 49.5 | 38.885 | 100.0% | 10 |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 119.134256124
Full duration: 139.814013958
test scenario CinderVolumes.create_and_delete_snapshot
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_snapshot | 3.047 | 3.312 | 3.751 | 4.588 | 5.426 | 3.504 | 100.0% | 10 |
| cinder.delete_snapshot | 2.515 | 2.959 | 3.129 | 3.134 | 3.139 | 2.904 | 100.0% | 10 |
| total | 5.93 | 6.273 | 6.77 | 7.355 | 7.941 | 6.408 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 18.6710958481
Full duration: 52.810079813
test scenario CinderVolumes.create_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.645 | 3.983 | 4.278 | 4.284 | 4.291 | 4.015 | 100.0% | 10 |
| total | 3.645 | 3.983 | 4.278 | 4.284 | 4.291 | 4.015 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 11.9593629837
Full duration: 30.0458798409
test scenario CinderVolumes.create_volume
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-----+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-----+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.5 | 4.11 | 4.423 | 4.479 | 4.535 | 4.045 | 100.0% | 10 |
| total | 3.5 | 4.11 | 4.423 | 4.479 | 4.535 | 4.045 | 100.0% | 10 |
+----------------------+-----+--------+--------+--------+-------+-------+---------+-------+
Load duration: 11.9883899689
Full duration: 34.5793349743
test scenario CinderVolumes.list_volumes
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.list_volumes | 0.527 | 0.566 | 0.622 | 0.634 | 0.647 | 0.579 | 100.0% | 10 |
| total | 0.527 | 0.566 | 0.622 | 0.635 | 0.647 | 0.579 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.71377515793
Full duration: 66.8403449059
test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.423 | 3.79 | 4.204 | 4.228 | 4.253 | 3.832 | 100.0% | 10 |
| cinder.create_snapshot | 2.595 | 2.914 | 3.105 | 3.107 | 3.109 | 2.93 | 100.0% | 10 |
| nova.attach_volume | 3.943 | 6.629 | 7.921 | 8.552 | 9.183 | 6.368 | 100.0% | 10 |
| nova.detach_volume | 3.275 | 3.933 | 4.098 | 4.151 | 4.204 | 3.813 | 100.0% | 10 |
| cinder.delete_snapshot | 2.26 | 2.576 | 3.109 | 3.173 | 3.237 | 2.627 | 100.0% | 10 |
| cinder.delete_volume | 0.572 | 2.766 | 2.935 | 3.011 | 3.086 | 2.543 | 100.0% | 10 |
| total | 20.778 | 22.953 | 25.368 | 26.28 | 27.193 | 23.194 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 69.8529119492
Full duration: 173.89911294
test scenario CinderVolumes.create_from_volume_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.664 | 3.994 | 4.4 | 4.405 | 4.411 | 4.043 | 100.0% | 10 |
| cinder.delete_volume | 2.706 | 3.262 | 3.503 | 3.525 | 3.547 | 3.211 | 100.0% | 10 |
| total | 6.956 | 7.239 | 7.437 | 7.513 | 7.589 | 7.254 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 21.7929730415
Full duration: 56.4282138348
test scenario CinderVolumes.create_and_extend_volume
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.519 | 3.91 | 4.25 | 4.293 | 4.336 | 3.898 | 100.0% | 10 |
| cinder.extend_volume | 0.954 | 3.479 | 3.822 | 3.974 | 4.126 | 3.266 | 100.0% | 10 |
| cinder.delete_volume | 2.743 | 3.002 | 3.324 | 3.34 | 3.356 | 3.018 | 100.0% | 10 |
| total | 8.353 | 10.523 | 10.792 | 10.838 | 10.885 | 10.182 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 30.6360728741
Full duration: 49.9283909798
test scenario CinderVolumes.create_snapshot_and_attach_volume
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.39 | 3.97 | 4.263 | 4.45 | 4.638 | 3.957 | 100.0% | 10 |
| cinder.create_snapshot | 2.608 | 3.069 | 3.308 | 3.31 | 3.312 | 3.012 | 100.0% | 10 |
| nova.attach_volume | 4.043 | 5.478 | 7.465 | 8.181 | 8.896 | 5.734 | 100.0% | 10 |
| nova.detach_volume | 3.111 | 3.712 | 4.231 | 4.297 | 4.362 | 3.748 | 100.0% | 10 |
| cinder.delete_snapshot | 2.272 | 2.63 | 2.889 | 3.032 | 3.174 | 2.679 | 100.0% | 10 |
| cinder.delete_volume | 0.594 | 2.64 | 3.158 | 3.173 | 3.187 | 2.251 | 100.0% | 10 |
| total | 18.408 | 23.294 | 24.568 | 24.632 | 24.697 | 22.576 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 68.1245191097
Full duration: 178.916586161
test scenario CinderVolumes.create_snapshot_and_attach_volume
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.136 | 3.923 | 4.27 | 4.334 | 4.398 | 3.903 | 100.0% | 10 |
| cinder.create_snapshot | 2.708 | 2.894 | 3.269 | 3.309 | 3.348 | 2.997 | 100.0% | 10 |
| nova.attach_volume | 3.853 | 5.659 | 9.176 | 9.424 | 9.673 | 6.046 | 100.0% | 10 |
| nova.detach_volume | 3.349 | 3.857 | 4.334 | 4.582 | 4.829 | 3.88 | 100.0% | 10 |
| cinder.delete_snapshot | 2.261 | 2.578 | 3.148 | 3.183 | 3.219 | 2.687 | 100.0% | 10 |
| cinder.delete_volume | 2.584 | 2.856 | 3.08 | 3.208 | 3.335 | 2.877 | 100.0% | 10 |
| total | 21.769 | 23.113 | 27.189 | 27.9 | 28.611 | 24.037 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 69.8956279755
Full duration: 185.589872122
run_rally - INFO - Test scenario: "cinder" OK.
run_rally - INFO - Starting test scenario "heat" ...
run_rally - INFO -
Preparing input task
Task 6323c0be-a020-4b31-99f0-846288593cf5: started
Task 6323c0be-a020-4b31-99f0-846288593cf5: finished
test scenario HeatStacks.create_suspend_resume_delete_stack
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| heat.create_stack | 3.897 | 4.064 | 4.38 | 4.573 | 4.766 | 4.148 | 100.0% | 10 |
| heat.suspend_stack | 0.856 | 1.754 | 2.035 | 2.047 | 2.058 | 1.584 | 100.0% | 10 |
| heat.resume_stack | 1.455 | 1.659 | 1.714 | 1.716 | 1.718 | 1.62 | 100.0% | 10 |
| heat.delete_stack | 1.394 | 1.581 | 2.739 | 2.752 | 2.765 | 1.784 | 100.0% | 10 |
| total | 8.071 | 9.183 | 10.285 | 10.314 | 10.344 | 9.135 | 100.0% | 10 |
+--------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 27.614921093
Full duration: 38.014703989
test scenario HeatStacks.create_and_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 4.032 | 4.108 | 4.322 | 4.37 | 4.419 | 4.169 | 100.0% | 10 |
| heat.delete_stack | 1.408 | 1.463 | 1.821 | 2.204 | 2.588 | 1.599 | 100.0% | 10 |
| total | 5.497 | 5.706 | 5.963 | 6.33 | 6.698 | 5.768 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 17.1844079494
Full duration: 27.193780899
test scenario HeatStacks.create_and_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 22.283 | 23.81 | 24.26 | 24.642 | 25.023 | 23.576 | 100.0% | 10 |
| heat.delete_stack | 10.675 | 11.83 | 13.071 | 13.072 | 13.073 | 12.167 | 100.0% | 10 |
| total | 33.542 | 35.738 | 36.805 | 36.843 | 36.881 | 35.743 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 107.773921967
Full duration: 118.200341225
test scenario HeatStacks.create_and_delete_stack
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
| heat.create_stack | 18.184 | 20.407 | 21.635 | 21.85 | 22.065 | 20.2 | 100.0% | 10 |
| heat.delete_stack | 10.601 | 10.722 | 11.882 | 11.945 | 12.008 | 11.03 | 100.0% | 10 |
| total | 28.903 | 31.02 | 33.025 | 33.24 | 33.455 | 31.23 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 92.4247808456
Full duration: 102.624263048
test scenario HeatStacks.list_stacks_and_resources
+------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.list_stacks | 0.493 | 0.534 | 0.591 | 0.604 | 0.617 | 0.542 | 100.0% | 10 |
| heat.list_resources_of_0_stacks | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
| total | 0.493 | 0.534 | 0.592 | 0.604 | 0.617 | 0.542 | 100.0% | 10 |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.70831894875
Full duration: 10.6722428799
test scenario HeatStacks.create_update_delete_stack
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 4.142 | 4.331 | 4.481 | 4.527 | 4.573 | 4.327 | 100.0% | 10 |
| heat.update_stack | 3.575 | 3.673 | 3.746 | 3.752 | 3.758 | 3.674 | 100.0% | 10 |
| heat.delete_stack | 1.9 | 2.609 | 2.795 | 2.836 | 2.877 | 2.6 | 100.0% | 10 |
| total | 9.714 | 10.635 | 10.858 | 10.879 | 10.899 | 10.601 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 32.1056320667
Full duration: 42.6386361122
test scenario HeatStacks.create_update_delete_stack
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| heat.create_stack | 4.12 | 4.273 | 4.323 | 4.33 | 4.336 | 4.247 | 100.0% | 10 |
| heat.update_stack | 3.504 | 3.594 | 3.722 | 3.741 | 3.76 | 3.615 | 100.0% | 10 |
| heat.delete_stack | 1.391 | 1.433 | 1.71 | 2.139 | 2.568 | 1.584 | 100.0% | 10 |
| total | 9.04 | 9.38 | 9.599 | 10.09 | 10.581 | 9.447 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 29.2272830009
Full duration: 40.1677620411
test scenario HeatStacks.create_update_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 3.97 | 4.292 | 4.415 | 4.448 | 4.481 | 4.271 | 100.0% | 10 |
| heat.update_stack | 5.842 | 5.898 | 5.997 | 6.123 | 6.248 | 5.932 | 100.0% | 10 |
| heat.delete_stack | 2.495 | 2.556 | 3.706 | 3.713 | 3.721 | 2.769 | 100.0% | 10 |
| total | 12.606 | 12.776 | 13.842 | 13.936 | 14.029 | 12.972 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 39.4572560787
Full duration: 50.1925730705
test scenario HeatStacks.create_update_delete_stack
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+-------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+-------+--------+---------+-------+
| heat.create_stack | 4.629 | 5.407 | 5.516 | 5.7 | 5.884 | 5.364 | 100.0% | 10 |
| heat.update_stack | 8.444 | 9.309 | 9.353 | 9.359 | 9.365 | 9.16 | 100.0% | 10 |
| heat.delete_stack | 3.645 | 3.715 | 3.749 | 3.76 | 3.771 | 3.715 | 100.0% | 10 |
| total | 17.585 | 18.448 | 18.542 | 18.731 | 18.92 | 18.239 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+-------+--------+---------+-------+
Load duration: 54.5839819908
Full duration: 66.1476221085
test scenario HeatStacks.create_update_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 4.153 | 4.42 | 4.537 | 4.626 | 4.716 | 4.414 | 100.0% | 10 |
| heat.update_stack | 5.756 | 5.867 | 5.968 | 5.986 | 6.003 | 5.879 | 100.0% | 10 |
| heat.delete_stack | 2.537 | 2.569 | 3.682 | 3.771 | 3.859 | 2.812 | 100.0% | 10 |
| total | 12.735 | 12.934 | 13.781 | 13.841 | 13.901 | 13.105 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 39.6327600479
Full duration: 51.5351819992
test scenario HeatStacks.create_update_delete_stack
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| heat.create_stack | 4.216 | 4.41 | 4.524 | 4.563 | 4.602 | 4.398 | 100.0% | 10 |
| heat.update_stack | 3.532 | 3.608 | 3.773 | 3.784 | 3.795 | 3.634 | 100.0% | 10 |
| heat.delete_stack | 1.377 | 1.48 | 2.549 | 2.553 | 2.557 | 1.868 | 100.0% | 10 |
| total | 9.266 | 9.676 | 10.603 | 10.665 | 10.728 | 9.9 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 29.3563029766
Full duration: 41.178768158
test scenario HeatStacks.create_and_list_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 4.154 | 4.25 | 4.32 | 4.358 | 4.396 | 4.255 | 100.0% | 10 |
| heat.list_stacks | 0.074 | 0.097 | 0.126 | 0.128 | 0.13 | 0.104 | 100.0% | 10 |
| total | 4.279 | 4.357 | 4.412 | 4.448 | 4.484 | 4.359 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 13.1276688576
Full duration: 29.3930869102
test scenario HeatStacks.create_check_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 4.092 | 4.317 | 4.556 | 4.566 | 4.577 | 4.328 | 100.0% | 10 |
| heat.check_stack | 1.476 | 1.524 | 1.598 | 1.722 | 1.845 | 1.56 | 100.0% | 10 |
| heat.delete_stack | 1.38 | 2.515 | 2.587 | 2.689 | 2.791 | 2.103 | 100.0% | 10 |
| total | 7.059 | 8.243 | 8.619 | 8.666 | 8.713 | 7.99 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 24.3825399876
Full duration: 35.8954949379
run_rally - INFO - Test scenario: "heat" OK.
run_rally - INFO - Starting test scenario "keystone" ...
run_rally - INFO -
Preparing input task
Task 01416586-e6ad-4e3a-a1a2-6fc6305bbaea: started
Task 01416586-e6ad-4e3a-a1a2-6fc6305bbaea: finished
test scenario KeystoneBasic.create_tenant_with_users
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.27 | 0.298 | 0.409 | 0.435 | 0.46 | 0.321 | 100.0% | 10 |
| keystone.create_users | 1.62 | 1.702 | 1.784 | 1.8 | 1.816 | 1.71 | 100.0% | 10 |
| total | 1.925 | 2.027 | 2.126 | 2.152 | 2.178 | 2.031 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 6.16570997238
Full duration: 22.7167549133
test scenario KeystoneBasic.create_add_and_list_user_roles
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.266 | 0.303 | 0.411 | 0.414 | 0.418 | 0.326 | 100.0% | 10 |
| keystone.add_role | 0.268 | 0.295 | 0.314 | 0.344 | 0.373 | 0.3 | 100.0% | 10 |
| keystone.list_roles | 0.148 | 0.159 | 0.168 | 0.169 | 0.17 | 0.158 | 100.0% | 10 |
| total | 0.695 | 0.767 | 0.865 | 0.868 | 0.872 | 0.784 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.35486006737
Full duration: 15.306978941
test scenario KeystoneBasic.add_and_remove_user_role
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.29 | 0.387 | 0.421 | 0.453 | 0.485 | 0.366 | 100.0% | 10 |
| keystone.add_role | 0.258 | 0.281 | 0.337 | 0.355 | 0.373 | 0.294 | 100.0% | 10 |
| keystone.remove_role | 0.164 | 0.171 | 0.231 | 0.302 | 0.373 | 0.197 | 100.0% | 10 |
| total | 0.747 | 0.827 | 0.964 | 1.078 | 1.191 | 0.857 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.82508516312
Full duration: 16.1954729557
test scenario KeystoneBasic.create_update_and_delete_tenant
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.258 | 0.319 | 0.527 | 0.533 | 0.538 | 0.37 | 100.0% | 10 |
| keystone.update_tenant | 0.138 | 0.159 | 0.258 | 0.263 | 0.269 | 0.18 | 100.0% | 10 |
| keystone.delete_tenant | 0.319 | 0.34 | 0.454 | 0.455 | 0.455 | 0.371 | 100.0% | 10 |
| total | 0.776 | 0.89 | 1.119 | 1.121 | 1.124 | 0.922 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.63998699188
Full duration: 14.1927289963
test scenario KeystoneBasic.create_and_delete_service
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_service | 0.278 | 0.299 | 0.315 | 0.315 | 0.316 | 0.3 | 100.0% | 10 |
| keystone.delete_service | 0.15 | 0.17 | 0.241 | 0.247 | 0.253 | 0.182 | 100.0% | 10 |
| total | 0.434 | 0.481 | 0.533 | 0.538 | 0.544 | 0.482 | 100.0% | 10 |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.47481298447
Full duration: 13.4397730827
test scenario KeystoneBasic.create_tenant
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.301 | 0.315 | 0.339 | 0.384 | 0.429 | 0.325 | 100.0% | 10 |
| total | 0.301 | 0.316 | 0.339 | 0.384 | 0.429 | 0.325 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.985784053802
Full duration: 9.20213198662
test scenario KeystoneBasic.create_user
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+------+--------+--------+--------+-------+------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+------+--------+--------+--------+-------+------+---------+-------+
| keystone.create_user | 0.31 | 0.315 | 0.333 | 0.333 | 0.333 | 0.32 | 100.0% | 10 |
| total | 0.31 | 0.315 | 0.333 | 0.333 | 0.333 | 0.32 | 100.0% | 10 |
+----------------------+------+--------+--------+--------+-------+------+---------+-------+
Load duration: 1.00818705559
Full duration: 9.22635006905
test scenario KeystoneBasic.create_and_list_tenants
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.287 | 0.304 | 0.325 | 0.327 | 0.329 | 0.306 | 100.0% | 10 |
| keystone.list_tenants | 0.127 | 0.136 | 0.153 | 0.157 | 0.16 | 0.139 | 100.0% | 10 |
| total | 0.42 | 0.445 | 0.462 | 0.466 | 0.469 | 0.445 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.36337804794
Full duration: 14.8872029781
test scenario KeystoneBasic.create_and_delete_role
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.282 | 0.386 | 0.408 | 0.422 | 0.436 | 0.365 | 100.0% | 10 |
| keystone.delete_role | 0.268 | 0.3 | 0.401 | 0.491 | 0.581 | 0.334 | 100.0% | 10 |
| total | 0.575 | 0.677 | 0.804 | 0.911 | 1.018 | 0.699 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.04137206078
Full duration: 14.1024041176
test scenario KeystoneBasic.get_entities
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.286 | 0.308 | 0.319 | 0.328 | 0.336 | 0.307 | 100.0% | 10 |
| keystone.create_user | 0.143 | 0.156 | 0.164 | 0.167 | 0.17 | 0.157 | 100.0% | 10 |
| keystone.create_role | 0.135 | 0.143 | 0.175 | 0.19 | 0.204 | 0.151 | 100.0% | 10 |
| keystone.get_tenant | 0.117 | 0.13 | 0.135 | 0.136 | 0.138 | 0.129 | 100.0% | 10 |
| keystone.get_user | 0.127 | 0.15 | 0.222 | 0.227 | 0.232 | 0.162 | 100.0% | 10 |
| keystone.get_role | 0.12 | 0.132 | 0.144 | 0.154 | 0.164 | 0.134 | 100.0% | 10 |
| keystone.service_list | 0.125 | 0.138 | 0.243 | 0.244 | 0.245 | 0.164 | 100.0% | 10 |
| keystone.get_service | 0.124 | 0.133 | 0.153 | 0.194 | 0.235 | 0.143 | 100.0% | 10 |
| total | 1.279 | 1.333 | 1.411 | 1.47 | 1.528 | 1.345 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.00930905342
Full duration: 20.4269800186
test scenario KeystoneBasic.create_and_list_users
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_user | 0.295 | 0.304 | 0.332 | 0.342 | 0.351 | 0.311 | 100.0% | 10 |
| keystone.list_users | 0.127 | 0.146 | 0.162 | 0.201 | 0.24 | 0.151 | 100.0% | 10 |
| total | 0.422 | 0.458 | 0.506 | 0.523 | 0.539 | 0.462 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.42111587524
Full duration: 9.87036585808
run_rally - INFO - Test scenario: "keystone" OK.
run_rally - INFO - Starting test scenario "neutron" ...
run_rally - INFO -
Preparing input task
Task 31a75089-836c-4dd2-bea5-146049608ff3: started
Task 31a75089-836c-4dd2-bea5-146049608ff3: finished
test scenario NeutronNetworks.create_and_delete_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.763 | 0.911 | 1.019 | 1.048 | 1.078 | 0.909 | 100.0% | 10 |
| neutron.delete_port | 0.237 | 0.633 | 0.682 | 0.717 | 0.752 | 0.534 | 100.0% | 10 |
| total | 1.07 | 1.489 | 1.683 | 1.704 | 1.726 | 1.443 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.20432686806
Full duration: 54.8132340908
test scenario NeutronNetworks.create_and_list_routers
+---------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.762 | 0.836 | 0.949 | 0.98 | 1.011 | 0.863 | 100.0% | 10 |
| neutron.create_router | 0.066 | 0.493 | 0.686 | 0.691 | 0.695 | 0.459 | 100.0% | 10 |
| neutron.add_interface_router | 0.262 | 0.695 | 0.795 | 0.844 | 0.892 | 0.637 | 100.0% | 10 |
| neutron.list_routers | 0.039 | 0.407 | 0.441 | 0.452 | 0.462 | 0.308 | 100.0% | 10 |
| total | 1.54 | 2.352 | 2.744 | 2.824 | 2.904 | 2.268 | 100.0% | 10 |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 7.36094808578
Full duration: 61.3011310101
test scenario NeutronNetworks.create_and_delete_routers
+------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.79 | 0.836 | 0.945 | 1.009 | 1.072 | 0.868 | 100.0% | 10 |
| neutron.create_router | 0.074 | 0.436 | 0.479 | 0.499 | 0.518 | 0.377 | 100.0% | 10 |
| neutron.add_interface_router | 0.284 | 0.545 | 0.739 | 0.812 | 0.886 | 0.527 | 100.0% | 10 |
| neutron.remove_interface_router | 0.221 | 0.615 | 0.709 | 0.724 | 0.739 | 0.518 | 100.0% | 10 |
| neutron.delete_router | 0.187 | 0.566 | 0.709 | 0.751 | 0.793 | 0.508 | 100.0% | 10 |
| total | 2.124 | 2.811 | 3.347 | 3.379 | 3.412 | 2.799 | 100.0% | 10 |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 8.68784189224
Full duration: 59.8806409836
test scenario NeutronNetworks.create_and_list_ports
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+------+---------+-------+
| neutron.create_port | 0.777 | 0.895 | 0.981 | 1.01 | 1.039 | 0.89 | 100.0% | 10 |
| neutron.list_ports | 0.525 | 0.678 | 0.726 | 0.735 | 0.743 | 0.65 | 100.0% | 10 |
| total | 1.351 | 1.564 | 1.694 | 1.729 | 1.764 | 1.54 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+------+---------+-------+
Load duration: 4.66481399536
Full duration: 56.677120924
test scenario NeutronNetworks.create_and_delete_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.785 | 0.926 | 1.065 | 1.065 | 1.065 | 0.914 | 100.0% | 10 |
| neutron.delete_subnet | 0.193 | 0.762 | 0.952 | 1.035 | 1.117 | 0.745 | 100.0% | 10 |
| total | 1.258 | 1.702 | 1.876 | 1.903 | 1.929 | 1.659 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 5.09031915665
Full duration: 56.7336909771
test scenario NeutronNetworks.create_and_delete_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.614 | 0.708 | 0.774 | 0.81 | 0.847 | 0.712 | 100.0% | 10 |
| neutron.delete_network | 0.144 | 0.554 | 0.592 | 0.645 | 0.698 | 0.489 | 100.0% | 10 |
| total | 0.809 | 1.248 | 1.41 | 1.418 | 1.427 | 1.202 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.66986989975
Full duration: 34.80159688
test scenario NeutronNetworks.create_and_list_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.627 | 0.707 | 0.85 | 0.851 | 0.853 | 0.719 | 100.0% | 10 |
| neutron.list_networks | 0.059 | 0.439 | 0.513 | 0.515 | 0.518 | 0.413 | 100.0% | 10 |
| total | 0.909 | 1.126 | 1.242 | 1.306 | 1.371 | 1.132 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.38921308517
Full duration: 36.8345379829
test scenario NeutronNetworks.create_and_update_routers
+---------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.751 | 0.824 | 0.876 | 0.921 | 0.967 | 0.832 | 100.0% | 10 |
| neutron.create_router | 0.431 | 0.473 | 0.541 | 0.577 | 0.613 | 0.489 | 100.0% | 10 |
| neutron.add_interface_router | 0.301 | 0.711 | 0.928 | 1.08 | 1.231 | 0.684 | 100.0% | 10 |
| neutron.update_router | 0.48 | 0.514 | 0.703 | 0.74 | 0.778 | 0.579 | 100.0% | 10 |
| total | 2.062 | 2.629 | 2.871 | 3.084 | 3.298 | 2.584 | 100.0% | 10 |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 7.65487504005
Full duration: 63.1229610443
test scenario NeutronNetworks.create_and_update_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.656 | 0.719 | 1.152 | 1.152 | 1.153 | 0.796 | 100.0% | 10 |
| neutron.update_network | 0.136 | 0.33 | 0.656 | 0.684 | 0.711 | 0.37 | 100.0% | 10 |
| total | 0.793 | 1.067 | 1.71 | 1.757 | 1.803 | 1.166 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.25723409653
Full duration: 35.7245519161
test scenario NeutronNetworks.create_and_update_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.757 | 0.871 | 0.937 | 0.949 | 0.961 | 0.872 | 100.0% | 10 |
| neutron.update_port | 0.152 | 0.553 | 0.69 | 0.695 | 0.7 | 0.449 | 100.0% | 10 |
| total | 1.013 | 1.374 | 1.562 | 1.591 | 1.621 | 1.322 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.26963686943
Full duration: 56.3142960072
test scenario NeutronNetworks.create_and_list_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.759 | 0.838 | 0.884 | 0.921 | 0.959 | 0.833 | 100.0% | 10 |
| neutron.list_subnets | 0.419 | 0.437 | 0.474 | 0.504 | 0.535 | 0.447 | 100.0% | 10 |
| total | 1.205 | 1.29 | 1.325 | 1.352 | 1.379 | 1.281 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.90167307854
Full duration: 56.5125339031
test scenario NeutronNetworks.create_and_update_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.739 | 0.86 | 0.894 | 0.899 | 0.904 | 0.847 | 100.0% | 10 |
| neutron.update_subnet | 0.215 | 0.626 | 0.747 | 0.751 | 0.754 | 0.619 | 100.0% | 10 |
| total | 0.992 | 1.503 | 1.597 | 1.604 | 1.611 | 1.466 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.40182685852
Full duration: 57.6830070019
run_rally - INFO - Test scenario: "neutron" OK.
run_rally - INFO - Starting test scenario "nova" ...
run_rally - INFO -
Preparing input task
Task 584052d3-7a9b-44cb-b72b-0fa69c80ff0f: started
Task 584052d3-7a9b-44cb-b72b-0fa69c80ff0f: finished
test scenario NovaKeypair.create_and_delete_keypair
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.create_keypair | 0.784 | 0.836 | 1.474 | 1.484 | 1.495 | 0.974 | 100.0% | 10 |
| nova.delete_keypair | 0.034 | 0.05 | 0.055 | 0.057 | 0.058 | 0.047 | 100.0% | 10 |
| total | 0.832 | 0.883 | 1.529 | 1.541 | 1.553 | 1.022 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.34695100784
Full duration: 45.7756779194
test scenario NovaServers.snapshot_server
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 7.554 | 10.346 | 11.835 | 11.965 | 12.095 | 10.244 | 100.0% | 10 |
| nova.create_image | 11.631 | 12.185 | 12.844 | 13.707 | 14.57 | 12.355 | 100.0% | 10 |
| nova.delete_server | 2.863 | 3.258 | 3.364 | 3.387 | 3.409 | 3.184 | 100.0% | 10 |
| nova.boot_server (2) | 7.672 | 8.531 | 9.58 | 9.806 | 10.032 | 8.647 | 100.0% | 10 |
| nova.delete_server (2) | 2.536 | 2.983 | 3.338 | 3.367 | 3.396 | 3.003 | 100.0% | 10 |
| nova.delete_image | 2.294 | 3.138 | 3.917 | 3.949 | 3.981 | 3.199 | 100.0% | 10 |
| total | 37.226 | 39.77 | 43.868 | 44.502 | 45.136 | 40.632 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 120.862003088
Full duration: 196.742653131
test scenario NovaKeypair.boot_and_delete_server_with_keypair
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_keypair | 0.722 | 0.911 | 1.196 | 1.303 | 1.41 | 0.932 | 100.0% | 10 |
| nova.boot_server | 8.584 | 9.058 | 10.234 | 10.397 | 10.559 | 9.363 | 100.0% | 10 |
| nova.delete_server | 2.535 | 3.3 | 3.362 | 3.407 | 3.453 | 3.174 | 100.0% | 10 |
| nova.delete_keypair | 0.037 | 0.048 | 0.055 | 0.057 | 0.059 | 0.049 | 100.0% | 10 |
| total | 12.316 | 13.426 | 14.867 | 14.936 | 15.006 | 13.518 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 39.9865550995
Full duration: 111.508669853
test scenario NovaKeypair.create_and_list_keypairs
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.create_keypair | 0.648 | 0.815 | 1.082 | 1.098 | 1.113 | 0.837 | 100.0% | 10 |
| nova.list_keypairs | 0.019 | 0.028 | 0.042 | 0.042 | 0.042 | 0.03 | 100.0% | 10 |
| total | 0.674 | 0.84 | 1.113 | 1.126 | 1.139 | 0.868 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.55701994896
Full duration: 46.8838369846
test scenario NovaServers.list_servers
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.list_servers | 1.225 | 1.717 | 2.028 | 2.148 | 2.269 | 1.703 | 100.0% | 10 |
| total | 1.225 | 1.717 | 2.028 | 2.149 | 2.269 | 1.703 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 5.18592405319
Full duration: 131.096873999
test scenario NovaServers.resize_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 7.681 | 9.106 | 9.667 | 9.855 | 10.043 | 8.967 | 100.0% | 10 |
| nova.resize | 41.039 | 42.444 | 47.666 | 47.89 | 48.113 | 43.647 | 100.0% | 10 |
| nova.resize_confirm | 3.05 | 3.839 | 5.756 | 5.796 | 5.836 | 4.129 | 100.0% | 10 |
| nova.delete_server | 2.538 | 2.977 | 3.37 | 3.436 | 3.502 | 2.99 | 100.0% | 10 |
| total | 56.14 | 58.909 | 63.601 | 64.059 | 64.517 | 59.734 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 175.1216681
Full duration: 218.552350998
test scenario NovaServers.boot_server_from_volume_and_delete
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 10.051 | 10.651 | 11.762 | 11.824 | 11.885 | 10.8 | 100.0% | 10 |
| nova.boot_server | 9.377 | 9.86 | 11.429 | 11.996 | 12.563 | 10.33 | 100.0% | 10 |
| nova.delete_server | 3.706 | 5.644 | 6.192 | 6.201 | 6.209 | 5.374 | 100.0% | 10 |
| total | 23.576 | 26.289 | 28.117 | 28.514 | 28.911 | 26.505 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 78.3103020191
Full duration: 163.452836037
test scenario NovaServers.boot_and_migrate_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 8.257 | 9.346 | 10.61 | 10.662 | 10.713 | 9.544 | 100.0% | 10 |
| nova.stop_server | 4.295 | 6.497 | 7.089 | 7.118 | 7.147 | 6.056 | 100.0% | 10 |
| nova.migrate | 9.675 | 12.304 | 13.12 | 13.229 | 13.338 | 12.161 | 100.0% | 10 |
| nova.resize_confirm | 3.122 | 3.507 | 4.272 | 4.364 | 4.457 | 3.653 | 100.0% | 10 |
| nova.delete_server | 2.554 | 3.188 | 3.429 | 3.496 | 3.562 | 3.139 | 100.0% | 10 |
| total | 32.033 | 35.063 | 36.096 | 36.58 | 37.064 | 34.553 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 105.193811893
Full duration: 148.141517878
test scenario NovaServers.boot_and_delete_server
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 8.014 | 9.185 | 9.831 | 10.523 | 11.215 | 9.243 | 100.0% | 10 |
| nova.delete_server | 2.908 | 3.295 | 3.466 | 3.472 | 3.478 | 3.254 | 100.0% | 10 |
| total | 11.295 | 12.557 | 13.028 | 13.839 | 14.649 | 12.498 | 100.0% | 10 |
+--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 36.6073288918
Full duration: 109.97128582
test scenario NovaServers.boot_and_rebuild_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 7.698 | 9.483 | 10.427 | 10.794 | 11.162 | 9.37 | 100.0% | 10 |
| nova.rebuild_server | 8.598 | 9.448 | 10.319 | 10.378 | 10.438 | 9.551 | 100.0% | 10 |
| nova.delete_server | 2.858 | 3.099 | 3.428 | 3.623 | 3.817 | 3.161 | 100.0% | 10 |
| total | 20.044 | 22.42 | 23.365 | 23.559 | 23.752 | 22.083 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 64.9432969093
Full duration: 139.465661049
test scenario NovaSecGroup.create_and_list_secgroups
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 4.683 | 5.344 | 5.852 | 5.859 | 5.866 | 5.356 | 100.0% | 10 |
| nova.create_100_rules | 42.414 | 45.678 | 47.163 | 47.368 | 47.574 | 45.254 | 100.0% | 10 |
| nova.list_security_groups | 0.175 | 0.212 | 0.354 | 0.608 | 0.863 | 0.283 | 100.0% | 10 |
| total | 47.348 | 51.421 | 52.56 | 52.638 | 52.716 | 50.893 | 100.0% | 10 |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 151.312942028
Full duration: 221.151799202
test scenario NovaSecGroup.create_and_delete_secgroups
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 4.207 | 5.153 | 5.865 | 6.016 | 6.167 | 5.223 | 100.0% | 10 |
| nova.create_100_rules | 44.426 | 45.496 | 46.391 | 46.57 | 46.749 | 45.514 | 100.0% | 10 |
| nova.delete_10_security_groups | 1.719 | 2.314 | 3.033 | 3.409 | 3.786 | 2.461 | 100.0% | 10 |
| total | 51.911 | 53.27 | 54.098 | 54.11 | 54.121 | 53.199 | 100.0% | 10 |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 158.767210007
Full duration: 204.404190063
test scenario NovaServers.boot_and_bounce_server
+-------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 8.232 | 10.238 | 11.257 | 11.387 | 11.516 | 9.989 | 100.0% | 10 |
| nova.reboot_server | 5.292 | 6.196 | 8.351 | 8.675 | 8.999 | 6.856 | 100.0% | 10 |
| nova.soft_reboot_server | 7.958 | 8.738 | 8.914 | 8.918 | 8.923 | 8.624 | 100.0% | 10 |
| nova.stop_server | 3.374 | 6.332 | 7.13 | 7.453 | 7.776 | 5.867 | 100.0% | 10 |
| nova.start_server | 2.904 | 4.376 | 4.992 | 5.042 | 5.093 | 4.338 | 100.0% | 10 |
| nova.rescue_server | 7.695 | 9.49 | 10.886 | 11.148 | 11.409 | 9.448 | 100.0% | 10 |
| nova.unrescue_server | 5.081 | 5.557 | 7.819 | 8.065 | 8.31 | 5.985 | 100.0% | 10 |
| nova.delete_server | 2.544 | 3.077 | 3.429 | 3.523 | 3.617 | 3.093 | 100.0% | 10 |
| total | 49.625 | 55.207 | 55.707 | 56.454 | 57.202 | 54.222 | 100.0% | 10 |
+-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 163.818984032
Full duration: 233.215523958
test scenario NovaServers.boot_server
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| nova.boot_server | 8.48 | 8.958 | 10.243 | 10.531 | 10.819 | 9.243 | 100.0% | 10 |
| total | 8.481 | 8.958 | 10.244 | 10.531 | 10.819 | 9.244 | 100.0% | 10 |
+------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 27.3609120846
Full duration: 84.3593919277
test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 4.247 | 5.184 | 5.369 | 5.396 | 5.424 | 5.095 | 100.0% | 10 |
| nova.create_100_rules | 40.661 | 43.059 | 43.938 | 44.458 | 44.978 | 42.794 | 100.0% | 10 |
| nova.boot_server | 6.947 | 8.26 | 9.169 | 9.358 | 9.548 | 8.098 | 100.0% | 10 |
| nova.get_attached_security_groups | 0.225 | 0.263 | 0.273 | 0.293 | 0.313 | 0.26 | 100.0% | 10 |
| nova.delete_server | 2.528 | 2.586 | 2.843 | 2.904 | 2.965 | 2.638 | 100.0% | 10 |
| nova.delete_10_security_groups | 1.791 | 2.426 | 2.99 | 3.057 | 3.123 | 2.475 | 100.0% | 10 |
| total | 59.505 | 61.408 | 62.425 | 63.244 | 64.063 | 61.363 | 100.0% | 10 |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 184.570534945
Full duration: 253.34465313
test scenario NovaServers.pause_and_unpause_server
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+-------+---------+-------+
| nova.boot_server | 7.448 | 9.26 | 10.374 | 10.502 | 10.629 | 9.397 | 100.0% | 10 |
| nova.pause_server | 2.424 | 3.161 | 3.286 | 3.379 | 3.472 | 3.026 | 100.0% | 10 |
| nova.unpause_server | 2.773 | 3.096 | 3.242 | 3.272 | 3.303 | 3.035 | 100.0% | 10 |
| nova.delete_server | 2.878 | 3.224 | 3.526 | 3.553 | 3.58 | 3.191 | 100.0% | 10 |
| total | 15.943 | 18.76 | 19.747 | 19.77 | 19.793 | 18.65 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 56.3870060444
Full duration: 124.540560007
test scenario NovaServers.boot_server_from_volume
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 9.453 | 10.083 | 10.563 | 10.801 | 11.039 | 10.104 | 100.0% | 10 |
| nova.boot_server | 9.213 | 10.415 | 10.885 | 11.116 | 11.346 | 10.301 | 100.0% | 10 |
| total | 18.667 | 20.779 | 21.44 | 21.628 | 21.816 | 20.405 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 60.3854188919
Full duration: 124.319462061
test scenario NovaServers.boot_and_list_server
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 8.037 | 9.396 | 10.043 | 10.516 | 10.989 | 9.351 | 100.0% | 10 |
| nova.list_servers | 0.654 | 1.026 | 1.113 | 1.156 | 1.198 | 0.988 | 100.0% | 10 |
| total | 8.984 | 10.311 | 11.119 | 11.575 | 12.032 | 10.339 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 31.5458390713
Full duration: 114.252287149
run_rally - INFO - Test scenario: "nova" OK.
run_rally - INFO - Starting test scenario "quotas" ...
run_rally - INFO -
Preparing input task
Task 5d3885f2-1759-48e8-9284-c14f3492c4f3: started
Task 5d3885f2-1759-48e8-9284-c14f3492c4f3: finished
test scenario Quotas.cinder_update
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 1.126 | 1.235 | 1.607 | 1.612 | 1.618 | 1.297 | 100.0% | 10 |
| total | 1.126 | 1.235 | 1.607 | 1.613 | 1.618 | 1.297 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.74135613441
Full duration: 16.1623110771
test scenario Quotas.neutron_update
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.407 | 0.429 | 0.526 | 0.528 | 0.531 | 0.447 | 100.0% | 10 |
| total | 0.552 | 0.586 | 0.666 | 0.671 | 0.676 | 0.599 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.82448792458
Full duration: 13.357311964
test scenario Quotas.cinder_update_and_delete
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 1.093 | 1.146 | 1.27 | 1.276 | 1.282 | 1.177 | 100.0% | 10 |
| quotas.delete_quotas | 0.536 | 0.907 | 0.975 | 1.01 | 1.046 | 0.862 | 100.0% | 10 |
| total | 1.67 | 2.089 | 2.177 | 2.184 | 2.192 | 2.039 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 6.09977889061
Full duration: 18.3411080837
test scenario Quotas.nova_update_and_delete
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.58 | 0.636 | 0.718 | 0.764 | 0.81 | 0.652 | 100.0% | 10 |
| quotas.delete_quotas | 0.018 | 0.026 | 0.035 | 0.039 | 0.043 | 0.028 | 100.0% | 10 |
| total | 0.616 | 0.657 | 0.741 | 0.793 | 0.844 | 0.68 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.00378704071
Full duration: 13.8784749508
test scenario Quotas.nova_update
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.583 | 0.637 | 0.914 | 1.049 | 1.185 | 0.713 | 100.0% | 10 |
| total | 0.583 | 0.637 | 0.914 | 1.05 | 1.186 | 0.713 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.00103402138
Full duration: 13.8432979584
run_rally - INFO - Test scenario: "quotas" OK.
run_rally - INFO - Starting test scenario "requests" ...
run_rally - INFO -
Preparing input task
Task 6e9ed029-0497-4707-a4d4-c83a848e12e4: started
Task 6e9ed029-0497-4707-a4d4-c83a848e12e4: finished
test scenario HttpRequests.check_random_request
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| requests.check_request | 0.044 | 0.183 | 0.349 | 0.376 | 0.402 | 0.201 | 100.0% | 10 |
| total | 0.045 | 0.183 | 0.349 | 0.376 | 0.403 | 0.201 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.716305971146
Full duration: 5.89718389511
test scenario HttpRequests.check_request
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| requests.check_request | 0.044 | 0.046 | 0.052 | 0.053 | 0.054 | 0.048 | 100.0% | 10 |
| total | 0.044 | 0.046 | 0.052 | 0.053 | 0.054 | 0.048 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.182355165482
Full duration: 5.23191189766
run_rally - INFO - Test scenario: "requests" OK.
run_rally - INFO -
Rally Summary Report
+===================+============+===============+===========+
| Module | Duration | nb. Test Run | Success |
+===================+============+===============+===========+
| authenticate | 00:58 | 10 | 100.00% |
+-------------------+------------+---------------+-----------+
| glance | 03:31 | 7 | 100.00% |
+-------------------+------------+---------------+-----------+
| cinder | 22:25 | 50 | 100.00% |
+-------------------+------------+---------------+-----------+
| heat | 10:53 | 35 | 100.00% |
+-------------------+------------+---------------+-----------+
| keystone | 02:39 | 29 | 100.00% |
+-------------------+------------+---------------+-----------+
| neutron | 10:30 | 31 | 100.00% |
+-------------------+------------+---------------+-----------+
| nova | 44:31 | 61 | 100.00% |
+-------------------+------------+---------------+-----------+
| quotas | 01:15 | 7 | 100.00% |
+-------------------+------------+---------------+-----------+
| requests | 00:11 | 2 | 100.00% |
+-------------------+------------+---------------+-----------+
+===================+============+===============+===========+
| TOTAL: | 01:36:57 | 232 | 100.00% |
+===================+============+===============+===========+
SDN Controller¶
ONOS¶
FUNCTEST.info: Running ONOS test case...
FUNCvirNetNB - INFO - Creating component Handle: ONOSrest
******************************
CASE INIT
******************************
['ONOSrest']
******************************
Result summary for Testcase2
******************************
[2016-02-21 09:55:56.965174] [FUNCvirNetNB] [CASE] Virtual Network NBI Test - Network Post
[2016-02-21 09:55:56.965727] [FUNCvirNetNB] [STEP] 2.1: Generate Post Data
[2016-02-21 09:55:56.966454] [FUNCvirNetNB] [STEP] 2.2: Post Data via HTTP
[2016-02-21 09:55:57.006264] [FUNCvirNetNB] [STEP] 2.3: Get Data via HTTP
[2016-02-21 09:55:57.037745] [FUNCvirNetNB] [STEP] 2.4: Compare Send Id and Get Id
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase3
******************************
[2016-02-21 09:55:57.048240] [FUNCvirNetNB] [CASE] Virtual Network NBI Test - Network Update
[2016-02-21 09:55:57.048783] [FUNCvirNetNB] [STEP] 3.1: Generate Post Data
[2016-02-21 09:55:57.049571] [FUNCvirNetNB] [STEP] 3.2: Post Data via HTTP
[2016-02-21 09:55:57.056744] [FUNCvirNetNB] [STEP] 3.3: Update Data via HTTP
[2016-02-21 09:55:57.064248] [FUNCvirNetNB] [STEP] 3.4: Get Data via HTTP
[2016-02-21 09:55:57.072845] [FUNCvirNetNB] [STEP] 3.5: Compare Update data.
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase4
******************************
[2016-02-21 09:55:57.084363] [FUNCvirNetNB] [CASE] Virtual Network NBI Test - Network Delete
[2016-02-21 09:55:57.084882] [FUNCvirNetNB] [STEP] 4.1: Generate Post Data
[2016-02-21 09:55:57.085617] [FUNCvirNetNB] [STEP] 4.2: Post Data via HTTP
[2016-02-21 09:55:57.093018] [FUNCvirNetNB] [STEP] 4.3: Delete Data via HTTP
[2016-02-21 09:55:57.099770] [FUNCvirNetNB] [STEP] 4.4: Get Data is NULL
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase5
******************************
[2016-02-21 09:56:02.115745] [FUNCvirNetNB] [CASE] Virtual Network NBI Test - Subnet Post
[2016-02-21 09:56:02.116339] [FUNCvirNetNB] [STEP] 5.1: Generate Post Data
[2016-02-21 09:56:02.117459] [FUNCvirNetNB] [STEP] 5.2: Post Network Data via HTTP(Post Subnet need post network)
[2016-02-21 09:56:02.126052] [FUNCvirNetNB] [STEP] 5.3: Post Subnet Data via HTTP
[2016-02-21 09:56:02.159577] [FUNCvirNetNB] [STEP] 5.4: Get Subnet Data via HTTP
[2016-02-21 09:56:02.172655] [FUNCvirNetNB] [STEP] 5.5: Compare Post Subnet Data via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase6
******************************
[2016-02-21 09:56:02.183187] [FUNCvirNetNB] [CASE] Virtual Network NBI Test - Subnet Update
[2016-02-21 09:56:02.183876] [FUNCvirNetNB] [STEP] 6.1: Generate Post Data
[2016-02-21 09:56:02.184887] [FUNCvirNetNB] [STEP] 6.2: Post Network Data via HTTP(Post Subnet need post network)
[2016-02-21 09:56:02.192777] [FUNCvirNetNB] [STEP] 6.3: Post Subnet Data via HTTP
[2016-02-21 09:56:02.201349] [FUNCvirNetNB] [STEP] 6.4: Update Subnet Data via HTTP
[2016-02-21 09:56:02.209629] [FUNCvirNetNB] [STEP] 6.5: Get Subnet Data via HTTP
[2016-02-21 09:56:02.216700] [FUNCvirNetNB] [STEP] 6.6: Compare Subnet Data
[2016-02-21 09:56:02.217492] [FUNCvirNetNB] [STEP] 6.7: Delete Subnet via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase7
******************************
[2016-02-21 09:56:02.227738] [FUNCvirNetNB] [CASE] Virtual Network NBI Test - Subnet Delete
[2016-02-21 09:56:02.228309] [FUNCvirNetNB] [STEP] 7.1: Generate Post Data
[2016-02-21 09:56:02.229188] [FUNCvirNetNB] [STEP] 7.2: Post Network Data via HTTP(Post Subnet need post network)
[2016-02-21 09:56:02.237036] [FUNCvirNetNB] [STEP] 7.3: Post Subnet Data via HTTP
[2016-02-21 09:56:02.245482] [FUNCvirNetNB] [STEP] 7.4: Delete Subnet Data via HTTP
[2016-02-21 09:56:02.253076] [FUNCvirNetNB] [STEP] 7.5: Get Subnet Data is NULL
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase8
******************************
[2016-02-21 09:56:07.269037] [FUNCvirNetNB] [CASE] Virtual Network NBI Test - Port Post
[2016-02-21 09:56:07.269689] [FUNCvirNetNB] [STEP] 8.1: Generate Post Data
[2016-02-21 09:56:07.270772] [FUNCvirNetNB] [STEP] 8.2: Post Network Data via HTTP(Post port need post network)
[2016-02-21 09:56:07.279440] [FUNCvirNetNB] [STEP] 8.3: Post Subnet Data via HTTP(Post port need post subnet)
[2016-02-21 09:56:07.287800] [FUNCvirNetNB] [STEP] 8.4: Post Port Data via HTTP
[2016-02-21 09:56:07.296863] [FUNCvirNetNB] [STEP] 8.5: Get Port Data via HTTP
[2016-02-21 09:56:07.306388] [FUNCvirNetNB] [STEP] 8.6: Compare Post Port Data
[2016-02-21 09:56:07.307677] [FUNCvirNetNB] [STEP] 8.7: Clean Data via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase9
******************************
[2016-02-21 09:56:07.318023] [FUNCvirNetNB] [CASE] Virtual Network NBI Test - Port Update
[2016-02-21 09:56:07.318708] [FUNCvirNetNB] [STEP] 9.1: Generate Post Data
[2016-02-21 09:56:07.320149] [FUNCvirNetNB] [STEP] 9.2: Post Network Data via HTTP(Post port need post network)
[2016-02-21 09:56:07.327326] [FUNCvirNetNB] [STEP] 9.3: Post Subnet Data via HTTP(Post port need post subnet)
[2016-02-21 09:56:07.336517] [FUNCvirNetNB] [STEP] 9.4: Post Port Data via HTTP
[2016-02-21 09:56:07.345702] [FUNCvirNetNB] [STEP] 9.5: Update Port Data via HTTP
[2016-02-21 09:56:07.354021] [FUNCvirNetNB] [STEP] 9.6: Get Port Data via HTTP
[2016-02-21 09:56:07.360429] [FUNCvirNetNB] [STEP] 9.7: Compare Update Port Data
[2016-02-21 09:56:07.361666] [FUNCvirNetNB] [STEP] 9.8: Clean Data via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase10
******************************
[2016-02-21 09:56:07.372086] [FUNCvirNetNB] [CASE] Virtual Network NBI Test - Port Delete
[2016-02-21 09:56:07.372739] [FUNCvirNetNB] [STEP] 10.1: Generate Post Data
[2016-02-21 09:56:07.373778] [FUNCvirNetNB] [STEP] 10.2: Post Network Data via HTTP(Post port need post network)
[2016-02-21 09:56:07.380739] [FUNCvirNetNB] [STEP] 10.3: Post Subnet Data via HTTP(Post port need post subnet)
[2016-02-21 09:56:07.388862] [FUNCvirNetNB] [STEP] 10.4: Post Port Data via HTTP
[2016-02-21 09:56:07.396014] [FUNCvirNetNB] [STEP] 10.5: Delete Port Data via HTTP
[2016-02-21 09:56:07.417621] [FUNCvirNetNB] [STEP] 10.6: Get Port Data is NULL
[2016-02-21 09:56:12.430407] [FUNCvirNetNB] [STEP] 10.7: Clean Data via HTTP
*****************************
Result: Pass
*****************************
*************************************
Test Execution Summary
*************************************
Test Start : 21 Feb 2016 09:55:56
Test End : 21 Feb 2016 09:56:12
Execution Time : 0:00:15.628718
Total tests planned : 9
Total tests RUN : 9
Total Pass : 9
Total Fail : 0
Total No Result : 0
Success Percentage : 100%
Execution Result : 100%
******************************
CASE INIT
******************************
['ONOSrest']
******************************
Result summary for Testcase2
******************************
[2016-02-21 09:56:12.836955] [FUNCvirNetNBL3] [CASE] Virtual Network NBI Test - Router Post
[2016-02-21 09:56:12.838221] [FUNCvirNetNBL3] [STEP] 2.1: Post Network Data via HTTP(Post Router need post network)
[2016-02-21 09:56:12.873649] [FUNCvirNetNBL3] [STEP] 2.2: Post Router Data via HTTP
[2016-02-21 09:56:12.881751] [FUNCvirNetNBL3] [STEP] 2.3: Get Router Data via HTTP
[2016-02-21 09:56:12.914578] [FUNCvirNetNBL3] [STEP] 2.4: Compare Post Router Data via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase3
******************************
[2016-02-21 09:56:12.930658] [FUNCvirNetNBL3] [CASE] Virtual Network NBI Test - Router Update
[2016-02-21 09:56:12.931841] [FUNCvirNetNBL3] [STEP] 3.1: Post Network Data via HTTP(Post Router need post network)
[2016-02-21 09:56:12.939584] [FUNCvirNetNBL3] [STEP] 3.2: Post Router Data via HTTP
[2016-02-21 09:56:12.946895] [FUNCvirNetNBL3] [STEP] 3.3: Update Router Data via HTTP
[2016-02-21 09:56:12.953601] [FUNCvirNetNBL3] [STEP] 3.4: Get Router Data via HTTP
[2016-02-21 09:56:12.959887] [FUNCvirNetNBL3] [STEP] 3.5: Compare Router Data
[2016-02-21 09:56:12.961048] [FUNCvirNetNBL3] [STEP] 3.6: Delete Router via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase4
******************************
[2016-02-21 09:56:12.970433] [FUNCvirNetNBL3] [CASE] Virtual Network NBI Test - Router Delete
[2016-02-21 09:56:12.971622] [FUNCvirNetNBL3] [STEP] 4.1: Post Network Data via HTTP(Post Router need post network)
[2016-02-21 09:56:12.979473] [FUNCvirNetNBL3] [STEP] 4.2: Post Router Data via HTTP
[2016-02-21 09:56:12.986263] [FUNCvirNetNBL3] [STEP] 4.3: Delete Router Data via HTTP
[2016-02-21 09:56:12.992190] [FUNCvirNetNBL3] [STEP] 4.4: Get Router Data is NULL
Verify the Router status
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase5
******************************
[2016-02-21 09:56:18.008957] [FUNCvirNetNBL3] [CASE] Virtual Network NBI Test - RouterInterface Post
[2016-02-21 09:56:18.010175] [FUNCvirNetNBL3] [STEP] 5.1: Post Network Data via HTTP(Post port need post network)
[2016-02-21 09:56:18.018296] [FUNCvirNetNBL3] [STEP] 5.2: Post Subnet Data via HTTP(Post port need post subnet)
[2016-02-21 09:56:18.026382] [FUNCvirNetNBL3] [STEP] 5.3: Post Port Data via HTTP
[2016-02-21 09:56:18.034099] [FUNCvirNetNBL3] [STEP] 5.4: Post Router Data via HTTP
[2016-02-21 09:56:18.040193] [FUNCvirNetNBL3] [STEP] 5.5: Put RouterInterface Data via HTTP
[2016-02-21 09:56:18.047317] [FUNCvirNetNBL3] [STEP] 5.6: Get RouterInterface Data via HTTP
[2016-02-21 09:56:18.053592] [FUNCvirNetNBL3] [STEP] 5.7: Compare Post Port Data
[2016-02-21 09:56:18.055253] [FUNCvirNetNBL3] [STEP] 5.8: Del RouterInterface Data via HTTP
[2016-02-21 09:56:18.062038] [FUNCvirNetNBL3] [STEP] 5.9: Clean Data via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase6
******************************
[2016-02-21 09:56:18.078391] [FUNCvirNetNBL3] [CASE] Virtual Network NBI Test - RouterInterface Delete
[2016-02-21 09:56:18.079883] [FUNCvirNetNBL3] [STEP] 6.1: Post Network Data via HTTP(Post port need post network)
[2016-02-21 09:56:18.087420] [FUNCvirNetNBL3] [STEP] 6.2: Post Subnet Data via HTTP(Post port need post subnet)
[2016-02-21 09:56:18.095337] [FUNCvirNetNBL3] [STEP] 6.3: Post Port Data via HTTP
[2016-02-21 09:56:18.103345] [FUNCvirNetNBL3] [STEP] 6.4: Post Router Data via HTTP
[2016-02-21 09:56:18.109767] [FUNCvirNetNBL3] [STEP] 6.5: Post RouterInterface Data via HTTP
[2016-02-21 09:56:18.116024] [FUNCvirNetNBL3] [STEP] 6.6: Del RouterInterface Data via HTTP
[2016-02-21 09:56:18.122686] [FUNCvirNetNBL3] [STEP] 6.7: Delete Port Data via HTTP
[2016-02-21 09:56:18.129655] [FUNCvirNetNBL3] [STEP] 6.8: Get Port Data is NULL
[2016-02-21 09:56:23.145559] [FUNCvirNetNBL3] [STEP] 6.9: Clean Data via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase7
******************************
[2016-02-21 09:56:23.164294] [FUNCvirNetNBL3] [CASE] Virtual Network NBI Test - FloatingIp Post
[2016-02-21 09:56:23.165631] [FUNCvirNetNBL3] [STEP] 7.1: Post Network Data via HTTP(Post port need post network)
[2016-02-21 09:56:23.173909] [FUNCvirNetNBL3] [STEP] 7.2: Post Subnet Data via HTTP(Post port need post subnet)
[2016-02-21 09:56:23.182105] [FUNCvirNetNBL3] [STEP] 7.3: Post Port Data via HTTP
[2016-02-21 09:56:23.189623] [FUNCvirNetNBL3] [STEP] 7.4: Post Router Data via HTTP
[2016-02-21 09:56:23.196108] [FUNCvirNetNBL3] [STEP] 7.5: Get Port Data via HTTP
[2016-02-21 09:56:23.204332] [FUNCvirNetNBL3] [STEP] 7.6: Post FloatingIp Data via HTTP
[2016-02-21 09:56:23.211580] [FUNCvirNetNBL3] [STEP] 7.7: Get Port Data via HTTP
[2016-02-21 09:56:23.218993] [FUNCvirNetNBL3] [STEP] 7.8: Get FloatingIp Data via HTTP
[2016-02-21 09:56:23.251318] [FUNCvirNetNBL3] [STEP] 7.9: Get FloatingIp Data via HTTP
[2016-02-21 09:56:23.259068] [FUNCvirNetNBL3] [STEP] 7.10: Compare Post FloatingIp Data
[2016-02-21 09:56:23.260001] [FUNCvirNetNBL3] [STEP] 7.11: Post FloatingIp Clean Data via HTTP
[2016-02-21 09:56:23.266784] [FUNCvirNetNBL3] [STEP] 7.12: Clean Data via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase8
******************************
[2016-02-21 09:56:23.289110] [FUNCvirNetNBL3] [CASE] Virtual Network NBI Test - FloatingIp Update
[2016-02-21 09:56:23.291300] [FUNCvirNetNBL3] [STEP] 8.1: Post Network Data via HTTP(Post port need post network)
[2016-02-21 09:56:23.299318] [FUNCvirNetNBL3] [STEP] 8.2: Post Subnet Data via HTTP(Post port need post subnet)
[2016-02-21 09:56:23.307738] [FUNCvirNetNBL3] [STEP] 8.3: Post Port Data via HTTP
[2016-02-21 09:56:23.315822] [FUNCvirNetNBL3] [STEP] 8.4: Post Router Data via HTTP
[2016-02-21 09:56:23.322853] [FUNCvirNetNBL3] [STEP] 8.5: Post FloatingIp Data via HTTP
[2016-02-21 09:56:23.329316] [FUNCvirNetNBL3] [STEP] 8.6: Post Delete Data via HTTP
[2016-02-21 09:56:23.337183] [FUNCvirNetNBL3] [STEP] 8.7: Post NewPort Data via HTTP
[2016-02-21 09:56:23.345756] [FUNCvirNetNBL3] [STEP] 8.8: Post NewFloatingIp Data via HTTP
[2016-02-21 09:56:23.353311] [FUNCvirNetNBL3] [STEP] 8.9: Get NewFloatingIp Data via HTTP
[2016-02-21 09:56:23.384949] [FUNCvirNetNBL3] [STEP] 8.10: Compare Post FloatingIp Data
[2016-02-21 09:56:23.385934] [FUNCvirNetNBL3] [STEP] 8.11: Post FloatingIp Clean Data via HTTP
[2016-02-21 09:56:23.392515] [FUNCvirNetNBL3] [STEP] 8.12: Clean Data via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase9
******************************
[2016-02-21 09:56:23.416898] [FUNCvirNetNBL3] [CASE] Virtual Network NBI Test - FloatingIp Delete
[2016-02-21 09:56:23.418399] [FUNCvirNetNBL3] [STEP] 9.1: Post Network Data via HTTP(Post port need post network)
[2016-02-21 09:56:23.425551] [FUNCvirNetNBL3] [STEP] 9.2: Post Subnet Data via HTTP(Post port need post subnet)
[2016-02-21 09:56:23.433217] [FUNCvirNetNBL3] [STEP] 9.3: Post Port Data via HTTP
[2016-02-21 09:56:23.440717] [FUNCvirNetNBL3] [STEP] 9.4: Post Router Data via HTTP
[2016-02-21 09:56:23.447116] [FUNCvirNetNBL3] [STEP] 9.5: Post FloatingIp Data via HTTP
[2016-02-21 09:56:23.454356] [FUNCvirNetNBL3] [STEP] 9.6: Post FloatingIp Clean Data via HTTP
[2016-02-21 09:56:23.465800] [FUNCvirNetNBL3] [STEP] 9.7: Get FloatingIp Data is NULL
[2016-02-21 09:56:28.479269] [FUNCvirNetNBL3] [STEP] 9.8: Clean Data via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase10
******************************
[2016-02-21 09:56:28.496538] [FUNCvirNetNBL3] [CASE] Virtual Network NBI Test - Gateway Post
[2016-02-21 09:56:28.498465] [FUNCvirNetNBL3] [STEP] 10.1: Post Network Data via HTTP(Post port need post network)
[2016-02-21 09:56:28.507466] [FUNCvirNetNBL3] [STEP] 10.2: Post Subnet Data via HTTP(Post port need post subnet)
[2016-02-21 09:56:28.515564] [FUNCvirNetNBL3] [STEP] 10.3: Post Port Data via HTTP
[2016-02-21 09:56:28.522598] [FUNCvirNetNBL3] [STEP] 10.4: Post Router Data via HTTP
[2016-02-21 09:56:28.528755] [FUNCvirNetNBL3] [STEP] 10.5: Get Gateway Data via HTTP
[2016-02-21 09:56:28.536142] [FUNCvirNetNBL3] [STEP] 10.6: Compare Post Gateway Data
[2016-02-21 09:56:28.537198] [FUNCvirNetNBL3] [STEP] 10.7: Clean Data via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase11
******************************
[2016-02-21 09:56:28.553805] [FUNCvirNetNBL3] [CASE] Virtual Network NBI Test - Gateway Update
[2016-02-21 09:56:28.555461] [FUNCvirNetNBL3] [STEP] 11.1: Post Network Data via HTTP(Post port need post network)
[2016-02-21 09:56:28.562664] [FUNCvirNetNBL3] [STEP] 11.2: Post Subnet Data via HTTP(Post port need post subnet)
[2016-02-21 09:56:28.570094] [FUNCvirNetNBL3] [STEP] 11.3: Post Port Data via HTTP
[2016-02-21 09:56:28.577203] [FUNCvirNetNBL3] [STEP] 11.4: Post Router Data via HTTP
[2016-02-21 09:56:28.583265] [FUNCvirNetNBL3] [STEP] 11.5: Post New Router Data via HTTP
[2016-02-21 09:56:28.589203] [FUNCvirNetNBL3] [STEP] 11.6: Get Gateway Data via HTTP
[2016-02-21 09:56:28.594700] [FUNCvirNetNBL3] [STEP] 11.7: Compare Post Gateway Data
[2016-02-21 09:56:28.595799] [FUNCvirNetNBL3] [STEP] 11.8: Clean Data via HTTP
*****************************
Result: Pass
*****************************
******************************
Result summary for Testcase12
******************************
[2016-02-21 09:56:28.611322] [FUNCvirNetNBL3] [CASE] Virtual Network NBI Test - Gateway Delete
[2016-02-21 09:56:28.612734] [FUNCvirNetNBL3] [STEP] 12.1: Post Network Data via HTTP(Post port need post network)
[2016-02-21 09:56:28.620160] [FUNCvirNetNBL3] [STEP] 12.2: Post Subnet Data via HTTP(Post port need post subnet)
[2016-02-21 09:56:28.628079] [FUNCvirNetNBL3] [STEP] 12.3: Post Port Data via HTTP
[2016-02-21 09:56:28.635761] [FUNCvirNetNBL3] [STEP] 12.4: Post Router Data via HTTP
[2016-02-21 09:56:28.642664] [FUNCvirNetNBL3] [STEP] 12.5: Post Del Gateway Data via HTTP
[2016-02-21 09:56:28.648775] [FUNCvirNetNBL3] [STEP] 12.6: Get Gateway Data via HTTP
[2016-02-21 09:56:28.654590] [FUNCvirNetNBL3] [STEP] 12.7: If Gateway Data is NULL
[2016-02-21 09:56:33.660980] [FUNCvirNetNBL3] [STEP] 12.8: Clean Data via HTTP
*****************************
Result: Pass
*****************************
*************************************
Test Execution Summary
*************************************
Test Start : 21 Feb 2016 09:56:12
Test End : 21 Feb 2016 09:56:33
Execution Time : 0:00:20.999784
Total tests planned : 11
Total tests RUN : 11
Total Pass : 11
Total Fail : 0
Total No Result : 0
Success Percentage : 100%
Execution Result : 100%
Feature tests¶
Promise¶
FUNCTEST.info: Running PROMISE test case...
Promise- INFO - Creating tenant 'promise'...
Promise- INFO - Adding role '9d0a0a36d3d54cdcb4cd3c29c5f79a28' to tenant 'promise'...
Promise- INFO - Creating user 'promiser'...
Promise- INFO - Updating OpenStack credentials...
Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
Promise- INFO - Creating flavor 'promise-flavor'...
Promise- INFO - Exporting environment variables...
Promise- INFO - Running command: npm run -s test -- --reporter json
Promise- INFO - The test succeeded.
Promise- DEBUG -
{
"stats": {
"suites": 23,
"tests": 33,
"passes": 33,
"pending": 0,
"failures": 0,
"start": "2016-02-21T09:56:46.846Z",
"end": "2016-02-21T09:56:51.847Z",
"duration": 5524
},
"tests": [
{
"title": "should add a new OpenStack provider without error",
"fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
"duration": 1217,
"err": {}
},
{
"title": "should update promise.providers with a new entry",
"fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
"duration": 10,
"err": {}
},
{
"title": "should contain a new ResourceProvider record in the store",
"fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
"duration": 0,
"err": {}
},
{
"title": "should add more capacity to the reservation service without error",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
"duration": 25,
"err": {}
},
{
"title": "should update promise.pools with a new entry",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
"duration": 1,
"err": {}
},
{
"title": "should contain a ResourcePool record in the store",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
"duration": 0,
"err": {}
},
{
"title": "should report total collections and utilizations",
"fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
"duration": 18,
"err": {}
},
{
"title": "should contain newly added capacity pool",
"fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
"duration": 8,
"err": {}
},
{
"title": "should create a new server in target provider without error",
"fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
"duration": 1768,
"err": {}
},
{
"title": "should update promise.allocations with a new entry",
"fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
"duration": 2,
"err": {}
},
{
"title": "should contain a new ResourceAllocation record in the store",
"fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should reference the created server ID from the provider",
"fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
"duration": 1,
"err": {}
},
{
"title": "should have low priority state",
"fullTitle": "promise allocation without reservation create-instance should have low priority state",
"duration": 0,
"err": {}
},
{
"title": "should create reservation record (no start/end) without error",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
"duration": 41,
"err": {}
},
{
"title": "should update promise.reservations with a new entry",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
"duration": 7,
"err": {}
},
{
"title": "should contain a new ResourceReservation record in the store",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should create a new server in target provider (with reservation) without error",
"fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
"duration": 1617,
"err": {}
},
{
"title": "should contain a new ResourceAllocation record in the store",
"fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
"duration": 1,
"err": {}
},
{
"title": "should be referenced in the reservation record",
"fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
"duration": 7,
"err": {}
},
{
"title": "should have high priority state",
"fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
"duration": 0,
"err": {}
},
{
"title": "should create reservation record (for future) without error",
"fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
"duration": 75,
"err": {}
},
{
"title": "should update promise.reservations with a new entry",
"fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
"duration": 17,
"err": {}
},
{
"title": "should contain a new ResourceReservation record in the store",
"fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should contain newly created future reservation",
"fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
"duration": 61,
"err": {}
},
{
"title": "should modify existing reservation without error",
"fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
"duration": 65,
"err": {}
},
{
"title": "should modify existing reservation without error",
"fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
"duration": 17,
"err": {}
},
{
"title": "should no longer contain record of the deleted reservation",
"fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
"duration": 0,
"err": {}
},
{
"title": "should decrease available capacity from a provider in the future",
"fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
"duration": 15,
"err": {}
},
{
"title": "should increase available capacity from a provider in the future",
"fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
"duration": 11,
"err": {}
},
{
"title": "should report available collections and utilizations",
"fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
"duration": 56,
"err": {}
},
{
"title": "should fail to create immediate reservation record with proper error",
"fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
"duration": 60,
"err": {}
},
{
"title": "should fail to create future reservation record with proper error",
"fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
"duration": 38,
"err": {}
},
{
"title": "should successfully destroy all allocations",
"fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
"duration": 361,
"err": {}
}
],
"pending": [],
"failures": [],
"passes": [
{
"title": "should add a new OpenStack provider without error",
"fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
"duration": 1217,
"err": {}
},
{
"title": "should update promise.providers with a new entry",
"fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
"duration": 10,
"err": {}
},
{
"title": "should contain a new ResourceProvider record in the store",
"fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
"duration": 0,
"err": {}
},
{
"title": "should add more capacity to the reservation service without error",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
"duration": 25,
"err": {}
},
{
"title": "should update promise.pools with a new entry",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
"duration": 1,
"err": {}
},
{
"title": "should contain a ResourcePool record in the store",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
"duration": 0,
"err": {}
},
{
"title": "should report total collections and utilizations",
"fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
"duration": 18,
"err": {}
},
{
"title": "should contain newly added capacity pool",
"fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
"duration": 8,
"err": {}
},
{
"title": "should create a new server in target provider without error",
"fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
"duration": 1768,
"err": {}
},
{
"title": "should update promise.allocations with a new entry",
"fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
"duration": 2,
"err": {}
},
{
"title": "should contain a new ResourceAllocation record in the store",
"fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should reference the created server ID from the provider",
"fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
"duration": 1,
"err": {}
},
{
"title": "should have low priority state",
"fullTitle": "promise allocation without reservation create-instance should have low priority state",
"duration": 0,
"err": {}
},
{
"title": "should create reservation record (no start/end) without error",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
"duration": 41,
"err": {}
},
{
"title": "should update promise.reservations with a new entry",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
"duration": 7,
"err": {}
},
{
"title": "should contain a new ResourceReservation record in the store",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should create a new server in target provider (with reservation) without error",
"fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
"duration": 1617,
"err": {}
},
{
"title": "should contain a new ResourceAllocation record in the store",
"fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
"duration": 1,
"err": {}
},
{
"title": "should be referenced in the reservation record",
"fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
"duration": 7,
"err": {}
},
{
"title": "should have high priority state",
"fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
"duration": 0,
"err": {}
},
{
"title": "should create reservation record (for future) without error",
"fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
"duration": 75,
"err": {}
},
{
"title": "should update promise.reservations with a new entry",
"fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
"duration": 17,
"err": {}
},
{
"title": "should contain a new ResourceReservation record in the store",
"fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should contain newly created future reservation",
"fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
"duration": 61,
"err": {}
},
{
"title": "should modify existing reservation without error",
"fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
"duration": 65,
"err": {}
},
{
"title": "should modify existing reservation without error",
"fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
"duration": 17,
"err": {}
},
{
"title": "should no longer contain record of the deleted reservation",
"fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
"duration": 0,
"err": {}
},
{
"title": "should decrease available capacity from a provider in the future",
"fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
"duration": 15,
"err": {}
},
{
"title": "should increase available capacity from a provider in the future",
"fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
"duration": 11,
"err": {}
},
{
"title": "should report available collections and utilizations",
"fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
"duration": 56,
"err": {}
},
{
"title": "should fail to create immediate reservation record with proper error",
"fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
"duration": 60,
"err": {}
},
{
"title": "should fail to create future reservation record with proper error",
"fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
"duration": 38,
"err": {}
},
{
"title": "should successfully destroy all allocations",
"fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
"duration": 361,
"err": {}
}
]
}
Promise- INFO -
****************************************
Promise test report
****************************************
Suites: 23
Tests: 33
Passes: 33
Pending: 0
Failures: 0
Start: 2016-02-21T09:56:46.846Z
End: 2016-02-21T09:56:51.847Z
Duration: 6.301
****************************************
Detailed test results for apex-os-odl_l2-nofeature-ha¶
VIM¶
vping_ssh¶
FUNCTEST.info: Running vPing-SSH test...
vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
vPing_ssh- INFO - Creating neutron network vping-net...
vPing_ssh- INFO - Creating security group 'vPing-sg'...
vPing_ssh- INFO - Using existing Flavor 'm1.small'...
vPing_ssh- INFO - vPing Start Time:'2016-02-23 07:43:00'
vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
name=opnfv-vping-1
flavor=<Flavor: m1.small>
image=a0698b8a-e881-4b84-b540-a0324d671c5a
network=df3509f4-ef3d-4264-9293-9e0688a5c38e
vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
name=opnfv-vping-2
flavor=<Flavor: m1.small>
image=a0698b8a-e881-4b84-b540-a0324d671c5a
network=df3509f4-ef3d-4264-9293-9e0688a5c38e
vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
vPing_ssh- INFO - Floating IP created: '172.30.9.201'
vPing_ssh- INFO - Associating floating ip: '172.30.9.201' to VM 'opnfv-vping-2'
vPing_ssh- INFO - Trying to establish SSH connection to 172.30.9.201...
vPing_ssh- INFO - Waiting for ping...
vPing_ssh- INFO - vPing detected!
vPing_ssh- INFO - vPing duration:'82.0' s.
vPing_ssh- INFO - Cleaning up...
vPing_ssh- INFO - vPing OK
vping_userdata¶
FUNCTEST.info: Running vPing-userdata test...
vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
vPing_userdata- INFO - Creating neutron network vping-net...
vPing_userdata- INFO - Creating security group 'vPing-sg'...
vPing_userdata- INFO - Flavor found 'm1.small'
vPing_userdata- INFO - vPing Start Time:'2016-02-23 07:44:41'
vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
name=opnfv-vping-1
flavor=<Flavor: m1.small>
image=78cd8dbf-54fb-43ce-9f19-7801130b5a99
network=a030c4ca-00ea-4913-bbec-505eaca9f5ff
vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
name=opnfv-vping-2
flavor=<Flavor: m1.small>
image=78cd8dbf-54fb-43ce-9f19-7801130b5a99
network=a030c4ca-00ea-4913-bbec-505eaca9f5ff
userdata=
#!/bin/sh
while true; do
ping -c 1 192.168.130.6 2>&1 >/dev/null
RES=$?
if [ "Z$RES" = "Z0" ] ; then
echo 'vPing OK'
break
else
echo 'vPing KO'
fi
sleep 1
done
vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
vPing_userdata- INFO - Waiting for ping...
vPing_userdata- INFO - vPing detected!
vPing_userdata- INFO - vPing duration:'72.7'
vPing_userdata- INFO - vPing OK
vPing_userdata- INFO - Cleaning up...
vPing_userdata- INFO - Deleting network 'vping-net'...
Tempest¶
FUNCTEST.info: Running Tempest tests...
run_tempest - INFO - Creating tenant and user for Tempest suite
INFO rally.verification.tempest.tempest [-] Starting: Creating configuration file for Tempest.
INFO rally.verification.tempest.tempest [-] Completed: Creating configuration file for Tempest.
run_tempest - INFO - Starting Tempest test suite: '--tests-file /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/custom_tests/test_list.txt'.
Total results of verification:
+--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
| UUID | Deployment UUID | Set name | Tests | Failures | Created at | Status |
+--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
| b470a125-b6d9-400e-872e-abe779ff1ab5 | 784b68a9-2eab-4e1e-abc7-a4f68d4d02fe | | 70 | 8 | 2016-02-23 07:46:13.668289 | finished |
+--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
Tests:
+----------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
| name | time | status |
+----------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since | 0.10275 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name | 0.14924 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id | 0.05661 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref | 0.32593 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status | 0.38913 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type | 0.05691 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results | 0.09185 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since | 0.04789 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name | 0.04881 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref | 0.27540 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status | 0.10541 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type | 0.13467 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results | 0.33891 | success |
| tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete | 2.13276 | success |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name | 331.74491 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers | 0.41803 | success |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail | 0.17025 | success |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus | 316.35661 | fail |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details | 0.00272 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password | 1.84308 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair | 10.10318 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name | 17.23894 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address | 7.82065 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name | 7.02428 | success |
| tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services | 0.0 | fail |
| tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user | 0.09527 | success |
| tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete | 0.16436 | success |
| tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists | 0.02123 | success |
| tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain | 0.32681 | success |
| tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list | 0.74903 | success |
| tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all | 1.33567 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.01368 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.01283 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.01451 | success |
| tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params | 0.17814 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image | 0.69374 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file | 1.40285 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image | 2.95154 | success |
| tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address | 0.85749 | success |
| tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip | 1.12230 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network | 1.29858 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port | 3.11215 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet | 3.42505 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet | 3.05471 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility | 0.15865 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks | 0.08296 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets | 0.08528 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network | 0.02219 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet | 0.09302 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group | 0.71309 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule | 3.81771 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups | 0.01890 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group | 1.06254 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule | 2.54527 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups | 0.26689 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list | 1.09816 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata | 0.67413 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config | 0.56914 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate | 0.37443 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change | 0.74292 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change | 0.43472 | success |
| tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources | 0.0 | fail |
| tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds | 0.0 | fail |
| tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications | 303.15352 | fail |
| tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications | 301.75020 | fail |
| tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance | 2.79412 | success |
| tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete | 9.60493 | success |
| tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image | 11.53698 | success |
| tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list | 0.40696 | success |
| tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern | 383.53375 | fail |
+----------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
run_tempest - INFO - Results: {'timestart': '2016-02-2307:46:13.668289', 'duration': 695, 'tests': 70, 'failures': 8}
run_tempest - INFO - Pushing results to DB: 'http://testresults.opnfv.org/testapi/results'.
run_tempest - INFO - Deleting tenant and user for Tempest suite)
Rally¶
FUNCTEST.info: Running Rally benchmark suite...
run_rally - INFO - Starting test scenario "authenticate" ...
Preparing input task
Task 7ac7e940-ea41-4f7d-9cca-facd241c0d42: started
Task 7ac7e940-ea41-4f7d-9cca-facd241c0d42: finished
test scenario Authenticate.validate_glance
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_glance | 0.14 | 0.147 | 0.19 | 0.23 | 0.27 | 0.164 | 100.0% | 10 |
| authenticate.validate_glance (2) | 0.027 | 0.085 | 0.091 | 0.097 | 0.103 | 0.081 | 100.0% | 10 |
| total | 0.24 | 0.324 | 0.449 | 0.497 | 0.544 | 0.354 | 100.0% | 10 |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.991291999817
Full duration: 3.52114295959
test scenario Authenticate.keystone
+-----------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
| total | 0.062 | 0.071 | 0.092 | 0.093 | 0.093 | 0.075 | 100.0% | 10 |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.256750106812
Full duration: 3.22034788132
test scenario Authenticate.validate_heat
+-----------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_heat | 0.079 | 0.083 | 0.086 | 0.089 | 0.091 | 0.083 | 100.0% | 10 |
| authenticate.validate_heat (2) | 0.073 | 0.083 | 0.088 | 0.088 | 0.088 | 0.082 | 100.0% | 10 |
| total | 0.219 | 0.235 | 0.273 | 0.281 | 0.289 | 0.247 | 100.0% | 10 |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.758399963379
Full duration: 3.36240792274
test scenario Authenticate.validate_nova
+-----------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_nova | 0.08 | 0.095 | 0.164 | 0.194 | 0.225 | 0.116 | 100.0% | 10 |
| authenticate.validate_nova (2) | 0.018 | 0.024 | 0.032 | 0.035 | 0.037 | 0.025 | 100.0% | 10 |
| total | 0.172 | 0.198 | 0.261 | 0.297 | 0.333 | 0.221 | 100.0% | 10 |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.659279108047
Full duration: 3.35535907745
test scenario Authenticate.validate_cinder
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_cinder | 0.073 | 0.079 | 0.092 | 0.094 | 0.097 | 0.082 | 100.0% | 10 |
| authenticate.validate_cinder (2) | 0.013 | 0.082 | 0.149 | 0.265 | 0.381 | 0.106 | 100.0% | 10 |
| total | 0.152 | 0.241 | 0.344 | 0.464 | 0.585 | 0.272 | 100.0% | 10 |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.793002128601
Full duration: 3.46288895607
test scenario Authenticate.validate_neutron
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_neutron | 0.082 | 0.095 | 0.115 | 0.137 | 0.159 | 0.1 | 100.0% | 10 |
| authenticate.validate_neutron (2) | 0.018 | 0.089 | 0.103 | 0.104 | 0.105 | 0.072 | 100.0% | 10 |
| total | 0.177 | 0.243 | 0.29 | 0.321 | 0.353 | 0.247 | 100.0% | 10 |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.788791894913
Full duration: 3.39974403381
run_rally - INFO - Test scenario: "authenticate" OK.
run_rally - INFO - Starting test scenario "glance" ...
Preparing input task
Task 56b5e198-2c90-4440-a9bf-b098659c5783: started
Task 56b5e198-2c90-4440-a9bf-b098659c5783: finished
test scenario GlanceImages.list_images
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| glance.list_images | 0.226 | 0.256 | 0.328 | 0.335 | 0.343 | 0.268 | 100.0% | 10 |
| total | 0.226 | 0.256 | 0.328 | 0.336 | 0.343 | 0.268 | 100.0% | 10 |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.82669711113
Full duration: 4.65047502518
test scenario GlanceImages.create_image_and_boot_instances
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| glance.create_image | 3.917 | 4.559 | 4.731 | 4.819 | 4.906 | 4.469 | 100.0% | 10 |
| nova.boot_servers | 5.082 | 8.269 | 10.835 | 11.119 | 11.402 | 8.596 | 100.0% | 10 |
| total | 9.684 | 12.929 | 15.683 | 15.704 | 15.725 | 13.065 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 38.0555651188
Full duration: 65.7321281433
test scenario GlanceImages.create_and_list_image
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| glance.create_image | 3.631 | 4.223 | 4.681 | 4.717 | 4.753 | 4.26 | 100.0% | 10 |
| glance.list_images | 0.03 | 0.1 | 0.11 | 0.132 | 0.153 | 0.085 | 100.0% | 10 |
| total | 3.731 | 4.287 | 4.781 | 4.817 | 4.854 | 4.345 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 13.4343621731
Full duration: 20.5471830368
test scenario GlanceImages.create_and_delete_image
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| glance.create_image | 3.679 | 4.522 | 4.775 | 4.781 | 4.786 | 4.475 | 100.0% | 10 |
| glance.delete_image | 0.68 | 1.416 | 1.924 | 1.945 | 1.966 | 1.355 | 100.0% | 10 |
| total | 4.359 | 5.895 | 6.659 | 6.682 | 6.706 | 5.83 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 17.0444431305
Full duration: 21.4709100723
run_rally - INFO - Test scenario: "glance" OK.
run_rally - INFO - Starting test scenario "cinder" ...
Preparing input task
Task 30bb498c-6dda-4d30-bf2d-cf3979a83615: started
Task 30bb498c-6dda-4d30-bf2d-cf3979a83615: finished
test scenario CinderVolumes.create_and_attach_volume
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 3.361 | 5.067 | 5.688 | 5.748 | 5.808 | 4.948 | 100.0% | 10 |
| cinder.create_volume | 2.56 | 2.856 | 3.04 | 3.098 | 3.156 | 2.872 | 100.0% | 10 |
| nova.attach_volume | 3.018 | 3.376 | 4.145 | 5.024 | 5.903 | 3.65 | 100.0% | 10 |
| nova.detach_volume | 2.643 | 2.895 | 3.093 | 3.156 | 3.219 | 2.912 | 100.0% | 10 |
| cinder.delete_volume | 0.517 | 2.429 | 2.538 | 2.676 | 2.814 | 2.268 | 100.0% | 10 |
| nova.delete_server | 2.329 | 2.456 | 2.645 | 2.656 | 2.667 | 2.468 | 100.0% | 10 |
| total | 17.686 | 19.384 | 20.284 | 20.286 | 20.288 | 19.117 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 56.4022140503
Full duration: 68.9135789871
test scenario CinderVolumes.create_and_list_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 5.146 | 5.432 | 5.632 | 5.652 | 5.673 | 5.415 | 100.0% | 10 |
| cinder.list_volumes | 0.034 | 0.115 | 0.135 | 0.135 | 0.135 | 0.096 | 100.0% | 10 |
| total | 5.18 | 5.507 | 5.747 | 5.772 | 5.797 | 5.511 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 16.3556389809
Full duration: 27.6093170643
test scenario CinderVolumes.create_and_list_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.773 | 2.959 | 3.11 | 3.137 | 3.165 | 2.955 | 100.0% | 10 |
| cinder.list_volumes | 0.028 | 0.127 | 0.202 | 0.219 | 0.237 | 0.111 | 100.0% | 10 |
| total | 2.812 | 3.033 | 3.293 | 3.298 | 3.302 | 3.066 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 9.06200098991
Full duration: 19.9587731361
test scenario CinderVolumes.create_and_list_snapshots
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_snapshot | 2.482 | 4.642 | 4.889 | 4.91 | 4.931 | 4.296 | 100.0% | 10 |
| cinder.list_snapshots | 0.013 | 0.096 | 0.107 | 0.134 | 0.162 | 0.079 | 100.0% | 10 |
| total | 2.583 | 4.772 | 4.95 | 4.967 | 4.984 | 4.375 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 12.2352650166
Full duration: 44.3921279907
test scenario CinderVolumes.create_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.707 | 2.813 | 2.903 | 2.956 | 3.009 | 2.825 | 100.0% | 10 |
| cinder.delete_volume | 2.407 | 2.548 | 2.613 | 2.626 | 2.638 | 2.55 | 100.0% | 10 |
| total | 5.191 | 5.377 | 5.507 | 5.532 | 5.558 | 5.375 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 16.1588079929
Full duration: 22.6795511246
test scenario CinderVolumes.create_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 5.089 | 5.255 | 5.753 | 6.601 | 7.449 | 5.494 | 100.0% | 10 |
| cinder.delete_volume | 2.343 | 2.456 | 2.615 | 2.688 | 2.761 | 2.496 | 100.0% | 10 |
| total | 7.471 | 7.795 | 8.253 | 9.073 | 9.893 | 7.991 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 23.303401947
Full duration: 30.3196620941
test scenario CinderVolumes.create_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.724 | 2.844 | 2.939 | 2.963 | 2.986 | 2.856 | 100.0% | 10 |
| cinder.delete_volume | 2.353 | 2.519 | 2.659 | 2.718 | 2.778 | 2.525 | 100.0% | 10 |
| total | 5.147 | 5.393 | 5.45 | 5.541 | 5.633 | 5.381 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 16.1724491119
Full duration: 22.9236290455
test scenario CinderVolumes.create_and_upload_volume_to_image
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 2.726 | 2.886 | 3.014 | 3.047 | 3.08 | 2.888 | 100.0% | 10 |
| cinder.upload_volume_to_image | 28.041 | 44.016 | 44.644 | 44.698 | 44.751 | 40.726 | 100.0% | 10 |
| cinder.delete_volume | 2.34 | 2.458 | 2.551 | 2.622 | 2.692 | 2.452 | 100.0% | 10 |
| nova.delete_image | 0.846 | 1.837 | 2.379 | 2.418 | 2.456 | 1.73 | 100.0% | 10 |
| total | 34.983 | 51.394 | 51.872 | 51.877 | 51.881 | 47.796 | 100.0% | 10 |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 136.222712994
Full duration: 144.124747038
test scenario CinderVolumes.create_and_delete_snapshot
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_snapshot | 2.51 | 4.611 | 4.709 | 4.787 | 4.865 | 4.288 | 100.0% | 10 |
| cinder.delete_snapshot | 2.233 | 4.443 | 4.619 | 4.627 | 4.634 | 3.882 | 100.0% | 10 |
| total | 4.981 | 9.079 | 9.333 | 9.362 | 9.39 | 8.17 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 23.2197830677
Full duration: 42.1724328995
test scenario CinderVolumes.create_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.725 | 2.887 | 3.064 | 3.106 | 3.149 | 2.895 | 100.0% | 10 |
| total | 2.725 | 2.887 | 3.064 | 3.106 | 3.149 | 2.895 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 8.62664198875
Full duration: 18.587531805
test scenario CinderVolumes.create_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.696 | 2.857 | 2.932 | 2.943 | 2.954 | 2.838 | 100.0% | 10 |
| total | 2.696 | 2.857 | 2.932 | 2.943 | 2.954 | 2.838 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 8.48678183556
Full duration: 20.6692960262
test scenario CinderVolumes.list_volumes
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.list_volumes | 0.202 | 0.275 | 0.381 | 0.408 | 0.435 | 0.283 | 100.0% | 10 |
| total | 0.202 | 0.275 | 0.381 | 0.408 | 0.435 | 0.284 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.910716056824
Full duration: 47.5472760201
test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
+-----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 2.74 | 2.894 | 3.015 | 3.036 | 3.056 | 2.893 | 100.0% | 10 |
| cinder.create_snapshot | 2.407 | 2.549 | 4.689 | 4.745 | 4.802 | 3.163 | 100.0% | 10 |
| nova.attach_volume | 2.856 | 3.305 | 5.42 | 5.647 | 5.874 | 3.866 | 100.0% | 10 |
| nova.detach_volume | 2.746 | 3.092 | 3.492 | 4.368 | 5.245 | 3.261 | 100.0% | 10 |
| cinder.delete_snapshot | 2.347 | 2.508 | 4.471 | 4.534 | 4.596 | 2.868 | 100.0% | 10 |
| cinder.delete_volume | 2.418 | 2.546 | 2.956 | 3.852 | 4.748 | 2.758 | 100.0% | 10 |
| total | 16.42 | 18.913 | 21.766 | 22.976 | 24.185 | 19.181 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 55.4410011768
Full duration: 103.909024954
test scenario CinderVolumes.create_from_volume_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.821 | 4.176 | 7.514 | 7.588 | 7.662 | 4.605 | 100.0% | 10 |
| cinder.delete_volume | 2.451 | 4.688 | 4.929 | 4.955 | 4.981 | 4.087 | 100.0% | 10 |
| total | 5.373 | 8.93 | 12.095 | 12.233 | 12.37 | 8.692 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 24.4642841816
Full duration: 44.0787379742
test scenario CinderVolumes.create_and_extend_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 2.58 | 2.854 | 3.055 | 3.19 | 3.325 | 2.89 | 100.0% | 10 |
| cinder.extend_volume | 2.55 | 2.699 | 2.795 | 2.849 | 2.903 | 2.705 | 100.0% | 10 |
| cinder.delete_volume | 2.458 | 2.516 | 2.674 | 2.786 | 2.898 | 2.573 | 100.0% | 10 |
| total | 7.82 | 8.198 | 8.396 | 8.442 | 8.488 | 8.169 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 24.4196460247
Full duration: 31.8590240479
test scenario CinderVolumes.create_snapshot_and_attach_volume
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 2.748 | 2.952 | 3.137 | 3.199 | 3.261 | 2.978 | 100.0% | 10 |
| cinder.create_snapshot | 2.472 | 2.569 | 4.675 | 4.696 | 4.717 | 3.178 | 100.0% | 10 |
| nova.attach_volume | 3.051 | 3.462 | 5.38 | 5.41 | 5.439 | 3.956 | 100.0% | 10 |
| nova.detach_volume | 2.802 | 3.058 | 3.281 | 3.413 | 3.546 | 3.096 | 100.0% | 10 |
| cinder.delete_snapshot | 2.255 | 2.431 | 4.385 | 4.44 | 4.496 | 2.984 | 100.0% | 10 |
| cinder.delete_volume | 2.341 | 2.485 | 2.773 | 3.721 | 4.67 | 2.693 | 100.0% | 10 |
| total | 16.553 | 19.163 | 21.677 | 21.681 | 21.686 | 19.224 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 55.8534150124
Full duration: 107.20220089
test scenario CinderVolumes.create_snapshot_and_attach_volume
+-----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+-------+---------+-------+
| cinder.create_volume | 2.655 | 2.924 | 3.771 | 3.779 | 3.786 | 3.159 | 100.0% | 10 |
| cinder.create_snapshot | 2.411 | 2.565 | 4.602 | 4.659 | 4.716 | 3.157 | 100.0% | 10 |
| nova.attach_volume | 3.053 | 3.236 | 5.158 | 5.352 | 5.546 | 3.726 | 100.0% | 10 |
| nova.detach_volume | 2.752 | 2.964 | 3.54 | 4.371 | 5.201 | 3.196 | 100.0% | 10 |
| cinder.delete_snapshot | 2.147 | 2.424 | 4.491 | 4.497 | 4.503 | 2.802 | 100.0% | 10 |
| cinder.delete_volume | 2.484 | 2.574 | 2.677 | 2.726 | 2.775 | 2.582 | 100.0% | 10 |
| total | 17.334 | 19.301 | 20.332 | 21.118 | 21.904 | 19.2 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 56.6079628468
Full duration: 108.998883963
run_rally - INFO - Test scenario: "cinder" OK.
run_rally - INFO - Starting test scenario "heat" ...
Preparing input task
Task aae5a92c-66ff-4c8c-b4a3-0957baac4610: started
Task aae5a92c-66ff-4c8c-b4a3-0957baac4610: finished
test scenario HeatStacks.create_suspend_resume_delete_stack
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.922 | 3.271 | 3.354 | 3.38 | 3.406 | 3.229 | 100.0% | 10 |
| heat.suspend_stack | 1.21 | 1.305 | 1.397 | 1.4 | 1.403 | 1.31 | 100.0% | 10 |
| heat.resume_stack | 1.183 | 1.318 | 1.348 | 1.352 | 1.356 | 1.301 | 100.0% | 10 |
| heat.delete_stack | 1.161 | 1.306 | 2.368 | 2.383 | 2.398 | 1.68 | 100.0% | 10 |
| total | 6.612 | 7.196 | 8.411 | 8.476 | 8.541 | 7.519 | 100.0% | 10 |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 21.979665041
Full duration: 25.784487009
test scenario HeatStacks.create_and_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.8 | 2.896 | 3.053 | 3.136 | 3.219 | 2.929 | 100.0% | 10 |
| heat.delete_stack | 1.167 | 1.185 | 1.272 | 1.284 | 1.296 | 1.202 | 100.0% | 10 |
| total | 3.967 | 4.11 | 4.26 | 4.334 | 4.409 | 4.13 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 12.3352811337
Full duration: 16.1414811611
test scenario HeatStacks.create_and_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 13.463 | 15.842 | 17.472 | 17.519 | 17.565 | 15.768 | 100.0% | 10 |
| heat.delete_stack | 8.575 | 9.635 | 10.691 | 10.703 | 10.714 | 9.537 | 100.0% | 10 |
| total | 22.054 | 25.534 | 27.126 | 27.181 | 27.236 | 25.305 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 74.6174178123
Full duration: 78.7209010124
test scenario HeatStacks.create_and_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 9.848 | 12.353 | 14.548 | 14.574 | 14.6 | 12.757 | 100.0% | 10 |
| heat.delete_stack | 6.448 | 7.541 | 8.549 | 8.581 | 8.612 | 7.65 | 100.0% | 10 |
| total | 17.369 | 19.894 | 23.098 | 23.155 | 23.212 | 20.407 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 61.6486670971
Full duration: 65.8705642223
test scenario HeatStacks.list_stacks_and_resources
+------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.list_stacks | 0.198 | 0.23 | 0.268 | 0.302 | 0.337 | 0.238 | 100.0% | 10 |
| heat.list_resources_of_0_stacks | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
| total | 0.198 | 0.231 | 0.268 | 0.302 | 0.337 | 0.238 | 100.0% | 10 |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.700455904007
Full duration: 4.55407810211
test scenario HeatStacks.create_update_delete_stack
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| heat.create_stack | 3.01 | 3.109 | 3.377 | 3.561 | 3.744 | 3.173 | 100.0% | 10 |
| heat.update_stack | 3.232 | 3.408 | 4.335 | 4.354 | 4.374 | 3.612 | 100.0% | 10 |
| heat.delete_stack | 1.146 | 1.207 | 2.478 | 2.887 | 3.296 | 1.721 | 100.0% | 10 |
| total | 7.423 | 7.67 | 9.921 | 10.311 | 10.702 | 8.505 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 24.7915220261
Full duration: 29.4085850716
test scenario HeatStacks.create_update_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.881 | 3.066 | 3.233 | 3.377 | 3.52 | 3.09 | 100.0% | 10 |
| heat.update_stack | 3.212 | 3.254 | 3.48 | 3.507 | 3.535 | 3.303 | 100.0% | 10 |
| heat.delete_stack | 1.154 | 1.167 | 1.188 | 1.194 | 1.201 | 1.17 | 100.0% | 10 |
| total | 7.263 | 7.498 | 7.904 | 7.912 | 7.921 | 7.563 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 22.4006979465
Full duration: 26.8767819405
test scenario HeatStacks.create_update_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 3.972 | 4.032 | 6.634 | 6.716 | 6.798 | 4.942 | 100.0% | 10 |
| heat.update_stack | 5.327 | 5.354 | 5.482 | 5.548 | 5.614 | 5.388 | 100.0% | 10 |
| heat.delete_stack | 2.19 | 2.207 | 2.213 | 2.214 | 2.215 | 2.203 | 100.0% | 10 |
| total | 11.521 | 11.583 | 14.284 | 14.325 | 14.367 | 12.534 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 37.184043169
Full duration: 41.6411378384
test scenario HeatStacks.create_update_delete_stack
+-----------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----+--------+--------+--------+-----+-----+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------+-----+--------+--------+--------+-----+-----+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | 0.0% | 8 |
+--------+-----+--------+--------+--------+-----+-----+---------+-------+
Load duration: 8.45521402359
Full duration: 17.6498777866
test scenario HeatStacks.create_update_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 3.971 | 5.16 | 5.356 | 5.407 | 5.459 | 4.973 | 100.0% | 10 |
| heat.update_stack | 5.318 | 5.359 | 5.382 | 5.394 | 5.405 | 5.358 | 100.0% | 10 |
| heat.delete_stack | 2.188 | 2.198 | 2.266 | 2.267 | 2.267 | 2.211 | 100.0% | 10 |
| total | 11.488 | 12.723 | 12.979 | 13.011 | 13.043 | 12.543 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 37.0396420956
Full duration: 41.5464501381
test scenario HeatStacks.create_update_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.829 | 3.044 | 3.212 | 3.247 | 3.283 | 3.029 | 100.0% | 10 |
| heat.update_stack | 3.215 | 3.228 | 3.295 | 3.317 | 3.339 | 3.248 | 100.0% | 10 |
| heat.delete_stack | 1.144 | 1.154 | 1.183 | 1.191 | 1.198 | 1.161 | 100.0% | 10 |
| total | 7.202 | 7.41 | 7.611 | 7.692 | 7.774 | 7.438 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 22.2332119942
Full duration: 26.9551222324
test scenario HeatStacks.create_and_list_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.901 | 3.019 | 3.106 | 3.131 | 3.157 | 3.024 | 100.0% | 10 |
| heat.list_stacks | 0.026 | 0.033 | 0.038 | 0.039 | 0.039 | 0.032 | 100.0% | 10 |
| total | 2.94 | 3.049 | 3.139 | 3.163 | 3.188 | 3.056 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 9.14466500282
Full duration: 16.6371269226
test scenario HeatStacks.create_check_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 2.988 | 3.093 | 3.17 | 3.178 | 3.187 | 3.087 | 100.0% | 10 |
| heat.check_stack | 1.182 | 1.191 | 1.218 | 1.227 | 1.235 | 1.197 | 100.0% | 10 |
| heat.delete_stack | 1.135 | 1.146 | 1.159 | 1.163 | 1.167 | 1.148 | 100.0% | 10 |
| total | 5.315 | 5.451 | 5.54 | 5.549 | 5.558 | 5.432 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 16.1800320148
Full duration: 20.4218199253
run_rally - INFO - Test scenario: "heat" Failed.
run_rally - INFO - Starting test scenario "keystone" ...
Preparing input task
Task a2566777-434b-4a10-8720-118485a7d427: started
Task a2566777-434b-4a10-8720-118485a7d427: finished
test scenario KeystoneBasic.create_tenant_with_users
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.129 | 0.152 | 0.179 | 0.185 | 0.19 | 0.153 | 100.0% | 10 |
| keystone.create_users | 1.041 | 1.142 | 1.45 | 1.48 | 1.509 | 1.211 | 100.0% | 10 |
| total | 1.177 | 1.295 | 1.637 | 1.653 | 1.668 | 1.363 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.19324994087
Full duration: 15.3481221199
test scenario KeystoneBasic.create_add_and_list_user_roles
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.126 | 0.137 | 0.15 | 0.155 | 0.16 | 0.138 | 100.0% | 10 |
| keystone.add_role | 0.116 | 0.123 | 0.145 | 0.158 | 0.171 | 0.128 | 100.0% | 10 |
| keystone.list_roles | 0.055 | 0.064 | 0.076 | 0.093 | 0.11 | 0.068 | 100.0% | 10 |
| total | 0.308 | 0.334 | 0.36 | 0.362 | 0.364 | 0.335 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.02259397507
Full duration: 7.21977186203
test scenario KeystoneBasic.add_and_remove_user_role
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.127 | 0.155 | 0.187 | 0.19 | 0.192 | 0.159 | 100.0% | 10 |
| keystone.add_role | 0.117 | 0.131 | 0.161 | 0.175 | 0.188 | 0.137 | 100.0% | 10 |
| keystone.remove_role | 0.089 | 0.104 | 0.137 | 0.161 | 0.184 | 0.113 | 100.0% | 10 |
| total | 0.352 | 0.4 | 0.454 | 0.471 | 0.487 | 0.408 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.2577559948
Full duration: 7.18419408798
test scenario KeystoneBasic.create_update_and_delete_tenant
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.131 | 0.147 | 0.168 | 0.175 | 0.181 | 0.15 | 100.0% | 10 |
| keystone.update_tenant | 0.073 | 0.081 | 0.138 | 0.138 | 0.138 | 0.094 | 100.0% | 10 |
| keystone.delete_tenant | 0.146 | 0.181 | 0.212 | 0.215 | 0.218 | 0.182 | 100.0% | 10 |
| total | 0.356 | 0.436 | 0.488 | 0.501 | 0.514 | 0.426 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.28746080399
Full duration: 5.78163409233
test scenario KeystoneBasic.create_and_delete_service
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_service | 0.136 | 0.149 | 0.185 | 0.201 | 0.217 | 0.158 | 100.0% | 10 |
| keystone.delete_service | 0.079 | 0.081 | 0.094 | 0.105 | 0.116 | 0.086 | 100.0% | 10 |
| total | 0.22 | 0.233 | 0.267 | 0.288 | 0.309 | 0.244 | 100.0% | 10 |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.732470035553
Full duration: 5.50471711159
test scenario KeystoneBasic.create_tenant
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.135 | 0.141 | 0.177 | 0.184 | 0.19 | 0.151 | 100.0% | 10 |
| total | 0.135 | 0.141 | 0.177 | 0.184 | 0.191 | 0.152 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.47666311264
Full duration: 4.65166783333
test scenario KeystoneBasic.create_user
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_user | 0.145 | 0.17 | 0.2 | 0.206 | 0.211 | 0.174 | 100.0% | 10 |
| total | 0.145 | 0.171 | 0.2 | 0.206 | 0.212 | 0.174 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.544457912445
Full duration: 4.52855014801
test scenario KeystoneBasic.create_and_list_tenants
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.139 | 0.151 | 0.184 | 0.204 | 0.224 | 0.161 | 100.0% | 10 |
| keystone.list_tenants | 0.054 | 0.062 | 0.076 | 0.095 | 0.115 | 0.067 | 100.0% | 10 |
| total | 0.201 | 0.213 | 0.277 | 0.286 | 0.295 | 0.227 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.684409141541
Full duration: 7.2159280777
test scenario KeystoneBasic.create_and_delete_role
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.131 | 0.156 | 0.212 | 0.213 | 0.215 | 0.167 | 100.0% | 10 |
| keystone.delete_role | 0.132 | 0.159 | 0.222 | 0.244 | 0.266 | 0.174 | 100.0% | 10 |
| total | 0.276 | 0.349 | 0.375 | 0.409 | 0.444 | 0.341 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.00079798698
Full duration: 5.79344797134
test scenario KeystoneBasic.get_entities
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.14 | 0.148 | 0.211 | 0.214 | 0.216 | 0.161 | 100.0% | 10 |
| keystone.create_user | 0.083 | 0.09 | 0.105 | 0.122 | 0.138 | 0.094 | 100.0% | 10 |
| keystone.create_role | 0.065 | 0.081 | 0.12 | 0.126 | 0.131 | 0.087 | 100.0% | 10 |
| keystone.get_tenant | 0.054 | 0.064 | 0.115 | 0.117 | 0.119 | 0.078 | 100.0% | 10 |
| keystone.get_user | 0.055 | 0.062 | 0.081 | 0.104 | 0.127 | 0.069 | 100.0% | 10 |
| keystone.get_role | 0.055 | 0.062 | 0.096 | 0.109 | 0.121 | 0.071 | 100.0% | 10 |
| keystone.service_list | 0.053 | 0.06 | 0.069 | 0.072 | 0.074 | 0.061 | 100.0% | 10 |
| keystone.get_service | 0.054 | 0.059 | 0.068 | 0.087 | 0.105 | 0.063 | 100.0% | 10 |
| total | 0.577 | 0.674 | 0.806 | 0.815 | 0.825 | 0.685 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.99226713181
Full duration: 11.5220220089
test scenario KeystoneBasic.create_and_list_users
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_user | 0.148 | 0.173 | 0.197 | 0.206 | 0.215 | 0.175 | 100.0% | 10 |
| keystone.list_users | 0.059 | 0.062 | 0.068 | 0.068 | 0.069 | 0.063 | 100.0% | 10 |
| total | 0.207 | 0.238 | 0.259 | 0.267 | 0.275 | 0.238 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.724813938141
Full duration: 4.96498990059
run_rally - INFO - Test scenario: "keystone" OK.
run_rally - INFO - Starting test scenario "neutron" ...
Preparing input task
Task 54896a60-668a-4109-89ce-b6be1526b03c: started
Task 54896a60-668a-4109-89ce-b6be1526b03c: finished
test scenario NeutronNetworks.create_and_delete_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.495 | 0.647 | 0.86 | 0.862 | 0.864 | 0.662 | 100.0% | 10 |
| neutron.delete_port | 0.138 | 0.389 | 0.568 | 0.757 | 0.946 | 0.413 | 100.0% | 10 |
| total | 0.633 | 0.994 | 1.292 | 1.551 | 1.809 | 1.075 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.11711192131
Full duration: 33.0977571011
test scenario NeutronNetworks.create_and_list_routers
+---------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.499 | 0.61 | 0.652 | 0.678 | 0.704 | 0.602 | 100.0% | 10 |
| neutron.create_router | 0.146 | 0.344 | 0.458 | 0.463 | 0.467 | 0.349 | 100.0% | 10 |
| neutron.add_interface_router | 0.258 | 0.522 | 0.604 | 0.672 | 0.739 | 0.519 | 100.0% | 10 |
| neutron.list_routers | 0.026 | 0.282 | 0.457 | 0.501 | 0.545 | 0.272 | 100.0% | 10 |
| total | 1.316 | 1.657 | 1.975 | 2.111 | 2.247 | 1.742 | 100.0% | 10 |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 5.24421405792
Full duration: 37.3269040585
test scenario NeutronNetworks.create_and_delete_routers
+------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.563 | 0.666 | 0.868 | 1.002 | 1.136 | 0.721 | 100.0% | 10 |
| neutron.create_router | 0.13 | 0.373 | 0.573 | 0.595 | 0.616 | 0.384 | 100.0% | 10 |
| neutron.add_interface_router | 0.274 | 0.505 | 0.574 | 0.605 | 0.637 | 0.471 | 100.0% | 10 |
| neutron.remove_interface_router | 0.234 | 0.492 | 0.66 | 0.676 | 0.692 | 0.512 | 100.0% | 10 |
| neutron.delete_router | 0.117 | 0.329 | 0.731 | 0.744 | 0.756 | 0.341 | 100.0% | 10 |
| total | 1.572 | 2.372 | 2.966 | 3.156 | 3.347 | 2.43 | 100.0% | 10 |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 7.02413988113
Full duration: 37.7696969509
test scenario NeutronNetworks.create_and_list_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.507 | 0.678 | 0.859 | 0.871 | 0.883 | 0.7 | 100.0% | 10 |
| neutron.list_ports | 0.131 | 0.305 | 0.497 | 0.512 | 0.526 | 0.325 | 100.0% | 10 |
| total | 0.792 | 1.051 | 1.18 | 1.187 | 1.193 | 1.025 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.00920605659
Full duration: 34.7632040977
test scenario NeutronNetworks.create_and_delete_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.505 | 0.561 | 0.698 | 0.722 | 0.747 | 0.592 | 100.0% | 10 |
| neutron.delete_subnet | 0.141 | 0.477 | 0.75 | 0.785 | 0.82 | 0.516 | 100.0% | 10 |
| total | 0.759 | 1.066 | 1.367 | 1.429 | 1.491 | 1.108 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.30927801132
Full duration: 34.2646439075
test scenario NeutronNetworks.create_and_delete_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.368 | 0.511 | 0.727 | 0.746 | 0.765 | 0.541 | 100.0% | 10 |
| neutron.delete_network | 0.115 | 0.331 | 0.399 | 0.421 | 0.443 | 0.328 | 100.0% | 10 |
| total | 0.519 | 0.876 | 1.09 | 1.149 | 1.209 | 0.87 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.45112395287
Full duration: 17.3522310257
test scenario NeutronNetworks.create_and_list_networks
+-----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| neutron.create_network | 0.376 | 0.514 | 51.874 | 51.881 | 51.887 | 21.012 | 100.0% | 10 |
| neutron.list_networks | 0.048 | 0.264 | 0.303 | 0.312 | 0.32 | 0.246 | 100.0% | 10 |
| total | 0.644 | 0.78 | 52.142 | 52.175 | 52.208 | 21.258 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 53.5037658215
Full duration: 70.7888660431
test scenario NeutronNetworks.create_and_update_routers
+---------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.457 | 0.651 | 0.738 | 0.757 | 0.777 | 0.631 | 100.0% | 10 |
| neutron.create_router | 0.144 | 0.334 | 0.45 | 0.477 | 0.504 | 0.349 | 100.0% | 10 |
| neutron.add_interface_router | 0.286 | 0.546 | 0.676 | 0.685 | 0.695 | 0.555 | 100.0% | 10 |
| neutron.update_router | 0.099 | 0.36 | 0.43 | 0.438 | 0.446 | 0.312 | 100.0% | 10 |
| total | 1.176 | 1.895 | 2.106 | 2.13 | 2.155 | 1.848 | 100.0% | 10 |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 5.49681401253
Full duration: 37.4188079834
test scenario NeutronNetworks.create_and_update_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.36 | 0.471 | 0.71 | 0.73 | 0.75 | 0.528 | 100.0% | 10 |
| neutron.update_network | 0.123 | 0.355 | 0.42 | 0.426 | 0.431 | 0.336 | 100.0% | 10 |
| total | 0.651 | 0.826 | 1.115 | 1.126 | 1.137 | 0.863 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.45435285568
Full duration: 19.8497779369
test scenario NeutronNetworks.create_and_update_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.522 | 0.606 | 0.691 | 0.706 | 0.721 | 0.612 | 100.0% | 10 |
| neutron.update_port | 0.187 | 0.343 | 0.388 | 0.389 | 0.39 | 0.336 | 100.0% | 10 |
| total | 0.756 | 0.965 | 1.027 | 1.044 | 1.061 | 0.948 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.89304494858
Full duration: 35.0843141079
test scenario NeutronNetworks.create_and_list_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.435 | 0.561 | 0.697 | 0.716 | 0.735 | 0.584 | 100.0% | 10 |
| neutron.list_subnets | 0.259 | 0.312 | 0.4 | 0.427 | 0.455 | 0.331 | 100.0% | 10 |
| total | 0.785 | 0.877 | 1.111 | 1.12 | 1.129 | 0.915 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.61414718628
Full duration: 34.7340919971
test scenario NeutronNetworks.create_and_update_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.496 | 0.57 | 0.724 | 0.732 | 0.741 | 0.598 | 100.0% | 10 |
| neutron.update_subnet | 0.356 | 0.433 | 0.584 | 0.599 | 0.615 | 0.47 | 100.0% | 10 |
| total | 0.889 | 1.045 | 1.22 | 1.231 | 1.242 | 1.068 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.22795987129
Full duration: 33.4197108746
run_rally - INFO - Test scenario: "neutron" OK.
run_rally - INFO - Starting test scenario "nova" ...
Preparing input task
Task d97765c7-bb1a-461c-8a74-ade03e3cc05a: started
Task d97765c7-bb1a-461c-8a74-ade03e3cc05a: finished
test scenario NovaKeypair.create_and_delete_keypair
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.create_keypair | 0.404 | 0.52 | 1.075 | 1.084 | 1.093 | 0.647 | 100.0% | 10 |
| nova.delete_keypair | 0.021 | 0.023 | 0.03 | 0.036 | 0.041 | 0.026 | 100.0% | 10 |
| total | 0.432 | 0.546 | 1.099 | 1.11 | 1.122 | 0.673 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.18305206299
Full duration: 18.7849049568
test scenario NovaServers.snapshot_server
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 4.34 | 6.072 | 6.37 | 6.458 | 6.546 | 5.696 | 100.0% | 10 |
| nova.create_image | 26.042 | 43.405 | 45.329 | 45.435 | 45.541 | 40.593 | 100.0% | 10 |
| nova.delete_server | 2.313 | 2.59 | 2.699 | 2.859 | 3.019 | 2.586 | 100.0% | 10 |
| nova.boot_server (2) | 8.297 | 11.985 | 12.916 | 13.279 | 13.642 | 11.495 | 100.0% | 10 |
| nova.delete_server (2) | 2.4 | 2.622 | 2.761 | 2.777 | 2.792 | 2.638 | 100.0% | 10 |
| nova.delete_image | 1.443 | 2.236 | 2.891 | 3.258 | 3.626 | 2.279 | 100.0% | 10 |
| total | 45.514 | 69.068 | 71.631 | 72.478 | 73.326 | 65.288 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 189.056165934
Full duration: 227.369397879
test scenario NovaKeypair.boot_and_delete_server_with_keypair
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| nova.create_keypair | 0.393 | 0.542 | 0.682 | 0.906 | 1.129 | 0.575 | 100.0% | 10 |
| nova.boot_server | 5.333 | 6.169 | 7.894 | 7.9 | 7.907 | 6.354 | 100.0% | 10 |
| nova.delete_server | 2.343 | 2.689 | 2.83 | 2.847 | 2.864 | 2.658 | 100.0% | 10 |
| nova.delete_keypair | 0.02 | 0.025 | 0.032 | 0.034 | 0.035 | 0.026 | 100.0% | 10 |
| total | 8.385 | 9.359 | 11.149 | 11.258 | 11.367 | 9.613 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 29.3410420418
Full duration: 66.8611400127
test scenario NovaKeypair.create_and_list_keypairs
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+------+--------+--------+--------+-------+-------+---------+-------+
| nova.create_keypair | 0.4 | 0.494 | 0.589 | 0.867 | 1.146 | 0.544 | 100.0% | 10 |
| nova.list_keypairs | 0.01 | 0.014 | 0.017 | 0.018 | 0.019 | 0.013 | 100.0% | 10 |
| total | 0.41 | 0.508 | 0.603 | 0.884 | 1.165 | 0.558 | 100.0% | 10 |
+---------------------+------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.71813702583
Full duration: 20.3168940544
test scenario NovaServers.list_servers
+---------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+------+--------+--------+--------+-------+-------+---------+-------+
| nova.list_servers | 0.64 | 0.917 | 1.069 | 1.117 | 1.165 | 0.895 | 100.0% | 10 |
| total | 0.64 | 0.917 | 1.07 | 1.117 | 1.165 | 0.895 | 100.0% | 10 |
+-------------------+------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.65287709236
Full duration: 66.0498650074
test scenario NovaServers.resize_server
+-----------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----+--------+--------+--------+-----+-----+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------+-----+--------+--------+--------+-----+-----+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | 0.0% | 6 |
+--------+-----+--------+--------+--------+-----+-----+---------+-------+
Load duration: 815.834815979
Full duration: 839.469985008
test scenario NovaServers.boot_server_from_volume_and_delete
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+-------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+-------+--------+---------+-------+
| cinder.create_volume | 5.574 | 6.234 | 8.567 | 8.613 | 8.66 | 6.605 | 100.0% | 10 |
| nova.boot_server | 4.812 | 6.08 | 6.59 | 6.789 | 6.988 | 6.029 | 100.0% | 10 |
| nova.delete_server | 2.339 | 2.631 | 2.668 | 2.687 | 2.707 | 2.602 | 100.0% | 10 |
| total | 13.379 | 15.107 | 16.804 | 16.977 | 17.15 | 15.236 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+-------+--------+---------+-------+
Load duration: 45.449835062
Full duration: 88.6502871513
test scenario NovaServers.boot_and_migrate_server
+-----------------------------------------------------------------------+
| Response Times (sec) |
+--------+-----+--------+--------+--------+-----+-----+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------+-----+--------+--------+--------+-----+-----+---------+-------+
| total | n/a | n/a | n/a | n/a | n/a | n/a | 0.0% | 5 |
+--------+-----+--------+--------+--------+-----+-----+---------+-------+
Load duration: 824.306979895
Full duration: 846.910109043
test scenario NovaServers.boot_and_delete_server
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.boot_server | 4.471 | 5.91 | 6.147 | 6.182 | 6.217 | 5.681 | 100.0% | 10 |
| nova.delete_server | 2.378 | 2.586 | 2.707 | 2.746 | 2.785 | 2.579 | 100.0% | 10 |
| total | 7.061 | 8.47 | 8.67 | 8.754 | 8.839 | 8.26 | 100.0% | 10 |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 24.1857261658
Full duration: 60.5944719315
test scenario NovaServers.boot_and_rebuild_server
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+-------+---------+-------+
| nova.boot_server | 4.333 | 5.804 | 6.335 | 6.417 | 6.498 | 5.565 | 100.0% | 10 |
| nova.rebuild_server | 7.496 | 8.885 | 9.786 | 9.911 | 10.036 | 8.862 | 100.0% | 10 |
| nova.delete_server | 2.289 | 2.614 | 2.738 | 2.741 | 2.744 | 2.563 | 100.0% | 10 |
| total | 14.866 | 17.495 | 18.471 | 18.474 | 18.476 | 16.99 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 49.6322209835
Full duration: 85.0604588985
test scenario NovaSecGroup.create_and_list_secgroups
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 3.185 | 3.686 | 3.987 | 4.312 | 4.638 | 3.699 | 100.0% | 10 |
| nova.create_100_rules | 18.567 | 26.267 | 26.534 | 26.699 | 26.865 | 24.773 | 100.0% | 10 |
| nova.list_security_groups | 0.078 | 0.128 | 0.182 | 0.185 | 0.187 | 0.13 | 100.0% | 10 |
| total | 22.414 | 29.93 | 30.82 | 30.98 | 31.14 | 28.603 | 100.0% | 10 |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 82.9733760357
Full duration: 116.589685917
test scenario NovaSecGroup.create_and_delete_secgroups
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 2.944 | 3.432 | 3.733 | 3.782 | 3.831 | 3.421 | 100.0% | 10 |
| nova.create_100_rules | 16.376 | 21.41 | 22.17 | 22.462 | 22.754 | 20.611 | 100.0% | 10 |
| nova.delete_10_security_groups | 0.917 | 1.088 | 1.275 | 1.303 | 1.332 | 1.093 | 100.0% | 10 |
| total | 20.695 | 25.965 | 26.896 | 26.95 | 27.004 | 25.125 | 100.0% | 10 |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 72.9624798298
Full duration: 89.82077384
test scenario NovaServers.boot_and_bounce_server
+---------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+--------+--------+--------+---------+---------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------+--------+--------+--------+---------+---------+--------+---------+-------+
| nova.boot_server | 4.125 | 4.583 | 6.312 | 6.519 | 6.725 | 5.156 | 100.0% | 10 |
| nova.reboot_server | 2.419 | 2.493 | 2.871 | 3.889 | 4.906 | 2.736 | 100.0% | 10 |
| nova.soft_reboot_server | 4.365 | 4.758 | 16.946 | 70.03 | 123.114 | 16.564 | 100.0% | 10 |
| nova.stop_server | 5.106 | 14.074 | 15.736 | 15.772 | 15.808 | 13.538 | 100.0% | 10 |
| nova.start_server | 1.398 | 1.653 | 1.789 | 2.027 | 2.264 | 1.691 | 100.0% | 10 |
| nova.rescue_server | 6.466 | 6.855 | 15.712 | 16.593 | 17.474 | 8.701 | 100.0% | 10 |
| nova.unrescue_server | 2.236 | 2.258 | 2.473 | 2.501 | 2.529 | 2.318 | 100.0% | 10 |
| nova.delete_server | 2.302 | 2.339 | 2.497 | 2.533 | 2.568 | 2.392 | 100.0% | 10 |
| total | 30.075 | 40.221 | 65.737 | 113.006 | 160.274 | 53.112 | 100.0% | 10 |
+-------------------------+--------+--------+--------+---------+---------+--------+---------+-------+
Load duration: 160.307124138
Full duration: 195.760754108
test scenario NovaServers.boot_server
+---------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.boot_server | 4.346 | 5.987 | 7.641 | 7.662 | 7.683 | 6.099 | 100.0% | 10 |
| total | 4.346 | 5.987 | 7.641 | 7.662 | 7.684 | 6.099 | 100.0% | 10 |
+------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 17.5887329578
Full duration: 42.9464931488
test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 2.723 | 3.726 | 4.171 | 4.216 | 4.261 | 3.683 | 100.0% | 10 |
| nova.create_100_rules | 18.505 | 26.114 | 26.91 | 26.926 | 26.943 | 24.62 | 100.0% | 10 |
| nova.boot_server | 3.627 | 4.946 | 5.965 | 6.019 | 6.073 | 4.932 | 100.0% | 10 |
| nova.get_attached_security_groups | 0.108 | 0.131 | 0.253 | 0.324 | 0.396 | 0.166 | 100.0% | 10 |
| nova.delete_server | 2.334 | 2.379 | 2.491 | 2.512 | 2.533 | 2.396 | 100.0% | 10 |
| nova.delete_10_security_groups | 0.973 | 1.409 | 1.639 | 1.832 | 2.026 | 1.399 | 100.0% | 10 |
| total | 28.564 | 39.133 | 39.77 | 39.952 | 40.134 | 37.197 | 100.0% | 10 |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 107.169257164
Full duration: 144.236375093
test scenario NovaServers.pause_and_unpause_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 4.178 | 6.265 | 6.892 | 7.037 | 7.182 | 6.066 | 100.0% | 10 |
| nova.pause_server | 2.287 | 2.526 | 2.683 | 2.743 | 2.804 | 2.548 | 100.0% | 10 |
| nova.unpause_server | 2.436 | 2.503 | 2.571 | 2.571 | 2.572 | 2.507 | 100.0% | 10 |
| nova.delete_server | 2.294 | 2.606 | 2.995 | 3.945 | 4.895 | 2.755 | 100.0% | 10 |
| total | 11.529 | 13.896 | 14.859 | 15.712 | 16.564 | 13.876 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 40.5261249542
Full duration: 76.823114872
test scenario NovaServers.boot_server_from_volume
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 5.836 | 6.478 | 9.07 | 9.177 | 9.283 | 7.115 | 100.0% | 10 |
| nova.boot_server | 5.52 | 6.079 | 6.596 | 7.362 | 8.128 | 6.22 | 100.0% | 10 |
| total | 11.526 | 12.516 | 15.434 | 15.438 | 15.442 | 13.335 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 39.5622808933
Full duration: 73.6733939648
test scenario NovaServers.boot_and_list_server
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.boot_server | 4.694 | 6.002 | 6.133 | 6.249 | 6.365 | 5.738 | 100.0% | 10 |
| nova.list_servers | 0.141 | 0.377 | 0.551 | 0.599 | 0.646 | 0.376 | 100.0% | 10 |
| total | 5.074 | 6.186 | 6.707 | 6.807 | 6.906 | 6.114 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 17.6599957943
Full duration: 64.1471071243
run_rally - INFO - Test scenario: "nova" Failed.
run_rally - INFO - Starting test scenario "quotas" ...
Preparing input task
Task 5eda6ea1-f001-4a0e-b6cd-7685d1803fd5: started
Task 5eda6ea1-f001-4a0e-b6cd-7685d1803fd5: finished
test scenario Quotas.cinder_update
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.692 | 0.867 | 1.007 | 1.025 | 1.043 | 0.869 | 100.0% | 10 |
| total | 0.692 | 0.867 | 1.007 | 1.025 | 1.043 | 0.869 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.54990196228
Full duration: 9.24233794212
test scenario Quotas.neutron_update
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.318 | 0.578 | 0.742 | 0.759 | 0.776 | 0.558 | 100.0% | 10 |
| total | 0.384 | 0.669 | 0.825 | 0.837 | 0.848 | 0.646 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.74635910988
Full duration: 8.15396595001
test scenario Quotas.cinder_update_and_delete
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.686 | 0.867 | 1.072 | 1.087 | 1.102 | 0.87 | 100.0% | 10 |
| quotas.delete_quotas | 0.563 | 0.613 | 0.737 | 0.75 | 0.763 | 0.631 | 100.0% | 10 |
| total | 1.274 | 1.453 | 1.698 | 1.782 | 1.865 | 1.501 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.41035509109
Full duration: 11.0862941742
test scenario Quotas.nova_update_and_delete
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.48 | 0.753 | 1.082 | 1.107 | 1.133 | 0.811 | 100.0% | 10 |
| quotas.delete_quotas | 0.025 | 0.066 | 0.091 | 0.114 | 0.138 | 0.066 | 100.0% | 10 |
| total | 0.505 | 0.812 | 1.14 | 1.173 | 1.206 | 0.878 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.45851612091
Full duration: 8.88383197784
test scenario Quotas.nova_update
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.516 | 0.798 | 1.182 | 1.19 | 1.198 | 0.829 | 100.0% | 10 |
| total | 0.516 | 0.798 | 1.182 | 1.19 | 1.198 | 0.829 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.38111186028
Full duration: 8.62598204613
run_rally - INFO - Test scenario: "quotas" OK.
run_rally - INFO - Starting test scenario "requests" ...
Preparing input task
Task 6afaa02c-ce64-423c-8af7-1f3436c08dbd: started
Task 6afaa02c-ce64-423c-8af7-1f3436c08dbd: finished
test scenario HttpRequests.check_random_request
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| requests.check_request | 5.022 | 5.033 | 5.491 | 5.493 | 5.495 | 5.191 | 100.0% | 10 |
| total | 5.022 | 5.034 | 5.491 | 5.493 | 5.495 | 5.191 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 15.5716190338
Full duration: 18.0286371708
test scenario HttpRequests.check_request
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| requests.check_request | 5.021 | 5.026 | 5.03 | 5.032 | 5.033 | 5.026 | 100.0% | 10 |
| total | 5.021 | 5.026 | 5.03 | 5.032 | 5.033 | 5.026 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 15.1103169918
Full duration: 17.6116039753
run_rally - INFO - Test scenario: "requests" OK.
Rally Summary Report
+===================+============+===============+===========+
| Module | Duration | nb. Test Run | Success |
+===================+============+===============+===========+
| authenticate | 00:20 | 10 | 100.00% |
+-------------------+------------+---------------+-----------+
| glance | 01:52 | 7 | 100.00% |
+-------------------+------------+---------------+-----------+
| cinder | 15:05 | 50 | 100.00% |
+-------------------+------------+---------------+-----------+
| heat | 06:52 | 32 | 92.31% |
+-------------------+------------+---------------+-----------+
| keystone | 01:19 | 29 | 100.00% |
+-------------------+------------+---------------+-----------+
| neutron | 07:05 | 31 | 100.00% |
+-------------------+------------+---------------+-----------+
| nova | 52:04 | 52 | 88.89% |
+-------------------+------------+---------------+-----------+
| quotas | 00:45 | 7 | 100.00% |
+-------------------+------------+---------------+-----------+
| requests | 00:35 | 2 | 100.00% |
+-------------------+------------+---------------+-----------+
+===================+============+===============+===========+
| TOTAL: | 01:26:02 | 220 | 97.91% |
+===================+============+===============+===========+
SDN Controller¶
ODL¶
FUNCTEST.info: Running ODL test...
==============================================================================
Basic
==============================================================================
Basic.010 Restconf OK :: Test suite to verify Restconf is OK
==============================================================================
Get Controller Modules :: Get the controller modules via Restconf | PASS |
------------------------------------------------------------------------------
Basic.010 Restconf OK :: Test suite to verify Restconf is OK | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Basic | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Output: /home/opnfv/output.xml
Log: /home/opnfv/log.html
Report: /home/opnfv/report.html
==============================================================================
Neutron :: Test suite for Neutron Plugin
==============================================================================
Neutron.Networks :: Checking Network created in OpenStack are pushed to Ope...
==============================================================================
Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS |
------------------------------------------------------------------------------
Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS |
------------------------------------------------------------------------------
Create Network :: Create new network in OpenStack | PASS |
------------------------------------------------------------------------------
Check Network :: Check Network created in OpenDaylight | FAIL |
404 != 200
------------------------------------------------------------------------------
Neutron.Networks :: Checking Network created in OpenStack are push... | FAIL |
4 critical tests, 3 passed, 1 failed
4 tests total, 3 passed, 1 failed
==============================================================================
Neutron.Subnets :: Checking Subnets created in OpenStack are pushed to Open...
==============================================================================
Check OpenStack Subnets :: Checking OpenStack Neutron for known Su... | PASS |
------------------------------------------------------------------------------
Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS |
------------------------------------------------------------------------------
Create New subnet :: Create new subnet in OpenStack | PASS |
------------------------------------------------------------------------------
Check New subnet :: Check new subnet created in OpenDaylight | FAIL |
404 != 200
------------------------------------------------------------------------------
Neutron.Subnets :: Checking Subnets created in OpenStack are pushe... | FAIL |
4 critical tests, 3 passed, 1 failed
4 tests total, 3 passed, 1 failed
==============================================================================
Neutron.Ports :: Checking Port created in OpenStack are pushed to OpenDaylight
==============================================================================
Check OpenStack ports :: Checking OpenStack Neutron for known ports | PASS |
------------------------------------------------------------------------------
Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS |
------------------------------------------------------------------------------
Create New Port :: Create new port in OpenStack | PASS |
------------------------------------------------------------------------------
Check New Port :: Check new subnet created in OpenDaylight | FAIL |
404 != 200
------------------------------------------------------------------------------
Neutron.Ports :: Checking Port created in OpenStack are pushed to ... | FAIL |
4 critical tests, 3 passed, 1 failed
4 tests total, 3 passed, 1 failed
==============================================================================
Neutron.Delete Ports :: Checking Port deleted in OpenStack are deleted also...
==============================================================================
Delete New Port :: Delete previously created port in OpenStack | PASS |
------------------------------------------------------------------------------
Check Port Deleted :: Check port deleted in OpenDaylight | PASS |
------------------------------------------------------------------------------
Neutron.Delete Ports :: Checking Port deleted in OpenStack are del... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack are deleted...
==============================================================================
Delete New subnet :: Delete previously created subnet in OpenStack | PASS |
------------------------------------------------------------------------------
Check New subnet deleted :: Check subnet deleted in OpenDaylight | PASS |
------------------------------------------------------------------------------
Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack ar... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Neutron.Delete Networks :: Checking Network deleted in OpenStack are delete...
==============================================================================
Delete Network :: Delete network in OpenStack | PASS |
------------------------------------------------------------------------------
Check Network deleted :: Check Network deleted in OpenDaylight | PASS |
------------------------------------------------------------------------------
Neutron.Delete Networks :: Checking Network deleted in OpenStack a... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Neutron :: Test suite for Neutron Plugin | FAIL |
18 critical tests, 15 passed, 3 failed
18 tests total, 15 passed, 3 failed
==============================================================================
Output: /home/opnfv/output.xml
Log: /home/opnfv/log.html
Report: /home/opnfv/report.html
Log: /home/opnfv/log.html
Report: /home/opnfv/report.html
Feature tests¶
vIMS¶
FUNCTEST.info: Running vIMS test...
vIMS - INFO - Prepare OpenStack plateform (create tenant and user)
vIMS - INFO - Update OpenStack creds informations
vIMS - INFO - Upload some OS images if it doesn't exist
vIMS - INFO - centos_7 image doesn't exist on glance repository.
Try downloading this image and upload on glance !
vIMS - INFO - ubuntu_14.04 image doesn't exist on glance repository.
Try downloading this image and upload on glance !
vIMS - INFO - Update security group quota for this tenant
vIMS - INFO - Update cinder quota for this tenant
vIMS - INFO - Collect flavor id for cloudify manager server
vIMS - INFO - Prepare virtualenv for cloudify-cli
vIMS - INFO - Downloading the cloudify manager server blueprint
vIMS - INFO - Cloudify deployment Start Time:'2016-02-23 08:04:17'
vIMS - INFO - Writing the inputs file
vIMS - INFO - Launching the cloudify-manager deployment
vIMS - INFO - Cloudify-manager server is UP !
vIMS - INFO - Cloudify deployment duration:'495.7'
vIMS - INFO - Collect flavor id for all clearwater vm
vIMS - INFO - vIMS VNF deployment Start Time:'2016-02-23 08:12:33'
vIMS - INFO - Downloading the openstack-blueprint.yaml blueprint
vIMS - INFO - Writing the inputs file
vIMS - INFO - Launching the clearwater deployment
vIMS - INFO - The deployment of clearwater-opnfv is ended
vIMS - INFO - vIMS VNF deployment duration:'759.1'
vIMS - INFO - vIMS functional test Start Time:'2016-02-23 08:28:17'
vIMS - INFO - vIMS functional test duration:'109.1'
vIMS - INFO - Launching the clearwater-opnfv undeployment
vIMS - ERROR - Error when executing command /bin/bash -c 'source /home/opnfv/functest/data/vIMS/venv_cloudify/bin/activate; cd /home/opnfv/functest/data/vIMS/; cfy executions start -w uninstall -d clearwater-opnfv --timeout 1800 ; cfy deployments delete -d clearwater-opnfv; '
vIMS - INFO - Launching the cloudify-manager undeployment
vIMS - INFO - Cloudify-manager server has been successfully removed!
vIMS - INFO - Removing vIMS tenant ..
vIMS - INFO - Removing vIMS user ..
Doctor¶
FUNCTEST.info: Running Doctor test...
doctor - DEBUG - Executing command : cd /home/opnfv/repos/doctor/tests && ./run.sh
doctor - DEBUG - + IMAGE_URL=https://launchpad.net/cirros/trunk/0.3.0/+download/cirros-0.3.0-x86_64-disk.img
Note: doctor/tests/run.sh has been executed.
PING 192.30.9.7 (192.30.9.7) 56(84) bytes of data.
64 bytes from 192.30.9.7: icmp_seq=1 ttl=63 time=0.753 ms
--- 192.30.9.7 ping statistics ---
1 packets transmitted, 1 received, 0% packet loss, time 0ms
rtt min/avg/max/mdev = 0.753/0.753/0.753/0.000 ms
preparing VM image...
+------------------+--------------------------------------+
| Property | Value |
+------------------+--------------------------------------+
| checksum | 11834a548b5f6fa25d331353b139cb1a |
| container_format | bare |
| created_at | 2016-02-24T07:59:46Z |
| disk_format | qcow2 |
| id | 0074bf80-807e-4cb7-b904-bf4347c2a668 |
| min_disk | 0 |
| min_ram | 0 |
| name | cirros |
| owner | 3d15a63c2519439f839df6785236b0e1 |
| protected | False |
| size | 15482 |
| status | active |
| tags | [] |
| updated_at | 2016-02-24T07:59:47Z |
| virtual_size | None |
| visibility | public |
+------------------+--------------------------------------+
starting doctor sample components...
creating VM and alarm...
+--------------------------------------+-----------------------------------------------+
| Property | Value |
+--------------------------------------+-----------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | |
| OS-EXT-SRV-ATTR:host | - |
| OS-EXT-SRV-ATTR:hypervisor_hostname | - |
| OS-EXT-SRV-ATTR:instance_name | instance-00000048 |
| OS-EXT-STS:power_state | 0 |
| OS-EXT-STS:task_state | scheduling |
| OS-EXT-STS:vm_state | building |
| OS-SRV-USG:launched_at | - |
| OS-SRV-USG:terminated_at | - |
| accessIPv4 | |
| accessIPv6 | |
| adminPass | AaUNZaoqw74Q |
| config_drive | |
| created | 2016-02-24T07:59:49Z |
| flavor | m1.tiny (1) |
| hostId | |
| id | 1ab94214-1d8c-46b5-8467-3d3e3b602f04 |
| image | cirros (0074bf80-807e-4cb7-b904-bf4347c2a668) |
| key_name | - |
| metadata | {} |
| name | doctor_vm1 |
| os-extended-volumes:volumes_attached | [] |
| progress | 0 |
| security_groups | default |
| status | BUILD |
| tenant_id | 3d15a63c2519439f839df6785236b0e1 |
| updated | 2016-02-24T07:59:49Z |
| user_id | 0cfa3d72e33b490880278ff6676aa961 |
+--------------------------------------+-----------------------------------------------+
+---------------------------+----------------------------------------------------------------------+
| Property | Value |
+---------------------------+----------------------------------------------------------------------+
| alarm_actions | ["http://localhost:12346/failure"] |
| alarm_id | 739ca887-1a9d-4fb4-ad77-17793de1db16 |
| description | VM failure |
| enabled | True |
| event_type | compute.instance.update |
| insufficient_data_actions | [] |
| name | doctor_alarm1 |
| ok_actions | [] |
| project_id | 3d15a63c2519439f839df6785236b0e1 |
| query | [{"field": "traits.state", "type": "string", "value": "error", "op": |
| | "eq"}, {"field": "traits.instance_id", "type": "string", "value": |
| | "1ab94214-1d8c-46b5-8467-3d3e3b602f04", "op": "eq"}] |
| repeat_actions | False |
| severity | moderate |
| state | insufficient data |
| type | event |
| user_id | 0cfa3d72e33b490880278ff6676aa961 |
+---------------------------+----------------------------------------------------------------------+
waiting for vm launch...
injecting host failure...
disabling network of comupte host [overcloud-novacompute-0] for 3 mins...
Warning: Permanently added '192.30.9.7' (ECDSA) to the list of known hosts.
Warning: Permanently added '192.30.9.7' (ECDSA) to the list of known hosts.
0 OK
done
cleanup...
24120
24124
24122
24144
Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
Your request was processed by a Nova API which does not support microversions (X-OpenStack-Nova-API-Version header is missing from response). Warning: Response may be incorrect.
24125
24136
+ ssh -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -i instack_key heat-admin@192.30.9.7 '[ -e disable_network.log ] && cat disable_network.log'
Warning: Permanently added '192.30.9.7' (ECDSA) to the list of known hosts.
sudo ip link set enp8s0 down
<Response [200]>
Request to delete server doctor_vm1 has been accepted.
waiting disabled compute host back to be enabled...
doctor - INFO - doctor OK
Detailed test results for joid-os-odl_l2-nofeature-ha¶
VIM¶
vping_ssh¶
FUNCTEST.info: Running vPing-SSH test...
vPing_ssh- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
vPing_ssh- INFO - Creating neutron network vping-net...
vPing_ssh- INFO - Creating security group 'vPing-sg'...
vPing_ssh- INFO - Using existing Flavor 'm1.small'...
vPing_ssh- INFO - vPing Start Time:'2016-02-23 10:26:42'
vPing_ssh- INFO - Creating instance 'opnfv-vping-1'...
name=opnfv-vping-1
flavor=<Flavor: m1.small>
image=13cc508d-303d-46a8-bd03-3edae4434dfb
network=b183c17a-bac5-4e45-afba-f5bc61edcf9e
vPing_ssh- INFO - Instance 'opnfv-vping-1' is ACTIVE.
vPing_ssh- INFO - Adding 'opnfv-vping-1' to security group 'vPing-sg'...
vPing_ssh- INFO - Creating instance 'opnfv-vping-2'...
name=opnfv-vping-2
flavor=<Flavor: m1.small>
image=13cc508d-303d-46a8-bd03-3edae4434dfb
network=b183c17a-bac5-4e45-afba-f5bc61edcf9e
vPing_ssh- INFO - Instance 'opnfv-vping-2' is ACTIVE.
vPing_ssh- INFO - Adding 'opnfv-vping-2' to security group 'vPing-sg'...
vPing_ssh- INFO - Creating floating IP for VM 'opnfv-vping-2'...
vPing_ssh- INFO - Floating IP created: '161.105.231.3'
vPing_ssh- INFO - Associating floating ip: '161.105.231.3' to VM 'opnfv-vping-2'
vPing_ssh- INFO - Trying to establish SSH connection to 161.105.231.3...
vPing_ssh- INFO - Waiting for ping...
vPing_ssh- INFO - vPing detected!
vPing_ssh- INFO - vPing duration:'33.5' s.
vPing_ssh- INFO - Cleaning up...
vPing_ssh- INFO - vPing OK
vping_userdata¶
FUNCTEST.info: Running vPing-userdata test...
vPing_userdata- INFO - Creating image 'functest-vping' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
vPing_userdata- INFO - Creating neutron network vping-net...
vPing_userdata- INFO - Creating security group 'vPing-sg'...
vPing_userdata- INFO - Flavor found 'm1.small'
vPing_userdata- INFO - vPing Start Time:'2016-02-23 10:27:41'
vPing_userdata- INFO - Creating instance 'opnfv-vping-1'...
name=opnfv-vping-1
flavor=<Flavor: m1.small>
image=a9b0741e-0d2d-4503-b267-af151870739e
network=9d9b24f9-7bea-48b1-a4eb-771bf3784900
vPing_userdata- INFO - Instance 'opnfv-vping-1' is ACTIVE.
vPing_userdata- INFO - Creating instance 'opnfv-vping-2'...
name=opnfv-vping-2
flavor=<Flavor: m1.small>
image=a9b0741e-0d2d-4503-b267-af151870739e
network=9d9b24f9-7bea-48b1-a4eb-771bf3784900
userdata=
#!/bin/sh
while true; do
ping -c 1 192.168.130.3 2>&1 >/dev/null
RES=$?
if [ "Z$RES" = "Z0" ] ; then
echo 'vPing OK'
break
else
echo 'vPing KO'
fi
sleep 1
done
vPing_userdata- INFO - Instance 'opnfv-vping-2' is ACTIVE.
vPing_userdata- INFO - Waiting for ping...
vPing_userdata- INFO - vPing detected!
vPing_userdata- INFO - vPing duration:'17.9'
vPing_userdata- INFO - vPing OK
vPing_userdata- INFO - Cleaning up...
vPing_userdata- INFO - Deleting network 'vping-net'...
Tempest¶
FUNCTEST.info: Running Tempest tests...
run_tempest - INFO - Creating tenant and user for Tempest suite
2016-02-23 10:28:17.615 23826 INFO rally.verification.tempest.tempest [-] Starting: Creating configuration file for Tempest.
2016-02-23 10:28:23.990 23826 INFO rally.verification.tempest.tempest [-] Completed: Creating configuration file for Tempest.
run_tempest - INFO - Starting Tempest test suite: '--tests-file /home/opnfv/repos/functest/testcases/VIM/OpenStack/CI/custom_tests/test_list.txt'.
Total results of verification:
+--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
| UUID | Deployment UUID | Set name | Tests | Failures | Created at | Status |
+--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
| 473116be-ef51-45b4-a46d-dcc17b02d920 | 7fa447a8-f40c-475e-bae8-d4f62027b80b | | 210 | 5 | 2016-02-23 10:28:27.307831 | finished |
+--------------------------------------+--------------------------------------+----------+-------+----------+----------------------------+----------+
Tests:
+------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
| name | time | status |
+------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
| tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor | 0.88396 | success |
| tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors | 0.17728 | success |
| tempest.api.compute.images.test_images.ImagesTestJSON.test_delete_saving_image | 9.72530 | success |
| tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image | 9.15814 | success |
| tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name | 7.24988 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_changes_since | 0.23094 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_name | 1.23775 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_id | 0.92287 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_server_ref | 0.79109 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_status | 0.20110 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_filter_by_type | 0.48230 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_limit_results | 0.46126 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_changes_since | 0.50215 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_name | 0.21126 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_server_ref | 0.24888 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_status | 0.19557 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_filter_by_type | 0.53114 | success |
| tempest.api.compute.images.test_list_image_filters.ListImageFiltersTestJSON.test_list_images_with_detail_limit_results | 0.88118 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_get_image | 0.52117 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images | 1.01633 | success |
| tempest.api.compute.images.test_list_images.ListImagesTestJSON.test_list_images_with_detail | 0.40909 | success |
| tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create | 0.80631 | success |
| tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list | 1.57659 | success |
| tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete | 2.75110 | success |
| tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip | 9.21019 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name | 62.75436 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers | 0.17342 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail | 0.30973 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus | 0.33235 | success |
| tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details | 0.00133 | success |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name | 62.74257 | success |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers | 0.19542 | success |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail | 0.35564 | success |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus | 0.36918 | success |
| tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details | 0.00129 | success |
| tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action | 0.18644 | success |
| tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions | 3.81844 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor | 0.52933 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image | 0.50494 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name | 0.33257 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status | 0.38382 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results | 0.47799 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor | 0.24448 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image | 0.22883 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit | 0.21227 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name | 0.27651 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_status | 0.06020 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip | 0.40370 | success |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_ip_regex | 0.00142 | skip |
| tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard | 0.30281 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date | 0.25500 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date | 0.21292 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits | 0.19699 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count | 0.07649 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value | 0.14378 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string | 0.01122 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor | 0.03176 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image | 0.06131 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name | 0.04448 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted | 0.21242 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing | 0.18448 | success |
| tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server | 0.06615 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_change_server_password | 0.00170 | skip |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_get_console_output | 5.05891 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server | 12.21875 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard | 10.99696 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_soft | 1.04170 | skip |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server | 24.60148 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_confirm | 15.56771 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_resize_server_revert | 21.94185 | success |
| tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server | 7.25441 | success |
| tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses | 0.17943 | success |
| tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network | 1.00217 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item | 0.76858 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item | 1.16728 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata | 0.46748 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata | 0.60523 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item | 0.70657 | success |
| tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata | 0.91519 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password | 2.30147 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair | 7.86437 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name | 15.09430 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address | 9.89837 | success |
| tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name | 10.11169 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name | 1.55906 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit | 1.98352 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 | 1.47851 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor | 1.88043 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image | 1.53679 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid | 1.27055 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_a_server_of_another_tenant | 1.08039 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit | 0.73357 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id | 0.86542 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server | 0.99209 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address | 1.08220 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server | 0.83730 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server | 0.99153 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_non_existent_flavor | 0.54860 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_resize_server_with_null_flavor | 0.37611 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank | 1.44613 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server | 0.55699 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server | 0.56507 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 | 0.48514 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_of_another_tenant | 0.86713 | success |
| tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name | 0.61486 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_keypair_in_analt_user_tenant | 0.12864 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_fails_when_tenant_incorrect | 0.67877 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_create_server_with_unauthorized_image | 0.61740 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_keypair_of_alt_account_fails | 0.13677 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_get_metadata_of_alt_account_server_fails | 1.40358 | success |
| tempest.api.compute.test_authorization.AuthorizationTestJSON.test_set_metadata_of_alt_account_server_fails | 0.16372 | success |
| tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas | 0.18319 | success |
| tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas | 0.33858 | success |
| tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume | 45.56777 | success |
| tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list | 0.72770 | success |
| tempest.api.compute.volumes.test_volumes_list.VolumesTestJSON.test_volume_list_with_details | 0.30390 | success |
| tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id | 0.20202 | success |
| tempest.api.compute.volumes.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id | 0.17999 | success |
| tempest.api.identity.admin.v2.test_services.ServicesTestJSON.test_list_services | 0.34894 | success |
| tempest.api.identity.admin.v2.test_users.UsersTestJSON.test_create_user | 0.13656 | success |
| tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete | 0.0 | fail |
| tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists | 0.05100 | success |
| tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain | 0.50255 | success |
| tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint | 0.27108 | success |
| tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete | 1.16016 | success |
| tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy | 0.21180 | success |
| tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id | 0.14141 | success |
| tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_get_list | 0.25298 | success |
| tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service | 0.20613 | success |
| tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all | 1.42131 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.04287 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.05581 | success |
| tempest.api.identity.v2.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.05518 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types | 0.04135 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources | 0.03642 | success |
| tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses | 0.04205 | success |
| tempest.api.image.v1.test_images.ListImagesTest.test_index_no_params | 0.32191 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image | 1.18189 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file | 1.74422 | success |
| tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image | 2.30171 | success |
| tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions | 3.45772 | success |
| tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address | 1.03994 | success |
| tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip | 1.42863 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_network | 1.14505 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_port | 1.60767 | success |
| tempest.api.network.test_networks.BulkNetworkOpsIpV6TestJSON.test_bulk_create_delete_subnet | 7.84206 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_network | 1.21731 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_port | 2.11434 | success |
| tempest.api.network.test_networks.BulkNetworkOpsTestJSON.test_bulk_create_delete_subnet | 2.79624 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_create_update_delete_network_subnet | 1.61530 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_external_network_visibility | 0.38291 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_networks | 0.20594 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_list_subnets | 0.19821 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_network | 0.20089 | success |
| tempest.api.network.test_networks.NetworksIpV6TestAttrs.test_show_subnet | 0.19206 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_create_update_delete_network_subnet | 1.49044 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_external_network_visibility | 0.23415 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_networks | 0.21291 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_list_subnets | 0.07398 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_network | 0.17873 | success |
| tempest.api.network.test_networks.NetworksIpV6TestJSON.test_show_subnet | 0.20287 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools | 1.38012 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups | 1.87547 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port | 1.20872 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports | 0.05621 | success |
| tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port | 0.20890 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools | 1.70139 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups | 1.75502 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port | 1.16521 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_list_ports | 0.22620 | success |
| tempest.api.network.test_ports.PortsTestJSON.test_show_port | 0.28640 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces | 4.12301 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id | 2.49067 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id | 2.25252 | success |
| tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router | 1.48564 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces | 4.58651 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id | 2.38901 | success |
| tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id | 2.54963 | success |
| tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router | 1.37000 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group | 1.31226 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule | 2.04438 | success |
| tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups | 0.19052 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group | 1.32708 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule | 2.12672 | success |
| tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups | 0.20945 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_list | 0.55381 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_show | 7.80051 | success |
| tempest.api.orchestration.stacks.test_resource_types.ResourceTypesTest.test_resource_type_template | 0.03030 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_list | 1.61156 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_deployment_metadata | 0.86944 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_get_software_config | 0.57507 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_create_validate | 0.36337 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_no_metadata_change | 0.66632 | success |
| tempest.api.orchestration.stacks.test_soft_conf.TestSoftwareConfig.test_software_deployment_update_with_metadata_change | 0.47493 | success |
| tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_crud_no_resources | 3.52216 | success |
| tempest.api.orchestration.stacks.test_stacks.StacksTestJSON.test_stack_list_responds | 0.18647 | success |
| tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v1_notifications | 303.03506 | fail |
| tempest.api.telemetry.test_telemetry_notification_api.TelemetryNotificationAPITestJSON.test_check_glance_v2_notifications | 301.96207 | fail |
| tempest.api.volume.test_volumes_actions.VolumesV1ActionsTest.test_attach_detach_volume_to_instance | 3.14842 | success |
| tempest.api.volume.test_volumes_actions.VolumesV2ActionsTest.test_attach_detach_volume_to_instance | 2.66111 | success |
| tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete | 9.31807 | success |
| tempest.api.volume.test_volumes_get.VolumesV1GetTest.test_volume_create_get_update_delete_from_image | 15.30017 | success |
| tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete | 10.64441 | success |
| tempest.api.volume.test_volumes_get.VolumesV2GetTest.test_volume_create_get_update_delete_from_image | 13.02957 | success |
| tempest.api.volume.test_volumes_list.VolumesV1ListTestJSON.test_volume_list | 0.56814 | success |
| tempest.api.volume.test_volumes_list.VolumesV2ListTestJSON.test_volume_list | 0.23431 | success |
| tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops | 42.47353 | success |
| tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basicops | 82.90131 | success |
| tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern.test_volume_boot_pattern | 499.21662 | fail |
| tempest.scenario.test_volume_boot_pattern.TestVolumeBootPatternV2.test_volume_boot_pattern | 501.43822 | fail |
+------------------------------------------------------------------------------------------------------------------------------------------+-----------+---------+
run_tempest - INFO - Results: {'timestart': '2016-02-2310:28:27.307831', 'duration': 931, 'tests': 210, 'failures': 5}
run_tempest - INFO - Pushing results to DB: 'http://testresults.opnfv.org/testapi/results'.
run_tempest - INFO - Deleting tenant and user for Tempest suite)
Rally¶
FUNCTEST.info: Running Rally benchmark suite...
run_rally - INFO - Starting test scenario "authenticate" ...
run_rally - INFO -
Preparing input task
Task 1e91fffe-1834-4d97-b18c-95b1c3a11763: started
Task 1e91fffe-1834-4d97-b18c-95b1c3a11763: finished
test scenario Authenticate.validate_glance
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_glance | 0.393 | 0.462 | 0.625 | 0.642 | 0.659 | 0.499 | 100.0% | 10 |
| authenticate.validate_glance (2) | 0.042 | 0.05 | 0.222 | 0.235 | 0.247 | 0.101 | 100.0% | 10 |
| total | 0.56 | 0.722 | 0.84 | 0.907 | 0.975 | 0.716 | 100.0% | 10 |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.11308193207
Full duration: 6.43925094604
test scenario Authenticate.keystone
+-----------------------------------------------------------------------------+
| Response Times (sec) |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
| total | 0.096 | 0.108 | 0.117 | 0.118 | 0.118 | 0.108 | 100.0% | 10 |
+--------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.360912799835
Full duration: 4.84613108635
test scenario Authenticate.validate_heat
+-----------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_heat | 0.198 | 0.223 | 0.243 | 0.246 | 0.25 | 0.222 | 100.0% | 10 |
| authenticate.validate_heat (2) | 0.035 | 0.229 | 0.268 | 0.272 | 0.275 | 0.195 | 100.0% | 10 |
| total | 0.349 | 0.56 | 0.636 | 0.648 | 0.66 | 0.537 | 100.0% | 10 |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.73545908928
Full duration: 5.89906620979
test scenario Authenticate.validate_nova
+-----------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_nova | 0.191 | 0.225 | 0.273 | 0.326 | 0.379 | 0.239 | 100.0% | 10 |
| authenticate.validate_nova (2) | 0.193 | 0.215 | 0.268 | 0.324 | 0.379 | 0.233 | 100.0% | 10 |
| total | 0.512 | 0.561 | 0.696 | 0.708 | 0.719 | 0.589 | 100.0% | 10 |
+--------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.73631811142
Full duration: 6.18624401093
test scenario Authenticate.validate_cinder
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_cinder | 0.187 | 0.219 | 0.269 | 0.451 | 0.632 | 0.256 | 100.0% | 10 |
| authenticate.validate_cinder (2) | 0.019 | 0.202 | 0.228 | 0.232 | 0.235 | 0.19 | 100.0% | 10 |
| total | 0.318 | 0.572 | 0.652 | 0.81 | 0.967 | 0.582 | 100.0% | 10 |
+----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.90990018845
Full duration: 6.19068098068
test scenario Authenticate.validate_neutron
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| authenticate.validate_neutron | 0.22 | 0.241 | 0.324 | 0.326 | 0.328 | 0.255 | 100.0% | 10 |
| authenticate.validate_neutron (2) | 0.21 | 0.234 | 0.327 | 0.349 | 0.37 | 0.254 | 100.0% | 10 |
| total | 0.529 | 0.595 | 0.67 | 0.689 | 0.708 | 0.613 | 100.0% | 10 |
+-----------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.81688117981
Full duration: 5.97459483147
run_rally - INFO - Test scenario: "authenticate" OK.
run_rally - INFO - Starting test scenario "glance" ...
run_rally - INFO -
Preparing input task
Task c991643e-676b-49d8-af8c-cf9655ae236b: started
Task c991643e-676b-49d8-af8c-cf9655ae236b: finished
test scenario GlanceImages.list_images
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| glance.list_images | 0.47 | 0.551 | 0.604 | 0.621 | 0.638 | 0.559 | 100.0% | 10 |
| total | 0.471 | 0.551 | 0.604 | 0.621 | 0.638 | 0.559 | 100.0% | 10 |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.7134771347
Full duration: 7.86669206619
test scenario GlanceImages.create_image_and_boot_instances
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| glance.create_image | 3.881 | 4.628 | 5.228 | 5.273 | 5.317 | 4.643 | 100.0% | 10 |
| nova.boot_servers | 7.198 | 8.691 | 9.617 | 9.773 | 9.929 | 8.609 | 100.0% | 10 |
| total | 11.395 | 13.062 | 14.63 | 14.674 | 14.718 | 13.252 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 40.5051100254
Full duration: 80.9348599911
test scenario GlanceImages.create_and_list_image
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| glance.create_image | 4.473 | 4.791 | 5.258 | 5.513 | 5.767 | 4.935 | 100.0% | 10 |
| glance.list_images | 0.046 | 0.143 | 0.285 | 0.293 | 0.302 | 0.159 | 100.0% | 10 |
| total | 4.67 | 5.043 | 5.524 | 5.679 | 5.834 | 5.095 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 15.4974470139
Full duration: 26.4936869144
test scenario GlanceImages.create_and_delete_image
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| glance.create_image | 4.297 | 4.864 | 5.167 | 5.345 | 5.523 | 4.859 | 100.0% | 10 |
| glance.delete_image | 0.842 | 1.496 | 1.603 | 1.702 | 1.801 | 1.371 | 100.0% | 10 |
| total | 5.14 | 6.405 | 6.623 | 6.626 | 6.63 | 6.23 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 18.5310051441
Full duration: 24.86997509
run_rally - INFO - Test scenario: "glance" OK.
run_rally - INFO - Starting test scenario "cinder" ...
run_rally - INFO -
Preparing input task
Task 388cb584-9c00-4d54-8f76-53ed3182a475: started
Task 388cb584-9c00-4d54-8f76-53ed3182a475: finished
test scenario CinderVolumes.create_and_attach_volume
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 4.792 | 5.804 | 8.436 | 8.476 | 8.516 | 6.313 | 100.0% | 10 |
| cinder.create_volume | 3.049 | 3.381 | 3.469 | 3.471 | 3.473 | 3.317 | 100.0% | 10 |
| nova.attach_volume | 3.722 | 3.987 | 4.207 | 4.245 | 4.283 | 4.012 | 100.0% | 10 |
| nova.detach_volume | 3.492 | 3.685 | 3.892 | 3.925 | 3.958 | 3.702 | 100.0% | 10 |
| cinder.delete_volume | 0.502 | 0.765 | 2.927 | 2.998 | 3.068 | 1.357 | 100.0% | 10 |
| nova.delete_server | 2.66 | 3.128 | 3.235 | 3.243 | 3.251 | 3.056 | 100.0% | 10 |
| total | 19.466 | 20.925 | 25.056 | 25.456 | 25.856 | 21.758 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 64.0748999119
Full duration: 88.3469510078
test scenario CinderVolumes.create_and_list_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 6.151 | 6.548 | 8.972 | 9.007 | 9.043 | 7.201 | 100.0% | 10 |
| cinder.list_volumes | 0.044 | 0.249 | 0.299 | 0.32 | 0.34 | 0.227 | 100.0% | 10 |
| total | 6.424 | 6.801 | 9.229 | 9.255 | 9.28 | 7.429 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 22.3146419525
Full duration: 39.1755928993
test scenario CinderVolumes.create_and_list_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.269 | 3.372 | 3.545 | 3.556 | 3.566 | 3.406 | 100.0% | 10 |
| cinder.list_volumes | 0.051 | 0.27 | 0.296 | 0.304 | 0.313 | 0.249 | 100.0% | 10 |
| total | 3.321 | 3.662 | 3.786 | 3.819 | 3.852 | 3.656 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 11.0692770481
Full duration: 26.8993549347
test scenario CinderVolumes.create_and_list_snapshots
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_snapshot | 2.807 | 3.0 | 3.236 | 4.094 | 4.951 | 3.175 | 100.0% | 10 |
| cinder.list_snapshots | 0.023 | 0.263 | 0.29 | 0.295 | 0.299 | 0.238 | 100.0% | 10 |
| total | 3.039 | 3.247 | 3.493 | 4.372 | 5.251 | 3.413 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 11.5568339825
Full duration: 45.8590891361
test scenario CinderVolumes.create_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.35 | 3.413 | 3.511 | 3.567 | 3.622 | 3.434 | 100.0% | 10 |
| cinder.delete_volume | 0.666 | 2.775 | 3.101 | 3.101 | 3.101 | 2.07 | 100.0% | 10 |
| total | 4.016 | 6.163 | 6.511 | 6.555 | 6.6 | 5.505 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 16.3949551582
Full duration: 29.3589651585
test scenario CinderVolumes.create_and_delete_volume
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| cinder.create_volume | 6.12 | 6.499 | 8.727 | 8.888 | 9.049 | 6.934 | 100.0% | 10 |
| cinder.delete_volume | 0.689 | 2.95 | 3.117 | 3.132 | 3.147 | 2.519 | 100.0% | 10 |
| total | 6.97 | 9.45 | 11.391 | 11.777 | 12.163 | 9.454 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 27.9512338638
Full duration: 42.110273838
test scenario CinderVolumes.create_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.153 | 3.382 | 3.523 | 3.546 | 3.569 | 3.401 | 100.0% | 10 |
| cinder.delete_volume | 0.459 | 1.756 | 3.107 | 3.143 | 3.179 | 1.823 | 100.0% | 10 |
| total | 3.976 | 5.273 | 6.386 | 6.427 | 6.468 | 5.225 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 14.3155708313
Full duration: 27.9943380356
test scenario CinderVolumes.create_and_upload_volume_to_image
+-------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.216 | 3.504 | 3.612 | 3.614 | 3.616 | 3.473 | 100.0% | 10 |
| cinder.upload_volume_to_image | 48.706 | 66.291 | 69.416 | 69.518 | 69.621 | 64.031 | 100.0% | 10 |
| cinder.delete_volume | 0.681 | 1.721 | 3.226 | 3.286 | 3.347 | 1.88 | 100.0% | 10 |
| nova.delete_image | 1.064 | 1.392 | 1.76 | 1.884 | 2.007 | 1.407 | 100.0% | 10 |
| total | 57.671 | 73.06 | 75.032 | 75.707 | 76.382 | 70.791 | 100.0% | 10 |
+-------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 206.246454954
Full duration: 221.344403028
test scenario CinderVolumes.create_and_delete_snapshot
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_snapshot | 2.886 | 3.18 | 5.409 | 5.479 | 5.548 | 3.789 | 100.0% | 10 |
| cinder.delete_snapshot | 2.442 | 2.892 | 3.051 | 3.111 | 3.172 | 2.875 | 100.0% | 10 |
| total | 5.432 | 6.063 | 8.28 | 8.355 | 8.429 | 6.664 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 20.3915560246
Full duration: 49.2419481277
test scenario CinderVolumes.create_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.151 | 3.492 | 3.579 | 3.641 | 3.703 | 3.459 | 100.0% | 10 |
| total | 3.151 | 3.492 | 3.579 | 3.641 | 3.703 | 3.459 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 10.2652549744
Full duration: 23.4044110775
test scenario CinderVolumes.create_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.221 | 3.489 | 3.632 | 3.639 | 3.647 | 3.448 | 100.0% | 10 |
| total | 3.222 | 3.489 | 3.632 | 3.64 | 3.647 | 3.448 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 10.2576260567
Full duration: 27.1289498806
test scenario CinderVolumes.list_volumes
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.list_volumes | 0.347 | 0.409 | 0.467 | 0.49 | 0.514 | 0.416 | 100.0% | 10 |
| total | 0.347 | 0.409 | 0.467 | 0.49 | 0.514 | 0.416 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.25233316422
Full duration: 60.8991248608
test scenario CinderVolumes.create_nested_snapshots_and_attach_volume
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.37 | 3.431 | 3.543 | 3.585 | 3.627 | 3.454 | 100.0% | 10 |
| cinder.create_snapshot | 2.744 | 2.922 | 2.98 | 2.993 | 3.006 | 2.901 | 100.0% | 10 |
| nova.attach_volume | 4.052 | 4.214 | 6.878 | 6.969 | 7.06 | 4.803 | 100.0% | 10 |
| nova.detach_volume | 3.392 | 3.988 | 4.066 | 4.11 | 4.154 | 3.906 | 100.0% | 10 |
| cinder.delete_snapshot | 0.753 | 2.605 | 2.986 | 3.013 | 3.04 | 2.343 | 100.0% | 10 |
| cinder.delete_volume | 0.492 | 2.767 | 2.955 | 3.011 | 3.067 | 1.989 | 100.0% | 10 |
| total | 16.494 | 20.022 | 23.368 | 23.417 | 23.465 | 20.126 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 59.1712889671
Full duration: 133.726794958
test scenario CinderVolumes.create_from_volume_and_delete_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.434 | 3.618 | 4.006 | 4.825 | 5.645 | 3.835 | 100.0% | 10 |
| cinder.delete_volume | 2.853 | 2.996 | 3.194 | 3.231 | 3.269 | 3.035 | 100.0% | 10 |
| total | 6.323 | 6.672 | 7.143 | 7.89 | 8.637 | 6.87 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 20.0482749939
Full duration: 48.4943790436
test scenario CinderVolumes.create_and_extend_volume
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| cinder.create_volume | 3.242 | 3.547 | 3.574 | 3.574 | 3.575 | 3.477 | 100.0% | 10 |
| cinder.extend_volume | 0.67 | 0.904 | 3.113 | 3.227 | 3.341 | 1.343 | 100.0% | 10 |
| cinder.delete_volume | 0.756 | 2.645 | 3.074 | 3.111 | 3.147 | 2.224 | 100.0% | 10 |
| total | 5.261 | 7.245 | 7.684 | 8.512 | 9.341 | 7.045 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 21.6863160133
Full duration: 35.5403769016
test scenario CinderVolumes.create_snapshot_and_attach_volume
+-----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 3.427 | 3.543 | 3.82 | 3.829 | 3.838 | 3.59 | 100.0% | 10 |
| cinder.create_snapshot | 2.673 | 2.992 | 3.109 | 3.111 | 3.112 | 2.928 | 100.0% | 10 |
| nova.attach_volume | 3.759 | 4.112 | 4.508 | 5.345 | 6.182 | 4.292 | 100.0% | 10 |
| nova.detach_volume | 3.458 | 4.067 | 4.174 | 4.261 | 4.348 | 4.006 | 100.0% | 10 |
| cinder.delete_snapshot | 2.665 | 2.794 | 2.946 | 2.986 | 3.026 | 2.823 | 100.0% | 10 |
| cinder.delete_volume | 0.707 | 2.907 | 3.246 | 3.257 | 3.268 | 2.558 | 100.0% | 10 |
| total | 18.87 | 21.068 | 21.909 | 22.497 | 23.086 | 20.904 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 61.3498468399
Full duration: 141.86026597
test scenario CinderVolumes.create_snapshot_and_attach_volume
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 2.885 | 3.335 | 3.519 | 3.55 | 3.581 | 3.305 | 100.0% | 10 |
| cinder.create_snapshot | 2.609 | 2.889 | 3.002 | 3.021 | 3.041 | 2.853 | 100.0% | 10 |
| nova.attach_volume | 3.794 | 4.368 | 6.443 | 6.495 | 6.548 | 4.951 | 100.0% | 10 |
| nova.detach_volume | 3.341 | 3.93 | 4.07 | 4.11 | 4.15 | 3.862 | 100.0% | 10 |
| cinder.delete_snapshot | 2.73 | 2.943 | 3.009 | 3.029 | 3.049 | 2.912 | 100.0% | 10 |
| cinder.delete_volume | 0.667 | 2.901 | 3.015 | 3.027 | 3.039 | 2.437 | 100.0% | 10 |
| total | 18.717 | 21.217 | 22.919 | 23.013 | 23.108 | 21.377 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 62.8349030018
Full duration: 143.571810007
run_rally - INFO - Test scenario: "cinder" OK.
run_rally - INFO - Starting test scenario "heat" ...
run_rally - INFO -
Preparing input task
Task 1055c160-be9e-4209-9219-2eda388f64ca: started
Task 1055c160-be9e-4209-9219-2eda388f64ca: finished
test scenario HeatStacks.create_suspend_resume_delete_stack
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 3.658 | 4.153 | 4.633 | 4.957 | 5.28 | 4.179 | 100.0% | 10 |
| heat.suspend_stack | 0.603 | 0.984 | 1.772 | 1.876 | 1.98 | 1.163 | 100.0% | 10 |
| heat.resume_stack | 0.553 | 1.347 | 2.26 | 2.264 | 2.268 | 1.425 | 100.0% | 10 |
| heat.delete_stack | 1.527 | 1.61 | 1.95 | 1.96 | 1.97 | 1.701 | 100.0% | 10 |
| total | 7.456 | 8.457 | 9.273 | 9.324 | 9.376 | 8.469 | 100.0% | 10 |
+--------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 25.1924760342
Full duration: 31.4871768951
test scenario HeatStacks.create_and_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 3.724 | 4.253 | 4.355 | 4.361 | 4.366 | 4.141 | 100.0% | 10 |
| heat.delete_stack | 1.538 | 1.86 | 2.427 | 2.427 | 2.428 | 1.933 | 100.0% | 10 |
| total | 5.609 | 6.117 | 6.381 | 6.402 | 6.422 | 6.073 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 18.3157711029
Full duration: 24.7532258034
test scenario HeatStacks.create_and_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 19.874 | 21.385 | 22.341 | 22.535 | 22.729 | 21.343 | 100.0% | 10 |
| heat.delete_stack | 10.707 | 11.672 | 12.205 | 12.275 | 12.345 | 11.562 | 100.0% | 10 |
| total | 30.923 | 33.359 | 33.959 | 34.235 | 34.512 | 32.905 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 99.1549890041
Full duration: 105.660290003
test scenario HeatStacks.create_and_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 15.572 | 18.262 | 19.048 | 19.088 | 19.127 | 18.071 | 100.0% | 10 |
| heat.delete_stack | 10.145 | 10.711 | 11.519 | 11.545 | 11.571 | 10.78 | 100.0% | 10 |
| total | 25.725 | 29.14 | 29.903 | 30.143 | 30.382 | 28.851 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 85.5803580284
Full duration: 92.0883340836
test scenario HeatStacks.list_stacks_and_resources
+------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.list_stacks | 0.391 | 0.425 | 0.461 | 0.477 | 0.492 | 0.432 | 100.0% | 10 |
| heat.list_resources_of_0_stacks | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 10 |
| total | 0.391 | 0.425 | 0.461 | 0.477 | 0.492 | 0.432 | 100.0% | 10 |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.32646512985
Full duration: 6.55452680588
test scenario HeatStacks.create_update_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 3.818 | 4.127 | 4.55 | 4.634 | 4.719 | 4.191 | 100.0% | 10 |
| heat.update_stack | 2.555 | 3.026 | 3.487 | 3.49 | 3.493 | 2.994 | 100.0% | 10 |
| heat.delete_stack | 1.278 | 1.905 | 2.468 | 2.484 | 2.501 | 1.938 | 100.0% | 10 |
| total | 8.59 | 8.987 | 9.575 | 9.58 | 9.585 | 9.123 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 27.2428030968
Full duration: 34.0842261314
test scenario HeatStacks.create_update_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 3.817 | 4.322 | 4.498 | 4.571 | 4.643 | 4.268 | 100.0% | 10 |
| heat.update_stack | 2.571 | 3.085 | 3.495 | 3.651 | 3.807 | 3.093 | 100.0% | 10 |
| heat.delete_stack | 1.261 | 1.933 | 2.188 | 2.23 | 2.271 | 1.85 | 100.0% | 10 |
| total | 8.823 | 9.193 | 9.529 | 9.645 | 9.76 | 9.211 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 27.712323904
Full duration: 34.6925389767
test scenario HeatStacks.create_update_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 3.534 | 4.559 | 4.878 | 4.986 | 5.094 | 4.397 | 100.0% | 10 |
| heat.update_stack | 4.274 | 4.722 | 5.38 | 5.427 | 5.474 | 4.782 | 100.0% | 10 |
| heat.delete_stack | 2.324 | 2.687 | 3.01 | 3.031 | 3.051 | 2.761 | 100.0% | 10 |
| total | 10.398 | 11.879 | 12.749 | 13.064 | 13.379 | 11.941 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 36.5785570145
Full duration: 43.5735290051
test scenario HeatStacks.create_update_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 4.244 | 4.341 | 4.695 | 4.992 | 5.29 | 4.489 | 100.0% | 10 |
| heat.update_stack | 7.174 | 8.094 | 8.59 | 8.598 | 8.605 | 8.081 | 100.0% | 10 |
| heat.delete_stack | 2.663 | 2.892 | 3.804 | 3.808 | 3.813 | 3.088 | 100.0% | 10 |
| total | 15.231 | 15.561 | 16.269 | 16.292 | 16.315 | 15.659 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 46.8214969635
Full duration: 54.2644329071
test scenario HeatStacks.create_update_delete_stack
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 4.041 | 4.381 | 4.699 | 4.835 | 4.971 | 4.435 | 100.0% | 10 |
| heat.update_stack | 4.032 | 4.694 | 5.611 | 5.758 | 5.906 | 4.82 | 100.0% | 10 |
| heat.delete_stack | 2.715 | 3.034 | 3.306 | 3.315 | 3.324 | 3.036 | 100.0% | 10 |
| total | 11.427 | 12.204 | 13.196 | 13.241 | 13.286 | 12.292 | 100.0% | 10 |
+-------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 37.1505100727
Full duration: 44.6821551323
test scenario HeatStacks.create_update_delete_stack
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
| heat.create_stack | 3.692 | 4.397 | 4.751 | 4.908 | 5.065 | 4.428 | 100.0% | 10 |
| heat.update_stack | 3.631 | 4.037 | 4.866 | 4.875 | 4.885 | 4.167 | 100.0% | 10 |
| heat.delete_stack | 1.267 | 1.966 | 2.279 | 2.33 | 2.382 | 1.871 | 100.0% | 10 |
| total | 9.823 | 10.45 | 11.136 | 11.248 | 11.361 | 10.466 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 31.3539619446
Full duration: 39.0203011036
test scenario HeatStacks.create_and_list_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 4.039 | 4.653 | 4.788 | 4.792 | 4.796 | 4.563 | 100.0% | 10 |
| heat.list_stacks | 0.052 | 0.39 | 0.447 | 0.461 | 0.474 | 0.339 | 100.0% | 10 |
| total | 4.106 | 4.992 | 5.218 | 5.244 | 5.27 | 4.902 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 14.8402919769
Full duration: 27.3945071697
test scenario HeatStacks.create_check_delete_stack
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| heat.create_stack | 3.744 | 4.489 | 4.836 | 4.864 | 4.891 | 4.475 | 100.0% | 10 |
| heat.check_stack | 0.612 | 1.265 | 1.684 | 1.853 | 2.022 | 1.261 | 100.0% | 10 |
| heat.delete_stack | 1.272 | 1.804 | 2.077 | 2.209 | 2.342 | 1.813 | 100.0% | 10 |
| total | 6.355 | 7.754 | 8.128 | 8.148 | 8.168 | 7.55 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 23.1206851006
Full duration: 31.1694560051
run_rally - INFO - Test scenario: "heat" OK.
run_rally - INFO - Starting test scenario "keystone" ...
run_rally - INFO -
Preparing input task
Task 897d895f-d779-44a7-bb9b-0e66854f43da: started
Task 897d895f-d779-44a7-bb9b-0e66854f43da: finished
test scenario KeystoneBasic.create_tenant_with_users
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.199 | 0.225 | 0.245 | 0.26 | 0.274 | 0.227 | 100.0% | 10 |
| keystone.create_users | 1.448 | 1.551 | 1.618 | 1.62 | 1.621 | 1.544 | 100.0% | 10 |
| total | 1.702 | 1.78 | 1.819 | 1.83 | 1.842 | 1.772 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 5.34110379219
Full duration: 17.6792171001
test scenario KeystoneBasic.create_add_and_list_user_roles
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.206 | 0.231 | 0.279 | 0.28 | 0.281 | 0.238 | 100.0% | 10 |
| keystone.add_role | 0.248 | 0.256 | 0.3 | 0.314 | 0.328 | 0.269 | 100.0% | 10 |
| keystone.list_roles | 0.133 | 0.143 | 0.175 | 0.182 | 0.189 | 0.149 | 100.0% | 10 |
| total | 0.596 | 0.655 | 0.689 | 0.719 | 0.75 | 0.657 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.96121311188
Full duration: 11.1928119659
test scenario KeystoneBasic.add_and_remove_user_role
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.201 | 0.224 | 0.231 | 0.232 | 0.233 | 0.22 | 100.0% | 10 |
| keystone.add_role | 0.245 | 0.259 | 0.287 | 0.295 | 0.304 | 0.265 | 100.0% | 10 |
| keystone.remove_role | 0.137 | 0.148 | 0.164 | 0.172 | 0.18 | 0.15 | 100.0% | 10 |
| total | 0.605 | 0.631 | 0.668 | 0.673 | 0.679 | 0.635 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.9179649353
Full duration: 11.3398149014
test scenario KeystoneBasic.create_update_and_delete_tenant
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.204 | 0.23 | 0.249 | 0.262 | 0.276 | 0.234 | 100.0% | 10 |
| keystone.update_tenant | 0.134 | 0.136 | 0.178 | 0.179 | 0.18 | 0.148 | 100.0% | 10 |
| keystone.delete_tenant | 0.288 | 0.308 | 0.353 | 0.36 | 0.367 | 0.316 | 100.0% | 10 |
| total | 0.653 | 0.684 | 0.749 | 0.761 | 0.774 | 0.698 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.11506795883
Full duration: 10.1015338898
test scenario KeystoneBasic.create_and_delete_service
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_service | 0.223 | 0.237 | 0.288 | 0.289 | 0.29 | 0.245 | 100.0% | 10 |
| keystone.delete_service | 0.14 | 0.152 | 0.165 | 0.175 | 0.185 | 0.154 | 100.0% | 10 |
| total | 0.373 | 0.389 | 0.43 | 0.442 | 0.453 | 0.399 | 100.0% | 10 |
+-------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.24712610245
Full duration: 9.40017700195
test scenario KeystoneBasic.create_tenant
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.219 | 0.235 | 0.25 | 0.263 | 0.277 | 0.238 | 100.0% | 10 |
| total | 0.219 | 0.236 | 0.25 | 0.263 | 0.277 | 0.238 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.738801002502
Full duration: 6.97619819641
test scenario KeystoneBasic.create_user
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_user | 0.242 | 0.253 | 0.272 | 0.28 | 0.288 | 0.257 | 100.0% | 10 |
| total | 0.242 | 0.253 | 0.272 | 0.28 | 0.288 | 0.258 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.813333034515
Full duration: 7.2009499073
test scenario KeystoneBasic.create_and_list_tenants
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.215 | 0.241 | 0.264 | 0.277 | 0.289 | 0.245 | 100.0% | 10 |
| keystone.list_tenants | 0.128 | 0.136 | 0.183 | 0.202 | 0.22 | 0.151 | 100.0% | 10 |
| total | 0.366 | 0.388 | 0.425 | 0.44 | 0.455 | 0.396 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.19499707222
Full duration: 10.8357591629
test scenario KeystoneBasic.create_and_delete_role
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_role | 0.231 | 0.252 | 0.281 | 0.294 | 0.307 | 0.258 | 100.0% | 10 |
| keystone.delete_role | 0.28 | 0.293 | 0.399 | 0.418 | 0.437 | 0.329 | 100.0% | 10 |
| total | 0.511 | 0.579 | 0.676 | 0.69 | 0.704 | 0.587 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.80924010277
Full duration: 10.1753411293
test scenario KeystoneBasic.get_entities
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_tenant | 0.24 | 0.257 | 0.281 | 0.283 | 0.284 | 0.258 | 100.0% | 10 |
| keystone.create_user | 0.15 | 0.164 | 0.206 | 0.206 | 0.206 | 0.171 | 100.0% | 10 |
| keystone.create_role | 0.13 | 0.136 | 0.143 | 0.159 | 0.176 | 0.139 | 100.0% | 10 |
| keystone.get_tenant | 0.13 | 0.138 | 0.141 | 0.143 | 0.146 | 0.137 | 100.0% | 10 |
| keystone.get_user | 0.112 | 0.132 | 0.137 | 0.137 | 0.137 | 0.131 | 100.0% | 10 |
| keystone.get_role | 0.129 | 0.133 | 0.139 | 0.156 | 0.174 | 0.137 | 100.0% | 10 |
| keystone.service_list | 0.129 | 0.132 | 0.135 | 0.137 | 0.138 | 0.133 | 100.0% | 10 |
| keystone.get_service | 0.132 | 0.135 | 0.178 | 0.178 | 0.178 | 0.147 | 100.0% | 10 |
| total | 1.204 | 1.22 | 1.323 | 1.328 | 1.332 | 1.252 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.79558706284
Full duration: 16.6252310276
test scenario KeystoneBasic.create_and_list_users
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| keystone.create_user | 0.239 | 0.266 | 0.295 | 0.298 | 0.301 | 0.27 | 100.0% | 10 |
| keystone.list_users | 0.137 | 0.143 | 0.186 | 0.211 | 0.235 | 0.157 | 100.0% | 10 |
| total | 0.397 | 0.419 | 0.448 | 0.474 | 0.5 | 0.427 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.30778193474
Full duration: 8.03108906746
run_rally - INFO - Test scenario: "keystone" OK.
run_rally - INFO - Starting test scenario "neutron" ...
run_rally - INFO -
Preparing input task
Task 6e4f3aaf-b5ee-4eeb-8ac3-057f7b4d6309: started
Task 6e4f3aaf-b5ee-4eeb-8ac3-057f7b4d6309: finished
test scenario NeutronNetworks.create_and_delete_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.806 | 0.859 | 0.937 | 0.938 | 0.939 | 0.873 | 100.0% | 10 |
| neutron.delete_port | 0.202 | 0.689 | 0.761 | 0.777 | 0.794 | 0.529 | 100.0% | 10 |
| total | 1.023 | 1.572 | 1.686 | 1.703 | 1.72 | 1.401 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.3307390213
Full duration: 57.6386358738
test scenario NeutronNetworks.create_and_list_routers
+---------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.739 | 0.817 | 0.85 | 0.861 | 0.871 | 0.812 | 100.0% | 10 |
| neutron.create_router | 0.079 | 0.545 | 0.57 | 0.584 | 0.598 | 0.499 | 100.0% | 10 |
| neutron.add_interface_router | 0.348 | 0.89 | 0.978 | 0.986 | 0.994 | 0.793 | 100.0% | 10 |
| neutron.list_routers | 0.047 | 0.566 | 0.607 | 0.612 | 0.617 | 0.515 | 100.0% | 10 |
| total | 2.172 | 2.707 | 2.868 | 2.88 | 2.891 | 2.618 | 100.0% | 10 |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 7.91338610649
Full duration: 64.1935119629
test scenario NeutronNetworks.create_and_delete_routers
+------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.769 | 0.8 | 0.846 | 0.881 | 0.915 | 0.809 | 100.0% | 10 |
| neutron.create_router | 0.488 | 0.528 | 0.576 | 0.615 | 0.653 | 0.539 | 100.0% | 10 |
| neutron.add_interface_router | 0.839 | 0.882 | 0.983 | 0.985 | 0.987 | 0.901 | 100.0% | 10 |
| neutron.remove_interface_router | 0.343 | 0.809 | 0.898 | 0.906 | 0.913 | 0.763 | 100.0% | 10 |
| neutron.delete_router | 0.614 | 0.686 | 0.787 | 0.849 | 0.912 | 0.708 | 100.0% | 10 |
| total | 3.419 | 3.666 | 3.994 | 3.997 | 3.999 | 3.719 | 100.0% | 10 |
+---------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 11.0299580097
Full duration: 65.4096131325
test scenario NeutronNetworks.create_and_list_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.83 | 0.888 | 0.995 | 1.184 | 1.372 | 0.935 | 100.0% | 10 |
| neutron.list_ports | 0.554 | 0.625 | 0.697 | 0.704 | 0.712 | 0.626 | 100.0% | 10 |
| total | 1.405 | 1.487 | 1.692 | 1.888 | 2.084 | 1.562 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 5.07633280754
Full duration: 59.1840729713
test scenario NeutronNetworks.create_and_delete_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.731 | 0.806 | 0.857 | 0.933 | 1.01 | 0.812 | 100.0% | 10 |
| neutron.delete_subnet | 0.183 | 0.688 | 0.872 | 0.918 | 0.965 | 0.691 | 100.0% | 10 |
| total | 0.948 | 1.544 | 1.665 | 1.681 | 1.696 | 1.503 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.69728302956
Full duration: 58.486093998
test scenario NeutronNetworks.create_and_delete_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.641 | 0.686 | 0.757 | 0.82 | 0.883 | 0.707 | 100.0% | 10 |
| neutron.delete_network | 0.158 | 0.632 | 0.656 | 0.665 | 0.674 | 0.585 | 100.0% | 10 |
| total | 0.901 | 1.305 | 1.424 | 1.469 | 1.514 | 1.292 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.96865105629
Full duration: 36.4033529758
test scenario NeutronNetworks.create_and_list_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.634 | 0.679 | 0.751 | 0.797 | 0.844 | 0.695 | 100.0% | 10 |
| neutron.list_networks | 0.472 | 0.522 | 0.552 | 0.555 | 0.557 | 0.521 | 100.0% | 10 |
| total | 1.154 | 1.192 | 1.284 | 1.327 | 1.369 | 1.216 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.68979907036
Full duration: 38.8585669994
test scenario NeutronNetworks.create_and_update_routers
+---------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.759 | 0.82 | 0.863 | 0.871 | 0.879 | 0.819 | 100.0% | 10 |
| neutron.create_router | 0.518 | 0.558 | 0.62 | 0.627 | 0.634 | 0.566 | 100.0% | 10 |
| neutron.add_interface_router | 0.465 | 0.878 | 1.032 | 1.081 | 1.13 | 0.879 | 100.0% | 10 |
| neutron.update_router | 0.158 | 0.636 | 0.722 | 0.73 | 0.737 | 0.564 | 100.0% | 10 |
| total | 2.298 | 2.877 | 3.13 | 3.178 | 3.226 | 2.827 | 100.0% | 10 |
+------------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 8.47763490677
Full duration: 62.3842899799
test scenario NeutronNetworks.create_and_update_networks
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_network | 0.627 | 0.673 | 0.974 | 1.044 | 1.114 | 0.744 | 100.0% | 10 |
| neutron.update_network | 0.153 | 0.605 | 0.623 | 0.626 | 0.629 | 0.564 | 100.0% | 10 |
| total | 0.809 | 1.285 | 1.576 | 1.65 | 1.723 | 1.308 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.00336408615
Full duration: 38.2563900948
test scenario NeutronNetworks.create_and_update_ports
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_port | 0.796 | 0.874 | 1.084 | 1.1 | 1.116 | 0.908 | 100.0% | 10 |
| neutron.update_port | 0.595 | 0.622 | 0.697 | 0.76 | 0.823 | 0.646 | 100.0% | 10 |
| total | 1.44 | 1.497 | 1.737 | 1.82 | 1.904 | 1.554 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.89373588562
Full duration: 57.0287640095
test scenario NeutronNetworks.create_and_list_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.706 | 0.775 | 0.866 | 0.893 | 0.92 | 0.789 | 100.0% | 10 |
| neutron.list_subnets | 0.487 | 0.519 | 0.53 | 0.54 | 0.55 | 0.517 | 100.0% | 10 |
| total | 1.233 | 1.291 | 1.393 | 1.414 | 1.435 | 1.307 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.97321105003
Full duration: 55.8097410202
test scenario NeutronNetworks.create_and_update_subnets
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| neutron.create_subnet | 0.72 | 0.834 | 0.873 | 0.905 | 0.936 | 0.819 | 100.0% | 10 |
| neutron.update_subnet | 0.24 | 0.66 | 0.83 | 0.838 | 0.847 | 0.61 | 100.0% | 10 |
| total | 1.098 | 1.433 | 1.66 | 1.686 | 1.713 | 1.429 | 100.0% | 10 |
+-----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.11318302155
Full duration: 55.0307190418
run_rally - INFO - Test scenario: "neutron" OK.
run_rally - INFO - Starting test scenario "nova" ...
run_rally - INFO -
Preparing input task
Task 52be10f0-6365-4abd-8a9b-5f626b8c2e7a: started
Task 52be10f0-6365-4abd-8a9b-5f626b8c2e7a: finished
test scenario NovaKeypair.create_and_delete_keypair
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.create_keypair | 0.695 | 0.769 | 0.948 | 0.991 | 1.035 | 0.816 | 100.0% | 10 |
| nova.delete_keypair | 0.017 | 0.453 | 0.499 | 0.551 | 0.604 | 0.423 | 100.0% | 10 |
| total | 0.944 | 1.187 | 1.524 | 1.533 | 1.542 | 1.239 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.69359993935
Full duration: 34.1216721535
test scenario NovaServers.snapshot_server
+------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 6.466 | 7.619 | 9.603 | 9.617 | 9.63 | 7.898 | 100.0% | 10 |
| nova.create_image | 7.251 | 8.663 | 10.95 | 11.033 | 11.116 | 8.905 | 100.0% | 10 |
| nova.delete_server | 2.865 | 4.177 | 4.352 | 4.362 | 4.373 | 3.878 | 100.0% | 10 |
| nova.boot_server (2) | 7.263 | 7.636 | 9.053 | 9.177 | 9.301 | 7.965 | 100.0% | 10 |
| nova.delete_server (2) | 2.41 | 3.487 | 3.939 | 4.129 | 4.318 | 3.406 | 100.0% | 10 |
| nova.delete_image | 2.217 | 3.339 | 3.856 | 3.864 | 3.873 | 3.205 | 100.0% | 10 |
| total | 32.246 | 34.577 | 37.931 | 38.819 | 39.707 | 35.259 | 100.0% | 10 |
+------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 104.138304949
Full duration: 162.17621994
test scenario NovaKeypair.boot_and_delete_server_with_keypair
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_keypair | 0.717 | 0.776 | 0.905 | 0.916 | 0.927 | 0.799 | 100.0% | 10 |
| nova.boot_server | 5.96 | 7.356 | 9.573 | 9.701 | 9.829 | 7.641 | 100.0% | 10 |
| nova.delete_server | 3.226 | 3.979 | 4.24 | 4.272 | 4.305 | 3.929 | 100.0% | 10 |
| nova.delete_keypair | 0.018 | 0.446 | 0.498 | 0.498 | 0.498 | 0.375 | 100.0% | 10 |
| total | 11.513 | 12.362 | 14.5 | 14.767 | 15.033 | 12.746 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 37.7138030529
Full duration: 95.0321340561
test scenario NovaKeypair.create_and_list_keypairs
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.create_keypair | 0.706 | 0.754 | 0.859 | 0.881 | 0.904 | 0.766 | 100.0% | 10 |
| nova.list_keypairs | 0.021 | 0.458 | 0.489 | 0.492 | 0.495 | 0.412 | 100.0% | 10 |
| total | 0.767 | 1.195 | 1.282 | 1.326 | 1.371 | 1.178 | 100.0% | 10 |
+---------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.66450190544
Full duration: 35.3121151924
test scenario NovaServers.list_servers
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| nova.list_servers | 1.158 | 1.197 | 1.257 | 1.26 | 1.263 | 1.207 | 100.0% | 10 |
| total | 1.158 | 1.197 | 1.257 | 1.26 | 1.263 | 1.207 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.67958188057
Full duration: 102.272238016
test scenario NovaServers.resize_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 6.482 | 7.414 | 8.638 | 9.129 | 9.619 | 7.594 | 100.0% | 10 |
| nova.resize | 12.87 | 13.632 | 13.841 | 14.061 | 14.281 | 13.519 | 100.0% | 10 |
| nova.resize_confirm | 3.854 | 4.236 | 4.429 | 4.579 | 4.729 | 4.184 | 100.0% | 10 |
| nova.delete_server | 2.853 | 3.971 | 4.187 | 4.209 | 4.231 | 3.798 | 100.0% | 10 |
| total | 27.866 | 29.013 | 29.93 | 30.646 | 31.361 | 29.095 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 86.1472420692
Full duration: 116.147330999
test scenario NovaServers.boot_server_from_volume_and_delete
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 7.809 | 9.646 | 10.21 | 10.4 | 10.59 | 9.268 | 100.0% | 10 |
| nova.boot_server | 7.938 | 9.663 | 10.373 | 10.451 | 10.528 | 9.379 | 100.0% | 10 |
| nova.delete_server | 3.263 | 4.164 | 4.323 | 4.341 | 4.359 | 3.965 | 100.0% | 10 |
| total | 21.009 | 22.166 | 24.464 | 24.608 | 24.752 | 22.612 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 65.8047540188
Full duration: 133.871994019
test scenario NovaServers.boot_and_migrate_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 6.526 | 7.611 | 9.253 | 9.328 | 9.404 | 7.939 | 100.0% | 10 |
| nova.stop_server | 3.956 | 4.801 | 7.753 | 7.839 | 7.924 | 5.676 | 100.0% | 10 |
| nova.migrate | 9.278 | 9.686 | 10.387 | 10.401 | 10.415 | 9.75 | 100.0% | 10 |
| nova.resize_confirm | 3.763 | 4.624 | 4.769 | 4.775 | 4.781 | 4.457 | 100.0% | 10 |
| nova.delete_server | 3.333 | 3.772 | 4.263 | 4.388 | 4.514 | 3.895 | 100.0% | 10 |
| total | 28.369 | 30.746 | 35.217 | 35.664 | 36.111 | 31.718 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 95.1431679726
Full duration: 124.915132999
test scenario NovaServers.boot_and_delete_server
+--------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 7.051 | 7.863 | 9.774 | 9.886 | 9.999 | 8.295 | 100.0% | 10 |
| nova.delete_server | 2.506 | 4.173 | 4.427 | 5.12 | 5.813 | 4.06 | 100.0% | 10 |
| total | 10.355 | 11.708 | 14.201 | 15.006 | 15.812 | 12.355 | 100.0% | 10 |
+--------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 36.3530268669
Full duration: 92.853083849
test scenario NovaServers.boot_and_rebuild_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 6.552 | 7.699 | 10.036 | 10.113 | 10.19 | 8.371 | 100.0% | 10 |
| nova.rebuild_server | 9.522 | 11.78 | 13.651 | 13.906 | 14.162 | 11.746 | 100.0% | 10 |
| nova.delete_server | 3.327 | 4.064 | 4.61 | 4.82 | 5.03 | 4.065 | 100.0% | 10 |
| total | 19.511 | 25.224 | 26.458 | 26.522 | 26.586 | 24.182 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 73.8343379498
Full duration: 129.419740915
test scenario NovaSecGroup.create_and_list_secgroups
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 6.563 | 9.397 | 10.161 | 10.173 | 10.185 | 8.839 | 100.0% | 10 |
| nova.create_100_rules | 45.018 | 49.294 | 56.133 | 56.18 | 56.227 | 50.472 | 100.0% | 10 |
| nova.list_security_groups | 0.111 | 0.217 | 0.579 | 0.601 | 0.623 | 0.264 | 100.0% | 10 |
| total | 52.204 | 58.754 | 65.138 | 65.785 | 66.433 | 59.576 | 100.0% | 10 |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 179.173851967
Full duration: 240.213445902
test scenario NovaSecGroup.create_and_delete_secgroups
+--------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 7.358 | 9.711 | 10.153 | 10.476 | 10.798 | 9.428 | 100.0% | 10 |
| nova.create_100_rules | 47.694 | 51.106 | 54.599 | 55.137 | 55.674 | 51.004 | 100.0% | 10 |
| nova.delete_10_security_groups | 1.777 | 3.576 | 4.456 | 4.736 | 5.016 | 3.515 | 100.0% | 10 |
| total | 59.615 | 63.877 | 66.262 | 66.848 | 67.435 | 63.947 | 100.0% | 10 |
+--------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 191.541640997
Full duration: 222.269508839
test scenario NovaServers.boot_and_bounce_server
+-------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 7.313 | 7.988 | 8.758 | 9.045 | 9.331 | 8.15 | 100.0% | 10 |
| nova.reboot_server | 5.889 | 6.906 | 7.056 | 7.078 | 7.101 | 6.624 | 100.0% | 10 |
| nova.soft_reboot_server | 6.349 | 6.773 | 8.096 | 8.126 | 8.156 | 6.947 | 100.0% | 10 |
| nova.stop_server | 4.4 | 5.425 | 6.714 | 7.318 | 7.922 | 5.67 | 100.0% | 10 |
| nova.start_server | 2.424 | 4.059 | 5.269 | 5.417 | 5.564 | 4.057 | 100.0% | 10 |
| nova.rescue_server | 8.473 | 9.131 | 9.695 | 9.957 | 10.219 | 9.177 | 100.0% | 10 |
| nova.unrescue_server | 2.688 | 5.82 | 6.893 | 6.92 | 6.948 | 5.504 | 100.0% | 10 |
| nova.delete_server | 3.393 | 3.812 | 4.417 | 4.473 | 4.53 | 3.858 | 100.0% | 10 |
| total | 47.129 | 50.214 | 51.652 | 52.087 | 52.523 | 50.006 | 100.0% | 10 |
+-------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 150.170030117
Full duration: 206.320158958
test scenario NovaServers.boot_server
+----------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| nova.boot_server | 7.775 | 8.214 | 9.964 | 10.061 | 10.157 | 8.648 | 100.0% | 10 |
| total | 7.775 | 8.214 | 9.965 | 10.061 | 10.157 | 8.649 | 100.0% | 10 |
+------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 25.5615310669
Full duration: 72.0356788635
test scenario NovaSecGroup.boot_and_delete_server_with_secgroups
+-----------------------------------------------------------------------------------------------------------+
| Response Times (sec) |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.create_10_security_groups | 7.852 | 9.225 | 10.298 | 10.398 | 10.498 | 9.327 | 100.0% | 10 |
| nova.create_100_rules | 45.734 | 50.042 | 52.231 | 53.454 | 54.678 | 49.891 | 100.0% | 10 |
| nova.boot_server | 5.843 | 6.686 | 7.412 | 7.548 | 7.683 | 6.632 | 100.0% | 10 |
| nova.get_attached_security_groups | 0.173 | 0.215 | 0.678 | 0.757 | 0.836 | 0.311 | 100.0% | 10 |
| nova.delete_server | 2.437 | 2.94 | 3.313 | 3.412 | 3.512 | 2.92 | 100.0% | 10 |
| nova.delete_10_security_groups | 2.172 | 3.217 | 4.733 | 5.576 | 6.419 | 3.474 | 100.0% | 10 |
| total | 67.914 | 73.688 | 75.248 | 75.466 | 75.684 | 72.556 | 100.0% | 10 |
+-----------------------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 217.134851933
Full duration: 273.106995821
test scenario NovaServers.pause_and_unpause_server
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| nova.boot_server | 7.355 | 8.061 | 9.184 | 9.727 | 10.271 | 8.306 | 100.0% | 10 |
| nova.pause_server | 2.766 | 3.437 | 3.779 | 3.807 | 3.836 | 3.361 | 100.0% | 10 |
| nova.unpause_server | 2.762 | 3.685 | 3.988 | 4.013 | 4.037 | 3.492 | 100.0% | 10 |
| nova.delete_server | 2.835 | 3.909 | 4.299 | 4.343 | 4.387 | 3.776 | 100.0% | 10 |
| total | 16.602 | 18.903 | 20.184 | 20.456 | 20.729 | 18.936 | 100.0% | 10 |
+---------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 57.0698840618
Full duration: 114.94224596
test scenario NovaServers.boot_server_from_volume
+----------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
| cinder.create_volume | 7.772 | 10.48 | 10.909 | 11.031 | 11.154 | 9.647 | 100.0% | 10 |
| nova.boot_server | 8.129 | 9.825 | 11.137 | 11.167 | 11.196 | 9.722 | 100.0% | 10 |
| total | 16.389 | 19.221 | 21.482 | 21.884 | 22.285 | 19.369 | 100.0% | 10 |
+----------------------+--------+--------+--------+--------+--------+--------+---------+-------+
Load duration: 57.2666420937
Full duration: 114.729999065
test scenario NovaServers.boot_and_list_server
+-----------------------------------------------------------------------------------------+
| Response Times (sec) |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
| nova.boot_server | 7.43 | 8.747 | 9.88 | 10.022 | 10.163 | 8.832 | 100.0% | 10 |
| nova.list_servers | 0.267 | 1.207 | 1.259 | 1.275 | 1.29 | 1.04 | 100.0% | 10 |
| total | 8.602 | 9.378 | 11.07 | 11.227 | 11.384 | 9.873 | 100.0% | 10 |
+-------------------+-------+--------+--------+--------+--------+-------+---------+-------+
Load duration: 29.5450980663
Full duration: 106.656322002
run_rally - INFO - Test scenario: "nova" OK.
run_rally - INFO - Starting test scenario "quotas" ...
run_rally - INFO -
Preparing input task
Task dcebd6f2-6fd1-4d5d-8d66-445030082b6c: started
Task dcebd6f2-6fd1-4d5d-8d66-445030082b6c: finished
test scenario Quotas.cinder_update
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 1.163 | 1.265 | 1.531 | 1.556 | 1.581 | 1.345 | 100.0% | 10 |
| total | 1.163 | 1.265 | 1.531 | 1.556 | 1.581 | 1.345 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 4.06574201584
Full duration: 14.4119129181
test scenario Quotas.neutron_update
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.498 | 0.56 | 0.589 | 0.591 | 0.593 | 0.558 | 100.0% | 10 |
| total | 0.62 | 0.66 | 0.701 | 0.702 | 0.703 | 0.667 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 2.05467915535
Full duration: 11.7390589714
test scenario Quotas.cinder_update_and_delete
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 1.19 | 1.288 | 1.399 | 1.415 | 1.432 | 1.303 | 100.0% | 10 |
| quotas.delete_quotas | 0.531 | 1.107 | 1.208 | 1.235 | 1.262 | 1.062 | 100.0% | 10 |
| total | 1.779 | 2.435 | 2.535 | 2.549 | 2.562 | 2.365 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 7.07872509956
Full duration: 17.2571020126
test scenario Quotas.nova_update_and_delete
+-------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| quotas.update_quotas | 0.669 | 0.708 | 0.732 | 0.745 | 0.757 | 0.703 | 100.0% | 10 |
| quotas.delete_quotas | 0.02 | 0.508 | 0.557 | 0.558 | 0.559 | 0.466 | 100.0% | 10 |
| total | 0.727 | 1.212 | 1.275 | 1.28 | 1.285 | 1.169 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 3.64670991898
Full duration: 13.1532580853
test scenario Quotas.nova_update
+------------------------------------------------------------------------------------------+
| Response Times (sec) |
+----------------------+-------+--------+--------+--------+------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+----------------------+-------+--------+--------+--------+------+-------+---------+-------+
| quotas.update_quotas | 0.652 | 0.726 | 0.761 | 0.766 | 0.77 | 0.722 | 100.0% | 10 |
| total | 0.652 | 0.727 | 0.762 | 0.766 | 0.77 | 0.722 | 100.0% | 10 |
+----------------------+-------+--------+--------+--------+------+-------+---------+-------+
Load duration: 2.22018194199
Full duration: 11.9367260933
run_rally - INFO - Test scenario: "quotas" OK.
run_rally - INFO - Starting test scenario "requests" ...
run_rally - INFO -
Preparing input task
Task 89de006e-a4fd-4526-9211-477075f8e5fc: started
Task 89de006e-a4fd-4526-9211-477075f8e5fc: finished
test scenario HttpRequests.check_random_request
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| requests.check_request | 0.184 | 0.456 | 1.019 | 1.022 | 1.026 | 0.555 | 100.0% | 10 |
| total | 0.184 | 0.456 | 1.02 | 1.023 | 1.026 | 0.555 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 1.69973492622
Full duration: 5.72609114647
test scenario HttpRequests.check_request
+---------------------------------------------------------------------------------------------+
| Response Times (sec) |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| action | min | median | 90%ile | 95%ile | max | avg | success | count |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
| requests.check_request | 0.185 | 0.189 | 0.191 | 0.194 | 0.197 | 0.189 | 100.0% | 10 |
| total | 0.185 | 0.189 | 0.191 | 0.194 | 0.197 | 0.189 | 100.0% | 10 |
+------------------------+-------+--------+--------+--------+-------+-------+---------+-------+
Load duration: 0.616016864777
Full duration: 4.89253997803
run_rally - INFO - Test scenario: "requests" OK.
run_rally - INFO -
Rally Summary Report
+===================+============+===============+===========+
| Module | Duration | nb. Test Run | Success |
+===================+============+===============+===========+
| authenticate | 00:35 | 10 | 100.00% |
+-------------------+------------+---------------+-----------+
| glance | 02:20 | 7 | 100.00% |
+-------------------+------------+---------------+-----------+
| cinder | 19:44 | 50 | 100.00% |
+-------------------+------------+---------------+-----------+
| heat | 09:29 | 35 | 100.00% |
+-------------------+------------+---------------+-----------+
| keystone | 01:59 | 29 | 100.00% |
+-------------------+------------+---------------+-----------+
| neutron | 10:48 | 31 | 100.00% |
+-------------------+------------+---------------+-----------+
| nova | 39:36 | 61 | 100.00% |
+-------------------+------------+---------------+-----------+
| quotas | 01:08 | 7 | 100.00% |
+-------------------+------------+---------------+-----------+
| requests | 00:10 | 2 | 100.00% |
+-------------------+------------+---------------+-----------+
+===================+============+===============+===========+
| TOTAL: | 01:25:53 | 232 | 100.00% |
+===================+============+===============+===========+
SDN Controller¶
ODL¶
==============================================================================
Basic
==============================================================================
Basic.010 Restconf OK :: Test suite to verify Restconf is OK
==============================================================================
Get Controller Modules :: Get the controller modules via Restconf | PASS |
------------------------------------------------------------------------------
Basic.010 Restconf OK :: Test suite to verify Restconf is OK | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Basic | PASS |
1 critical test, 1 passed, 0 failed
1 test total, 1 passed, 0 failed
==============================================================================
Output: /home/opnfv/output.xml
Log: /home/opnfv/log.html
Report: /home/opnfv/report.html
==============================================================================
Neutron :: Test suite for Neutron Plugin
==============================================================================
Neutron.Networks :: Checking Network created in OpenStack are pushed to Ope...
==============================================================================
Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS |
------------------------------------------------------------------------------
Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS |
------------------------------------------------------------------------------
Create Network :: Create new network in OpenStack | PASS |
------------------------------------------------------------------------------
Check Network :: Check Network created in OpenDaylight | PASS |
------------------------------------------------------------------------------
Neutron.Networks :: Checking Network created in OpenStack are push... | PASS |
4 critical tests, 4 passed, 0 failed
4 tests total, 4 passed, 0 failed
==============================================================================
Neutron.Subnets :: Checking Subnets created in OpenStack are pushed to Open...
==============================================================================
Check OpenStack Subnets :: Checking OpenStack Neutron for known Su... | PASS |
------------------------------------------------------------------------------
Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS |
------------------------------------------------------------------------------
Create New subnet :: Create new subnet in OpenStack | PASS |
------------------------------------------------------------------------------
Check New subnet :: Check new subnet created in OpenDaylight | PASS |
------------------------------------------------------------------------------
Neutron.Subnets :: Checking Subnets created in OpenStack are pushe... | PASS |
4 critical tests, 4 passed, 0 failed
4 tests total, 4 passed, 0 failed
==============================================================================
Neutron.Ports :: Checking Port created in OpenStack are pushed to OpenDaylight
==============================================================================
Check OpenStack ports :: Checking OpenStack Neutron for known ports | PASS |
------------------------------------------------------------------------------
Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS |
------------------------------------------------------------------------------
Create New Port :: Create new port in OpenStack | PASS |
------------------------------------------------------------------------------
Check New Port :: Check new subnet created in OpenDaylight | PASS |
------------------------------------------------------------------------------
Neutron.Ports :: Checking Port created in OpenStack are pushed to ... | PASS |
4 critical tests, 4 passed, 0 failed
4 tests total, 4 passed, 0 failed
==============================================================================
Neutron.Delete Ports :: Checking Port deleted in OpenStack are deleted also...
==============================================================================
Delete New Port :: Delete previously created port in OpenStack | PASS |
------------------------------------------------------------------------------
Check Port Deleted :: Check port deleted in OpenDaylight | PASS |
------------------------------------------------------------------------------
Neutron.Delete Ports :: Checking Port deleted in OpenStack are del... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack are deleted...
==============================================================================
Delete New subnet :: Delete previously created subnet in OpenStack | PASS |
------------------------------------------------------------------------------
Check New subnet deleted :: Check subnet deleted in OpenDaylight | PASS |
------------------------------------------------------------------------------
Neutron.Delete Subnets :: Checking Subnets deleted in OpenStack ar... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Neutron.Delete Networks :: Checking Network deleted in OpenStack are delete...
==============================================================================
Delete Network :: Delete network in OpenStack | PASS |
------------------------------------------------------------------------------
Check Network deleted :: Check Network deleted in OpenDaylight | PASS |
------------------------------------------------------------------------------
Neutron.Delete Networks :: Checking Network deleted in OpenStack a... | PASS |
2 critical tests, 2 passed, 0 failed
2 tests total, 2 passed, 0 failed
==============================================================================
Neutron :: Test suite for Neutron Plugin | PASS |
18 critical tests, 18 passed, 0 failed
18 tests total, 18 passed, 0 failed
Feature tests¶
Promise¶
FUNCTEST.info: Running PROMISE test case...
Promise- INFO - Creating tenant 'promise'...
Promise- INFO - Adding role 'eed9b04b536646c994679496e7b653cc' to tenant 'promise'...
Promise- INFO - Creating user 'promiser'...
Promise- INFO - Updating OpenStack credentials...
Promise- INFO - Creating image 'promise-img' from '/home/opnfv/functest/data/cirros-0.3.4-x86_64-disk.img'...
Promise- INFO - Creating flavor 'promise-flavor'...
Promise- INFO - Exporting environment variables...
Promise- INFO - Running command: npm run -s test -- --reporter json
Promise- INFO - The test succeeded.
{
"stats": {
"suites": 23,
"tests": 33,
"passes": 33,
"pending": 0,
"failures": 0,
"start": "2016-02-23T10:44:37.402Z",
"end": "2016-02-23T10:44:42.006Z",
"duration": 4604
},
"tests": [
{
"title": "should add a new OpenStack provider without error",
"fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
"duration": 1171,
"err": {}
},
{
"title": "should update promise.providers with a new entry",
"fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
"duration": 7,
"err": {}
},
{
"title": "should contain a new ResourceProvider record in the store",
"fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
"duration": 1,
"err": {}
},
{
"title": "should add more capacity to the reservation service without error",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
"duration": 29,
"err": {}
},
{
"title": "should update promise.pools with a new entry",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
"duration": 1,
"err": {}
},
{
"title": "should contain a ResourcePool record in the store",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
"duration": 0,
"err": {}
},
{
"title": "should report total collections and utilizations",
"fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
"duration": 23,
"err": {}
},
{
"title": "should contain newly added capacity pool",
"fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
"duration": 13,
"err": {}
},
{
"title": "should create a new server in target provider without error",
"fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
"duration": 1144,
"err": {}
},
{
"title": "should update promise.allocations with a new entry",
"fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
"duration": 3,
"err": {}
},
{
"title": "should contain a new ResourceAllocation record in the store",
"fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should reference the created server ID from the provider",
"fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
"duration": 0,
"err": {}
},
{
"title": "should have low priority state",
"fullTitle": "promise allocation without reservation create-instance should have low priority state",
"duration": 0,
"err": {}
},
{
"title": "should create reservation record (no start/end) without error",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
"duration": 71,
"err": {}
},
{
"title": "should update promise.reservations with a new entry",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
"duration": 9,
"err": {}
},
{
"title": "should contain a new ResourceReservation record in the store",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should create a new server in target provider (with reservation) without error",
"fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
"duration": 1025,
"err": {}
},
{
"title": "should contain a new ResourceAllocation record in the store",
"fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should be referenced in the reservation record",
"fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
"duration": 5,
"err": {}
},
{
"title": "should have high priority state",
"fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
"duration": 0,
"err": {}
},
{
"title": "should create reservation record (for future) without error",
"fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
"duration": 125,
"err": {}
},
{
"title": "should update promise.reservations with a new entry",
"fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
"duration": 18,
"err": {}
},
{
"title": "should contain a new ResourceReservation record in the store",
"fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should contain newly created future reservation",
"fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
"duration": 74,
"err": {}
},
{
"title": "should modify existing reservation without error",
"fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
"duration": 88,
"err": {}
},
{
"title": "should modify existing reservation without error",
"fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
"duration": 19,
"err": {}
},
{
"title": "should no longer contain record of the deleted reservation",
"fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
"duration": 1,
"err": {}
},
{
"title": "should decrease available capacity from a provider in the future",
"fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
"duration": 18,
"err": {}
},
{
"title": "should increase available capacity from a provider in the future",
"fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
"duration": 13,
"err": {}
},
{
"title": "should report available collections and utilizations",
"fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
"duration": 66,
"err": {}
},
{
"title": "should fail to create immediate reservation record with proper error",
"fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
"duration": 74,
"err": {}
},
{
"title": "should fail to create future reservation record with proper error",
"fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
"duration": 69,
"err": {}
},
{
"title": "should successfully destroy all allocations",
"fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
"duration": 507,
"err": {}
}
],
"pending": [],
"failures": [],
"passes": [
{
"title": "should add a new OpenStack provider without error",
"fullTitle": "promise register OpenStack into resource pool add-provider should add a new OpenStack provider without error",
"duration": 1171,
"err": {}
},
{
"title": "should update promise.providers with a new entry",
"fullTitle": "promise register OpenStack into resource pool add-provider should update promise.providers with a new entry",
"duration": 7,
"err": {}
},
{
"title": "should contain a new ResourceProvider record in the store",
"fullTitle": "promise register OpenStack into resource pool add-provider should contain a new ResourceProvider record in the store",
"duration": 1,
"err": {}
},
{
"title": "should add more capacity to the reservation service without error",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should add more capacity to the reservation service without error",
"duration": 29,
"err": {}
},
{
"title": "should update promise.pools with a new entry",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should update promise.pools with a new entry",
"duration": 1,
"err": {}
},
{
"title": "should contain a ResourcePool record in the store",
"fullTitle": "promise register OpenStack into resource pool increase-capacity should contain a ResourcePool record in the store",
"duration": 0,
"err": {}
},
{
"title": "should report total collections and utilizations",
"fullTitle": "promise register OpenStack into resource pool query-capacity should report total collections and utilizations",
"duration": 23,
"err": {}
},
{
"title": "should contain newly added capacity pool",
"fullTitle": "promise register OpenStack into resource pool query-capacity should contain newly added capacity pool",
"duration": 13,
"err": {}
},
{
"title": "should create a new server in target provider without error",
"fullTitle": "promise allocation without reservation create-instance should create a new server in target provider without error",
"duration": 1144,
"err": {}
},
{
"title": "should update promise.allocations with a new entry",
"fullTitle": "promise allocation without reservation create-instance should update promise.allocations with a new entry",
"duration": 3,
"err": {}
},
{
"title": "should contain a new ResourceAllocation record in the store",
"fullTitle": "promise allocation without reservation create-instance should contain a new ResourceAllocation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should reference the created server ID from the provider",
"fullTitle": "promise allocation without reservation create-instance should reference the created server ID from the provider",
"duration": 0,
"err": {}
},
{
"title": "should have low priority state",
"fullTitle": "promise allocation without reservation create-instance should have low priority state",
"duration": 0,
"err": {}
},
{
"title": "should create reservation record (no start/end) without error",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should create reservation record (no start/end) without error",
"duration": 71,
"err": {}
},
{
"title": "should update promise.reservations with a new entry",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should update promise.reservations with a new entry",
"duration": 9,
"err": {}
},
{
"title": "should contain a new ResourceReservation record in the store",
"fullTitle": "promise allocation using reservation for immediate use create-reservation should contain a new ResourceReservation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should create a new server in target provider (with reservation) without error",
"fullTitle": "promise allocation using reservation for immediate use create-instance should create a new server in target provider (with reservation) without error",
"duration": 1025,
"err": {}
},
{
"title": "should contain a new ResourceAllocation record in the store",
"fullTitle": "promise allocation using reservation for immediate use create-instance should contain a new ResourceAllocation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should be referenced in the reservation record",
"fullTitle": "promise allocation using reservation for immediate use create-instance should be referenced in the reservation record",
"duration": 5,
"err": {}
},
{
"title": "should have high priority state",
"fullTitle": "promise allocation using reservation for immediate use create-instance should have high priority state",
"duration": 0,
"err": {}
},
{
"title": "should create reservation record (for future) without error",
"fullTitle": "promise reservation for future use create-reservation should create reservation record (for future) without error",
"duration": 125,
"err": {}
},
{
"title": "should update promise.reservations with a new entry",
"fullTitle": "promise reservation for future use create-reservation should update promise.reservations with a new entry",
"duration": 18,
"err": {}
},
{
"title": "should contain a new ResourceReservation record in the store",
"fullTitle": "promise reservation for future use create-reservation should contain a new ResourceReservation record in the store",
"duration": 0,
"err": {}
},
{
"title": "should contain newly created future reservation",
"fullTitle": "promise reservation for future use query-reservation should contain newly created future reservation",
"duration": 74,
"err": {}
},
{
"title": "should modify existing reservation without error",
"fullTitle": "promise reservation for future use update-reservation should modify existing reservation without error",
"duration": 88,
"err": {}
},
{
"title": "should modify existing reservation without error",
"fullTitle": "promise reservation for future use cancel-reservation should modify existing reservation without error",
"duration": 19,
"err": {}
},
{
"title": "should no longer contain record of the deleted reservation",
"fullTitle": "promise reservation for future use cancel-reservation should no longer contain record of the deleted reservation",
"duration": 1,
"err": {}
},
{
"title": "should decrease available capacity from a provider in the future",
"fullTitle": "promise capacity planning decrease-capacity should decrease available capacity from a provider in the future",
"duration": 18,
"err": {}
},
{
"title": "should increase available capacity from a provider in the future",
"fullTitle": "promise capacity planning increase-capacity should increase available capacity from a provider in the future",
"duration": 13,
"err": {}
},
{
"title": "should report available collections and utilizations",
"fullTitle": "promise capacity planning query-capacity should report available collections and utilizations",
"duration": 66,
"err": {}
},
{
"title": "should fail to create immediate reservation record with proper error",
"fullTitle": "promise reservation with conflict create-reservation should fail to create immediate reservation record with proper error",
"duration": 74,
"err": {}
},
{
"title": "should fail to create future reservation record with proper error",
"fullTitle": "promise reservation with conflict create-reservation should fail to create future reservation record with proper error",
"duration": 69,
"err": {}
},
{
"title": "should successfully destroy all allocations",
"fullTitle": "promise cleanup test allocations destroy-instance should successfully destroy all allocations",
"duration": 507,
"err": {}
}
]
}
Promise- INFO -
****************************************
Promise test report
****************************************
Suites: 23
Tests: 33
Passes: 33
Pending: 0
Failures: 0
Start: 2016-02-23T10:44:37.402Z
End: 2016-02-23T10:44:42.006Z
Duration: 4.604
****************************************
Promise- INFO - Pushing results to DB...
