2018-04-13 22:41:08,935 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+-----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+-----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-compass-virtual-daily-master-218 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | compass | | DEPLOY_SCENARIO | os-odl-sfc-noha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | huawei-virtual8 | +--------------------------------------+-----------------------------------------------------------+ 2018-04-13 22:41:08,938 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Ansible managed export LC_ALL=C # COMMON CINDER ENVS export CINDER_ENDPOINT_TYPE=publicURL # COMMON NOVA ENVS export NOVA_ENDPOINT_TYPE=publicURL # COMMON OPENSTACK ENVS export OS_ENDPOINT_TYPE=publicURL export OS_INTERFACE=publicURL export OS_USERNAME=admin export OS_PASSWORD='dfa73fabc4c3eb798be92e8f27f884b98e584ea65e9903c640f9e01007d0' export OS_PROJECT_NAME=admin export OS_TENANT_NAME=admin export OS_AUTH_URL=https://192.16.1.222:5000/v3 export OS_NO_CACHE=1 export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_REGION_NAME=RegionOne # For openstackclient export OS_IDENTITY_API_VERSION=3 export OS_AUTH_VERSION=3 export OS_AUTH_TYPE=password export SDN_CONTROLLER_IP=192.16.1.222 export OS_CACERT=/home/opnfv/functest/conf/os_cacert 2018-04-13 22:41:08,938 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-04-13 22:41:08,939 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------------+---------------+-------------------------------------------+-------------------------------------------------+------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------------+---------------+-------------------------------------------+-------------------------------------------------+------------------------------------+ | healthcheck | 0 | (merge)|(verify)|(daily)|(weekly) | First tier to be executed to verify the | connection_check api_check | | | | | basic operations in the VIM. | snaps_health_check | +---------------------+---------------+-------------------------------------------+-------------------------------------------------+------------------------------------+ 2018-04-13 22:41:08,941 - xtesting.ci.run_tests - INFO - Running tier 'healthcheck' 2018-04-13 22:41:08,941 - xtesting.ci.run_tests - INFO - Running test case 'connection_check'... 2018-04-13 22:41:12,571 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-04-13 22:41:21,725 - xtesting.core.unit - DEBUG - test_glance_connect_fail (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_glance_connect_success (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_keystone_connect_fail (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_keystone_connect_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_neutron_connect_fail (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_neutron_connect_success (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_retrieve_ext_network_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_nova_connect_fail (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_connect_success (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_get_hypervisor_hosts (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_heat_connect_fail (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_heat_connect_success (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_cinder_connect_fail (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok test_cinder_connect_success (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok ---------------------------------------------------------------------- Ran 14 tests in 9.147s OK 2018-04-13 22:41:22,272 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-13 22:41:22,272 - xtesting.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | connection_check | functest | 00:09 | PASS | +--------------------------+------------------+------------------+----------------+ 2018-04-13 22:41:22,274 - xtesting.ci.run_tests - INFO - Running test case 'api_check'... 2018-04-13 22:41:22,986 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-04-13 22:51:05,642 - xtesting.core.unit - DEBUG - test_create_project_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_user_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_credentials (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_service (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_with_each_interface (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_grant_user_role_to_project (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_admin_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user_2x (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_2x (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_bad_domain (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_quota_override (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_update_quotas (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_sec_grp_one_user (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_project_sec_grp_two_users (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_image_minimal_file (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_image_minimal_url (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_network (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_add_interface_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_missing_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip_to_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_network_object (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_simple (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_with_public_interface (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_delete_simple_sec_grp (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_rules (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_one_rule (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_get_sec_grp_by_id (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_floating_ips (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsFloatingIpTests) ... ok test_create_delete_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_key_from_file (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_delete_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_instance (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceTests) ... ok test_add_remove_volume (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_attach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_detach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_create_clean_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_delete_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_all_settings (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_existing (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_create_stack_x2 (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_get_settings_from_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateComplexStackTests) ... ok test_create_flavor_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsFlavorTests) ... ok test_create_keypair_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsKeypairTests) ... ok test_create_security_group_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsSecurityGroupTests) ... ok test_create_delete_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_back (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_both (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_front (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_delete_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_simple_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_delete_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_simple_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_bad_key_size (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_delete_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_simple_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_all_attrs (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_invalid_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos_and_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok ---------------------------------------------------------------------- Ran 84 tests in 582.626s OK 2018-04-13 22:51:06,240 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-13 22:51:06,240 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | api_check | functest | 09:43 | PASS | +-------------------+------------------+------------------+----------------+ 2018-04-13 22:51:06,242 - xtesting.ci.run_tests - INFO - Running test case 'snaps_health_check'... 2018-04-13 22:51:07,170 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-04-13 22:51:57,367 - xtesting.core.unit - DEBUG - test_check_vm_ip_dhcp (snaps.openstack.tests.create_instance_tests.SimpleHealthCheck) ... ok ---------------------------------------------------------------------- Ran 1 test in 50.196s OK 2018-04-13 22:51:57,922 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-13 22:51:57,923 - xtesting.ci.run_tests - INFO - Test result: +----------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------------+------------------+------------------+----------------+ | snaps_health_check | functest | 00:50 | PASS | +----------------------------+------------------+------------------+----------------+ 2018-04-13 22:51:57,925 - xtesting.ci.run_tests - INFO - Xtesting report: +----------------------------+------------------+---------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------------+------------------+---------------------+------------------+----------------+ | connection_check | functest | healthcheck | 00:09 | PASS | | api_check | functest | healthcheck | 09:43 | PASS | | snaps_health_check | functest | healthcheck | 00:50 | PASS | +----------------------------+------------------+---------------------+------------------+----------------+ 2018-04-13 22:51:57,926 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-04-13 22:52:49,700 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+-----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+-----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-compass-virtual-daily-master-218 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | compass | | DEPLOY_SCENARIO | os-odl-sfc-noha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | huawei-virtual8 | +--------------------------------------+-----------------------------------------------------------+ 2018-04-13 22:52:49,703 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Ansible managed export LC_ALL=C # COMMON CINDER ENVS export CINDER_ENDPOINT_TYPE=publicURL # COMMON NOVA ENVS export NOVA_ENDPOINT_TYPE=publicURL # COMMON OPENSTACK ENVS export OS_ENDPOINT_TYPE=publicURL export OS_INTERFACE=publicURL export OS_USERNAME=admin export OS_PASSWORD='dfa73fabc4c3eb798be92e8f27f884b98e584ea65e9903c640f9e01007d0' export OS_PROJECT_NAME=admin export OS_TENANT_NAME=admin export OS_AUTH_URL=https://192.16.1.222:5000/v3 export OS_NO_CACHE=1 export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_REGION_NAME=RegionOne # For openstackclient export OS_IDENTITY_API_VERSION=3 export OS_AUTH_VERSION=3 export OS_AUTH_TYPE=password export SDN_CONTROLLER_IP=192.16.1.222 export OS_CACERT=/home/opnfv/functest/conf/os_cacert 2018-04-13 22:52:49,703 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-04-13 22:52:49,704 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+--------------------------+------------------------------------------+--------------------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+--------------------------+------------------------------------------+--------------------------------------------------+ | smoke | 1 | (daily)|(weekly) | Set of basic Functional tests to | vping_ssh vping_userdata | | | | | validate the OPNFV scenarios. | tempest_smoke_serial rally_sanity | | | | | | refstack_defcore patrole odl snaps_smoke | | | | | | neutron_trunk | +---------------+---------------+--------------------------+------------------------------------------+--------------------------------------------------+ 2018-04-13 22:52:49,705 - xtesting.ci.run_tests - INFO - Running tier 'smoke' 2018-04-13 22:52:49,706 - xtesting.ci.run_tests - INFO - Running test case 'vping_ssh'... 2018-04-13 22:52:52,060 - xtesting.energy.energy - INFO - API recorder available at : http://energy.opnfv.fr/resources/recorders/environment/huawei-virtual8 2018-04-13 22:52:52,060 - xtesting.energy.energy - DEBUG - Getting current scenario 2018-04-13 22:52:53,131 - xtesting.energy.energy - DEBUG - Starting recording 2018-04-13 22:52:53,131 - xtesting.energy.energy - DEBUG - Submitting scenario (vping_ssh/running) 2018-04-13 22:52:53,931 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup 2018-04-13 22:52:53,931 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-04-13 22:52:53' 2018-04-13 22:52:53,931 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--67d5ec25-1ba9-4ac3-ad02-2bb9f5b2d357' 2018-04-13 22:52:56,274 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-67d5ec25-1ba9-4ac3-ad02-2bb9f5b2d357' 2018-04-13 22:53:00,019 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-67d5ec25-1ba9-4ac3-ad02-2bb9f5b2d357' 2018-04-13 22:53:06,877 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-67d5ec25-1ba9-4ac3-ad02-2bb9f5b2d357' 2018-04-13 22:53:07,694 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating keypair with name: 'vPing-keypair-67d5ec25-1ba9-4ac3-ad02-2bb9f5b2d357' 2018-04-13 22:53:08,415 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-67d5ec25-1ba9-4ac3-ad02-2bb9f5b2d357' 2018-04-13 22:53:14,016 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Security group with name: 'vPing-sg-67d5ec25-1ba9-4ac3-ad02-2bb9f5b2d357' 2018-04-13 22:53:17,603 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-67d5ec25-1ba9-4ac3-ad02-2bb9f5b2d357' 2018-04-13 22:53:37,403 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution 2018-04-13 22:53:52,455 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Trying to transfer ping.sh 2018-04-13 22:53:52,541 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping... 2018-04-13 22:53:53,550 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected! 2018-04-13 22:53:53,551 - xtesting.energy.energy - DEBUG - Restoring previous scenario (rally_sanity/running) 2018-04-13 22:53:53,551 - xtesting.energy.energy - DEBUG - Submitting scenario (rally_sanity/running) 2018-04-13 22:53:55,166 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-13 22:53:55,167 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | vping_ssh | functest | 00:60 | PASS | +-------------------+------------------+------------------+----------------+ 2018-04-13 22:54:16,562 - xtesting.ci.run_tests - INFO - Running test case 'vping_userdata'... 2018-04-13 22:54:16,632 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup 2018-04-13 22:54:16,633 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-04-13 22:54:16' 2018-04-13 22:54:16,633 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--4bd6ba27-01c0-499c-9c24-4a1ef1a8ab13' 2018-04-13 22:54:18,552 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-4bd6ba27-01c0-499c-9c24-4a1ef1a8ab13' 2018-04-13 22:54:21,091 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-4bd6ba27-01c0-499c-9c24-4a1ef1a8ab13' 2018-04-13 22:54:28,358 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-4bd6ba27-01c0-499c-9c24-4a1ef1a8ab13' 2018-04-13 22:54:29,085 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-4bd6ba27-01c0-499c-9c24-4a1ef1a8ab13' 2018-04-13 22:54:35,059 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-4bd6ba27-01c0-499c-9c24-4a1ef1a8ab13' 2018-04-13 22:54:40,184 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution 2018-04-13 22:54:49,203 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping... 2018-04-13 22:54:51,323 - functest.opnfv_tests.openstack.vping.vping_base - DEBUG - Pinging 192.168.130.3. Waiting for response... 2018-04-13 22:55:10,465 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected! 2018-04-13 22:55:11,024 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-13 22:55:11,025 - xtesting.ci.run_tests - INFO - Test result: +------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------+------------------+------------------+----------------+ | vping_userdata | functest | 00:54 | PASS | +------------------------+------------------+------------------+----------------+ 2018-04-13 22:55:28,424 - xtesting.ci.run_tests - INFO - Running test case 'tempest_smoke_serial'... 2018-04-13 22:55:28,516 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-13 22:55:37,095 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 55182a46-bb05-4981-a942-25cacce59e6b | 2018-04-13T22:55:36.960469 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 55182a46-bb05-4981-a942-25cacce59e6b ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-13 22:55:42,154 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+-------------------+-----------+ | Service | Service Type | Status | +-------------+-------------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | nfv-orchestration | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+-------------------+-----------+ 2018-04-13 22:55:42,154 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-04-13 22:55:51,198 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide Using verifier 'opnfv-tempest' (UUID=8e2cc1d7-a708-40ec-89da-110c0f9ce73b) as the default verifier for the future CLI operations. 2018-04-13 22:55:55,955 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-04-13 22:55:57,920 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-04-13 22:56:01,281 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-04-13 22:56:08,221 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-04-13 22:56:08,222 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-04-13 22:56:08,222 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-04-13 22:56:08,223 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-04-13 22:56:08,225 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-04-13 22:56:11,871 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-8e2cc1d7-a708-40ec-89da-110c0f9ce73b/repo; stestr list '^tempest\.(api|scenario).*\[.*\bsmoke\b.*\]$' >/home/opnfv/functest/results/tempest/test_list.txt 2>/dev/null) 2018-04-13 22:56:11,871 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Applying tempest blacklist... 2018-04-13 22:56:11,872 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Tempest blacklist file does not exist. 2018-04-13 22:56:11,873 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/tempest/test_list.txt', '--concurrency', '1']'. 2018-04-13 23:14:01,650 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Verification UUID: b88cb90a-b93e-4bc5-b578-ebee03efdfc8 2018-04-13 23:14:01,795 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', 'b88cb90a-b93e-4bc5-b578-ebee03efdfc8']'. 2018-04-13 23:14:03,054 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-04-13 23:14:03,054 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-04-13 23:14:03,054 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-13 23:14:03,055 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | b88cb90a-b93e-4bc5-b578-ebee03efdfc8 | 2018-04-13 23:14:03,055 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | failed | 2018-04-13 23:14:03,055 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-04-13 22:56:15 | 2018-04-13 23:14:03,055 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-04-13 23:14:01 | 2018-04-13 23:14:03,055 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:17:46 | 2018-04-13 23:14:03,055 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | concurrency: 1 | 2018-04-13 23:14:03,055 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | | load_list: (value is too long, use 'detailed' flag to display it) | 2018-04-13 23:14:03,055 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-04-13 23:14:03,055 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: 8e2cc1d7-a708-40ec-89da-110c0f9ce73b) | 2018-04-13 23:14:03,055 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-04-13 23:14:03,055 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 55182a46-bb05-4981-a942-25cacce59e6b) | 2018-04-13 23:14:03,055 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 109 | 2018-04-13 23:14:03,055 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 1059.29 | 2018-04-13 23:14:03,055 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 77 | 2018-04-13 23:14:03,055 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 20 | 2018-04-13 23:14:03,055 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-04-13 23:14:03,055 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-04-13 23:14:03,055 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 12 | 2018-04-13 23:14:03,055 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-13 23:14:03,056 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-04-13 23:14:03,057 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest tempest_smoke_serial success_rate is 86.5168539326% 2018-04-13 23:14:09,660 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-13 23:14:09,660 - xtesting.ci.run_tests - INFO - Test result: +------------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------------+------------------+------------------+----------------+ | tempest_smoke_serial | functest | 18:13 | FAIL | +------------------------------+------------------+------------------+----------------+ 2018-04-13 23:14:09,663 - xtesting.ci.run_tests - ERROR - The test case 'tempest_smoke_serial' failed. 2018-04-13 23:14:09,663 - xtesting.ci.run_tests - INFO - Running test case 'rally_sanity'... 2018-04-13 23:14:09,747 - xtesting.energy.energy - DEBUG - Getting current scenario 2018-04-13 23:14:10,558 - xtesting.energy.energy - DEBUG - Starting recording 2018-04-13 23:14:10,559 - xtesting.energy.energy - DEBUG - Submitting scenario (rally_sanity/running) 2018-04-13 23:14:11,320 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-13 23:14:15,065 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-04-13 23:14:18,750 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 5af25266-032c-4eb9-8dea-584bd4879acc | 2018-04-13T23:14:18.613539 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 5af25266-032c-4eb9-8dea-584bd4879acc ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-13 23:14:23,974 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+-------------------+-----------+ | Service | Service Type | Status | +-------------+-------------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | nfv-orchestration | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+-------------------+-----------+ 2018-04-13 23:14:23,975 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating the test name... 2018-04-13 23:14:25,651 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating image 'Cirros-0.4.0-03c3fa2b-3f97-4d1f-b597-2add643ea0ce'... 2018-04-13 23:14:27,778 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating network 'rally-net-03c3fa2b-3f97-4d1f-b597-2add643ea0ce'... 2018-04-13 23:14:30,515 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating router 'rally-router-03c3fa2b-3f97-4d1f-b597-2add643ea0ce'... 2018-04-13 23:14:41,022 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-tiny-03c3fa2b-3f97-4d1f-b597-2add643ea0ce'... 2018-04-13 23:14:41,777 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-mini-03c3fa2b-3f97-4d1f-b597-2add643ea0ce'... 2018-04-13 23:14:42,530 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2018-04-13 23:14:42,531 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-authenticate.yaml 2018-04-13 23:14:42,531 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-13 23:14:42,541 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_migrate_server', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_live_migrate_server', u'NovaServers.boot_server_from_volume_and_live_migrate'] 2018-04-13 23:14:42,543 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['authenticate'], 'concurrency': 4, 'netid': 'fa0619ca-3787-4ab8-b621-a2246ddda9ac', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'flavor_name': 'rally-tiny-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-13 23:15:55,474 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : e6b6b14e-fac3-4034-923f-319e4b3f21ff 2018-04-13 23:15:55,475 - functest.opnfv_tests.openstack.rally.rally - DEBUG - /home/opnfv/functest/results/rally does not exist, we create it. 2018-04-13 23:15:55,475 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'e6b6b14e-fac3-4034-923f-319e4b3f21ff'] 2018-04-13 23:15:56,746 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task e6b6b14e-fac3-4034-923f-319e4b3f21ff: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e6b6b14e-fac3-4034-923f-319e4b3f21ff has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.678 | 0.678 | 0.678 | 0.678 | 0.678 | 0.678 | 100.0% | 1 | | total | 0.678 | 0.678 | 0.678 | 0.678 | 0.678 | 0.678 | 100.0% | 1 | | -> duration | 0.678 | 0.678 | 0.678 | 0.678 | 0.678 | 0.678 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.678137 Full duration: 8.219808 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e6b6b14e-fac3-4034-923f-319e4b3f21ff has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.172 | 0.172 | 0.172 | 0.172 | 0.172 | 0.172 | 100.0% | 1 | | total | 0.809 | 0.809 | 0.809 | 0.809 | 0.809 | 0.809 | 100.0% | 1 | | -> duration | 0.809 | 0.809 | 0.809 | 0.809 | 0.809 | 0.809 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.808512 Full duration: 8.335276 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e6b6b14e-fac3-4034-923f-319e4b3f21ff has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.198 | 0.198 | 0.198 | 0.198 | 0.198 | 0.198 | 100.0% | 1 | | total | 0.824 | 0.824 | 0.824 | 0.824 | 0.824 | 0.824 | 100.0% | 1 | | -> duration | 0.824 | 0.824 | 0.824 | 0.824 | 0.824 | 0.824 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.824137 Full duration: 8.291541 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e6b6b14e-fac3-4034-923f-319e4b3f21ff has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.345 | 0.345 | 0.345 | 0.345 | 0.345 | 0.345 | 100.0% | 1 | | total | 1.31 | 1.31 | 1.31 | 1.31 | 1.31 | 1.31 | 100.0% | 1 | | -> duration | 1.31 | 1.31 | 1.31 | 1.31 | 1.31 | 1.31 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.310022 Full duration: 8.889875 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e6b6b14e-fac3-4034-923f-319e4b3f21ff has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.461 | 0.461 | 0.461 | 0.461 | 0.461 | 0.461 | 100.0% | 1 | | total | 1.092 | 1.092 | 1.092 | 1.092 | 1.092 | 1.092 | 100.0% | 1 | | -> duration | 1.092 | 1.092 | 1.092 | 1.092 | 1.092 | 1.092 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.091973 Full duration: 8.491429 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e6b6b14e-fac3-4034-923f-319e4b3f21ff has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.282 | 0.282 | 0.282 | 0.282 | 0.282 | 0.282 | 100.0% | 1 | | total | 0.951 | 0.951 | 0.951 | 0.951 | 0.951 | 0.951 | 100.0% | 1 | | -> duration | 0.951 | 0.951 | 0.951 | 0.951 | 0.951 | 0.951 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.950915 Full duration: 8.167717 HINTS: * To plot HTML graphics with this data, run: rally task report e6b6b14e-fac3-4034-923f-319e4b3f21ff --out output.html * To generate a JUnit report, run: rally task export e6b6b14e-fac3-4034-923f-319e4b3f21ff --type junit --to output.xml * To get raw JSON output of task results, run: rally task report e6b6b14e-fac3-4034-923f-319e4b3f21ff --json --out output.json 2018-04-13 23:15:56,746 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'e6b6b14e-fac3-4034-923f-319e4b3f21ff'] 2018-04-13 23:15:58,017 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-13 23:15:58,018 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'e6b6b14e-fac3-4034-923f-319e4b3f21ff', '--out', u'/home/opnfv/functest/results/rally/opnfv-authenticate.html'] 2018-04-13 23:15:58,024 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2018-04-13 23:15:58,024 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2018-04-13 23:15:58,025 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-glance.yaml 2018-04-13 23:15:58,025 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-13 23:15:58,037 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_migrate_server', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_live_migrate_server', u'NovaServers.boot_server_from_volume_and_live_migrate'] 2018-04-13 23:15:58,038 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['glance'], 'concurrency': 4, 'netid': 'fa0619ca-3787-4ab8-b621-a2246ddda9ac', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'flavor_name': 'rally-tiny-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-13 23:17:31,988 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 1f3916fc-ff23-49ba-a378-f48bfb98a010 2018-04-13 23:17:31,988 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '1f3916fc-ff23-49ba-a378-f48bfb98a010'] 2018-04-13 23:17:33,258 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 1f3916fc-ff23-49ba-a378-f48bfb98a010: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1f3916fc-ff23-49ba-a378-f48bfb98a010 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 2.995 | 2.995 | 2.995 | 2.995 | 2.995 | 2.995 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.117 | 0.117 | 0.117 | 0.117 | 0.117 | 0.117 | 100.0% | 1 | | -> glance_v2.upload_data | 0.638 | 0.638 | 0.638 | 0.638 | 0.638 | 0.638 | 100.0% | 1 | | glance_v2.delete_image | 1.022 | 1.022 | 1.022 | 1.022 | 1.022 | 1.022 | 100.0% | 1 | | total | 4.017 | 4.017 | 4.017 | 4.017 | 4.017 | 4.017 | 100.0% | 1 | | -> duration | 4.017 | 4.017 | 4.017 | 4.017 | 4.017 | 4.017 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.017231 Full duration: 13.446563 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1f3916fc-ff23-49ba-a378-f48bfb98a010 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 2.905 | 2.905 | 2.905 | 2.905 | 2.905 | 2.905 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.086 | 0.086 | 0.086 | 0.086 | 0.086 | 0.086 | 100.0% | 1 | | -> glance_v2.upload_data | 0.602 | 0.602 | 0.602 | 0.602 | 0.602 | 0.602 | 100.0% | 1 | | glance_v2.list_images | 0.063 | 0.063 | 0.063 | 0.063 | 0.063 | 0.063 | 100.0% | 1 | | total | 2.969 | 2.969 | 2.969 | 2.969 | 2.969 | 2.969 | 100.0% | 1 | | -> duration | 2.969 | 2.969 | 2.969 | 2.969 | 2.969 | 2.969 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.968508 Full duration: 14.922454 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1f3916fc-ff23-49ba-a378-f48bfb98a010 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.182 | 0.182 | 0.182 | 0.182 | 0.182 | 0.182 | 100.0% | 1 | | total | 0.182 | 0.182 | 0.182 | 0.182 | 0.182 | 0.182 | 100.0% | 1 | | -> duration | 0.182 | 0.182 | 0.182 | 0.182 | 0.182 | 0.182 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.18174 Full duration: 8.692353 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 } } }, "args": { "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "container_format": "bare", "disk_format": "qcow2", "number_instances": 2, "nics": [ { "net-id": "fa0619ca-3787-4ab8-b621-a2246ddda9ac" } ], "flavor": { "name": "rally-tiny-03c3fa2b-3f97-4d1f-b597-2add643ea0ce" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1f3916fc-ff23-49ba-a378-f48bfb98a010 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 2.897 | 2.897 | 2.897 | 2.897 | 2.897 | 2.897 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.07 | 0.07 | 0.07 | 0.07 | 0.07 | 0.07 | 100.0% | 1 | | -> glance_v2.upload_data | 0.601 | 0.601 | 0.601 | 0.601 | 0.601 | 0.601 | 100.0% | 1 | | nova.boot_servers | 11.59 | 11.59 | 11.59 | 11.59 | 11.59 | 11.59 | 100.0% | 1 | | total | 14.489 | 14.489 | 14.489 | 14.489 | 14.489 | 14.489 | 100.0% | 1 | | -> duration | 13.489 | 13.489 | 13.489 | 13.489 | 13.489 | 13.489 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.488501 Full duration: 36.430248 HINTS: * To plot HTML graphics with this data, run: rally task report 1f3916fc-ff23-49ba-a378-f48bfb98a010 --out output.html * To generate a JUnit report, run: rally task export 1f3916fc-ff23-49ba-a378-f48bfb98a010 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 1f3916fc-ff23-49ba-a378-f48bfb98a010 --json --out output.json 2018-04-13 23:17:33,258 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '1f3916fc-ff23-49ba-a378-f48bfb98a010'] 2018-04-13 23:17:34,507 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-13 23:17:34,508 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '1f3916fc-ff23-49ba-a378-f48bfb98a010', '--out', u'/home/opnfv/functest/results/rally/opnfv-glance.html'] 2018-04-13 23:17:34,512 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2018-04-13 23:17:34,512 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2018-04-13 23:17:34,512 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-cinder.yaml 2018-04-13 23:17:34,512 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-13 23:17:34,522 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_migrate_server', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_live_migrate_server', u'NovaServers.boot_server_from_volume_and_live_migrate'] 2018-04-13 23:17:34,526 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['cinder'], 'concurrency': 4, 'netid': 'fa0619ca-3787-4ab8-b621-a2246ddda9ac', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'flavor_name': 'rally-tiny-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-13 23:20:57,706 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 28b1a469-41fc-48d8-b8f0-1d9ecb3085d5 2018-04-13 23:20:57,707 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '28b1a469-41fc-48d8-b8f0-1d9ecb3085d5'] 2018-04-13 23:20:59,021 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 28b1a469-41fc-48d8-b8f0-1d9ecb3085d5: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "volumes": { "volumes_per_tenant": 1, "size": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "force": false }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 28b1a469-41fc-48d8-b8f0-1d9ecb3085d5 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_snapshot | 3.078 | 3.078 | 3.078 | 3.078 | 3.078 | 3.078 | 100.0% | 1 | | cinder_v2.delete_snapshot | 2.328 | 2.328 | 2.328 | 2.328 | 2.328 | 2.328 | 100.0% | 1 | | total | 5.405 | 5.405 | 5.405 | 5.405 | 5.405 | 5.405 | 100.0% | 1 | | -> duration | 5.405 | 5.405 | 5.405 | 5.405 | 5.405 | 5.405 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.405407 Full duration: 23.103188 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "size": { "max": 1, "min": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 28b1a469-41fc-48d8-b8f0-1d9ecb3085d5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.366 | 3.366 | 3.366 | 3.366 | 3.366 | 3.366 | 100.0% | 1 | | cinder_v2.delete_volume | 2.314 | 2.314 | 2.314 | 2.314 | 2.314 | 2.314 | 100.0% | 1 | | total | 5.68 | 5.68 | 5.68 | 5.68 | 5.68 | 5.68 | 100.0% | 1 | | -> duration | 5.68 | 5.68 | 5.68 | 5.68 | 5.68 | 5.68 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.680154 Full duration: 17.200143 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "image": { "name": "Cirros-0.4.0-03c3fa2b-3f97-4d1f-b597-2add643ea0ce" }, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 28b1a469-41fc-48d8-b8f0-1d9ecb3085d5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 6.646 | 6.646 | 6.646 | 6.646 | 6.646 | 6.646 | 100.0% | 1 | | cinder_v2.delete_volume | 2.295 | 2.295 | 2.295 | 2.295 | 2.295 | 2.295 | 100.0% | 1 | | total | 8.941 | 8.941 | 8.941 | 8.941 | 8.941 | 8.941 | 100.0% | 1 | | -> duration | 8.941 | 8.941 | 8.941 | 8.941 | 8.941 | 8.941 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.941052 Full duration: 20.967633 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 28b1a469-41fc-48d8-b8f0-1d9ecb3085d5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.259 | 3.259 | 3.259 | 3.259 | 3.259 | 3.259 | 100.0% | 1 | | cinder_v2.delete_volume | 2.277 | 2.277 | 2.277 | 2.277 | 2.277 | 2.277 | 100.0% | 1 | | total | 5.536 | 5.536 | 5.536 | 5.536 | 5.536 | 5.536 | 100.0% | 1 | | -> duration | 5.536 | 5.536 | 5.536 | 5.536 | 5.536 | 5.536 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.535978 Full duration: 16.520301 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "new_size": 2, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 28b1a469-41fc-48d8-b8f0-1d9ecb3085d5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.39 | 3.39 | 3.39 | 3.39 | 3.39 | 3.39 | 100.0% | 1 | | cinder_v2.extend_volume | 2.406 | 2.406 | 2.406 | 2.406 | 2.406 | 2.406 | 100.0% | 1 | | cinder_v2.delete_volume | 2.297 | 2.297 | 2.297 | 2.297 | 2.297 | 2.297 | 100.0% | 1 | | total | 8.093 | 8.093 | 8.093 | 8.093 | 8.093 | 8.093 | 100.0% | 1 | | -> duration | 8.093 | 8.093 | 8.093 | 8.093 | 8.093 | 8.093 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.093159 Full duration: 19.150133 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "volumes": { "volumes_per_tenant": 1, "size": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 28b1a469-41fc-48d8-b8f0-1d9ecb3085d5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.269 | 3.269 | 3.269 | 3.269 | 3.269 | 3.269 | 100.0% | 1 | | cinder_v2.delete_volume | 2.33 | 2.33 | 2.33 | 2.33 | 2.33 | 2.33 | 100.0% | 1 | | total | 5.599 | 5.599 | 5.599 | 5.599 | 5.599 | 5.599 | 100.0% | 1 | | -> duration | 5.599 | 5.599 | 5.599 | 5.599 | 5.599 | 5.599 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.598609 Full duration: 23.321326 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "write_iops_sec": "10", "consumer": "both", "read_iops_sec": "1000" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 28b1a469-41fc-48d8-b8f0-1d9ecb3085d5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 0.656 | 0.656 | 0.656 | 0.656 | 0.656 | 0.656 | 100.0% | 1 | | cinder_v2.list_qos | 0.035 | 0.035 | 0.035 | 0.035 | 0.035 | 0.035 | 100.0% | 1 | | total | 0.692 | 0.692 | 0.692 | 0.692 | 0.692 | 0.692 | 100.0% | 1 | | -> duration | 0.692 | 0.692 | 0.692 | 0.692 | 0.692 | 0.692 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.69207 Full duration: 12.97344 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "set_read_iops_sec": "1001", "set_consumer": "both", "read_iops_sec": "1000", "set_write_iops_sec": "11", "write_iops_sec": "10", "consumer": "back-end" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 28b1a469-41fc-48d8-b8f0-1d9ecb3085d5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 0.829 | 0.829 | 0.829 | 0.829 | 0.829 | 0.829 | 100.0% | 1 | | cinder_v2.set_qos | 0.073 | 0.073 | 0.073 | 0.073 | 0.073 | 0.073 | 100.0% | 1 | | total | 0.903 | 0.903 | 0.903 | 0.903 | 0.903 | 0.903 | 100.0% | 1 | | -> duration | 0.903 | 0.903 | 0.903 | 0.903 | 0.903 | 0.903 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.902915 Full duration: 14.042896 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "description": "rally tests creating types" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 28b1a469-41fc-48d8-b8f0-1d9ecb3085d5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.763 | 0.763 | 0.763 | 0.763 | 0.763 | 0.763 | 100.0% | 1 | | cinder_v2.list_types | 0.043 | 0.043 | 0.043 | 0.043 | 0.043 | 0.043 | 100.0% | 1 | | total | 0.806 | 0.806 | 0.806 | 0.806 | 0.806 | 0.806 | 100.0% | 1 | | -> duration | 0.806 | 0.806 | 0.806 | 0.806 | 0.806 | 0.806 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.805962 Full duration: 13.255975 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "control_location": "front-end", "cipher": "aes-xts-plain64", "description": "rally tests creating types", "key_size": 512, "provider": "LuksEncryptor" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 28b1a469-41fc-48d8-b8f0-1d9ecb3085d5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.782 | 0.782 | 0.782 | 0.782 | 0.782 | 0.782 | 100.0% | 1 | | cinder_v2.create_encryption_type | 0.098 | 0.098 | 0.098 | 0.098 | 0.098 | 0.098 | 100.0% | 1 | | total | 0.88 | 0.88 | 0.88 | 0.88 | 0.88 | 0.88 | 100.0% | 1 | | -> duration | 0.88 | 0.88 | 0.88 | 0.88 | 0.88 | 0.88 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.880422 Full duration: 13.581295 HINTS: * To plot HTML graphics with this data, run: rally task report 28b1a469-41fc-48d8-b8f0-1d9ecb3085d5 --out output.html * To generate a JUnit report, run: rally task export 28b1a469-41fc-48d8-b8f0-1d9ecb3085d5 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 28b1a469-41fc-48d8-b8f0-1d9ecb3085d5 --json --out output.json 2018-04-13 23:20:59,022 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '28b1a469-41fc-48d8-b8f0-1d9ecb3085d5'] 2018-04-13 23:21:00,305 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-13 23:21:00,306 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '28b1a469-41fc-48d8-b8f0-1d9ecb3085d5', '--out', u'/home/opnfv/functest/results/rally/opnfv-cinder.html'] 2018-04-13 23:21:00,310 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2018-04-13 23:21:00,310 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2018-04-13 23:21:00,311 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-heat.yaml 2018-04-13 23:21:00,311 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-13 23:21:00,320 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_migrate_server', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_live_migrate_server', u'NovaServers.boot_server_from_volume_and_live_migrate'] 2018-04-13 23:21:00,327 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['heat'], 'concurrency': 4, 'netid': 'fa0619ca-3787-4ab8-b621-a2246ddda9ac', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'flavor_name': 'rally-tiny-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-13 23:22:54,264 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 83e579ef-0873-4ee7-b601-d77ca56ec068 2018-04-13 23:22:54,265 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '83e579ef-0873-4ee7-b601-d77ca56ec068'] 2018-04-13 23:22:55,519 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 83e579ef-0873-4ee7-b601-d77ca56ec068: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 83e579ef-0873-4ee7-b601-d77ca56ec068 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 5.293 | 5.293 | 5.293 | 5.293 | 5.293 | 5.293 | 100.0% | 1 | | heat.update_stack | 2.462 | 2.462 | 2.462 | 2.462 | 2.462 | 2.462 | 100.0% | 1 | | heat.delete_stack | 2.48 | 2.48 | 2.48 | 2.48 | 2.48 | 2.48 | 100.0% | 1 | | total | 10.235 | 10.235 | 10.235 | 10.235 | 10.235 | 10.235 | 100.0% | 1 | | -> duration | 6.235 | 6.235 | 6.235 | 6.235 | 6.235 | 6.235 | 100.0% | 1 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.234936 Full duration: 23.702283 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 83e579ef-0873-4ee7-b601-d77ca56ec068 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.708 | 4.708 | 4.708 | 4.708 | 4.708 | 4.708 | 100.0% | 1 | | heat.check_stack | 0.359 | 0.359 | 0.359 | 0.359 | 0.359 | 0.359 | 100.0% | 1 | | heat.delete_stack | 2.4 | 2.4 | 2.4 | 2.4 | 2.4 | 2.4 | 100.0% | 1 | | total | 7.468 | 7.468 | 7.468 | 7.468 | 7.468 | 7.468 | 100.0% | 1 | | -> duration | 5.468 | 5.468 | 5.468 | 5.468 | 5.468 | 5.468 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.467936 Full duration: 20.192169 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 83e579ef-0873-4ee7-b601-d77ca56ec068 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 5.049 | 5.049 | 5.049 | 5.049 | 5.049 | 5.049 | 100.0% | 1 | | heat.suspend_stack | 0.422 | 0.422 | 0.422 | 0.422 | 0.422 | 0.422 | 100.0% | 1 | | heat.resume_stack | 1.47 | 1.47 | 1.47 | 1.47 | 1.47 | 1.47 | 100.0% | 1 | | heat.delete_stack | 2.473 | 2.473 | 2.473 | 2.473 | 2.473 | 2.473 | 100.0% | 1 | | total | 9.415 | 9.415 | 9.415 | 9.415 | 9.415 | 9.415 | 100.0% | 1 | | -> duration | 7.415 | 7.415 | 7.415 | 7.415 | 7.415 | 7.415 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.415458 Full duration: 22.496935 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "roles": [ "heat_stack_owner" ] }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 83e579ef-0873-4ee7-b601-d77ca56ec068 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.83 | 0.83 | 0.83 | 0.83 | 0.83 | 0.83 | 100.0% | 1 | | total | 0.83 | 0.83 | 0.83 | 0.83 | 0.83 | 0.83 | 100.0% | 1 | | -> duration | 0.83 | 0.83 | 0.83 | 0.83 | 0.83 | 0.83 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.82984 Full duration: 12.790638 HINTS: * To plot HTML graphics with this data, run: rally task report 83e579ef-0873-4ee7-b601-d77ca56ec068 --out output.html * To generate a JUnit report, run: rally task export 83e579ef-0873-4ee7-b601-d77ca56ec068 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 83e579ef-0873-4ee7-b601-d77ca56ec068 --json --out output.json 2018-04-13 23:22:55,520 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '83e579ef-0873-4ee7-b601-d77ca56ec068'] 2018-04-13 23:22:56,758 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-13 23:22:56,758 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '83e579ef-0873-4ee7-b601-d77ca56ec068', '--out', u'/home/opnfv/functest/results/rally/opnfv-heat.html'] 2018-04-13 23:22:56,762 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2018-04-13 23:22:56,763 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2018-04-13 23:22:56,763 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-keystone.yaml 2018-04-13 23:22:56,763 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-13 23:22:56,772 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_migrate_server', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_live_migrate_server', u'NovaServers.boot_server_from_volume_and_live_migrate'] 2018-04-13 23:22:56,780 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['keystone'], 'concurrency': 4, 'netid': 'fa0619ca-3787-4ab8-b621-a2246ddda9ac', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'flavor_name': 'rally-tiny-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-13 23:26:22,493 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : f79d9e26-89b4-4e6d-afaa-e5e3a6637990 2018-04-13 23:26:22,494 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'f79d9e26-89b4-4e6d-afaa-e5e3a6637990'] 2018-04-13 23:26:23,792 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task f79d9e26-89b4-4e6d-afaa-e5e3a6637990: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f79d9e26-89b4-4e6d-afaa-e5e3a6637990 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.559 | 0.559 | 0.559 | 0.559 | 0.559 | 0.559 | 100.0% | 1 | | keystone_v3.add_role | 0.059 | 0.059 | 0.059 | 0.059 | 0.059 | 0.059 | 100.0% | 1 | | keystone_v3.revoke_role | 0.077 | 0.077 | 0.077 | 0.077 | 0.077 | 0.077 | 100.0% | 1 | | total | 0.696 | 0.696 | 0.696 | 0.696 | 0.696 | 0.696 | 100.0% | 1 | | -> duration | 0.696 | 0.696 | 0.696 | 0.696 | 0.696 | 0.696 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.69562 Full duration: 16.264079 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f79d9e26-89b4-4e6d-afaa-e5e3a6637990 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.554 | 0.554 | 0.554 | 0.554 | 0.554 | 0.554 | 100.0% | 1 | | keystone_v3.add_role | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 100.0% | 1 | | keystone_v3.list_roles | 0.039 | 0.039 | 0.039 | 0.039 | 0.039 | 0.039 | 100.0% | 1 | | total | 0.637 | 0.637 | 0.637 | 0.637 | 0.637 | 0.637 | 100.0% | 1 | | -> duration | 0.637 | 0.637 | 0.637 | 0.637 | 0.637 | 0.637 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.637474 Full duration: 16.240314 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f79d9e26-89b4-4e6d-afaa-e5e3a6637990 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.64 | 0.64 | 0.64 | 0.64 | 0.64 | 0.64 | 100.0% | 1 | | keystone_v3.list_projects | 0.037 | 0.037 | 0.037 | 0.037 | 0.037 | 0.037 | 100.0% | 1 | | total | 0.677 | 0.677 | 0.677 | 0.677 | 0.677 | 0.677 | 100.0% | 1 | | -> duration | 0.677 | 0.677 | 0.677 | 0.677 | 0.677 | 0.677 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.676827 Full duration: 16.00418 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f79d9e26-89b4-4e6d-afaa-e5e3a6637990 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.538 | 0.538 | 0.538 | 0.538 | 0.538 | 0.538 | 100.0% | 1 | | keystone_v3.delete_role | 0.055 | 0.055 | 0.055 | 0.055 | 0.055 | 0.055 | 100.0% | 1 | | total | 0.593 | 0.593 | 0.593 | 0.593 | 0.593 | 0.593 | 100.0% | 1 | | -> duration | 0.593 | 0.593 | 0.593 | 0.593 | 0.593 | 0.593 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.592774 Full duration: 13.64594 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f79d9e26-89b4-4e6d-afaa-e5e3a6637990 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.58 | 0.58 | 0.58 | 0.58 | 0.58 | 0.58 | 100.0% | 1 | | keystone_v3.delete_service | 0.061 | 0.061 | 0.061 | 0.061 | 0.061 | 0.061 | 100.0% | 1 | | total | 0.641 | 0.641 | 0.641 | 0.641 | 0.641 | 0.641 | 100.0% | 1 | | -> duration | 0.641 | 0.641 | 0.641 | 0.641 | 0.641 | 0.641 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.6412 Full duration: 13.816336 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f79d9e26-89b4-4e6d-afaa-e5e3a6637990 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.639 | 0.639 | 0.639 | 0.639 | 0.639 | 0.639 | 100.0% | 1 | | keystone_v3.create_user | 0.216 | 0.216 | 0.216 | 0.216 | 0.216 | 0.216 | 100.0% | 1 | | -> keystone_v3.list_roles | 0.032 | 0.032 | 0.032 | 0.032 | 0.032 | 0.032 | 100.0% | 1 | | -> keystone_v3.add_role | 0.077 | 0.077 | 0.077 | 0.077 | 0.077 | 0.077 | 100.0% | 1 | | keystone_v3.create_role | 0.043 | 0.043 | 0.043 | 0.043 | 0.043 | 0.043 | 100.0% | 1 | | keystone_v3.get_project | 0.027 | 0.027 | 0.027 | 0.027 | 0.027 | 0.027 | 100.0% | 1 | | keystone_v3.get_user | 0.026 | 0.026 | 0.026 | 0.026 | 0.026 | 0.026 | 100.0% | 1 | | keystone_v3.get_role | 0.034 | 0.034 | 0.034 | 0.034 | 0.034 | 0.034 | 100.0% | 1 | | keystone_v3.list_services | 0.029 | 0.029 | 0.029 | 0.029 | 0.029 | 0.029 | 100.0% | 1 | | keystone_v3.get_services | 0.033 | 0.033 | 0.033 | 0.033 | 0.033 | 0.033 | 100.0% | 1 | | total | 1.076 | 1.076 | 1.076 | 1.076 | 1.076 | 1.076 | 100.0% | 1 | | -> duration | 1.076 | 1.076 | 1.076 | 1.076 | 1.076 | 1.076 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.076353 Full duration: 20.840289 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f79d9e26-89b4-4e6d-afaa-e5e3a6637990 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.633 | 0.633 | 0.633 | 0.633 | 0.633 | 0.633 | 100.0% | 1 | | keystone_v3.update_project | 0.068 | 0.068 | 0.068 | 0.068 | 0.068 | 0.068 | 100.0% | 1 | | keystone_v3.delete_project | 0.145 | 0.145 | 0.145 | 0.145 | 0.145 | 0.145 | 100.0% | 1 | | total | 0.846 | 0.846 | 0.846 | 0.846 | 0.846 | 0.846 | 100.0% | 1 | | -> duration | 0.846 | 0.846 | 0.846 | 0.846 | 0.846 | 0.846 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.845593 Full duration: 14.006682 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f79d9e26-89b4-4e6d-afaa-e5e3a6637990 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.619 | 0.619 | 0.619 | 0.619 | 0.619 | 0.619 | 100.0% | 1 | | total | 0.694 | 0.694 | 0.694 | 0.694 | 0.694 | 0.694 | 100.0% | 1 | | -> duration | 0.694 | 0.694 | 0.694 | 0.694 | 0.694 | 0.694 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.693754 Full duration: 16.157695 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f79d9e26-89b4-4e6d-afaa-e5e3a6637990 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.63 | 0.63 | 0.63 | 0.63 | 0.63 | 0.63 | 100.0% | 1 | | total | 0.63 | 0.63 | 0.63 | 0.63 | 0.63 | 0.63 | 100.0% | 1 | | -> duration | 0.63 | 0.63 | 0.63 | 0.63 | 0.63 | 0.63 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.629936 Full duration: 15.946454 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f79d9e26-89b4-4e6d-afaa-e5e3a6637990 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.631 | 0.631 | 0.631 | 0.631 | 0.631 | 0.631 | 100.0% | 1 | | keystone_v3.list_users | 0.061 | 0.061 | 0.061 | 0.061 | 0.061 | 0.061 | 100.0% | 1 | | total | 0.75 | 0.75 | 0.75 | 0.75 | 0.75 | 0.75 | 100.0% | 1 | | -> duration | 0.75 | 0.75 | 0.75 | 0.75 | 0.75 | 0.75 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.750157 Full duration: 16.105116 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "args": { "users_per_tenant": 10 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task f79d9e26-89b4-4e6d-afaa-e5e3a6637990 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.621 | 0.621 | 0.621 | 0.621 | 0.621 | 0.621 | 100.0% | 1 | | keystone_v3.create_users | 2.274 | 2.274 | 2.274 | 2.274 | 2.274 | 2.274 | 100.0% | 1 | | -> keystone_v3.create_user (x10) | 2.274 | 2.274 | 2.274 | 2.274 | 2.274 | 2.274 | 100.0% | 1 | | --> keystone_v3.list_roles (x10) | 0.339 | 0.339 | 0.339 | 0.339 | 0.339 | 0.339 | 100.0% | 1 | | --> keystone_v3.add_role (x10) | 0.812 | 0.812 | 0.812 | 0.812 | 0.812 | 0.812 | 100.0% | 1 | | total | 3.16 | 3.16 | 3.16 | 3.16 | 3.16 | 3.16 | 100.0% | 1 | | -> duration | 3.16 | 3.16 | 3.16 | 3.16 | 3.16 | 3.16 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.159742 Full duration: 22.506997 HINTS: * To plot HTML graphics with this data, run: rally task report f79d9e26-89b4-4e6d-afaa-e5e3a6637990 --out output.html * To generate a JUnit report, run: rally task export f79d9e26-89b4-4e6d-afaa-e5e3a6637990 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report f79d9e26-89b4-4e6d-afaa-e5e3a6637990 --json --out output.json 2018-04-13 23:26:23,793 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'f79d9e26-89b4-4e6d-afaa-e5e3a6637990'] 2018-04-13 23:26:25,071 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-13 23:26:25,071 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'f79d9e26-89b4-4e6d-afaa-e5e3a6637990', '--out', u'/home/opnfv/functest/results/rally/opnfv-keystone.html'] 2018-04-13 23:26:25,076 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2018-04-13 23:26:25,076 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2018-04-13 23:26:25,076 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-neutron.yaml 2018-04-13 23:26:25,076 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-13 23:26:25,086 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_migrate_server', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_live_migrate_server', u'NovaServers.boot_server_from_volume_and_live_migrate'] 2018-04-13 23:26:25,088 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['neutron'], 'concurrency': 4, 'netid': 'fa0619ca-3787-4ab8-b621-a2246ddda9ac', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'flavor_name': 'rally-tiny-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-13 23:32:42,976 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 1802bf4d-7587-4195-a55b-ceb4eb97eac0 2018-04-13 23:32:42,976 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '1802bf4d-7587-4195-a55b-ceb4eb97eac0'] 2018-04-13 23:32:44,277 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 1802bf4d-7587-4195-a55b-ceb4eb97eac0: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1802bf4d-7587-4195-a55b-ceb4eb97eac0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.465 | 1.465 | 1.465 | 1.465 | 1.465 | 1.465 | 100.0% | 1 | | neutron.delete_network | 1.335 | 1.335 | 1.335 | 1.335 | 1.335 | 1.335 | 100.0% | 1 | | total | 2.8 | 2.8 | 2.8 | 2.8 | 2.8 | 2.8 | 100.0% | 1 | | -> duration | 2.8 | 2.8 | 2.8 | 2.8 | 2.8 | 2.8 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.799885 Full duration: 16.756125 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "neutron": { "network": -1, "port": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": {} }, "args": { "network_create_args": {}, "ports_per_network": 1, "port_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1802bf4d-7587-4195-a55b-ceb4eb97eac0 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.253 | 2.253 | 2.253 | 2.253 | 2.253 | 2.253 | 100.0% | 1 | | neutron.delete_port | 1.077 | 1.077 | 1.077 | 1.077 | 1.077 | 1.077 | 100.0% | 1 | | total | 3.331 | 3.331 | 3.331 | 3.331 | 3.331 | 3.331 | 100.0% | 1 | | -> duration | 3.331 | 3.331 | 3.331 | 3.331 | 3.331 | 3.331 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.330824 Full duration: 32.539285 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "router": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": {} }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 1, "router_create_args": {}, "subnet_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1802bf4d-7587-4195-a55b-ceb4eb97eac0 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.127 | 1.127 | 1.127 | 1.127 | 1.127 | 1.127 | 100.0% | 1 | | neutron.create_subnet | 0.712 | 0.712 | 0.712 | 0.712 | 0.712 | 0.712 | 100.0% | 1 | | neutron.create_router | 0.111 | 0.111 | 0.111 | 0.111 | 0.111 | 0.111 | 100.0% | 1 | | neutron.add_interface_router | 2.976 | 2.976 | 2.976 | 2.976 | 2.976 | 2.976 | 100.0% | 1 | | neutron.remove_interface_router | 1.972 | 1.972 | 1.972 | 1.972 | 1.972 | 1.972 | 100.0% | 1 | | neutron.delete_router | 0.555 | 0.555 | 0.555 | 0.555 | 0.555 | 0.555 | 100.0% | 1 | | total | 7.453 | 7.453 | 7.453 | 7.453 | 7.453 | 7.453 | 100.0% | 1 | | -> duration | 7.453 | 7.453 | 7.453 | 7.453 | 7.453 | 7.453 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.453167 Full duration: 59.559441 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "network": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": {} }, "args": { "network_create_args": {}, "subnet_create_args": {}, "subnets_per_network": 1, "subnet_cidr_start": "1.1.0.0/30" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1802bf4d-7587-4195-a55b-ceb4eb97eac0 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 1.471 | 1.471 | 1.471 | 1.471 | 1.471 | 1.471 | 100.0% | 1 | | neutron.delete_subnet | 0.899 | 0.899 | 0.899 | 0.899 | 0.899 | 0.899 | 100.0% | 1 | | total | 2.37 | 2.37 | 2.37 | 2.37 | 2.37 | 2.37 | 100.0% | 1 | | -> duration | 2.37 | 2.37 | 2.37 | 2.37 | 2.37 | 2.37 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.370219 Full duration: 35.340115 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1802bf4d-7587-4195-a55b-ceb4eb97eac0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.426 | 1.426 | 1.426 | 1.426 | 1.426 | 1.426 | 100.0% | 1 | | neutron.list_networks | 0.267 | 0.267 | 0.267 | 0.267 | 0.267 | 0.267 | 100.0% | 1 | | total | 1.693 | 1.693 | 1.693 | 1.693 | 1.693 | 1.693 | 100.0% | 1 | | -> duration | 1.693 | 1.693 | 1.693 | 1.693 | 1.693 | 1.693 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.692598 Full duration: 18.8076 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "neutron": { "network": -1, "port": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": {} }, "args": { "network_create_args": {}, "ports_per_network": 1, "port_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1802bf4d-7587-4195-a55b-ceb4eb97eac0 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.18 | 2.18 | 2.18 | 2.18 | 2.18 | 2.18 | 100.0% | 1 | | neutron.list_ports | 0.134 | 0.134 | 0.134 | 0.134 | 0.134 | 0.134 | 100.0% | 1 | | total | 2.315 | 2.315 | 2.315 | 2.315 | 2.315 | 2.315 | 100.0% | 1 | | -> duration | 2.315 | 2.315 | 2.315 | 2.315 | 2.315 | 2.315 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.314807 Full duration: 33.866497 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": {} }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 1, "router_create_args": {}, "subnet_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1802bf4d-7587-4195-a55b-ceb4eb97eac0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.037 | 1.037 | 1.037 | 1.037 | 1.037 | 1.037 | 100.0% | 1 | | neutron.create_subnet | 1.107 | 1.107 | 1.107 | 1.107 | 1.107 | 1.107 | 100.0% | 1 | | neutron.create_router | 0.198 | 0.198 | 0.198 | 0.198 | 0.198 | 0.198 | 100.0% | 1 | | neutron.add_interface_router | 2.664 | 2.664 | 2.664 | 2.664 | 2.664 | 2.664 | 100.0% | 1 | | neutron.list_routers | 0.174 | 0.174 | 0.174 | 0.174 | 0.174 | 0.174 | 100.0% | 1 | | total | 5.18 | 5.18 | 5.18 | 5.18 | 5.18 | 5.18 | 100.0% | 1 | | -> duration | 5.18 | 5.18 | 5.18 | 5.18 | 5.18 | 5.18 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.179695 Full duration: 50.766219 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "network": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": {} }, "args": { "network_create_args": {}, "subnet_create_args": {}, "subnets_per_network": 1, "subnet_cidr_start": "1.1.0.0/30" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1802bf4d-7587-4195-a55b-ceb4eb97eac0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.14 | 1.14 | 1.14 | 1.14 | 1.14 | 1.14 | 100.0% | 1 | | neutron.create_subnet | 1.119 | 1.119 | 1.119 | 1.119 | 1.119 | 1.119 | 100.0% | 1 | | neutron.list_subnets | 0.106 | 0.106 | 0.106 | 0.106 | 0.106 | 0.106 | 100.0% | 1 | | total | 2.365 | 2.365 | 2.365 | 2.365 | 2.365 | 2.365 | 100.0% | 1 | | -> duration | 2.365 | 2.365 | 2.365 | 2.365 | 2.365 | 2.365 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.365454 Full duration: 41.156627 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1802bf4d-7587-4195-a55b-ceb4eb97eac0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.474 | 1.474 | 1.474 | 1.474 | 1.474 | 1.474 | 100.0% | 1 | | neutron.delete_security_group | 0.499 | 0.499 | 0.499 | 0.499 | 0.499 | 0.499 | 100.0% | 1 | | total | 1.973 | 1.973 | 1.973 | 1.973 | 1.973 | 1.973 | 100.0% | 1 | | -> duration | 1.973 | 1.973 | 1.973 | 1.973 | 1.973 | 1.973 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.973227 Full duration: 15.527411 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1802bf4d-7587-4195-a55b-ceb4eb97eac0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.411 | 1.411 | 1.411 | 1.411 | 1.411 | 1.411 | 100.0% | 1 | | neutron.create_security_group_rule | 0.296 | 0.296 | 0.296 | 0.296 | 0.296 | 0.296 | 100.0% | 1 | | neutron.delete_security_group_rule | 0.146 | 0.146 | 0.146 | 0.146 | 0.146 | 0.146 | 100.0% | 1 | | neutron.delete_security_group | 0.282 | 0.282 | 0.282 | 0.282 | 0.282 | 0.282 | 100.0% | 1 | | total | 2.136 | 2.136 | 2.136 | 2.136 | 2.136 | 2.136 | 100.0% | 1 | | -> duration | 2.136 | 2.136 | 2.136 | 2.136 | 2.136 | 2.136 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.135567 Full duration: 15.620333 -------------------------------------------------------------------------------- test scenario NeutronNetworks.set_and_clear_router_gateway args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "roles": [ "admin" ], "quotas": { "neutron": { "router": -1, "network": -1 } } }, "args": { "network_create_args": { "router:external": true } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1802bf4d-7587-4195-a55b-ceb4eb97eac0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.579 | 1.579 | 1.579 | 1.579 | 1.579 | 1.579 | 100.0% | 1 | | neutron.create_router | 0.125 | 0.125 | 0.125 | 0.125 | 0.125 | 0.125 | 100.0% | 1 | | neutron.add_gateway_router | 1.517 | 1.517 | 1.517 | 1.517 | 1.517 | 1.517 | 100.0% | 1 | | neutron.remove_gateway_router | 1.313 | 1.313 | 1.313 | 1.313 | 1.313 | 1.313 | 100.0% | 1 | | total | 4.534 | 4.534 | 4.534 | 4.534 | 4.534 | 4.534 | 100.0% | 1 | | -> duration | 4.534 | 4.534 | 4.534 | 4.534 | 4.534 | 4.534 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.534189 Full duration: 28.31595 HINTS: * To plot HTML graphics with this data, run: rally task report 1802bf4d-7587-4195-a55b-ceb4eb97eac0 --out output.html * To generate a JUnit report, run: rally task export 1802bf4d-7587-4195-a55b-ceb4eb97eac0 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 1802bf4d-7587-4195-a55b-ceb4eb97eac0 --json --out output.json 2018-04-13 23:32:44,278 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '1802bf4d-7587-4195-a55b-ceb4eb97eac0'] 2018-04-13 23:32:45,561 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-13 23:32:45,561 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '1802bf4d-7587-4195-a55b-ceb4eb97eac0', '--out', u'/home/opnfv/functest/results/rally/opnfv-neutron.html'] 2018-04-13 23:32:45,566 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2018-04-13 23:32:45,566 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2018-04-13 23:32:45,566 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-nova.yaml 2018-04-13 23:32:45,566 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-13 23:32:45,575 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_migrate_server', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_live_migrate_server', u'NovaServers.boot_server_from_volume_and_live_migrate'] 2018-04-13 23:32:45,577 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['nova'], 'concurrency': 4, 'netid': 'fa0619ca-3787-4ab8-b621-a2246ddda9ac', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'flavor_name': 'rally-tiny-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-13 23:40:33,519 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 1b7f9874-6396-44ed-bd37-ae2635656be4 2018-04-13 23:40:33,519 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '1b7f9874-6396-44ed-bd37-ae2635656be4'] 2018-04-13 23:40:34,787 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 1b7f9874-6396-44ed-bd37-ae2635656be4: aborted -------------------------------------------------------------------------------- test scenario NovaKeypair.boot_and_delete_server_with_keypair args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "key_pairs": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "server_kwargs": { "nics": [ { "net-id": "fa0619ca-3787-4ab8-b621-a2246ddda9ac" } ] }, "flavor": { "name": "rally-tiny-03c3fa2b-3f97-4d1f-b597-2add643ea0ce" }, "image": { "name": "Cirros-0.4.0-03c3fa2b-3f97-4d1f-b597-2add643ea0ce" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1b7f9874-6396-44ed-bd37-ae2635656be4 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 1.101 | 1.101 | 1.101 | 1.101 | 1.101 | 1.101 | 100.0% | 1 | | nova.boot_server | 9.776 | 9.776 | 9.776 | 9.776 | 9.776 | 9.776 | 100.0% | 1 | | nova.delete_server | 2.934 | 2.934 | 2.934 | 2.934 | 2.934 | 2.934 | 100.0% | 1 | | nova.delete_keypair | 0.048 | 0.048 | 0.048 | 0.048 | 0.048 | 0.048 | 100.0% | 1 | | total | 13.859 | 13.859 | 13.859 | 13.859 | 13.859 | 13.859 | 100.0% | 1 | | -> duration | 12.859 | 12.859 | 12.859 | 12.859 | 12.859 | 12.859 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.859269 Full duration: 40.190479 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume_and_delete args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 }, "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "volume_size": 5, "flavor": { "name": "rally-tiny-03c3fa2b-3f97-4d1f-b597-2add643ea0ce" }, "image": { "name": "Cirros-0.4.0-03c3fa2b-3f97-4d1f-b597-2add643ea0ce" }, "nics": [ { "net-id": "fa0619ca-3787-4ab8-b621-a2246ddda9ac" } ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1b7f9874-6396-44ed-bd37-ae2635656be4 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 6.156 | 6.156 | 6.156 | 6.156 | 6.156 | 6.156 | 100.0% | 1 | | nova.boot_server | 10.062 | 10.062 | 10.062 | 10.062 | 10.062 | 10.062 | 100.0% | 1 | | nova.delete_server | 5.142 | 5.142 | 5.142 | 5.142 | 5.142 | 5.142 | 100.0% | 1 | | total | 21.36 | 21.36 | 21.36 | 21.36 | 21.36 | 21.36 | 100.0% | 1 | | -> duration | 20.36 | 20.36 | 20.36 | 20.36 | 20.36 | 20.36 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.360414 Full duration: 54.442822 -------------------------------------------------------------------------------- test scenario NovaServers.pause_and_unpause_server args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "force_delete": false, "flavor": { "name": "rally-tiny-03c3fa2b-3f97-4d1f-b597-2add643ea0ce" }, "image": { "name": "Cirros-0.4.0-03c3fa2b-3f97-4d1f-b597-2add643ea0ce" }, "nics": [ { "net-id": "fa0619ca-3787-4ab8-b621-a2246ddda9ac" } ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 1b7f9874-6396-44ed-bd37-ae2635656be4 has 1 error(s) -------------------------------------------------------------------------------- TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_681734e6_sl7Ndj3b:899ea7c7-c7eb-4409-8585-a99c2999cf74 to become ('ACTIVE') current status SHUTOFF Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/servers.py", line 655, in run self._unpause_server(server) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 91, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally_openstack/scenarios/nova/utils.py", line 326, in _unpause_server check_interval=CONF.openstack.nova_server_unpause_poll_interval File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 252, in wait_for_status timeout=timeout) TimeoutException: Rally tired waiting 300.00 seconds for Server s_rally_681734e6_sl7Ndj3b:899ea7c7-c7eb-4409-8585-a99c2999cf74 to become ('ACTIVE') current status SHUTOFF -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 11.131 | 11.131 | 11.131 | 11.131 | 11.131 | 11.131 | 100.0% | 1 | | nova.pause_server | 2.678 | 2.678 | 2.678 | 2.678 | 2.678 | 2.678 | 100.0% | 1 | | nova.unpause_server | 304.534 | 304.534 | 304.534 | 304.534 | 304.534 | 304.534 | 0.0% | 1 | | total | 318.344 | 318.344 | 318.344 | 318.344 | 318.344 | 318.344 | 0.0% | 1 | | -> duration | 313.344 | 313.344 | 313.344 | 313.344 | 313.344 | 313.344 | 0.0% | 1 | | -> idle_duration | 5.0 | 5.0 | 5.0 | 5.0 | 5.0 | 5.0 | 0.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 313.343688 Full duration: 349.421451 HINTS: * To plot HTML graphics with this data, run: rally task report 1b7f9874-6396-44ed-bd37-ae2635656be4 --out output.html * To generate a JUnit report, run: rally task export 1b7f9874-6396-44ed-bd37-ae2635656be4 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 1b7f9874-6396-44ed-bd37-ae2635656be4 --json --out output.json At least one workload did not pass SLA criteria. 2018-04-13 23:40:34,787 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '1b7f9874-6396-44ed-bd37-ae2635656be4'] 2018-04-13 23:40:36,023 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-13 23:40:36,024 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '1b7f9874-6396-44ed-bd37-ae2635656be4', '--out', u'/home/opnfv/functest/results/rally/opnfv-nova.html'] 2018-04-13 23:40:36,028 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2018-04-13 23:40:36,028 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2018-04-13 23:40:36,028 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-quotas.yaml 2018-04-13 23:40:36,029 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-13 23:40:36,038 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete', u'NovaServers.boot_and_migrate_server', u'NovaServers.boot_server_attach_created_volume_and_live_migrate', u'NovaServers.boot_and_live_migrate_server', u'NovaServers.boot_server_from_volume_and_live_migrate'] 2018-04-13 23:40:36,046 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['quotas'], 'concurrency': 4, 'netid': 'fa0619ca-3787-4ab8-b621-a2246ddda9ac', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'flavor_name': 'rally-tiny-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-03c3fa2b-3f97-4d1f-b597-2add643ea0ce', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-13 23:41:32,987 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : a5f7126a-5174-4df7-8742-a50cf976bc2c 2018-04-13 23:41:32,988 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'a5f7126a-5174-4df7-8742-a50cf976bc2c'] 2018-04-13 23:41:34,238 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task a5f7126a-5174-4df7-8742-a50cf976bc2c: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a5f7126a-5174-4df7-8742-a50cf976bc2c has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.993 | 0.993 | 0.993 | 0.993 | 0.993 | 0.993 | 100.0% | 1 | | quotas.delete_quotas | 0.054 | 0.054 | 0.054 | 0.054 | 0.054 | 0.054 | 100.0% | 1 | | total | 1.048 | 1.048 | 1.048 | 1.048 | 1.048 | 1.048 | 100.0% | 1 | | -> duration | 1.048 | 1.048 | 1.048 | 1.048 | 1.048 | 1.048 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.047637 Full duration: 9.846786 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a5f7126a-5174-4df7-8742-a50cf976bc2c has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.878 | 0.878 | 0.878 | 0.878 | 0.878 | 0.878 | 100.0% | 1 | | total | 0.878 | 0.878 | 0.878 | 0.878 | 0.878 | 0.878 | 100.0% | 1 | | -> duration | 0.878 | 0.878 | 0.878 | 0.878 | 0.878 | 0.878 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.877925 Full duration: 9.619282 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a5f7126a-5174-4df7-8742-a50cf976bc2c has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.147 | 0.147 | 0.147 | 0.147 | 0.147 | 0.147 | 100.0% | 1 | | total | 0.732 | 0.732 | 0.732 | 0.732 | 0.732 | 0.732 | 100.0% | 1 | | -> duration | 0.732 | 0.732 | 0.732 | 0.732 | 0.732 | 0.732 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.732121 Full duration: 9.442316 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task a5f7126a-5174-4df7-8742-a50cf976bc2c has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.937 | 0.937 | 0.937 | 0.937 | 0.937 | 0.937 | 100.0% | 1 | | total | 0.937 | 0.937 | 0.937 | 0.937 | 0.937 | 0.937 | 100.0% | 1 | | -> duration | 0.937 | 0.937 | 0.937 | 0.937 | 0.937 | 0.937 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.93671 Full duration: 10.079535 HINTS: * To plot HTML graphics with this data, run: rally task report a5f7126a-5174-4df7-8742-a50cf976bc2c --out output.html * To generate a JUnit report, run: rally task export a5f7126a-5174-4df7-8742-a50cf976bc2c --type junit --to output.xml * To get raw JSON output of task results, run: rally task report a5f7126a-5174-4df7-8742-a50cf976bc2c --json --out output.json 2018-04-13 23:41:34,239 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'a5f7126a-5174-4df7-8742-a50cf976bc2c'] 2018-04-13 23:41:35,473 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-13 23:41:35,473 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'a5f7126a-5174-4df7-8742-a50cf976bc2c', '--out', u'/home/opnfv/functest/results/rally/opnfv-quotas.html'] 2018-04-13 23:41:35,477 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2018-04-13 23:41:35,479 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:50 | 6 | 100.00% | | glance | 01:13 | 4 | 100.00% | | cinder | 02:54 | 10 | 100.00% | | heat | 01:19 | 4 | 100.00% | | keystone | 03:01 | 11 | 100.00% | | neutron | 05:48 | 11 | 100.00% | | nova | 07:24 | 3 | 66.67% | | quotas | 00:38 | 4 | 100.00% | | | | | | | TOTAL: | 00:23:10 | 53 | 98.11% | +----------------+------------+----------------+-----------+ 2018-04-13 23:41:35,479 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_sanity' success_rate is 98.11% 2018-04-13 23:41:44,135 - xtesting.energy.energy - DEBUG - Restoring previous scenario (rally_sanity/running) 2018-04-13 23:41:44,135 - xtesting.energy.energy - DEBUG - Submitting scenario (rally_sanity/running) 2018-04-13 23:41:45,515 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-13 23:41:45,515 - xtesting.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | rally_sanity | functest | 27:33 | FAIL | +----------------------+------------------+------------------+----------------+ 2018-04-13 23:41:45,517 - xtesting.ci.run_tests - ERROR - The test case 'rally_sanity' failed. 2018-04-13 23:41:45,518 - xtesting.ci.run_tests - INFO - Running test case 'refstack_defcore'... 2018-04-13 23:41:45,594 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-13 23:41:49,364 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-04-13 23:41:53,314 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | d47ec02d-bf5d-48e0-a7b7-7155033fa064 | 2018-04-13T23:41:53.179348 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: d47ec02d-bf5d-48e0-a7b7-7155033fa064 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-13 23:41:58,299 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+-------------------+-----------+ | Service | Service Type | Status | +-------------+-------------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | nfv-orchestration | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+-------------------+-----------+ 2018-04-13 23:41:58,299 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-04-13 23:42:02,106 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-04-13 23:42:07,077 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide Using verifier 'opnfv-tempest' (UUID=89b0d31d-ca2a-4385-abf2-5572e8e745c2) as the default verifier for the future CLI operations. 2018-04-13 23:42:11,881 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-04-13 23:42:14,247 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-04-13 23:42:17,975 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-04-13 23:42:25,095 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-04-13 23:42:25,095 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-04-13 23:42:25,095 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-04-13 23:42:25,097 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-04-13 23:42:25,610 - functest.opnfv_tests.openstack.tempest.tempest - ERROR - Error with run Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/tempest/tempest.py", line 280, in run self.generate_test_list() File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/refstack/refstack.py", line 41, in generate_test_list nfile = parser.get_normalized_test_list(Refstack.defcorelist) File "/usr/lib/python2.7/site-packages/refstack_client/list_parser.py", line 203, in get_normalized_test_list tempest_test_ids = self._get_tempest_test_ids() File "/usr/lib/python2.7/site-packages/refstack_client/list_parser.py", line 58, in _get_tempest_test_ids ' '.join(cmd)) CalledProcessError: Command '/src/tempest/tools/with_venv.sh testr list-tests' returned non-zero exit status 3 2018-04-13 23:42:31,565 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-13 23:42:31,565 - xtesting.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | refstack_defcore | functest | 00:19 | FAIL | +--------------------------+------------------+------------------+----------------+ 2018-04-13 23:42:31,568 - xtesting.ci.run_tests - ERROR - The test case 'refstack_defcore' failed. 2018-04-13 23:42:31,568 - xtesting.ci.run_tests - INFO - Running test case 'patrole'... 2018-04-13 23:42:31,644 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-13 23:42:35,399 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-04-13 23:42:39,097 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 238ac71d-e7df-4dcb-a199-459a12b117e7 | 2018-04-13T23:42:38.963499 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 238ac71d-e7df-4dcb-a199-459a12b117e7 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-13 23:42:44,097 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+-------------------+-----------+ | Service | Service Type | Status | +-------------+-------------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | nfv-orchestration | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+-------------------+-----------+ 2018-04-13 23:42:44,098 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-04-13 23:42:47,824 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-04-13 23:42:52,843 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide Using verifier 'opnfv-tempest' (UUID=2cd1b16f-2b5b-4209-ba31-084a6c173237) as the default verifier for the future CLI operations. 2018-04-13 23:42:57,681 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-04-13 23:43:00,089 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-04-13 23:43:03,838 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-04-13 23:43:10,639 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-04-13 23:43:10,640 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-04-13 23:43:10,640 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-04-13 23:43:10,641 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-04-13 23:43:10,645 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-04-13 23:43:14,761 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-2cd1b16f-2b5b-4209-ba31-084a6c173237/repo; stestr list '(?!.*test_networks_multiprovider_rbac)(?=patrole_tempest_plugin.tests.api.(image|network|volume))' >/home/opnfv/functest/results/patrole/tempest-list.txt 2>/dev/null) 2018-04-13 23:43:14,761 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/patrole/tempest-list.txt']'. 2018-04-13 23:46:26,232 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Verification UUID: ea2ed962-11fb-47b2-8496-296bef7c1cba 2018-04-13 23:46:26,373 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', 'ea2ed962-11fb-47b2-8496-296bef7c1cba']'. 2018-04-13 23:46:28,137 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-04-13 23:46:28,137 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-04-13 23:46:28,137 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-13 23:46:28,137 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | ea2ed962-11fb-47b2-8496-296bef7c1cba | 2018-04-13 23:46:28,137 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | failed | 2018-04-13 23:46:28,137 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-04-13 23:43:18 | 2018-04-13 23:46:28,137 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-04-13 23:46:26 | 2018-04-13 23:46:28,137 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:03:08 | 2018-04-13 23:46:28,138 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-04-13 23:46:28,138 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-04-13 23:46:28,138 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: 2cd1b16f-2b5b-4209-ba31-084a6c173237) | 2018-04-13 23:46:28,138 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-04-13 23:46:28,138 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 238ac71d-e7df-4dcb-a199-459a12b117e7) | 2018-04-13 23:46:28,138 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 263 | 2018-04-13 23:46:28,138 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 176.802 | 2018-04-13 23:46:28,138 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 129 | 2018-04-13 23:46:28,138 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 39 | 2018-04-13 23:46:28,138 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-04-13 23:46:28,138 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-04-13 23:46:28,138 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 95 | 2018-04-13 23:46:28,138 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-13 23:46:28,138 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-04-13 23:46:28,139 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest patrole success_rate is 57.5892857143% 2018-04-13 23:46:34,670 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-13 23:46:34,670 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | patrole | functest | 03:36 | FAIL | +-------------------+------------------+------------------+----------------+ 2018-04-13 23:46:34,673 - xtesting.ci.run_tests - ERROR - The test case 'patrole' failed. 2018-04-13 23:46:34,673 - xtesting.ci.run_tests - INFO - Running test case 'odl'... 2018-04-13 23:46:57,409 - xtesting.core.robotframework - INFO - ============================================================================== Basic & Neutron ============================================================================== Basic & Neutron.Basic ============================================================================== Basic & Neutron.Basic.Restconf Modules :: Test suite to verify Restconf is OK. ============================================================================== Get Controller Modules :: Get the restconf modules, check 200 stat... | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Basic.Restconf Modules :: Test suite to verify Res... | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Basic & Neutron.Basic | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Basic & Neutron.Neutron :: Test suite for Neutron Plugin ============================================================================== Basic & Neutron.Neutron.Reachability ============================================================================== Get the complete list of networks :: Get the complete list of netw... | PASS | ------------------------------------------------------------------------------ Get the complete list of subnets :: Get the complete list of subnets | PASS | ------------------------------------------------------------------------------ Get the complete list of ports :: Get the complete list of ports | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Reachability | PASS | 3 critical tests, 3 passed, 0 failed 3 tests total, 3 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Networks :: Checking Network created in OpenStack a... ============================================================================== Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS | ------------------------------------------------------------------------------ Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS | ------------------------------------------------------------------------------ Create Network :: Create new network in OpenStack | PASS | ------------------------------------------------------------------------------ Check Network :: Check network created in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Networks :: Checking Network created in Op... | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Subnets :: Checking Subnets created in OpenStack ar... ============================================================================== Check OpenStack Subnets :: Checking OpenStack Neutron for known su... | PASS | ------------------------------------------------------------------------------ Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS | ------------------------------------------------------------------------------ Create New subnet :: Create new subnet in OpenStack | PASS | ------------------------------------------------------------------------------ Check New subnet :: Check new subnet created in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Subnets :: Checking Subnets created in Ope... | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Ports :: Checking Port created in OpenStack are pus... ============================================================================== Check OpenStack ports :: Checking OpenStack Neutron for known ports | PASS | ------------------------------------------------------------------------------ Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS | ------------------------------------------------------------------------------ Create New Port :: Create new port in OpenStack | PASS | ------------------------------------------------------------------------------ Check New Port :: Check new port created in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Ports :: Checking Port created in OpenStac... | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Delete Ports :: Checking Port deleted in OpenStack ... ============================================================================== Delete New Port :: Delete previously created port in OpenStack | PASS | ------------------------------------------------------------------------------ Check Port Deleted :: Check port deleted in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Delete Ports :: Checking Port deleted in O... | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Delete Subnets :: Checking Subnets deleted in OpenS... ============================================================================== Delete New subnet :: Delete previously created subnet in OpenStack | PASS | ------------------------------------------------------------------------------ Check New subnet deleted :: Check subnet deleted in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Delete Subnets :: Checking Subnets deleted... | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Delete Networks :: Checking Network deleted in Open... ============================================================================== Delete Network :: Delete network in OpenStack | PASS | ------------------------------------------------------------------------------ Check Network deleted :: Check network deleted in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Delete Networks :: Checking Network delete... | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Basic & Neutron.Neutron :: Test suite for Neutron Plugin | PASS | 21 critical tests, 21 passed, 0 failed 21 tests total, 21 passed, 0 failed ============================================================================== Basic & Neutron | PASS | 22 critical tests, 22 passed, 0 failed 22 tests total, 22 passed, 0 failed ============================================================================== Output: /home/opnfv/functest/results/odl/output.xml 2018-04-13 23:46:57,410 - xtesting.core.robotframework - INFO - Results were successfully generated 2018-04-13 23:46:57,433 - xtesting.core.robotframework - INFO - Results were successfully parsed 2018-04-13 23:46:58,021 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-13 23:46:58,021 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | odl | functest | 00:22 | PASS | +-------------------+------------------+------------------+----------------+ 2018-04-13 23:46:58,023 - xtesting.ci.run_tests - INFO - Running test case 'snaps_smoke'... 2018-04-13 23:46:59,172 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-04-14 00:36:37,893 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-14 00:36:37,893 - xtesting.ci.run_tests - INFO - Test result: +---------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +---------------------+------------------+------------------+----------------+ | snaps_smoke | functest | 49:38 | PASS | +---------------------+------------------+------------------+----------------+ 2018-04-14 00:36:37,904 - xtesting.ci.run_tests - INFO - Running test case 'neutron_trunk'... 2018-04-14 00:36:37,979 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-14 00:36:45,380 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-04-14 00:36:49,147 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | ca052241-71c9-4ee6-b002-f587291ad2f1 | 2018-04-14T00:36:49.004259 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: ca052241-71c9-4ee6-b002-f587291ad2f1 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-14 00:36:54,593 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+-------------------+-----------+ | Service | Service Type | Status | +-------------+-------------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | nfv-orchestration | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+-------------------+-----------+ 2018-04-14 00:36:54,593 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-04-14 00:36:58,415 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-04-14 00:37:04,032 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide Using verifier 'opnfv-tempest' (UUID=9e64a01b-502f-47e3-a2d1-ac7b1cf791c5) as the default verifier for the future CLI operations. 2018-04-14 00:37:15,922 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-04-14 00:37:23,200 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-04-14 00:37:26,923 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-9e64a01b-502f-47e3-a2d1-ac7b1cf791c5/repo; stestr list 'neutron.tests.tempest.(api|scenario).test_trunk' >/home/opnfv/functest/results/neutron_trunk/test_list.txt 2>/dev/null) 2018-04-14 00:37:26,930 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/neutron_trunk/test_list.txt']'. 2018-04-14 01:39:01,109 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Verification UUID: e223fced-2443-4f29-a0e1-13822f86a3c3 2018-04-14 01:39:01,256 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', 'e223fced-2443-4f29-a0e1-13822f86a3c3']'. 2018-04-14 01:39:03,594 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +----------------------------------------------------------------------------------+ 2018-04-14 01:39:03,594 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-04-14 01:39:03,594 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+------------------------------------------------------------+ 2018-04-14 01:39:03,594 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | e223fced-2443-4f29-a0e1-13822f86a3c3 | 2018-04-14 01:39:03,594 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | failed | 2018-04-14 01:39:03,595 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-04-14 00:37:30 | 2018-04-14 01:39:03,595 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-04-14 01:39:00 | 2018-04-14 01:39:03,595 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 1:01:30 | 2018-04-14 01:39:03,595 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | | 2018-04-14 01:39:03,595 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-04-14 01:39:03,595 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: 9e64a01b-502f-47e3-a2d1-ac7b1cf791c5) | 2018-04-14 01:39:03,595 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-04-14 01:39:03,595 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: ca052241-71c9-4ee6-b002-f587291ad2f1) | 2018-04-14 01:39:03,595 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 2103 | 2018-04-14 01:39:03,595 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 3660.227 | 2018-04-14 01:39:03,595 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 1173 | 2018-04-14 01:39:03,595 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 398 | 2018-04-14 01:39:03,595 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-04-14 01:39:03,595 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-04-14 01:39:03,595 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 401 | 2018-04-14 01:39:03,595 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+------------------------------------------------------------+ 2018-04-14 01:39:03,595 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-04-14 01:39:03,597 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest neutron_trunk success_rate is 68.7976539589% 2018-04-14 01:39:10,464 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-14 01:39:10,465 - xtesting.ci.run_tests - INFO - Test result: +-----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------+------------------+------------------+----------------+ | neutron_trunk | functest | 62:01 | FAIL | +-----------------------+------------------+------------------+----------------+ 2018-04-14 01:39:10,467 - xtesting.ci.run_tests - ERROR - The test case 'neutron_trunk' failed. 2018-04-14 01:39:10,468 - xtesting.ci.run_tests - INFO - Xtesting report: +------------------------------+------------------+---------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +------------------------------+------------------+---------------+------------------+----------------+ | vping_ssh | functest | smoke | 00:60 | PASS | | vping_userdata | functest | smoke | 00:54 | PASS | | tempest_smoke_serial | functest | smoke | 18:13 | FAIL | | rally_sanity | functest | smoke | 27:33 | FAIL | | refstack_defcore | functest | smoke | 00:19 | FAIL | | patrole | functest | smoke | 03:36 | FAIL | | odl | functest | smoke | 00:22 | PASS | | snaps_smoke | functest | smoke | 49:38 | PASS | | neutron_trunk | functest | smoke | 62:01 | FAIL | | odl_netvirt | functest | smoke | 00:00 | SKIP | +------------------------------+------------------+---------------+------------------+----------------+ 2018-04-14 01:39:10,472 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR 2018-04-14 01:40:18,139 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+-----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+-----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-compass-virtual-daily-master-218 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | compass | | DEPLOY_SCENARIO | os-odl-sfc-noha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | huawei-virtual8 | +--------------------------------------+-----------------------------------------------------------+ 2018-04-14 01:40:18,142 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Ansible managed export LC_ALL=C # COMMON CINDER ENVS export CINDER_ENDPOINT_TYPE=publicURL # COMMON NOVA ENVS export NOVA_ENDPOINT_TYPE=publicURL # COMMON OPENSTACK ENVS export OS_ENDPOINT_TYPE=publicURL export OS_INTERFACE=publicURL export OS_USERNAME=admin export OS_PASSWORD='dfa73fabc4c3eb798be92e8f27f884b98e584ea65e9903c640f9e01007d0' export OS_PROJECT_NAME=admin export OS_TENANT_NAME=admin export OS_AUTH_URL=https://192.16.1.222:5000/v3 export OS_NO_CACHE=1 export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_REGION_NAME=RegionOne # For openstackclient export OS_IDENTITY_API_VERSION=3 export OS_AUTH_VERSION=3 export OS_AUTH_TYPE=password export SDN_CONTROLLER_IP=192.16.1.222 export OS_CACERT=/home/opnfv/functest/conf/os_cacert 2018-04-14 01:40:18,142 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-04-14 01:40:18,143 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +------------------+---------------+--------------------------+-------------------------------------------+--------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +------------------+---------------+--------------------------+-------------------------------------------+--------------------------+ | features | 2 | (daily)|(weekly) | Test suites from feature projects | functest-odl-sfc | | | | | integrated in functest | | +------------------+---------------+--------------------------+-------------------------------------------+--------------------------+ 2018-04-14 01:40:18,145 - xtesting.ci.run_tests - INFO - Running tier 'features' 2018-04-14 01:40:18,145 - xtesting.ci.run_tests - INFO - Running test case 'functest-odl-sfc'... 2018-04-14 01:46:51,359 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-14 01:46:51,359 - xtesting.ci.run_tests - INFO - Test result: +--------------------------+-----------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+-----------------+------------------+----------------+ | functest-odl-sfc | sfc | 06:29 | PASS | +--------------------------+-----------------+------------------+----------------+ 2018-04-14 01:46:51,362 - xtesting.ci.run_tests - INFO - Xtesting report: +-----------------------------+------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-----------------------------+------------------------+------------------+------------------+----------------+ | functest-odl-sfc | sfc | features | 06:29 | PASS | | doctor-notification | doctor | features | 00:00 | SKIP | | bgpvpn | sdnvpn | features | 00:00 | SKIP | | barometercollectd | barometer | features | 00:00 | SKIP | | fds | fastdatastacks | features | 00:00 | SKIP | +-----------------------------+------------------------+------------------+------------------+----------------+ 2018-04-14 01:46:51,366 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK