2018-01-31 06:43:19,979 - functest.ci.check_deployment - DEBUG - 172.30.9.30:5000 is reachable! 2018-01-31 06:43:19,979 - functest.ci.check_deployment - INFO - Connectivity to OS_AUTH_URL http://172.30.9.30:5000/v3 ...OK 2018-01-31 06:43:20,436 - functest.ci.check_deployment - INFO - Got token ...OK 2018-01-31 06:43:20,904 - functest.ci.check_deployment - DEBUG - 172.30.9.30:5000 is reachable! 2018-01-31 06:43:20,904 - functest.ci.check_deployment - INFO - Connectivity to the public endpoint http://172.30.9.30:5000 ...OK 2018-01-31 06:43:21,287 - functest.ci.check_deployment - DEBUG - 172.30.9.30:8774 is reachable! 2018-01-31 06:43:21,288 - functest.ci.check_deployment - INFO - Connectivity to endpoint 'compute' http://172.30.9.30:8774/v2.1 ...OK 2018-01-31 06:43:21,671 - functest.ci.check_deployment - DEBUG - 172.30.9.30:9696 is reachable! 2018-01-31 06:43:21,671 - functest.ci.check_deployment - INFO - Connectivity to endpoint 'network' http://172.30.9.30:9696 ...OK 2018-01-31 06:43:22,050 - functest.ci.check_deployment - DEBUG - 172.30.9.30:9292 is reachable! 2018-01-31 06:43:22,051 - functest.ci.check_deployment - INFO - Connectivity to endpoint 'image' http://172.30.9.30:9292 ...OK 2018-01-31 06:43:23,397 - functest.ci.check_deployment - INFO - Nova service ...OK 2018-01-31 06:43:25,128 - functest.ci.check_deployment - INFO - Neutron service ...OK 2018-01-31 06:43:25,150 - functest.ci.check_deployment - INFO - Glance service ...OK 2018-01-31 06:43:27,517 - functest.ci.check_deployment - INFO - External network found: external 2018-01-31 06:43:30,355 - functest.ci.run_tests - DEBUG - Sourcing the OpenStack RC file... 2018-01-31 06:43:30,356 - functest.ci.run_tests - DEBUG - Test args: all 2018-01-31 06:43:30,357 - functest.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ | healthcheck | 0 | (daily)|(weekly) | First tier to be executed to verify the | connection_check api_check | | | | | basic operations in the VIM. | snaps_health_check | +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ 2018-01-31 06:43:30,358 - functest.ci.run_tests - INFO - Running tier 'healthcheck' 2018-01-31 06:43:30,358 - functest.ci.run_tests - INFO - Running test case 'connection_check'... 2018-01-31 06:43:32,920 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-01-31 06:43:42,802 - functest.core.unit - DEBUG - test_glance_connect_fail (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_glance_connect_success (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_keystone_connect_fail (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_keystone_connect_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_neutron_connect_fail (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_neutron_connect_success (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_retrieve_ext_network_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_nova_connect_fail (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_connect_success (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_get_hypervisor_hosts (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_heat_connect_fail (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_heat_connect_success (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_cinder_connect_fail (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok test_cinder_connect_success (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok ---------------------------------------------------------------------- Ran 14 tests in 9.879s OK 2018-01-31 06:43:42,803 - functest.core.testcase - ERROR - Please set env var: 'TEST_DB_URL' 2018-01-31 06:43:42,803 - functest.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | connection_check | functest | 00:10 | PASS | +--------------------------+------------------+------------------+----------------+ 2018-01-31 06:43:42,808 - functest.ci.run_tests - INFO - Running test case 'api_check'... 2018-01-31 06:43:45,171 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-01-31 06:55:06,994 - functest.core.unit - DEBUG - test_create_project_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_user_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_credentials (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_service (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_with_each_interface (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_grant_user_role_to_project (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_admin_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user_2x (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_2x (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_bad_domain (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_update_quotas (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_sec_grp_one_user (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_project_sec_grp_two_users (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_image_minimal_file (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_image_minimal_url (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_network (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_add_interface_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_missing_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip_to_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_network_object (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_simple (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_with_public_interface (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_delete_simple_sec_grp (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_rules (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_one_rule (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_get_sec_grp_by_id (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_floating_ips (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsFloatingIpTests) ... ok test_create_delete_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_key_from_file (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_delete_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_instance (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceTests) ... ok test_add_remove_volume (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_create_clean_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_delete_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_all_settings (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_existing (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_create_stack_x2 (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_get_settings_from_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateComplexStackTests) ... ok test_create_flavor_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsFlavorTests) ... ok test_create_keypair_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsKeypairTests) ... ok test_create_security_group_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsSecurityGroupTests) ... ok test_create_delete_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_back (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_both (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_front (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_delete_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_simple_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_delete_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_simple_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_bad_key_size (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_delete_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_simple_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_all_attrs (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_invalid_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos_and_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok ---------------------------------------------------------------------- Ran 81 tests in 681.814s OK 2018-01-31 06:55:06,995 - functest.core.testcase - ERROR - Please set env var: 'TEST_DB_URL' 2018-01-31 06:55:06,996 - functest.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | api_check | functest | 11:22 | PASS | +-------------------+------------------+------------------+----------------+ 2018-01-31 06:55:07,001 - functest.ci.run_tests - INFO - Running test case 'snaps_health_check'... 2018-01-31 06:55:07,914 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-01-31 06:55:51,993 - functest.core.unit - DEBUG - test_check_vm_ip_dhcp (snaps.openstack.tests.create_instance_tests.SimpleHealthCheck) ... ok ---------------------------------------------------------------------- Ran 1 test in 44.078s OK 2018-01-31 06:55:51,994 - functest.core.testcase - ERROR - Please set env var: 'TEST_DB_URL' 2018-01-31 06:55:51,995 - functest.ci.run_tests - INFO - Test result: +----------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------------+------------------+------------------+----------------+ | snaps_health_check | functest | 00:44 | PASS | +----------------------------+------------------+------------------+----------------+ 2018-01-31 06:55:51,999 - functest.ci.run_tests - INFO - Deployment description: +-------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+----------------------------------------------------------+ | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-ha | | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-730 | | CI_LOOP | daily | +-------------------------+----------------------------------------------------------+ 2018-01-31 06:55:52,002 - functest.ci.run_tests - INFO - FUNCTEST REPORT: +----------------------------+------------------+---------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------------+------------------+---------------------+------------------+----------------+ | connection_check | functest | healthcheck | 00:10 | PASS | | api_check | functest | healthcheck | 11:22 | PASS | | snaps_health_check | functest | healthcheck | 00:44 | PASS | +----------------------------+------------------+---------------------+------------------+----------------+ 2018-01-31 06:55:52,004 - functest.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-01-31 06:56:12,518 - functest.ci.run_tests - DEBUG - Sourcing the OpenStack RC file... 2018-01-31 06:56:12,519 - functest.ci.run_tests - DEBUG - Test args: all 2018-01-31 06:56:12,520 - functest.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+--------------------------+------------------------------------------+---------------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+--------------------------+------------------------------------------+---------------------------------------------+ | smoke | 1 | (daily)|(weekly) | Set of basic Functional tests to | vping_userdata tempest_smoke_serial | | | | | validate the OPNFV scenarios. | rally_sanity refstack_defcore odl | | | | | | snaps_smoke | +---------------+---------------+--------------------------+------------------------------------------+---------------------------------------------+ 2018-01-31 06:56:12,521 - functest.ci.run_tests - INFO - Running tier 'smoke' 2018-01-31 06:56:12,521 - functest.ci.run_tests - INFO - Running test case 'vping_userdata'... 2018-01-31 06:56:12,742 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup 2018-01-31 06:56:12,743 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-01-31 06:56:12' 2018-01-31 06:56:12,743 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--f8573ee4-7ac4-44a8-b423-3940f54060ba' 2018-01-31 06:56:15,019 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-f8573ee4-7ac4-44a8-b423-3940f54060ba' 2018-01-31 06:56:18,549 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-f8573ee4-7ac4-44a8-b423-3940f54060ba' 2018-01-31 06:56:24,764 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-f8573ee4-7ac4-44a8-b423-3940f54060ba' 2018-01-31 06:56:25,504 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-f8573ee4-7ac4-44a8-b423-3940f54060ba' 2018-01-31 06:56:32,565 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-f8573ee4-7ac4-44a8-b423-3940f54060ba' 2018-01-31 06:56:40,313 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution 2018-01-31 06:56:48,685 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping... 2018-01-31 06:56:51,748 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected! 2018-01-31 06:57:10,456 - functest.core.testcase - ERROR - Please set env var: 'TEST_DB_URL' 2018-01-31 06:57:10,457 - functest.ci.run_tests - INFO - Test result: +------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------+------------------+------------------+----------------+ | vping_userdata | functest | 00:39 | PASS | +------------------------+------------------+------------------+----------------+ 2018-01-31 06:57:10,461 - functest.ci.run_tests - INFO - Running test case 'tempest_smoke_serial'... 2018-01-31 06:57:10,662 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-01-31 06:57:13,824 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment create --fromenv --name=opnfv-rally' 2018-01-31 06:57:15,924 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment check' 2018-01-31 06:57:18,989 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-01-31 06:57:20,954 - functest.utils.functest_utils - DEBUG - Executing command: 'rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide' 2018-01-31 06:57:27,645 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-01-31 06:57:30,446 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating image for Tempest suite 2018-01-31 06:57:30,447 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating image for Tempest suite 2018-01-31 06:57:34,094 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Configuring the verifier... 2018-01-31 06:57:34,094 - functest.utils.functest_utils - DEBUG - Executing command: 'rally verify configure-verifier' 2018-01-31 06:57:37,012 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-01-31 06:57:37,012 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-01-31 06:57:37,014 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-01-31 06:57:37,026 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-01-31 06:57:37,026 - functest.utils.functest_utils - DEBUG - Executing command: 'cd /root/.rally/verification/verifier-b7414ea0-1647-4f4e-91cb-44bc506ab3cd/repo;testr list-tests smoke > /home/opnfv/functest/results/tempest/test_raw_list.txt;cd -;' 2018-01-31 06:57:39,183 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Applying tempest blacklist... 2018-01-31 06:57:39,190 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Tempest blacklist file does not exist. 2018-01-31 06:57:39,191 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: 'rally verify start --concurrency 1 --load-list /home/opnfv/functest/results/tempest/test_list.txt --detailed'. 2018-01-31 06:57:41,135 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 06:57:41.134 58 INFO rally.api [-] Starting verification (UUID=e0fdab95-6618-4358-9bec-d3dd6bbd310f) for deployment 'opnfv-rally' (UUID=bab786e9-f738-47d7-b9fd-f62ffc51cf71) by verifier 'opnfv-tempest' (UUID=b7414ea0-1647-4f4e-91cb-44bc506ab3cd). 2018-01-31 06:57:41,136 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: e0fdab95-6618-4358-9bec-d3dd6bbd310f 2018-01-31 06:57:47,751 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 06:57:47.751 58 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor ... success [0.186s] 2018-01-31 06:57:47,815 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 06:57:47.815 58 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.064s] 2018-01-31 06:57:54,862 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 06:57:54.861 58 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create ... success [1.658s] 2018-01-31 06:57:58,383 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 06:57:58.383 58 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list ... success [3.521s] 2018-01-31 06:58:12,516 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 06:58:12.516 58 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete ... success [6.827s] 2018-01-31 06:58:29,671 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 06:58:29.671 58 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip ... success [10.073s] 2018-01-31 06:59:05,726 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 06:59:05.725 58 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers ... success [0.067s] 2018-01-31 06:59:05,728 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 06:59:05.727 58 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details ... success [0.002s] 2018-01-31 06:59:39,334 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 06:59:39.334 58 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.069s] 2018-01-31 06:59:39,336 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 06:59:39.335 58 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.002s] 2018-01-31 07:00:11,289 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:00:11.289 58 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.068s] 2018-01-31 07:00:11,291 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:00:11.290 58 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.002s] 2018-01-31 07:00:54,002 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:00:54.002 58 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [12.036s] 2018-01-31 07:01:18,156 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:01:18.155 58 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses ... success [0.056s] 2018-01-31 07:01:18,266 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:01:18.265 58 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network ... success [0.110s] 2018-01-31 07:01:26,763 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:01:26.763 58 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_get_version_details ... success [0.694s] 2018-01-31 07:01:26,772 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:01:26.772 58 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.010s] 2018-01-31 07:01:28,265 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:01:28.264 58 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_services.ServicesTestJSON ... skip: Identity api v2 is not enabled 2018-01-31 07:01:28,266 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:01:28.266 58 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_users.UsersTestJSON ... skip: Identity api v2 is not enabled 2018-01-31 07:01:32,534 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:01:32.534 58 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete ... success [0.404s] 2018-01-31 07:01:39,121 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:01:39.120 58 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists ... success [0.086s] 2018-01-31 07:01:45,745 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:01:45.745 58 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain ... success [0.706s] 2018-01-31 07:01:54,072 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:01:54.072 58 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint ... success [0.453s] 2018-01-31 07:02:03,642 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:02:03.641 58 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete ... success [3.387s] 2018-01-31 07:02:10,202 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:02:10.202 58 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy ... success [0.375s] 2018-01-31 07:02:16,557 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:02:16.556 58 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id ... success [0.225s] 2018-01-31 07:02:24,577 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:02:24.576 58 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list ... success [0.389s] 2018-01-31 07:02:32,122 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:02:32.121 58 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service ... success [0.463s] 2018-01-31 07:02:41,029 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:02:41.028 58 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all ... success [2.984s] 2018-01-31 07:02:43,378 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:02:43.378 58 INFO opnfv-tempest [-] {0} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery ... skip: Identity api v2 is not enabled 2018-01-31 07:02:45,320 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:02:45.319 58 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.085s] 2018-01-31 07:02:45,395 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:02:45.395 58 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.075s] 2018-01-31 07:02:45,469 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:02:45.469 58 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.073s] 2018-01-31 07:02:45,476 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:02:45.476 58 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions ... success [0.007s] 2018-01-31 07:02:49,709 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:02:49.709 58 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.821s] 2018-01-31 07:02:51,508 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:02:51.508 58 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file ... success [1.798s] 2018-01-31 07:02:53,456 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:02:53.456 58 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [1.947s] 2018-01-31 07:02:59,771 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:02:59.770 58 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_versions.VersionsTest.test_list_versions ... success [0.006s] 2018-01-31 07:03:07,814 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:03:07.814 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions ... success [4.174s] 2018-01-31 07:03:20,458 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:03:20.457 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address ... success [2.721s] 2018-01-31 07:03:24,296 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:03:24.295 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip ... success [3.838s] 2018-01-31 07:03:35,583 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:03:35.583 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network ... success [3.079s] 2018-01-31 07:03:39,670 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:03:39.669 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port ... success [4.085s] 2018-01-31 07:03:48,477 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:03:48.477 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet ... success [8.807s] 2018-01-31 07:03:58,458 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:03:58.457 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network ... success [3.021s] 2018-01-31 07:04:02,132 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:04:02.132 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port ... success [3.673s] 2018-01-31 07:04:09,110 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:04:09.109 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet ... success [6.977s] 2018-01-31 07:04:26,168 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:04:26.168 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet ... success [7.088s] 2018-01-31 07:04:26,627 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:04:26.627 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility ... success [0.459s] 2018-01-31 07:04:26,778 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:04:26.778 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks ... success [0.150s] 2018-01-31 07:04:26,996 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:04:26.995 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets ... success [0.217s] 2018-01-31 07:04:27,256 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:04:27.256 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network ... success [0.259s] 2018-01-31 07:04:27,470 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:04:27.470 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet ... success [0.214s] 2018-01-31 07:04:44,321 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:04:44.321 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [7.484s] 2018-01-31 07:04:44,640 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:04:44.639 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.318s] 2018-01-31 07:04:44,771 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:04:44.771 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.131s] 2018-01-31 07:04:44,978 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:04:44.978 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.206s] 2018-01-31 07:04:45,103 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:04:45.103 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.124s] 2018-01-31 07:04:45,316 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:04:45.316 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.213s] 2018-01-31 07:04:59,799 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:04:59.799 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools ... success [5.380s] 2018-01-31 07:05:06,909 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:05:06.908 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups ... success [7.110s] 2018-01-31 07:05:08,532 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:05:08.532 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port ... success [1.623s] 2018-01-31 07:05:08,823 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:05:08.823 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports ... success [0.291s] 2018-01-31 07:05:08,892 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:05:08.892 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port ... success [0.069s] 2018-01-31 07:05:21,276 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:05:21.275 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [5.004s] 2018-01-31 07:05:28,048 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:05:28.047 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups ... success [6.772s] 2018-01-31 07:05:30,149 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:05:30.148 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [2.099s] 2018-01-31 07:05:30,382 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:05:30.382 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.234s] 2018-01-31 07:05:30,607 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:05:30.607 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.224s] 2018-01-31 07:05:46,514 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:05:46.514 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces ... success [10.519s] 2018-01-31 07:05:52,152 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:05:52.151 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id ... success [5.636s] 2018-01-31 07:05:57,448 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:05:57.448 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id ... success [5.297s] 2018-01-31 07:06:00,245 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:06:00.244 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router ... success [2.795s] 2018-01-31 07:06:26,912 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:06:26.911 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [10.143s] 2018-01-31 07:06:32,498 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:06:32.497 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [5.585s] 2018-01-31 07:06:36,879 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:06:36.879 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [4.381s] 2018-01-31 07:06:39,786 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:06:39.786 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [2.907s] 2018-01-31 07:06:57,532 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:06:57.532 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group ... success [1.398s] 2018-01-31 07:07:00,017 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:07:00.017 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule ... success [2.481s] 2018-01-31 07:07:00,217 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:07:00.217 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups ... success [0.202s] 2018-01-31 07:07:05,419 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:07:05.418 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.741s] 2018-01-31 07:07:08,112 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:07:08.112 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [2.691s] 2018-01-31 07:07:08,306 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:07:08.305 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.196s] 2018-01-31 07:07:12,861 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:07:12.861 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.365s] 2018-01-31 07:07:16,427 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:07:16.426 58 INFO opnfv-tempest [-] {0} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.007s] 2018-01-31 07:07:18,009 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:07:18.009 58 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest ... skip: AccountQuotasTest skipped as swift is not available 2018-01-31 07:07:18,011 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:07:18.011 58 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_services.AccountTest ... skip: AccountTest skipped as swift is not available 2018-01-31 07:07:18,013 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:07:18.013 58 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest ... skip: ContainerQuotasTest skipped as swift is not available 2018-01-31 07:07:18,014 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:07:18.014 58 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest ... skip: ContainerTest skipped as swift is not available 2018-01-31 07:07:18,015 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:07:18.015 58 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_object_services.ObjectTest ... skip: ObjectTest skipped as swift is not available 2018-01-31 07:07:19,951 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:07:19.950 58 INFO opnfv-tempest [-] {0} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.023s] 2018-01-31 07:07:34,806 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:07:34.805 58 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_attach_detach_volume_to_instance ... success [10.115s] 2018-01-31 07:07:50,017 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:07:50.017 58 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [9.715s] 2018-01-31 07:08:03,417 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:08:03.416 58 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [13.394s] 2018-01-31 07:08:14,448 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:08:14.447 58 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.042s] 2018-01-31 07:09:18,967 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:09:18.966 58 INFO opnfv-tempest [-] {0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops ... success [57.898s] 2018-01-31 07:09:56,038 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:09:56.038 58 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops ... success [27.026s] 2018-01-31 07:10:41,834 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-01-31 07:10:41.834 58 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_multinode.TestServerMultinode.test_schedule_to_all_nodes ... success [25.477s] 2018-01-31 07:10:59,350 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: 'rally verify show --uuid e0fdab95-6618-4358-9bec-d3dd6bbd310f'. 2018-01-31 07:11:00,158 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-01-31 07:11:00,158 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-01-31 07:11:00,158 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-01-31 07:11:00,158 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | e0fdab95-6618-4358-9bec-d3dd6bbd310f | 2018-01-31 07:11:00,158 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | finished | 2018-01-31 07:11:00,158 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-01-31 06:57:41 | 2018-01-31 07:11:00,158 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-01-31 07:10:59 | 2018-01-31 07:11:00,158 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:13:18 | 2018-01-31 07:11:00,159 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | concurrency: 1 | 2018-01-31 07:11:00,159 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | | load_list: (value is too long, use 'detailed' flag to display it) | 2018-01-31 07:11:00,159 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-01-31 07:11:00,159 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: b7414ea0-1647-4f4e-91cb-44bc506ab3cd) | 2018-01-31 07:11:00,159 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-01-31 07:11:00,159 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: bab786e9-f738-47d7-b9fd-f62ffc51cf71) | 2018-01-31 07:11:00,159 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 109 | 2018-01-31 07:11:00,159 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 776.285 | 2018-01-31 07:11:00,159 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 90 | 2018-01-31 07:11:00,159 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 19 | 2018-01-31 07:11:00,159 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-01-31 07:11:00,159 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-01-31 07:11:00,159 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 0 | 2018-01-31 07:11:00,159 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-01-31 07:11:00,159 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-01-31 07:11:00,211 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest tempest_smoke_serial success_rate is 100.0% 2018-01-31 07:11:05,595 - functest.core.testcase - ERROR - Please set env var: 'TEST_DB_URL' 2018-01-31 07:11:05,595 - functest.ci.run_tests - INFO - Test result: +------------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------------+------------------+------------------+----------------+ | tempest_smoke_serial | functest | 13:38 | PASS | +------------------------------+------------------+------------------+----------------+ 2018-01-31 07:11:05,599 - functest.ci.run_tests - INFO - Running test case 'rally_sanity'... 2018-01-31 07:11:06,211 - functest.energy.energy - INFO - API recorder available at : http://energy.opnfv.fr/resources/recorders/environment/lf-pod1 2018-01-31 07:11:06,211 - functest.energy.energy - DEBUG - Getting current scenario 2018-01-31 07:11:06,680 - functest.energy.energy - DEBUG - Starting recording 2018-01-31 07:11:06,680 - functest.energy.energy - DEBUG - Submitting scenario (rally_sanity/running) 2018-01-31 07:11:07,099 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-01-31 07:11:09,459 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment create --fromenv --name=opnfv-rally' 2018-01-31 07:11:11,743 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment check' 2018-01-31 07:11:14,950 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating the test name... 2018-01-31 07:11:16,541 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating image 'Cirros-0.4.0-38daf994-9497-466a-b7ca-d5257f7dee79'... 2018-01-31 07:11:19,493 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating network 'rally-net-38daf994-9497-466a-b7ca-d5257f7dee79'... 2018-01-31 07:11:22,002 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating router 'rally-router-38daf994-9497-466a-b7ca-d5257f7dee79'... 2018-01-31 07:11:27,106 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-tiny-38daf994-9497-466a-b7ca-d5257f7dee79'... 2018-01-31 07:11:27,737 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-mini-38daf994-9497-466a-b7ca-d5257f7dee79'... 2018-01-31 07:11:28,454 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2018-01-31 07:11:28,455 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-authenticate.yaml 2018-01-31 07:11:28,456 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-01-31 07:11:28,501 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-01-31 07:11:28,513 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['authenticate'], 'concurrency': 4, 'netid': 'ddc366a2-a3c1-47dd-86d0-aa44751f9661', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-38daf994-9497-466a-b7ca-d5257f7dee79', 'flavor_name': 'rally-tiny-38daf994-9497-466a-b7ca-d5257f7dee79', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-38daf994-9497-466a-b7ca-d5257f7dee79', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-01-31 07:12:35,044 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 0afa8a93-4e07-4546-9f04-cd983c122a5f 2018-01-31 07:12:35,045 - functest.opnfv_tests.openstack.rally.rally - DEBUG - /home/opnfv/functest/results/rally does not exist, we create it. 2018-01-31 07:12:35,046 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '0afa8a93-4e07-4546-9f04-cd983c122a5f'] 2018-01-31 07:12:35,942 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 0afa8a93-4e07-4546-9f04-cd983c122a5f: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 0afa8a93-4e07-4546-9f04-cd983c122a5f has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.487 | 0.487 | 0.487 | 0.487 | 0.487 | 0.487 | 100.0% | 1 | | total | 0.487 | 0.487 | 0.487 | 0.487 | 0.487 | 0.487 | 100.0% | 1 | | -> duration | 0.487 | 0.487 | 0.487 | 0.487 | 0.487 | 0.487 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.487224 Full duration: 7.330819 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 0afa8a93-4e07-4546-9f04-cd983c122a5f has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.366 | 0.366 | 0.366 | 0.366 | 0.366 | 0.366 | 100.0% | 1 | | total | 0.803 | 0.803 | 0.803 | 0.803 | 0.803 | 0.803 | 100.0% | 1 | | -> duration | 0.803 | 0.803 | 0.803 | 0.803 | 0.803 | 0.803 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.802574 Full duration: 7.689337 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 0afa8a93-4e07-4546-9f04-cd983c122a5f has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.544 | 0.544 | 0.544 | 0.544 | 0.544 | 0.544 | 100.0% | 1 | | total | 0.979 | 0.979 | 0.979 | 0.979 | 0.979 | 0.979 | 100.0% | 1 | | -> duration | 0.979 | 0.979 | 0.979 | 0.979 | 0.979 | 0.979 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.979344 Full duration: 8.107394 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 0afa8a93-4e07-4546-9f04-cd983c122a5f has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.416 | 0.416 | 0.416 | 0.416 | 0.416 | 0.416 | 100.0% | 1 | | total | 0.836 | 0.836 | 0.836 | 0.836 | 0.836 | 0.836 | 100.0% | 1 | | -> duration | 0.836 | 0.836 | 0.836 | 0.836 | 0.836 | 0.836 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.835783 Full duration: 8.233284 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 0afa8a93-4e07-4546-9f04-cd983c122a5f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.55 | 0.55 | 0.55 | 0.55 | 0.55 | 0.55 | 100.0% | 1 | | total | 0.955 | 0.955 | 0.955 | 0.955 | 0.955 | 0.955 | 100.0% | 1 | | -> duration | 0.955 | 0.955 | 0.955 | 0.955 | 0.955 | 0.955 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.954574 Full duration: 8.297503 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 0afa8a93-4e07-4546-9f04-cd983c122a5f has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.224 | 0.224 | 0.224 | 0.224 | 0.224 | 0.224 | 100.0% | 1 | | total | 0.685 | 0.685 | 0.685 | 0.685 | 0.685 | 0.685 | 100.0% | 1 | | -> duration | 0.685 | 0.685 | 0.685 | 0.685 | 0.685 | 0.685 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.684833 Full duration: 7.961477 HINTS: * To plot HTML graphics with this data, run: rally task report 0afa8a93-4e07-4546-9f04-cd983c122a5f --out output.html * To generate a JUnit report, run: rally task export 0afa8a93-4e07-4546-9f04-cd983c122a5f --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 0afa8a93-4e07-4546-9f04-cd983c122a5f --json --out output.json 2018-01-31 07:12:35,943 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '0afa8a93-4e07-4546-9f04-cd983c122a5f'] 2018-01-31 07:12:36,903 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-01-31 07:12:36,903 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '0afa8a93-4e07-4546-9f04-cd983c122a5f', '--out', '/home/opnfv/functest/results/rally/opnfv-authenticate.html'] 2018-01-31 07:12:36,911 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2018-01-31 07:12:36,911 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2018-01-31 07:12:36,912 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-glance.yaml 2018-01-31 07:12:36,912 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-01-31 07:12:36,951 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-01-31 07:12:36,953 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['glance'], 'concurrency': 4, 'netid': 'ddc366a2-a3c1-47dd-86d0-aa44751f9661', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-38daf994-9497-466a-b7ca-d5257f7dee79', 'flavor_name': 'rally-tiny-38daf994-9497-466a-b7ca-d5257f7dee79', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-38daf994-9497-466a-b7ca-d5257f7dee79', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-01-31 07:14:15,104 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 18b1bb77-53dd-4d6a-b053-50b7410d24fa 2018-01-31 07:14:15,104 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '18b1bb77-53dd-4d6a-b053-50b7410d24fa'] 2018-01-31 07:14:15,988 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 18b1bb77-53dd-4d6a-b053-50b7410d24fa: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 18b1bb77-53dd-4d6a-b053-50b7410d24fa has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.283 | 4.283 | 4.283 | 4.283 | 4.283 | 4.283 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.355 | 0.355 | 0.355 | 0.355 | 0.355 | 0.355 | 100.0% | 1 | | -> glance_v2.upload_data | 1.45 | 1.45 | 1.45 | 1.45 | 1.45 | 1.45 | 100.0% | 1 | | glance_v2.delete_image | 1.269 | 1.269 | 1.269 | 1.269 | 1.269 | 1.269 | 100.0% | 1 | | total | 5.552 | 5.552 | 5.552 | 5.552 | 5.552 | 5.552 | 100.0% | 1 | | -> duration | 5.552 | 5.552 | 5.552 | 5.552 | 5.552 | 5.552 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.552133 Full duration: 14.396877 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 18b1bb77-53dd-4d6a-b053-50b7410d24fa has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.3 | 4.3 | 4.3 | 4.3 | 4.3 | 4.3 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.537 | 0.537 | 0.537 | 0.537 | 0.537 | 0.537 | 100.0% | 1 | | -> glance_v2.upload_data | 1.319 | 1.319 | 1.319 | 1.319 | 1.319 | 1.319 | 100.0% | 1 | | glance_v2.list_images | 0.198 | 0.198 | 0.198 | 0.198 | 0.198 | 0.198 | 100.0% | 1 | | total | 4.499 | 4.499 | 4.499 | 4.499 | 4.499 | 4.499 | 100.0% | 1 | | -> duration | 4.499 | 4.499 | 4.499 | 4.499 | 4.499 | 4.499 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.498976 Full duration: 17.067144 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 18b1bb77-53dd-4d6a-b053-50b7410d24fa has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.366 | 0.366 | 0.366 | 0.366 | 0.366 | 0.366 | 100.0% | 1 | | total | 0.367 | 0.367 | 0.367 | 0.367 | 0.367 | 0.367 | 100.0% | 1 | | -> duration | 0.367 | 0.367 | 0.367 | 0.367 | 0.367 | 0.367 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.366686 Full duration: 8.093734 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally-tiny-38daf994-9497-466a-b7ca-d5257f7dee79" }, "number_instances": 2, "nics": [ { "net-id": "ddc366a2-a3c1-47dd-86d0-aa44751f9661" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } } } -------------------------------------------------------------------------------- Task 18b1bb77-53dd-4d6a-b053-50b7410d24fa has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.227 | 4.227 | 4.227 | 4.227 | 4.227 | 4.227 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.351 | 0.351 | 0.351 | 0.351 | 0.351 | 0.351 | 100.0% | 1 | | -> glance_v2.upload_data | 1.468 | 1.468 | 1.468 | 1.468 | 1.468 | 1.468 | 100.0% | 1 | | nova.boot_servers | 11.391 | 11.391 | 11.391 | 11.391 | 11.391 | 11.391 | 100.0% | 1 | | total | 15.619 | 15.619 | 15.619 | 15.619 | 15.619 | 15.619 | 100.0% | 1 | | -> duration | 14.619 | 14.619 | 14.619 | 14.619 | 14.619 | 14.619 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.619056 Full duration: 38.623988 HINTS: * To plot HTML graphics with this data, run: rally task report 18b1bb77-53dd-4d6a-b053-50b7410d24fa --out output.html * To generate a JUnit report, run: rally task export 18b1bb77-53dd-4d6a-b053-50b7410d24fa --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 18b1bb77-53dd-4d6a-b053-50b7410d24fa --json --out output.json 2018-01-31 07:14:15,989 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '18b1bb77-53dd-4d6a-b053-50b7410d24fa'] 2018-01-31 07:14:16,962 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-01-31 07:14:16,962 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '18b1bb77-53dd-4d6a-b053-50b7410d24fa', '--out', '/home/opnfv/functest/results/rally/opnfv-glance.html'] 2018-01-31 07:14:16,969 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2018-01-31 07:14:16,969 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "ceilometer" ... 2018-01-31 07:14:16,970 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-ceilometer.yaml 2018-01-31 07:14:16,970 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-01-31 07:14:17,008 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-01-31 07:14:17,019 - functest.opnfv_tests.openstack.rally.rally - INFO - No tests for scenario "ceilometer" 2018-01-31 07:14:17,019 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2018-01-31 07:14:17,019 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-cinder.yaml 2018-01-31 07:14:17,019 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-01-31 07:14:17,053 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-01-31 07:14:17,061 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['cinder'], 'concurrency': 4, 'netid': 'ddc366a2-a3c1-47dd-86d0-aa44751f9661', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-38daf994-9497-466a-b7ca-d5257f7dee79', 'flavor_name': 'rally-tiny-38daf994-9497-466a-b7ca-d5257f7dee79', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-38daf994-9497-466a-b7ca-d5257f7dee79', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-01-31 07:17:38,468 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : cce02b19-66c3-4b5a-aebe-c12df9885fe3 2018-01-31 07:17:38,468 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'cce02b19-66c3-4b5a-aebe-c12df9885fe3'] 2018-01-31 07:17:39,430 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task cce02b19-66c3-4b5a-aebe-c12df9885fe3: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "force": false }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task cce02b19-66c3-4b5a-aebe-c12df9885fe3 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_snapshot | 3.242 | 3.242 | 3.242 | 3.242 | 3.242 | 3.242 | 100.0% | 1 | | cinder_v2.delete_snapshot | 2.779 | 2.779 | 2.779 | 2.779 | 2.779 | 2.779 | 100.0% | 1 | | total | 6.021 | 6.021 | 6.021 | 6.021 | 6.021 | 6.021 | 100.0% | 1 | | -> duration | 6.021 | 6.021 | 6.021 | 6.021 | 6.021 | 6.021 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.021281 Full duration: 23.6347 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": { "max": 1, "min": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task cce02b19-66c3-4b5a-aebe-c12df9885fe3 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.125 | 3.125 | 3.125 | 3.125 | 3.125 | 3.125 | 100.0% | 1 | | cinder_v2.delete_volume | 2.489 | 2.489 | 2.489 | 2.489 | 2.489 | 2.489 | 100.0% | 1 | | total | 5.614 | 5.614 | 5.614 | 5.614 | 5.614 | 5.614 | 100.0% | 1 | | -> duration | 5.614 | 5.614 | 5.614 | 5.614 | 5.614 | 5.614 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.614094 Full duration: 15.865486 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "image": { "name": "Cirros-0.4.0-38daf994-9497-466a-b7ca-d5257f7dee79" }, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task cce02b19-66c3-4b5a-aebe-c12df9885fe3 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 9.03 | 9.03 | 9.03 | 9.03 | 9.03 | 9.03 | 100.0% | 1 | | cinder_v2.delete_volume | 2.483 | 2.483 | 2.483 | 2.483 | 2.483 | 2.483 | 100.0% | 1 | | total | 11.513 | 11.513 | 11.513 | 11.513 | 11.513 | 11.513 | 100.0% | 1 | | -> duration | 11.513 | 11.513 | 11.513 | 11.513 | 11.513 | 11.513 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.512552 Full duration: 22.551449 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task cce02b19-66c3-4b5a-aebe-c12df9885fe3 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.684 | 3.684 | 3.684 | 3.684 | 3.684 | 3.684 | 100.0% | 1 | | cinder_v2.delete_volume | 3.121 | 3.121 | 3.121 | 3.121 | 3.121 | 3.121 | 100.0% | 1 | | total | 6.805 | 6.805 | 6.805 | 6.805 | 6.805 | 6.805 | 100.0% | 1 | | -> duration | 6.805 | 6.805 | 6.805 | 6.805 | 6.805 | 6.805 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.804805 Full duration: 17.124233 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "new_size": 2, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task cce02b19-66c3-4b5a-aebe-c12df9885fe3 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.159 | 3.159 | 3.159 | 3.159 | 3.159 | 3.159 | 100.0% | 1 | | cinder_v2.extend_volume | 2.721 | 2.721 | 2.721 | 2.721 | 2.721 | 2.721 | 100.0% | 1 | | cinder_v2.delete_volume | 2.598 | 2.598 | 2.598 | 2.598 | 2.598 | 2.598 | 100.0% | 1 | | total | 8.478 | 8.478 | 8.478 | 8.478 | 8.478 | 8.478 | 100.0% | 1 | | -> duration | 8.478 | 8.478 | 8.478 | 8.478 | 8.478 | 8.478 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.478428 Full duration: 19.539991 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task cce02b19-66c3-4b5a-aebe-c12df9885fe3 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.218 | 3.218 | 3.218 | 3.218 | 3.218 | 3.218 | 100.0% | 1 | | cinder_v2.delete_volume | 2.473 | 2.473 | 2.473 | 2.473 | 2.473 | 2.473 | 100.0% | 1 | | total | 5.692 | 5.692 | 5.692 | 5.692 | 5.692 | 5.692 | 100.0% | 1 | | -> duration | 5.692 | 5.692 | 5.692 | 5.692 | 5.692 | 5.692 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.691829 Full duration: 22.740766 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task cce02b19-66c3-4b5a-aebe-c12df9885fe3 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 0.649 | 0.649 | 0.649 | 0.649 | 0.649 | 0.649 | 100.0% | 1 | | cinder_v2.list_qos | 0.177 | 0.177 | 0.177 | 0.177 | 0.177 | 0.177 | 100.0% | 1 | | total | 0.826 | 0.826 | 0.826 | 0.826 | 0.826 | 0.826 | 100.0% | 1 | | -> duration | 0.826 | 0.826 | 0.826 | 0.826 | 0.826 | 0.826 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.826498 Full duration: 12.711532 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task cce02b19-66c3-4b5a-aebe-c12df9885fe3 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 0.592 | 0.592 | 0.592 | 0.592 | 0.592 | 0.592 | 100.0% | 1 | | cinder_v2.set_qos | 0.197 | 0.197 | 0.197 | 0.197 | 0.197 | 0.197 | 100.0% | 1 | | total | 0.79 | 0.79 | 0.79 | 0.79 | 0.79 | 0.79 | 100.0% | 1 | | -> duration | 0.79 | 0.79 | 0.79 | 0.79 | 0.79 | 0.79 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.789634 Full duration: 12.546139 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "description": "rally tests creating types" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task cce02b19-66c3-4b5a-aebe-c12df9885fe3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.617 | 0.617 | 0.617 | 0.617 | 0.617 | 0.617 | 100.0% | 1 | | cinder_v2.list_types | 0.178 | 0.178 | 0.178 | 0.178 | 0.178 | 0.178 | 100.0% | 1 | | total | 0.796 | 0.796 | 0.796 | 0.796 | 0.796 | 0.796 | 100.0% | 1 | | -> duration | 0.796 | 0.796 | 0.796 | 0.796 | 0.796 | 0.796 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.79561 Full duration: 12.789729 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task cce02b19-66c3-4b5a-aebe-c12df9885fe3 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.764 | 0.764 | 0.764 | 0.764 | 0.764 | 0.764 | 100.0% | 1 | | cinder_v2.create_encryption_type | 0.379 | 0.379 | 0.379 | 0.379 | 0.379 | 0.379 | 100.0% | 1 | | total | 1.143 | 1.143 | 1.143 | 1.143 | 1.143 | 1.143 | 100.0% | 1 | | -> duration | 1.143 | 1.143 | 1.143 | 1.143 | 1.143 | 1.143 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.143107 Full duration: 13.299953 HINTS: * To plot HTML graphics with this data, run: rally task report cce02b19-66c3-4b5a-aebe-c12df9885fe3 --out output.html * To generate a JUnit report, run: rally task export cce02b19-66c3-4b5a-aebe-c12df9885fe3 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report cce02b19-66c3-4b5a-aebe-c12df9885fe3 --json --out output.json 2018-01-31 07:17:39,431 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'cce02b19-66c3-4b5a-aebe-c12df9885fe3'] 2018-01-31 07:17:40,395 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-01-31 07:17:40,395 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'cce02b19-66c3-4b5a-aebe-c12df9885fe3', '--out', '/home/opnfv/functest/results/rally/opnfv-cinder.html'] 2018-01-31 07:17:40,400 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2018-01-31 07:17:40,400 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2018-01-31 07:17:40,401 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-heat.yaml 2018-01-31 07:17:40,401 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-01-31 07:17:40,434 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-01-31 07:17:40,442 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['heat'], 'concurrency': 4, 'netid': 'ddc366a2-a3c1-47dd-86d0-aa44751f9661', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-38daf994-9497-466a-b7ca-d5257f7dee79', 'flavor_name': 'rally-tiny-38daf994-9497-466a-b7ca-d5257f7dee79', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-38daf994-9497-466a-b7ca-d5257f7dee79', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-01-31 07:19:03,845 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : a465972e-425f-4a26-8619-7f010c1de4b5 2018-01-31 07:19:03,846 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'a465972e-425f-4a26-8619-7f010c1de4b5'] 2018-01-31 07:19:04,776 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task a465972e-425f-4a26-8619-7f010c1de4b5: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task a465972e-425f-4a26-8619-7f010c1de4b5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.713 | 4.713 | 4.713 | 4.713 | 4.713 | 4.713 | 100.0% | 1 | | heat.update_stack | 3.096 | 3.096 | 3.096 | 3.096 | 3.096 | 3.096 | 100.0% | 1 | | heat.delete_stack | 2.702 | 2.702 | 2.702 | 2.702 | 2.702 | 2.702 | 100.0% | 1 | | total | 10.511 | 10.511 | 10.511 | 10.511 | 10.511 | 10.511 | 100.0% | 1 | | -> duration | 6.511 | 6.511 | 6.511 | 6.511 | 6.511 | 6.511 | 100.0% | 1 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.511297 Full duration: 19.489135 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task a465972e-425f-4a26-8619-7f010c1de4b5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.56 | 4.56 | 4.56 | 4.56 | 4.56 | 4.56 | 100.0% | 1 | | heat.check_stack | 0.734 | 0.734 | 0.734 | 0.734 | 0.734 | 0.734 | 100.0% | 1 | | heat.delete_stack | 2.246 | 2.246 | 2.246 | 2.246 | 2.246 | 2.246 | 100.0% | 1 | | total | 7.54 | 7.54 | 7.54 | 7.54 | 7.54 | 7.54 | 100.0% | 1 | | -> duration | 5.54 | 5.54 | 5.54 | 5.54 | 5.54 | 5.54 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.539708 Full duration: 16.210101 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task a465972e-425f-4a26-8619-7f010c1de4b5 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.752 | 4.752 | 4.752 | 4.752 | 4.752 | 4.752 | 100.0% | 1 | | heat.suspend_stack | 0.677 | 0.677 | 0.677 | 0.677 | 0.677 | 0.677 | 100.0% | 1 | | heat.resume_stack | 1.71 | 1.71 | 1.71 | 1.71 | 1.71 | 1.71 | 100.0% | 1 | | heat.delete_stack | 2.462 | 2.462 | 2.462 | 2.462 | 2.462 | 2.462 | 100.0% | 1 | | total | 9.6 | 9.6 | 9.6 | 9.6 | 9.6 | 9.6 | 100.0% | 1 | | -> duration | 7.6 | 7.6 | 7.6 | 7.6 | 7.6 | 7.6 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.600294 Full duration: 18.284192 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task a465972e-425f-4a26-8619-7f010c1de4b5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.599 | 0.599 | 0.599 | 0.599 | 0.599 | 0.599 | 100.0% | 1 | | total | 0.599 | 0.599 | 0.599 | 0.599 | 0.599 | 0.599 | 100.0% | 1 | | -> duration | 0.599 | 0.599 | 0.599 | 0.599 | 0.599 | 0.599 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.599388 Full duration: 8.741913 HINTS: * To plot HTML graphics with this data, run: rally task report a465972e-425f-4a26-8619-7f010c1de4b5 --out output.html * To generate a JUnit report, run: rally task export a465972e-425f-4a26-8619-7f010c1de4b5 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report a465972e-425f-4a26-8619-7f010c1de4b5 --json --out output.json 2018-01-31 07:19:04,777 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'a465972e-425f-4a26-8619-7f010c1de4b5'] 2018-01-31 07:19:05,585 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-01-31 07:19:05,585 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'a465972e-425f-4a26-8619-7f010c1de4b5', '--out', '/home/opnfv/functest/results/rally/opnfv-heat.html'] 2018-01-31 07:19:05,591 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2018-01-31 07:19:05,592 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2018-01-31 07:19:05,592 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-keystone.yaml 2018-01-31 07:19:05,592 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-01-31 07:19:05,629 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-01-31 07:19:05,644 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['keystone'], 'concurrency': 4, 'netid': 'ddc366a2-a3c1-47dd-86d0-aa44751f9661', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-38daf994-9497-466a-b7ca-d5257f7dee79', 'flavor_name': 'rally-tiny-38daf994-9497-466a-b7ca-d5257f7dee79', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-38daf994-9497-466a-b7ca-d5257f7dee79', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-01-31 07:22:24,500 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : ee4812f2-8dbe-4ecb-bc39-fdf0de80ca9e 2018-01-31 07:22:24,500 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'ee4812f2-8dbe-4ecb-bc39-fdf0de80ca9e'] 2018-01-31 07:22:25,481 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task ee4812f2-8dbe-4ecb-bc39-fdf0de80ca9e: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ee4812f2-8dbe-4ecb-bc39-fdf0de80ca9e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.511 | 0.511 | 0.511 | 0.511 | 0.511 | 0.511 | 100.0% | 1 | | keystone_v3.add_role | 0.13 | 0.13 | 0.13 | 0.13 | 0.13 | 0.13 | 100.0% | 1 | | keystone_v3.revoke_role | 0.144 | 0.144 | 0.144 | 0.144 | 0.144 | 0.144 | 100.0% | 1 | | total | 0.785 | 0.785 | 0.785 | 0.785 | 0.785 | 0.785 | 100.0% | 1 | | -> duration | 0.785 | 0.785 | 0.785 | 0.785 | 0.785 | 0.785 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.784831 Full duration: 14.754946 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ee4812f2-8dbe-4ecb-bc39-fdf0de80ca9e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.495 | 0.495 | 0.495 | 0.495 | 0.495 | 0.495 | 100.0% | 1 | | keystone_v3.add_role | 0.13 | 0.13 | 0.13 | 0.13 | 0.13 | 0.13 | 100.0% | 1 | | keystone_v3.list_roles | 0.227 | 0.227 | 0.227 | 0.227 | 0.227 | 0.227 | 100.0% | 1 | | total | 0.853 | 0.853 | 0.853 | 0.853 | 0.853 | 0.853 | 100.0% | 1 | | -> duration | 0.853 | 0.853 | 0.853 | 0.853 | 0.853 | 0.853 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.852837 Full duration: 14.865886 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ee4812f2-8dbe-4ecb-bc39-fdf0de80ca9e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.785 | 0.785 | 0.785 | 0.785 | 0.785 | 0.785 | 100.0% | 1 | | keystone_v3.list_projects | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 100.0% | 1 | | total | 0.87 | 0.87 | 0.87 | 0.87 | 0.87 | 0.87 | 100.0% | 1 | | -> duration | 0.87 | 0.87 | 0.87 | 0.87 | 0.87 | 0.87 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.870063 Full duration: 15.325171 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ee4812f2-8dbe-4ecb-bc39-fdf0de80ca9e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.523 | 0.523 | 0.523 | 0.523 | 0.523 | 0.523 | 100.0% | 1 | | keystone_v3.delete_role | 0.109 | 0.109 | 0.109 | 0.109 | 0.109 | 0.109 | 100.0% | 1 | | total | 0.632 | 0.632 | 0.632 | 0.632 | 0.632 | 0.632 | 100.0% | 1 | | -> duration | 0.632 | 0.632 | 0.632 | 0.632 | 0.632 | 0.632 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.632166 Full duration: 12.553765 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ee4812f2-8dbe-4ecb-bc39-fdf0de80ca9e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.517 | 0.517 | 0.517 | 0.517 | 0.517 | 0.517 | 100.0% | 1 | | keystone_v3.delete_service | 0.109 | 0.109 | 0.109 | 0.109 | 0.109 | 0.109 | 100.0% | 1 | | total | 0.627 | 0.627 | 0.627 | 0.627 | 0.627 | 0.627 | 100.0% | 1 | | -> duration | 0.627 | 0.627 | 0.627 | 0.627 | 0.627 | 0.627 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.626804 Full duration: 12.75974 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ee4812f2-8dbe-4ecb-bc39-fdf0de80ca9e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.671 | 0.671 | 0.671 | 0.671 | 0.671 | 0.671 | 100.0% | 1 | | keystone_v3.create_user | 0.5 | 0.5 | 0.5 | 0.5 | 0.5 | 0.5 | 100.0% | 1 | | -> keystone_v3.list_roles | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 100.0% | 1 | | -> keystone_v3.add_role | 0.122 | 0.122 | 0.122 | 0.122 | 0.122 | 0.122 | 100.0% | 1 | | keystone_v3.create_role | 0.103 | 0.103 | 0.103 | 0.103 | 0.103 | 0.103 | 100.0% | 1 | | keystone_v3.get_project | 0.095 | 0.095 | 0.095 | 0.095 | 0.095 | 0.095 | 100.0% | 1 | | keystone_v3.get_user | 0.1 | 0.1 | 0.1 | 0.1 | 0.1 | 0.1 | 100.0% | 1 | | keystone_v3.get_role | 0.089 | 0.089 | 0.089 | 0.089 | 0.089 | 0.089 | 100.0% | 1 | | keystone_v3.list_services | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 100.0% | 1 | | keystone_v3.get_services | 0.087 | 0.087 | 0.087 | 0.087 | 0.087 | 0.087 | 100.0% | 1 | | total | 1.829 | 1.829 | 1.829 | 1.829 | 1.829 | 1.829 | 100.0% | 1 | | -> duration | 1.829 | 1.829 | 1.829 | 1.829 | 1.829 | 1.829 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.828503 Full duration: 20.113732 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ee4812f2-8dbe-4ecb-bc39-fdf0de80ca9e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.685 | 0.685 | 0.685 | 0.685 | 0.685 | 0.685 | 100.0% | 1 | | keystone_v3.update_project | 0.102 | 0.102 | 0.102 | 0.102 | 0.102 | 0.102 | 100.0% | 1 | | keystone_v3.delete_project | 0.152 | 0.152 | 0.152 | 0.152 | 0.152 | 0.152 | 100.0% | 1 | | total | 0.939 | 0.939 | 0.939 | 0.939 | 0.939 | 0.939 | 100.0% | 1 | | -> duration | 0.939 | 0.939 | 0.939 | 0.939 | 0.939 | 0.939 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.939004 Full duration: 12.782142 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task ee4812f2-8dbe-4ecb-bc39-fdf0de80ca9e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.698 | 0.698 | 0.698 | 0.698 | 0.698 | 0.698 | 100.0% | 1 | | total | 0.8 | 0.8 | 0.8 | 0.8 | 0.8 | 0.8 | 100.0% | 1 | | -> duration | 0.8 | 0.8 | 0.8 | 0.8 | 0.8 | 0.8 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.80007 Full duration: 14.929964 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task ee4812f2-8dbe-4ecb-bc39-fdf0de80ca9e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.813 | 0.813 | 0.813 | 0.813 | 0.813 | 0.813 | 100.0% | 1 | | total | 0.814 | 0.814 | 0.814 | 0.814 | 0.814 | 0.814 | 100.0% | 1 | | -> duration | 0.814 | 0.814 | 0.814 | 0.814 | 0.814 | 0.814 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.813611 Full duration: 15.284 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task ee4812f2-8dbe-4ecb-bc39-fdf0de80ca9e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.731 | 0.731 | 0.731 | 0.731 | 0.731 | 0.731 | 100.0% | 1 | | keystone_v3.list_users | 0.1 | 0.1 | 0.1 | 0.1 | 0.1 | 0.1 | 100.0% | 1 | | total | 0.927 | 0.927 | 0.927 | 0.927 | 0.927 | 0.927 | 100.0% | 1 | | -> duration | 0.927 | 0.927 | 0.927 | 0.927 | 0.927 | 0.927 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.926991 Full duration: 15.133582 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "users_per_tenant": 10 }, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task ee4812f2-8dbe-4ecb-bc39-fdf0de80ca9e has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.698 | 0.698 | 0.698 | 0.698 | 0.698 | 0.698 | 100.0% | 1 | | keystone_v3.create_users | 5.027 | 5.027 | 5.027 | 5.027 | 5.027 | 5.027 | 100.0% | 1 | | -> keystone_v3.create_user (x10) | 5.027 | 5.027 | 5.027 | 5.027 | 5.027 | 5.027 | 100.0% | 1 | | --> keystone_v3.list_roles (x10) | 0.88 | 0.88 | 0.88 | 0.88 | 0.88 | 0.88 | 100.0% | 1 | | --> keystone_v3.add_role (x10) | 1.291 | 1.291 | 1.291 | 1.291 | 1.291 | 1.291 | 100.0% | 1 | | total | 6.717 | 6.717 | 6.717 | 6.717 | 6.717 | 6.717 | 100.0% | 1 | | -> duration | 6.717 | 6.717 | 6.717 | 6.717 | 6.717 | 6.717 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.716822 Full duration: 23.141169 HINTS: * To plot HTML graphics with this data, run: rally task report ee4812f2-8dbe-4ecb-bc39-fdf0de80ca9e --out output.html * To generate a JUnit report, run: rally task export ee4812f2-8dbe-4ecb-bc39-fdf0de80ca9e --type junit --to output.xml * To get raw JSON output of task results, run: rally task report ee4812f2-8dbe-4ecb-bc39-fdf0de80ca9e --json --out output.json 2018-01-31 07:22:25,481 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'ee4812f2-8dbe-4ecb-bc39-fdf0de80ca9e'] 2018-01-31 07:22:26,510 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-01-31 07:22:26,510 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'ee4812f2-8dbe-4ecb-bc39-fdf0de80ca9e', '--out', '/home/opnfv/functest/results/rally/opnfv-keystone.html'] 2018-01-31 07:22:26,516 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2018-01-31 07:22:26,516 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2018-01-31 07:22:26,517 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-neutron.yaml 2018-01-31 07:22:26,517 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-01-31 07:22:26,534 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-01-31 07:22:26,546 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['neutron'], 'concurrency': 4, 'netid': 'ddc366a2-a3c1-47dd-86d0-aa44751f9661', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-38daf994-9497-466a-b7ca-d5257f7dee79', 'flavor_name': 'rally-tiny-38daf994-9497-466a-b7ca-d5257f7dee79', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-38daf994-9497-466a-b7ca-d5257f7dee79', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-01-31 07:26:48,355 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 79cfe88a-2557-4b21-9b61-6615ca9ad1e3 2018-01-31 07:26:48,356 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '79cfe88a-2557-4b21-9b61-6615ca9ad1e3'] 2018-01-31 07:26:49,255 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 79cfe88a-2557-4b21-9b61-6615ca9ad1e3: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } } } -------------------------------------------------------------------------------- Task 79cfe88a-2557-4b21-9b61-6615ca9ad1e3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.122 | 1.122 | 1.122 | 1.122 | 1.122 | 1.122 | 100.0% | 1 | | neutron.delete_network | 1.284 | 1.284 | 1.284 | 1.284 | 1.284 | 1.284 | 100.0% | 1 | | total | 2.406 | 2.406 | 2.406 | 2.406 | 2.406 | 2.406 | 100.0% | 1 | | -> duration | 2.406 | 2.406 | 2.406 | 2.406 | 2.406 | 2.406 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.405604 Full duration: 15.754493 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "port": -1 } } } } -------------------------------------------------------------------------------- Task 79cfe88a-2557-4b21-9b61-6615ca9ad1e3 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.311 | 1.311 | 1.311 | 1.311 | 1.311 | 1.311 | 100.0% | 1 | | neutron.delete_port | 0.808 | 0.808 | 0.808 | 0.808 | 0.808 | 0.808 | 100.0% | 1 | | total | 2.12 | 2.12 | 2.12 | 2.12 | 2.12 | 2.12 | 100.0% | 1 | | -> duration | 2.12 | 2.12 | 2.12 | 2.12 | 2.12 | 2.12 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.119768 Full duration: 31.646825 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "router_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1, "router": -1 } } } } -------------------------------------------------------------------------------- Task 79cfe88a-2557-4b21-9b61-6615ca9ad1e3 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.025 | 1.025 | 1.025 | 1.025 | 1.025 | 1.025 | 100.0% | 1 | | neutron.create_subnet | 0.79 | 0.79 | 0.79 | 0.79 | 0.79 | 0.79 | 100.0% | 1 | | neutron.create_router | 0.334 | 0.334 | 0.334 | 0.334 | 0.334 | 0.334 | 100.0% | 1 | | neutron.add_interface_router | 1.612 | 1.612 | 1.612 | 1.612 | 1.612 | 1.612 | 100.0% | 1 | | neutron.remove_interface_router | 1.205 | 1.205 | 1.205 | 1.205 | 1.205 | 1.205 | 100.0% | 1 | | neutron.delete_router | 0.609 | 0.609 | 0.609 | 0.609 | 0.609 | 0.609 | 100.0% | 1 | | total | 5.574 | 5.574 | 5.574 | 5.574 | 5.574 | 5.574 | 100.0% | 1 | | -> duration | 5.574 | 5.574 | 5.574 | 5.574 | 5.574 | 5.574 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.574264 Full duration: 37.641488 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1 } } } } -------------------------------------------------------------------------------- Task 79cfe88a-2557-4b21-9b61-6615ca9ad1e3 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 1.121 | 1.121 | 1.121 | 1.121 | 1.121 | 1.121 | 100.0% | 1 | | neutron.delete_subnet | 2.09 | 2.09 | 2.09 | 2.09 | 2.09 | 2.09 | 100.0% | 1 | | total | 3.21 | 3.21 | 3.21 | 3.21 | 3.21 | 3.21 | 100.0% | 1 | | -> duration | 3.21 | 3.21 | 3.21 | 3.21 | 3.21 | 3.21 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.210364 Full duration: 33.948846 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } } } -------------------------------------------------------------------------------- Task 79cfe88a-2557-4b21-9b61-6615ca9ad1e3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.316 | 1.316 | 1.316 | 1.316 | 1.316 | 1.316 | 100.0% | 1 | | neutron.list_networks | 0.278 | 0.278 | 0.278 | 0.278 | 0.278 | 0.278 | 100.0% | 1 | | total | 1.593 | 1.593 | 1.593 | 1.593 | 1.593 | 1.593 | 100.0% | 1 | | -> duration | 1.593 | 1.593 | 1.593 | 1.593 | 1.593 | 1.593 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.593235 Full duration: 17.385897 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "port": -1 } } } } -------------------------------------------------------------------------------- Task 79cfe88a-2557-4b21-9b61-6615ca9ad1e3 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.422 | 1.422 | 1.422 | 1.422 | 1.422 | 1.422 | 100.0% | 1 | | neutron.list_ports | 0.269 | 0.269 | 0.269 | 0.269 | 0.269 | 0.269 | 100.0% | 1 | | total | 1.691 | 1.691 | 1.691 | 1.691 | 1.691 | 1.691 | 100.0% | 1 | | -> duration | 1.691 | 1.691 | 1.691 | 1.691 | 1.691 | 1.691 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.691011 Full duration: 31.975607 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "router_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } } } -------------------------------------------------------------------------------- Task 79cfe88a-2557-4b21-9b61-6615ca9ad1e3 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.813 | 0.813 | 0.813 | 0.813 | 0.813 | 0.813 | 100.0% | 1 | | neutron.create_subnet | 0.898 | 0.898 | 0.898 | 0.898 | 0.898 | 0.898 | 100.0% | 1 | | neutron.create_router | 0.291 | 0.291 | 0.291 | 0.291 | 0.291 | 0.291 | 100.0% | 1 | | neutron.add_interface_router | 1.981 | 1.981 | 1.981 | 1.981 | 1.981 | 1.981 | 100.0% | 1 | | neutron.list_routers | 0.243 | 0.243 | 0.243 | 0.243 | 0.243 | 0.243 | 100.0% | 1 | | total | 4.226 | 4.226 | 4.226 | 4.226 | 4.226 | 4.226 | 100.0% | 1 | | -> duration | 4.226 | 4.226 | 4.226 | 4.226 | 4.226 | 4.226 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.226308 Full duration: 43.44334 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1 } } } } -------------------------------------------------------------------------------- Task 79cfe88a-2557-4b21-9b61-6615ca9ad1e3 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 2.738117 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } } } -------------------------------------------------------------------------------- Task 79cfe88a-2557-4b21-9b61-6615ca9ad1e3 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 2.032747 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } } } -------------------------------------------------------------------------------- Task 79cfe88a-2557-4b21-9b61-6615ca9ad1e3 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 13.06263 -------------------------------------------------------------------------------- test scenario NeutronNetworks.set_and_clear_router_gateway args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": { "router:external": true } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "router": -1 } }, "roles": [ "admin" ] } } -------------------------------------------------------------------------------- Task 79cfe88a-2557-4b21-9b61-6615ca9ad1e3 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 4.042836 HINTS: * To plot HTML graphics with this data, run: rally task report 79cfe88a-2557-4b21-9b61-6615ca9ad1e3 --out output.html * To generate a JUnit report, run: rally task export 79cfe88a-2557-4b21-9b61-6615ca9ad1e3 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 79cfe88a-2557-4b21-9b61-6615ca9ad1e3 --json --out output.json 2018-01-31 07:26:49,256 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '79cfe88a-2557-4b21-9b61-6615ca9ad1e3'] 2018-01-31 07:26:50,249 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-01-31 07:26:50,249 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '79cfe88a-2557-4b21-9b61-6615ca9ad1e3', '--out', '/home/opnfv/functest/results/rally/opnfv-neutron.html'] 2018-01-31 07:26:50,257 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2018-01-31 07:26:50,257 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2018-01-31 07:26:50,258 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-nova.yaml 2018-01-31 07:26:50,258 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-01-31 07:26:50,292 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-01-31 07:26:50,303 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['nova'], 'concurrency': 4, 'netid': 'ddc366a2-a3c1-47dd-86d0-aa44751f9661', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-38daf994-9497-466a-b7ca-d5257f7dee79', 'flavor_name': 'rally-tiny-38daf994-9497-466a-b7ca-d5257f7dee79', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-38daf994-9497-466a-b7ca-d5257f7dee79', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-01-31 07:26:55,922 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : ec7aaeb1-ae95-4fc8-ad24-2a970a2b4d3c 2018-01-31 07:26:55,922 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'ec7aaeb1-ae95-4fc8-ad24-2a970a2b4d3c'] 2018-01-31 07:26:56,904 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task ec7aaeb1-ae95-4fc8-ad24-2a970a2b4d3c: crashed -------------------------------------------------------------------------------- AuthenticationFailed Failed to authenticate to http://172.30.9.30:5000/v3 for user 'admin' in project 'admin': ConnectFailure: Unable to establish connection to http://172.30.9.30:5000/v3: HTTPConnectionPool(host='172.30.9.30', port=5000): Max retries exceeded with url: /v3 (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] Host is unreachable',)) For more details run: rally -d task detailed ec7aaeb1-ae95-4fc8-ad24-2a970a2b4d3c 2018-01-31 07:26:56,904 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'ec7aaeb1-ae95-4fc8-ad24-2a970a2b4d3c'] 2018-01-31 07:26:57,792 - functest.opnfv_tests.openstack.rally.rally - ERROR - Error with run: No JSON object could be decoded 2018-01-31 07:26:58,701 - functest.opnfv_tests.openstack.rally.rally - ERROR - Unexpected error cleaning - Unable to establish connection to http://172.30.9.30:8774/v2.1/flavors/a5491a3c-f675-4c51-a75f-157cd242becc: HTTPConnectionPool(host='172.30.9.30', port=8774): Max retries exceeded with url: /v2.1/flavors/a5491a3c-f675-4c51-a75f-157cd242becc (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] Host is unreachable',)) 2018-01-31 07:27:01,715 - functest.opnfv_tests.openstack.rally.rally - ERROR - Unexpected error cleaning - Unable to establish connection to http://172.30.9.30:8774/v2.1/flavors/c2d5438d-6944-473c-b2e2-2a1877d84b44: HTTPConnectionPool(host='172.30.9.30', port=8774): Max retries exceeded with url: /v2.1/flavors/c2d5438d-6944-473c-b2e2-2a1877d84b44 (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] Host is unreachable',)) 2018-01-31 07:27:04,727 - functest.opnfv_tests.openstack.rally.rally - ERROR - Unexpected error cleaning - Unable to establish connection to http://172.30.9.30:9696/v2.0/routers/e0e4ae21-ff53-4bca-991e-0386475b428c/remove_router_interface: HTTPConnectionPool(host='172.30.9.30', port=9696): Max retries exceeded with url: /v2.0/routers/e0e4ae21-ff53-4bca-991e-0386475b428c/remove_router_interface (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 101] Network unreachable',)) 2018-01-31 07:27:05,739 - functest.opnfv_tests.openstack.rally.rally - ERROR - Unexpected error cleaning - Unable to establish connection to http://172.30.9.30:9696/v2.0/subnets/18f72cc6-2c01-442a-88e6-8a1ee2a2ab7a: HTTPConnectionPool(host='172.30.9.30', port=9696): Max retries exceeded with url: /v2.0/subnets/18f72cc6-2c01-442a-88e6-8a1ee2a2ab7a (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 101] Network unreachable',)) 2018-01-31 07:27:08,753 - functest.opnfv_tests.openstack.rally.rally - ERROR - Unexpected error cleaning - Error finding address for http://172.30.9.30:9292/v2/images/97933a44-b28b-4c66-bf99-b001693f69fe: Unable to establish connection to http://172.30.9.30:9292/v2/images/97933a44-b28b-4c66-bf99-b001693f69fe: HTTPConnectionPool(host='172.30.9.30', port=9292): Max retries exceeded with url: /v2/images/97933a44-b28b-4c66-bf99-b001693f69fe (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 101] Network unreachable',)) 2018-01-31 07:27:08,756 - functest.energy.energy - DEBUG - Restoring previous scenario (default/default) 2018-01-31 07:27:08,756 - functest.energy.energy - DEBUG - Submitting scenario (default/default) 2018-01-31 07:27:13,765 - functest.energy.energy - WARNING - submit_scenario: Unable to connect energy recorder API 2018-01-31 07:27:13,766 - functest.core.testcase - ERROR - Please set env var: 'TEST_DB_URL' 2018-01-31 07:27:13,766 - functest.core.testcase - ERROR - Please run test before checking the results 2018-01-31 07:27:13,767 - functest.core.testcase - ERROR - Please run test before checking the results 2018-01-31 07:27:13,768 - functest.core.testcase - ERROR - Please run test before checking the results 2018-01-31 07:27:13,769 - functest.core.testcase - ERROR - Please run test before checking the results 2018-01-31 07:27:13,770 - functest.core.testcase - ERROR - Please run test before checking the results 2018-01-31 07:27:13,766 - functest.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | rally_sanity | functest | 16:02 | FAIL | +----------------------+------------------+------------------+----------------+ 2018-01-31 07:27:13,771 - functest.core.testcase - ERROR - Please run test before checking the results 2018-01-31 07:27:13,771 - functest.ci.run_tests - ERROR - The test case 'rally_sanity' failed. 2018-01-31 07:27:13,771 - functest.ci.run_tests - INFO - Running test case 'refstack_defcore'... 2018-01-31 07:27:13,875 - functest.energy.energy - DEBUG - Getting current scenario 2018-01-31 07:27:14,354 - functest.energy.energy - DEBUG - Starting recording 2018-01-31 07:27:14,354 - functest.energy.energy - DEBUG - Submitting scenario (refstack_defcore/running) 2018-01-31 07:27:14,781 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-01-31 07:27:17,004 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment create --fromenv --name=opnfv-rally' 2018-01-31 07:27:19,481 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment check' 2018-01-31 07:27:22,591 - functest.utils.functest_utils - ERROR - OpenStack not responding or faulty Rally deployment. 2018-01-31 07:27:22,591 - functest.opnfv_tests.openstack.refstack_client.refstack_client - ERROR - Error with run Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/refstack_client/refstack_client.py", line 171, in run self.generate_conf() File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/refstack_client/refstack_client.py", line 70, in generate_conf self.tempestconf = TempestConf() File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/refstack_client/tempest_conf.py", line 26, in __init__ self.verifier_id = conf_utils.get_verifier_id() File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/tempest/conf_utils.py", line 111, in get_verifier_id create_rally_deployment() File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/tempest/conf_utils.py", line 88, in create_rally_deployment ft_utils.execute_command_raise(cmd, error_msg=error_msg) File "/usr/lib/python2.7/site-packages/functest/utils/functest_utils.py", line 103, in execute_command_raise raise Exception(error_msg) Exception: OpenStack not responding or faulty Rally deployment. 2018-01-31 07:27:22,623 - functest.energy.energy - ERROR - 'NoneType' object has no attribute 'clean' Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/functest/energy/energy.py", line 60, in wrapper return_value = method(*args) File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/refstack_client/refstack_client.py", line 179, in run self.tempestconf.clean() AttributeError: 'NoneType' object has no attribute 'clean' 2018-01-31 07:27:22,634 - functest.energy.energy - DEBUG - Restoring previous scenario (rally_sanity/running) 2018-01-31 07:27:22,634 - functest.energy.energy - DEBUG - Submitting scenario (rally_sanity/running) 2018-01-31 07:27:27,644 - functest.energy.energy - WARNING - submit_scenario: Unable to connect energy recorder API 2018-01-31 07:27:27,644 - functest.ci.run_tests - ERROR - Cannot get class RefstackClient Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/functest/ci/run_tests.py", line 144, in run_test test_case.run() File "/usr/lib/python2.7/site-packages/functest/energy/energy.py", line 65, in wrapper raise exc AttributeError: 'NoneType' object has no attribute 'clean' 2018-01-31 07:27:27,645 - functest.ci.run_tests - ERROR - The test case 'refstack_defcore' failed. 2018-01-31 07:27:27,645 - functest.ci.run_tests - INFO - Running test case 'odl'... 2018-01-31 07:27:34,285 - functest.opnfv_tests.sdn.odl.odl - ERROR - Cannot run ODL testcases. Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/sdn/odl/odl.py", line 159, in run service_type='network')} File "/usr/lib/python2.7/site-packages/functest/utils/openstack_utils.py", line 144, in get_endpoint interface=interface) File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 947, in get_endpoint return auth.get_endpoint(self, **kwargs) File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 378, in get_endpoint allow_version_hack=allow_version_hack, **kwargs) File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 269, in get_endpoint_data service_catalog = self.get_access(session).service_catalog File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 135, in get_access self.auth_ref = self.get_auth_ref(session) File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/generic/base.py", line 198, in get_auth_ref return self._plugin.get_auth_ref(session, **kwargs) File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/v3/base.py", line 167, in get_auth_ref authenticated=False, log=False, **rkwargs) File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 853, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python2.7/site-packages/positional/__init__.py", line 108, in inner return wrapped(*args, **kwargs) File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 703, in request resp = send(**kwargs) File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 777, in _send_request raise exceptions.ConnectFailure(msg) ConnectFailure: Unable to establish connection to http://172.30.9.30:5000/v3/auth/tokens: HTTPConnectionPool(host='172.30.9.30', port=5000): Max retries exceeded with url: /v3/auth/tokens (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] Host is unreachable',)) 2018-01-31 07:27:39,356 - functest.core.testcase - ERROR - Please run test before publishing the results Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/functest/core/testcase.py", line 181, in push_to_db assert self.start_time AssertionError 2018-01-31 07:27:40,197 - functest.core.testcase - ERROR - Please run test before getting the duration 2018-01-31 07:27:40,197 - functest.core.testcase - ERROR - Please run test before getting the duration 2018-01-31 07:27:40,199 - functest.core.testcase - ERROR - Please run test before getting the duration 2018-01-31 07:27:40,199 - functest.core.testcase - ERROR - Please run test before getting the duration 2018-01-31 07:27:40,196 - functest.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | odl | functest | XX:XX | FAIL | +-------------------+------------------+------------------+----------------+ 2018-01-31 07:27:40,200 - functest.ci.run_tests - ERROR - The test case 'odl' failed. 2018-01-31 07:27:40,201 - functest.ci.run_tests - INFO - Running test case 'snaps_smoke'... 2018-01-31 07:27:43,335 - functest.ci.run_tests - ERROR - Failures when running testcase(s) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/functest/ci/run_tests.py", line 226, in main self.run_all() File "/usr/lib/python2.7/site-packages/functest/ci/run_tests.py", line 204, in run_all self.run_tier(tier) File "/usr/lib/python2.7/site-packages/functest/ci/run_tests.py", line 173, in run_tier self.run_test(test) File "/usr/lib/python2.7/site-packages/functest/ci/run_tests.py", line 138, in run_test test_case = cls(**test_dict) File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/snaps/smoke.py", line 29, in __init__ super(SnapsSmoke, self).__init__(**kwargs) File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/snaps/snaps_test_runner.py", line 36, in __init__ self.ext_net_name = snaps_utils.get_ext_net_name(self.os_creds) File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/snaps/snaps_utils.py", line 26, in get_ext_net_name ext_nets = neutron_utils.get_external_networks(neutron) File "/usr/lib/python2.7/site-packages/snaps/openstack/utils/neutron_utils.py", line 714, in get_external_networks **{'router:external': True})['networks']: File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 795, in list_networks **_params) File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 367, in list for r in self._pagination(collection, path, **params): File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 382, in _pagination res = self.get(path, params=params) File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 352, in get headers=headers, params=params) File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 329, in retry_request headers=headers, params=params) File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 280, in do_request resp, replybody = self.httpclient.do_request(action, method, body=body) File "/usr/lib/python2.7/site-packages/neutronclient/client.py", line 341, in do_request self._check_uri_length(url) File "/usr/lib/python2.7/site-packages/neutronclient/client.py", line 334, in _check_uri_length uri_len = len(self.endpoint_url) + len(url) File "/usr/lib/python2.7/site-packages/neutronclient/client.py", line 348, in endpoint_url return self.get_endpoint() File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 226, in get_endpoint return self.session.get_endpoint(auth or self.auth, **kwargs) File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 947, in get_endpoint return auth.get_endpoint(self, **kwargs) File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 378, in get_endpoint allow_version_hack=allow_version_hack, **kwargs) File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 269, in get_endpoint_data service_catalog = self.get_access(session).service_catalog File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/base.py", line 135, in get_access self.auth_ref = self.get_auth_ref(session) File "/usr/lib/python2.7/site-packages/keystoneauth1/identity/v3/base.py", line 167, in get_auth_ref authenticated=False, log=False, **rkwargs) File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 853, in post return self.request(url, 'POST', **kwargs) File "/usr/lib/python2.7/site-packages/positional/__init__.py", line 108, in inner return wrapped(*args, **kwargs) File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 703, in request resp = send(**kwargs) File "/usr/lib/python2.7/site-packages/keystoneauth1/session.py", line 777, in _send_request raise exceptions.ConnectFailure(msg) ConnectFailure: Unable to establish connection to http://172.30.9.30:5000/v3/auth/tokens: HTTPConnectionPool(host='172.30.9.30', port=5000): Max retries exceeded with url: /v3/auth/tokens (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 113] Host is unreachable',)) 2018-01-31 07:27:43,391 - functest.ci.run_tests - INFO - Deployment description: +-------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+----------------------------------------------------------+ | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-ha | | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-730 | | CI_LOOP | daily | +-------------------------+----------------------------------------------------------+ 2018-01-31 07:27:43,394 - functest.core.testcase - ERROR - Please run test before checking the results 2018-01-31 07:27:43,394 - functest.core.testcase - ERROR - Please run test before getting the duration 2018-01-31 07:27:43,394 - functest.core.testcase - ERROR - Please run test before getting the duration 2018-01-31 07:27:43,394 - functest.ci.run_tests - INFO - FUNCTEST REPORT: +------------------------------+------------------+---------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +------------------------------+------------------+---------------+------------------+----------------+ | vping_userdata | functest | smoke | 00:39 | PASS | | tempest_smoke_serial | functest | smoke | 13:38 | PASS | | rally_sanity | functest | smoke | 16:02 | FAIL | | refstack_defcore | functest | smoke | XX:XX | FAIL | | odl | functest | smoke | XX:XX | FAIL | | snaps_smoke | functest | smoke | 00:00 | SKIP | | vping_ssh | functest | smoke | 00:00 | SKIP | | odl_netvirt | functest | smoke | 00:00 | SKIP | +------------------------------+------------------+---------------+------------------+----------------+ 2018-01-31 07:27:43,399 - functest.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR 2018-01-31 07:27:48,906 - functest.ci.run_tests - DEBUG - Sourcing the OpenStack RC file... 2018-01-31 07:27:48,907 - functest.ci.run_tests - DEBUG - Test args: all 2018-01-31 07:27:48,908 - functest.ci.run_tests - INFO - TESTS TO BE EXECUTED: +------------------+---------------+--------------------------+-------------------------------------------+------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +------------------+---------------+--------------------------+-------------------------------------------+------------------------------------+ | features | 2 | (daily)|(weekly) | Test suites from feature projects | doctor-notification bgpvpn | | | | | integrated in functest | | +------------------+---------------+--------------------------+-------------------------------------------+------------------------------------+ 2018-01-31 07:27:48,909 - functest.ci.run_tests - INFO - Running tier 'features' 2018-01-31 07:27:48,909 - functest.ci.run_tests - INFO - Running test case 'doctor-notification'... 2018-01-31 07:27:58,489 - functest.core.feature - ERROR - Execute command: doctor-test failed 2018-01-31 07:27:58,489 - functest.core.feature - INFO - Test result is stored in '/home/opnfv/functest/results/doctor-notification.log' 2018-01-31 07:27:58,490 - functest.core.testcase - ERROR - Please set env var: 'TEST_DB_URL' 2018-01-31 07:27:58,490 - functest.ci.run_tests - INFO - Test result: +-----------------------------+-----------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------------+-----------------+------------------+----------------+ | doctor-notification | doctor | 00:10 | FAIL | +-----------------------------+-----------------+------------------+----------------+ 2018-01-31 07:27:58,493 - functest.ci.run_tests - ERROR - The test case 'doctor-notification' failed. 2018-01-31 07:27:58,493 - functest.ci.run_tests - INFO - Running test case 'bgpvpn'... 2018-01-31 07:27:58,844 - functest.ci.run_tests - ERROR - Cannot get class SdnvpnFunctest Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/functest/ci/run_tests.py", line 135, in run_test module = importlib.import_module(run_dict['module']) File "/usr/lib/python2.7/importlib/__init__.py", line 37, in import_module __import__(name) File "/usr/lib/python2.7/site-packages/sdnvpn/test/functest/run_sdnvpn_tests.py", line 21, in from sdnvpn.lib.gather_logs import gather_logs File "/usr/lib/python2.7/site-packages/sdnvpn/lib/gather_logs.py", line 20, in import sdnvpn.lib.utils as test_utils File "/usr/lib/python2.7/site-packages/sdnvpn/lib/utils.py", line 26, in common_config = sdnvpn_config.CommonConfig() File "/usr/lib/python2.7/site-packages/sdnvpn/lib/config.py", line 67, in __init__ CommonConfig.commonCfgInstance = CommonConfig.__CommonConfig() File "/usr/lib/python2.7/site-packages/sdnvpn/lib/config.py", line 34, in __init__ self.test_db = CONST.results_test_db_url AttributeError: 'Constants' object has no attribute 'results_test_db_url' 2018-01-31 07:27:58,872 - functest.ci.run_tests - ERROR - Failures when running testcase(s) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/functest/ci/run_tests.py", line 226, in main self.run_all() File "/usr/lib/python2.7/site-packages/functest/ci/run_tests.py", line 204, in run_all self.run_tier(tier) File "/usr/lib/python2.7/site-packages/functest/ci/run_tests.py", line 174, in run_tier test_case = self.executed_test_cases[test.get_name()] KeyError: 'bgpvpn' 2018-01-31 07:27:58,873 - functest.ci.run_tests - INFO - Deployment description: +-------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+----------------------------------------------------------+ | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-ha | | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-730 | | CI_LOOP | daily | +-------------------------+----------------------------------------------------------+ 2018-01-31 07:27:58,875 - functest.ci.run_tests - INFO - FUNCTEST REPORT: +-----------------------------+------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-----------------------------+------------------------+------------------+------------------+----------------+ | doctor-notification | doctor | features | 00:10 | FAIL | | bgpvpn | sdnvpn | features | 00:00 | SKIP | | functest-odl-sfc | sfc | features | 00:00 | SKIP | | barometercollectd | barometer | features | 00:00 | SKIP | | fds | fastdatastacks | features | 00:00 | SKIP | +-----------------------------+------------------------+------------------+------------------+----------------+ 2018-01-31 07:27:58,879 - functest.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR 2018-01-31 07:28:21,960 - functest.ci.run_tests - DEBUG - Sourcing the OpenStack RC file... 2018-01-31 07:28:21,960 - functest.ci.run_tests - DEBUG - Test args: all 2018-01-31 07:28:21,961 - functest.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+-----------------+---------------------+-------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+-----------------+---------------------+-------------------+ +---------------+---------------+-----------------+---------------------+-------------------+ 2018-01-31 07:28:21,961 - functest.ci.run_tests - INFO - Deployment description: +-------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+----------------------------------------------------------+ | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-ha | | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-730 | | CI_LOOP | daily | +-------------------------+----------------------------------------------------------+ 2018-01-31 07:28:21,962 - functest.ci.run_tests - INFO - FUNCTEST REPORT: +---------------------------------+-------------------+--------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +---------------------------------+-------------------+--------------+------------------+----------------+ | cloudify_ims | functest | vnf | 00:00 | SKIP | | vyos_vrouter | functest | vnf | 00:00 | SKIP | | orchestra_openims | orchestra | vnf | 00:00 | SKIP | | orchestra_clearwaterims | orchestra | vnf | 00:00 | SKIP | | juju_epc | functest | vnf | 00:00 | SKIP | +---------------------------------+-------------------+--------------+------------------+----------------+ 2018-01-31 07:28:21,963 - functest.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-01-31 07:28:33,246 - functest.ci.run_tests - DEBUG - Sourcing the OpenStack RC file... 2018-01-31 07:28:33,246 - functest.ci.run_tests - DEBUG - Test args: all 2018-01-31 07:28:33,246 - functest.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+-----------------+---------------------+-------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+-----------------+---------------------+-------------------+ +---------------+---------------+-----------------+---------------------+-------------------+ 2018-01-31 07:28:33,247 - functest.ci.run_tests - INFO - Deployment description: +-------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+----------------------------------------------------------+ | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-ha | | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-730 | | CI_LOOP | daily | +-------------------------+----------------------------------------------------------+ 2018-01-31 07:28:33,248 - functest.ci.run_tests - INFO - FUNCTEST REPORT: +-----------------------+-----------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-----------------------+-----------------+------------------+------------------+----------------+ | parser-basics | parser | features | 00:00 | SKIP | +-----------------------+-----------------+------------------+------------------+----------------+ 2018-01-31 07:28:33,248 - functest.ci.run_tests - INFO - Execution exit value: Result.EX_OK