2018-04-13 00:54:44,038 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+-----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+-----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-compass-virtual-daily-master-212 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | compass | | DEPLOY_SCENARIO | os-nosdn-nofeature-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | huawei-virtual2 | +--------------------------------------+-----------------------------------------------------------+ 2018-04-13 00:54:44,041 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Ansible managed export LC_ALL=C # COMMON CINDER ENVS export CINDER_ENDPOINT_TYPE=publicURL # COMMON NOVA ENVS export NOVA_ENDPOINT_TYPE=publicURL # COMMON OPENSTACK ENVS export OS_ENDPOINT_TYPE=publicURL export OS_INTERFACE=publicURL export OS_USERNAME=admin export OS_PASSWORD='4d4508f971f692567' export OS_PROJECT_NAME=admin export OS_TENANT_NAME=admin export OS_AUTH_URL=https://192.16.1.222:5000/v3 export OS_NO_CACHE=1 export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_REGION_NAME=RegionOne # For openstackclient export OS_IDENTITY_API_VERSION=3 export OS_AUTH_VERSION=3 export OS_AUTH_TYPE=password export SDN_CONTROLLER_IP=192.16.1.222 export OS_CACERT=/home/opnfv/functest/conf/os_cacert 2018-04-13 00:54:44,041 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-04-13 00:54:44,042 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------------+---------------+-------------------------------------------+-------------------------------------------------+------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------------+---------------+-------------------------------------------+-------------------------------------------------+------------------------------------+ | healthcheck | 0 | (merge)|(verify)|(daily)|(weekly) | First tier to be executed to verify the | connection_check api_check | | | | | basic operations in the VIM. | snaps_health_check | +---------------------+---------------+-------------------------------------------+-------------------------------------------------+------------------------------------+ 2018-04-13 00:54:44,043 - xtesting.ci.run_tests - INFO - Running tier 'healthcheck' 2018-04-13 00:54:44,043 - xtesting.ci.run_tests - INFO - Running test case 'connection_check'... 2018-04-13 00:54:47,673 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-04-13 00:55:07,364 - xtesting.core.unit - DEBUG - test_glance_connect_fail (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_glance_connect_success (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_keystone_connect_fail (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_keystone_connect_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_neutron_connect_fail (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_neutron_connect_success (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_retrieve_ext_network_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_nova_connect_fail (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_connect_success (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_get_hypervisor_hosts (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_heat_connect_fail (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_heat_connect_success (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_cinder_connect_fail (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok test_cinder_connect_success (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok ---------------------------------------------------------------------- Ran 14 tests in 19.684s OK 2018-04-13 00:55:07,928 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-13 00:55:07,928 - xtesting.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | connection_check | functest | 00:20 | PASS | +--------------------------+------------------+------------------+----------------+ 2018-04-13 00:55:07,930 - xtesting.ci.run_tests - INFO - Running test case 'api_check'... 2018-04-13 00:55:10,728 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-04-13 01:10:31,146 - xtesting.core.unit - DEBUG - test_create_project_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_user_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_credentials (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_service (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_with_each_interface (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_grant_user_role_to_project (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_admin_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user_2x (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_2x (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_bad_domain (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_quota_override (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_update_quotas (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_sec_grp_one_user (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_project_sec_grp_two_users (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_image_minimal_file (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_image_minimal_url (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_network (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_add_interface_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_missing_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip_to_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_network_object (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_simple (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_with_public_interface (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_delete_simple_sec_grp (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_rules (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_one_rule (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_get_sec_grp_by_id (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_floating_ips (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsFloatingIpTests) ... ok test_create_delete_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_key_from_file (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_delete_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_instance (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceTests) ... ok test_add_remove_volume (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_attach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_detach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_create_clean_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_delete_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_all_settings (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_existing (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_create_stack_x2 (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_get_settings_from_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateComplexStackTests) ... ok test_create_flavor_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsFlavorTests) ... ok test_create_keypair_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsKeypairTests) ... ok test_create_security_group_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsSecurityGroupTests) ... ok test_create_delete_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_back (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_both (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_front (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_delete_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_simple_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_delete_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_simple_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_bad_key_size (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_delete_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_simple_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_all_attrs (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_invalid_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos_and_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok ---------------------------------------------------------------------- Ran 84 tests in 920.388s OK 2018-04-13 01:10:31,796 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-13 01:10:31,796 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | api_check | functest | 15:20 | PASS | +-------------------+------------------+------------------+----------------+ 2018-04-13 01:10:31,799 - xtesting.ci.run_tests - INFO - Running test case 'snaps_health_check'... 2018-04-13 01:10:32,942 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-04-13 01:11:23,707 - xtesting.core.unit - DEBUG - test_check_vm_ip_dhcp (snaps.openstack.tests.create_instance_tests.SimpleHealthCheck) ... ok ---------------------------------------------------------------------- Ran 1 test in 50.763s OK 2018-04-13 01:11:24,324 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-13 01:11:24,324 - xtesting.ci.run_tests - INFO - Test result: +----------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------------+------------------+------------------+----------------+ | snaps_health_check | functest | 00:51 | PASS | +----------------------------+------------------+------------------+----------------+ 2018-04-13 01:11:24,327 - xtesting.ci.run_tests - INFO - Xtesting report: +----------------------------+------------------+---------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------------+------------------+---------------------+------------------+----------------+ | connection_check | functest | healthcheck | 00:20 | PASS | | api_check | functest | healthcheck | 15:20 | PASS | | snaps_health_check | functest | healthcheck | 00:51 | PASS | +----------------------------+------------------+---------------------+------------------+----------------+ 2018-04-13 01:11:24,328 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-04-13 01:34:25,922 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+-----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+-----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-compass-virtual-daily-master-212 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | compass | | DEPLOY_SCENARIO | os-nosdn-nofeature-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | huawei-virtual2 | +--------------------------------------+-----------------------------------------------------------+ 2018-04-13 01:34:25,925 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Ansible managed export LC_ALL=C # COMMON CINDER ENVS export CINDER_ENDPOINT_TYPE=publicURL # COMMON NOVA ENVS export NOVA_ENDPOINT_TYPE=publicURL # COMMON OPENSTACK ENVS export OS_ENDPOINT_TYPE=publicURL export OS_INTERFACE=publicURL export OS_USERNAME=admin export OS_PASSWORD='4d4508f971f692567' export OS_PROJECT_NAME=admin export OS_TENANT_NAME=admin export OS_AUTH_URL=https://192.16.1.222:5000/v3 export OS_NO_CACHE=1 export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_REGION_NAME=RegionOne # For openstackclient export OS_IDENTITY_API_VERSION=3 export OS_AUTH_VERSION=3 export OS_AUTH_TYPE=password export SDN_CONTROLLER_IP=192.16.1.222 export OS_CACERT=/home/opnfv/functest/conf/os_cacert 2018-04-13 01:34:25,925 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-04-13 01:34:25,926 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+--------------------------+------------------------------------------+----------------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+--------------------------+------------------------------------------+----------------------------------------------+ | smoke | 1 | (daily)|(weekly) | Set of basic Functional tests to | vping_ssh vping_userdata | | | | | validate the OPNFV scenarios. | tempest_smoke_serial rally_sanity | | | | | | refstack_defcore patrole snaps_smoke | | | | | | neutron_trunk | +---------------+---------------+--------------------------+------------------------------------------+----------------------------------------------+ 2018-04-13 01:34:25,927 - xtesting.ci.run_tests - INFO - Running tier 'smoke' 2018-04-13 01:34:25,927 - xtesting.ci.run_tests - INFO - Running test case 'vping_ssh'... 2018-04-13 01:34:27,687 - xtesting.energy.energy - INFO - API recorder available at : http://energy.opnfv.fr/resources/recorders/environment/huawei-virtual2 2018-04-13 01:34:27,687 - xtesting.energy.energy - DEBUG - Getting current scenario 2018-04-13 01:34:28,823 - xtesting.energy.energy - INFO - No current running scenario at http://energy.opnfv.fr/resources/recorders/environment/huawei-virtual2 2018-04-13 01:34:28,823 - xtesting.energy.energy - DEBUG - Starting recording 2018-04-13 01:34:28,823 - xtesting.energy.energy - DEBUG - Submitting scenario (vping_ssh/running) 2018-04-13 01:34:29,893 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup 2018-04-13 01:34:29,893 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-04-13 01:34:29' 2018-04-13 01:34:29,893 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--1ea2ec9d-6f38-4478-aa4c-e5b1d346c186' 2018-04-13 01:34:32,188 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-1ea2ec9d-6f38-4478-aa4c-e5b1d346c186' 2018-04-13 01:34:36,173 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-1ea2ec9d-6f38-4478-aa4c-e5b1d346c186' 2018-04-13 01:34:51,664 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-1ea2ec9d-6f38-4478-aa4c-e5b1d346c186' 2018-04-13 01:34:53,192 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating keypair with name: 'vPing-keypair-1ea2ec9d-6f38-4478-aa4c-e5b1d346c186' 2018-04-13 01:34:54,667 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-1ea2ec9d-6f38-4478-aa4c-e5b1d346c186' 2018-04-13 01:35:02,885 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Security group with name: 'vPing-sg-1ea2ec9d-6f38-4478-aa4c-e5b1d346c186' 2018-04-13 01:35:07,280 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-1ea2ec9d-6f38-4478-aa4c-e5b1d346c186' 2018-04-13 01:35:35,728 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution 2018-04-13 01:35:41,233 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Trying to transfer ping.sh 2018-04-13 01:35:41,309 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping... 2018-04-13 01:35:42,321 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected! 2018-04-13 01:35:42,322 - xtesting.energy.energy - DEBUG - Stopping recording 2018-04-13 01:35:43,886 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-13 01:35:43,887 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | vping_ssh | functest | 01:12 | PASS | +-------------------+------------------+------------------+----------------+ 2018-04-13 01:36:10,259 - xtesting.ci.run_tests - INFO - Running test case 'vping_userdata'... 2018-04-13 01:36:10,324 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup 2018-04-13 01:36:10,324 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-04-13 01:36:10' 2018-04-13 01:36:10,324 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--98d27eb8-4d6c-41d8-9bc3-11ff03bcae27' 2018-04-13 01:36:12,710 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-98d27eb8-4d6c-41d8-9bc3-11ff03bcae27' 2018-04-13 01:36:15,584 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-98d27eb8-4d6c-41d8-9bc3-11ff03bcae27' 2018-04-13 01:36:31,374 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-98d27eb8-4d6c-41d8-9bc3-11ff03bcae27' 2018-04-13 01:36:32,712 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-98d27eb8-4d6c-41d8-9bc3-11ff03bcae27' 2018-04-13 01:36:41,367 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-98d27eb8-4d6c-41d8-9bc3-11ff03bcae27' 2018-04-13 01:36:48,919 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution 2018-04-13 01:36:57,087 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping... 2018-04-13 01:36:59,574 - functest.opnfv_tests.openstack.vping.vping_base - DEBUG - Pinging 192.168.130.12. Waiting for response... 2018-04-13 01:37:11,087 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected! 2018-04-13 01:37:11,710 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-13 01:37:11,711 - xtesting.ci.run_tests - INFO - Test result: +------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------+------------------+------------------+----------------+ | vping_userdata | functest | 01:01 | PASS | +------------------------+------------------+------------------+----------------+ 2018-04-13 01:37:35,162 - xtesting.ci.run_tests - INFO - Running test case 'tempest_smoke_serial'... 2018-04-13 01:37:35,229 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-13 01:37:41,266 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-04-13 01:37:41.144 18 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=ec4a0f8f-e398-4a04-aa78-3a9a00427302) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | ec4a0f8f-e398-4a04-aa78-3a9a00427302 | 2018-04-13T01:37:41 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: ec4a0f8f-e398-4a04-aa78-3a9a00427302 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-13 01:37:45,801 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+-------------------+-----------+ | Service | Service Type | Status | +-------------+-------------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | nfv-orchestration | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+-------------------+-----------+ 2018-04-13 01:37:45,802 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-04-13 01:37:52,923 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-04-13 01:37:51.624 27 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-04-13 01:37:51.672 27 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-04-13 01:37:52.794 27 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=c05e9d53-f80a-4baf-a22f-d715e17117cc) has been successfully created! Using verifier 'opnfv-tempest' (UUID=c05e9d53-f80a-4baf-a22f-d715e17117cc) as the default verifier for the future CLI operations. 2018-04-13 01:37:56,957 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-04-13 01:37:59,828 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-04-13 01:38:05,278 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-04-13 01:38:13,242 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-04-13 01:38:11.944 46 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=c05e9d53-f80a-4baf-a22f-d715e17117cc) for deployment 'opnfv-rally' (UUID=ec4a0f8f-e398-4a04-aa78-3a9a00427302). 2018-04-13 01:38:13.128 46 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=c05e9d53-f80a-4baf-a22f-d715e17117cc) has been successfully configured for deployment 'opnfv-rally' (UUID=ec4a0f8f-e398-4a04-aa78-3a9a00427302)! 2018-04-13 01:38:13,242 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-04-13 01:38:13,242 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-04-13 01:38:13,244 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-04-13 01:38:13,246 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-04-13 01:38:13,727 - functest.opnfv_tests.openstack.tempest.tempest - ERROR - Error with run Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/tempest/tempest.py", line 272, in run self.generate_test_list() File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/tempest/tempest.py", line 119, in generate_test_list output = subprocess.check_output(cmd, shell=True) File "/usr/lib/python2.7/subprocess.py", line 219, in check_output raise CalledProcessError(retcode, cmd, output=output) CalledProcessError: Command '(cd /root/.rally/verification/verifier-c05e9d53-f80a-4baf-a22f-d715e17117cc/repo; testr list-tests '^tempest\.(api|scenario).*\[.*\bsmoke\b.*\]$' >/home/opnfv/functest/results/tempest/test_list.txt 2>/dev/null)' returned non-zero exit status 3 2018-04-13 01:38:21,692 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-13 01:38:21,692 - xtesting.ci.run_tests - INFO - Test result: +------------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------------+------------------+------------------+----------------+ | tempest_smoke_serial | functest | 00:24 | FAIL | +------------------------------+------------------+------------------+----------------+ 2018-04-13 01:38:21,694 - xtesting.ci.run_tests - ERROR - The test case 'tempest_smoke_serial' failed. 2018-04-13 01:38:21,695 - xtesting.ci.run_tests - INFO - Running test case 'rally_sanity'... 2018-04-13 01:38:21,762 - xtesting.energy.energy - DEBUG - Getting current scenario 2018-04-13 01:38:22,742 - xtesting.energy.energy - INFO - No current running scenario at http://energy.opnfv.fr/resources/recorders/environment/huawei-virtual2 2018-04-13 01:38:22,743 - xtesting.energy.energy - DEBUG - Starting recording 2018-04-13 01:38:22,743 - xtesting.energy.energy - DEBUG - Submitting scenario (rally_sanity/running) 2018-04-13 01:38:24,597 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-13 01:38:27,577 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-04-13 01:38:27.440 51 INFO rally.deployment.engine [-] Deployment ec4a0f8f-e398-4a04-aa78-3a9a00427302 | Starting: Destroy cloud and free allocated resources. 2018-04-13 01:38:27.452 51 INFO rally.deployment.engine [-] Deployment ec4a0f8f-e398-4a04-aa78-3a9a00427302 | Completed: Destroy cloud and free allocated resources. 2018-04-13 01:38:27.465 51 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=c05e9d53-f80a-4baf-a22f-d715e17117cc). 2018-04-13 01:38:27.468 51 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-04-13 01:38:30,524 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-04-13 01:38:30.404 54 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=4b829987-490f-4b73-9f5d-16d895a9083a) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 4b829987-490f-4b73-9f5d-16d895a9083a | 2018-04-13T01:38:30 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 4b829987-490f-4b73-9f5d-16d895a9083a ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-13 01:38:35,202 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+-------------------+-----------+ | Service | Service Type | Status | +-------------+-------------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | nfv-orchestration | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+-------------------+-----------+ 2018-04-13 01:38:35,202 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating the test name... 2018-04-13 01:38:37,378 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating image 'Cirros-0.4.0-01300eb5-e678-450d-88e8-10123e6cf791'... 2018-04-13 01:38:39,347 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating network 'rally-net-01300eb5-e678-450d-88e8-10123e6cf791'... 2018-04-13 01:38:41,971 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating router 'rally-router-01300eb5-e678-450d-88e8-10123e6cf791'... 2018-04-13 01:38:57,372 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-tiny-01300eb5-e678-450d-88e8-10123e6cf791'... 2018-04-13 01:38:58,760 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-mini-01300eb5-e678-450d-88e8-10123e6cf791'... 2018-04-13 01:39:00,057 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2018-04-13 01:39:00,057 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-authenticate.yaml 2018-04-13 01:39:00,057 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-13 01:39:00,067 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-13 01:39:00,067 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['authenticate'], 'concurrency': 4, 'netid': 'dff22389-329d-4e74-870b-1f978f68baf8', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-01300eb5-e678-450d-88e8-10123e6cf791', 'flavor_name': 'rally-tiny-01300eb5-e678-450d-88e8-10123e6cf791', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-01300eb5-e678-450d-88e8-10123e6cf791', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-13 01:40:35,069 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : aa0f589e-f8b6-4350-8545-024b663d9562 2018-04-13 01:40:35,070 - functest.opnfv_tests.openstack.rally.rally - DEBUG - /home/opnfv/functest/results/rally does not exist, we create it. 2018-04-13 01:40:35,070 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'aa0f589e-f8b6-4350-8545-024b663d9562'] 2018-04-13 01:40:36,367 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task aa0f589e-f8b6-4350-8545-024b663d9562: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task aa0f589e-f8b6-4350-8545-024b663d9562 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.895 | 0.895 | 0.895 | 0.895 | 0.895 | 0.895 | 100.0% | 1 | | total | 0.895 | 0.895 | 0.895 | 0.895 | 0.895 | 0.895 | 100.0% | 1 | | -> duration | 0.895 | 0.895 | 0.895 | 0.895 | 0.895 | 0.895 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.895159 Full duration: 11.865215 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task aa0f589e-f8b6-4350-8545-024b663d9562 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 1.096 | 1.096 | 1.096 | 1.096 | 1.096 | 1.096 | 100.0% | 1 | | total | 1.814 | 1.814 | 1.814 | 1.814 | 1.814 | 1.814 | 100.0% | 1 | | -> duration | 1.814 | 1.814 | 1.814 | 1.814 | 1.814 | 1.814 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.814319 Full duration: 12.747066 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task aa0f589e-f8b6-4350-8545-024b663d9562 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.479 | 0.479 | 0.479 | 0.479 | 0.479 | 0.479 | 100.0% | 1 | | total | 1.298 | 1.298 | 1.298 | 1.298 | 1.298 | 1.298 | 100.0% | 1 | | -> duration | 1.298 | 1.298 | 1.298 | 1.298 | 1.298 | 1.298 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.298415 Full duration: 12.630064 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task aa0f589e-f8b6-4350-8545-024b663d9562 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 1.188 | 1.188 | 1.188 | 1.188 | 1.188 | 1.188 | 100.0% | 1 | | total | 1.881 | 1.881 | 1.881 | 1.881 | 1.881 | 1.881 | 100.0% | 1 | | -> duration | 1.881 | 1.881 | 1.881 | 1.881 | 1.881 | 1.881 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.881216 Full duration: 12.576059 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task aa0f589e-f8b6-4350-8545-024b663d9562 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.687 | 0.687 | 0.687 | 0.687 | 0.687 | 0.687 | 100.0% | 1 | | total | 1.343 | 1.343 | 1.343 | 1.343 | 1.343 | 1.343 | 100.0% | 1 | | -> duration | 1.343 | 1.343 | 1.343 | 1.343 | 1.343 | 1.343 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.34342 Full duration: 11.889956 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task aa0f589e-f8b6-4350-8545-024b663d9562 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.514 | 0.514 | 0.514 | 0.514 | 0.514 | 0.514 | 100.0% | 1 | | total | 1.191 | 1.191 | 1.191 | 1.191 | 1.191 | 1.191 | 100.0% | 1 | | -> duration | 1.191 | 1.191 | 1.191 | 1.191 | 1.191 | 1.191 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.19148 Full duration: 11.640761 HINTS: * To plot HTML graphics with this data, run: rally task report aa0f589e-f8b6-4350-8545-024b663d9562 --out output.html * To generate a JUnit report, run: rally task export aa0f589e-f8b6-4350-8545-024b663d9562 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report aa0f589e-f8b6-4350-8545-024b663d9562 --json --out output.json 2018-04-13 01:40:36,367 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'aa0f589e-f8b6-4350-8545-024b663d9562'] 2018-04-13 01:40:37,656 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-13 01:40:37,657 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'aa0f589e-f8b6-4350-8545-024b663d9562', '--out', u'/home/opnfv/functest/results/rally/opnfv-authenticate.html'] 2018-04-13 01:40:37,662 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2018-04-13 01:40:37,663 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2018-04-13 01:40:37,663 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-glance.yaml 2018-04-13 01:40:37,663 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-13 01:40:37,673 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-13 01:40:37,674 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['glance'], 'concurrency': 4, 'netid': 'dff22389-329d-4e74-870b-1f978f68baf8', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-01300eb5-e678-450d-88e8-10123e6cf791', 'flavor_name': 'rally-tiny-01300eb5-e678-450d-88e8-10123e6cf791', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-01300eb5-e678-450d-88e8-10123e6cf791', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-13 01:42:35,718 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 691a20f6-8af5-4f5e-8786-952b54f99471 2018-04-13 01:42:35,718 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '691a20f6-8af5-4f5e-8786-952b54f99471'] 2018-04-13 01:42:37,004 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 691a20f6-8af5-4f5e-8786-952b54f99471: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 691a20f6-8af5-4f5e-8786-952b54f99471 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.77 | 3.77 | 3.77 | 3.77 | 3.77 | 3.77 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.315 | 0.315 | 0.315 | 0.315 | 0.315 | 0.315 | 100.0% | 1 | | -> glance_v2.upload_data | 1.073 | 1.073 | 1.073 | 1.073 | 1.073 | 1.073 | 100.0% | 1 | | glance_v2.delete_image | 0.853 | 0.853 | 0.853 | 0.853 | 0.853 | 0.853 | 100.0% | 1 | | total | 4.623 | 4.623 | 4.623 | 4.623 | 4.623 | 4.623 | 100.0% | 1 | | -> duration | 4.623 | 4.623 | 4.623 | 4.623 | 4.623 | 4.623 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.623092 Full duration: 17.544037 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 691a20f6-8af5-4f5e-8786-952b54f99471 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.907 | 3.907 | 3.907 | 3.907 | 3.907 | 3.907 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.123 | 0.123 | 0.123 | 0.123 | 0.123 | 0.123 | 100.0% | 1 | | -> glance_v2.upload_data | 1.369 | 1.369 | 1.369 | 1.369 | 1.369 | 1.369 | 100.0% | 1 | | glance_v2.list_images | 0.094 | 0.094 | 0.094 | 0.094 | 0.094 | 0.094 | 100.0% | 1 | | total | 4.002 | 4.002 | 4.002 | 4.002 | 4.002 | 4.002 | 100.0% | 1 | | -> duration | 4.002 | 4.002 | 4.002 | 4.002 | 4.002 | 4.002 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.00162 Full duration: 19.43282 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 691a20f6-8af5-4f5e-8786-952b54f99471 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.362 | 0.362 | 0.362 | 0.362 | 0.362 | 0.362 | 100.0% | 1 | | total | 0.362 | 0.362 | 0.362 | 0.362 | 0.362 | 0.362 | 100.0% | 1 | | -> duration | 0.362 | 0.362 | 0.362 | 0.362 | 0.362 | 0.362 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.362284 Full duration: 13.04351 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally-tiny-01300eb5-e678-450d-88e8-10123e6cf791" }, "number_instances": 2, "nics": [ { "net-id": "dff22389-329d-4e74-870b-1f978f68baf8" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } } } -------------------------------------------------------------------------------- Task 691a20f6-8af5-4f5e-8786-952b54f99471 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.413 | 3.413 | 3.413 | 3.413 | 3.413 | 3.413 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.103 | 0.103 | 0.103 | 0.103 | 0.103 | 0.103 | 100.0% | 1 | | -> glance_v2.upload_data | 0.899 | 0.899 | 0.899 | 0.899 | 0.899 | 0.899 | 100.0% | 1 | | nova.boot_servers | 13.586 | 13.586 | 13.586 | 13.586 | 13.586 | 13.586 | 100.0% | 1 | | total | 17.0 | 17.0 | 17.0 | 17.0 | 17.0 | 17.0 | 100.0% | 1 | | -> duration | 16.0 | 16.0 | 16.0 | 16.0 | 16.0 | 16.0 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 15.999978 Full duration: 44.843593 HINTS: * To plot HTML graphics with this data, run: rally task report 691a20f6-8af5-4f5e-8786-952b54f99471 --out output.html * To generate a JUnit report, run: rally task export 691a20f6-8af5-4f5e-8786-952b54f99471 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 691a20f6-8af5-4f5e-8786-952b54f99471 --json --out output.json 2018-04-13 01:42:37,005 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '691a20f6-8af5-4f5e-8786-952b54f99471'] 2018-04-13 01:42:38,276 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-13 01:42:38,277 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '691a20f6-8af5-4f5e-8786-952b54f99471', '--out', u'/home/opnfv/functest/results/rally/opnfv-glance.html'] 2018-04-13 01:42:38,282 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2018-04-13 01:42:38,283 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2018-04-13 01:42:38,283 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-cinder.yaml 2018-04-13 01:42:38,283 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-13 01:42:38,293 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-13 01:42:38,293 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['cinder'], 'concurrency': 4, 'netid': 'dff22389-329d-4e74-870b-1f978f68baf8', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-01300eb5-e678-450d-88e8-10123e6cf791', 'flavor_name': 'rally-tiny-01300eb5-e678-450d-88e8-10123e6cf791', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-01300eb5-e678-450d-88e8-10123e6cf791', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-13 01:47:23,054 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 056ce900-86ca-4a74-89e7-c66d6fbba657 2018-04-13 01:47:23,054 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '056ce900-86ca-4a74-89e7-c66d6fbba657'] 2018-04-13 01:47:24,391 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 056ce900-86ca-4a74-89e7-c66d6fbba657: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "force": false }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 056ce900-86ca-4a74-89e7-c66d6fbba657 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_snapshot | 3.992 | 3.992 | 3.992 | 3.992 | 3.992 | 3.992 | 100.0% | 1 | | cinder_v2.delete_snapshot | 2.298 | 2.298 | 2.298 | 2.298 | 2.298 | 2.298 | 100.0% | 1 | | total | 6.29 | 6.29 | 6.29 | 6.29 | 6.29 | 6.29 | 100.0% | 1 | | -> duration | 6.29 | 6.29 | 6.29 | 6.29 | 6.29 | 6.29 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.290007 Full duration: 32.870319 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": { "max": 1, "min": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 056ce900-86ca-4a74-89e7-c66d6fbba657 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 4.453 | 4.453 | 4.453 | 4.453 | 4.453 | 4.453 | 100.0% | 1 | | cinder_v2.delete_volume | 2.377 | 2.377 | 2.377 | 2.377 | 2.377 | 2.377 | 100.0% | 1 | | total | 6.83 | 6.83 | 6.83 | 6.83 | 6.83 | 6.83 | 100.0% | 1 | | -> duration | 6.83 | 6.83 | 6.83 | 6.83 | 6.83 | 6.83 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.830074 Full duration: 24.955203 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "image": { "name": "Cirros-0.4.0-01300eb5-e678-450d-88e8-10123e6cf791" }, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 056ce900-86ca-4a74-89e7-c66d6fbba657 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 6.869 | 6.869 | 6.869 | 6.869 | 6.869 | 6.869 | 100.0% | 1 | | cinder_v2.delete_volume | 2.331 | 2.331 | 2.331 | 2.331 | 2.331 | 2.331 | 100.0% | 1 | | total | 9.2 | 9.2 | 9.2 | 9.2 | 9.2 | 9.2 | 100.0% | 1 | | -> duration | 9.2 | 9.2 | 9.2 | 9.2 | 9.2 | 9.2 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.199827 Full duration: 27.354072 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 056ce900-86ca-4a74-89e7-c66d6fbba657 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 4.75 | 4.75 | 4.75 | 4.75 | 4.75 | 4.75 | 100.0% | 1 | | cinder_v2.delete_volume | 2.519 | 2.519 | 2.519 | 2.519 | 2.519 | 2.519 | 100.0% | 1 | | total | 7.269 | 7.269 | 7.269 | 7.269 | 7.269 | 7.269 | 100.0% | 1 | | -> duration | 7.269 | 7.269 | 7.269 | 7.269 | 7.269 | 7.269 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.269006 Full duration: 26.758731 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "new_size": 2, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 056ce900-86ca-4a74-89e7-c66d6fbba657 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 4.059 | 4.059 | 4.059 | 4.059 | 4.059 | 4.059 | 100.0% | 1 | | cinder_v2.extend_volume | 2.844 | 2.844 | 2.844 | 2.844 | 2.844 | 2.844 | 100.0% | 1 | | cinder_v2.delete_volume | 2.302 | 2.302 | 2.302 | 2.302 | 2.302 | 2.302 | 100.0% | 1 | | total | 9.206 | 9.206 | 9.206 | 9.206 | 9.206 | 9.206 | 100.0% | 1 | | -> duration | 9.206 | 9.206 | 9.206 | 9.206 | 9.206 | 9.206 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.205774 Full duration: 27.938888 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 056ce900-86ca-4a74-89e7-c66d6fbba657 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.829 | 3.829 | 3.829 | 3.829 | 3.829 | 3.829 | 100.0% | 1 | | cinder_v2.delete_volume | 2.373 | 2.373 | 2.373 | 2.373 | 2.373 | 2.373 | 100.0% | 1 | | total | 6.202 | 6.202 | 6.202 | 6.202 | 6.202 | 6.202 | 100.0% | 1 | | -> duration | 6.202 | 6.202 | 6.202 | 6.202 | 6.202 | 6.202 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.201875 Full duration: 33.066579 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 056ce900-86ca-4a74-89e7-c66d6fbba657 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 1.673 | 1.673 | 1.673 | 1.673 | 1.673 | 1.673 | 100.0% | 1 | | cinder_v2.list_qos | 0.046 | 0.046 | 0.046 | 0.046 | 0.046 | 0.046 | 100.0% | 1 | | total | 1.72 | 1.72 | 1.72 | 1.72 | 1.72 | 1.72 | 100.0% | 1 | | -> duration | 1.72 | 1.72 | 1.72 | 1.72 | 1.72 | 1.72 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.72009 Full duration: 19.759117 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 056ce900-86ca-4a74-89e7-c66d6fbba657 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 1.994 | 1.994 | 1.994 | 1.994 | 1.994 | 1.994 | 100.0% | 1 | | cinder_v2.set_qos | 0.089 | 0.089 | 0.089 | 0.089 | 0.089 | 0.089 | 100.0% | 1 | | total | 2.083 | 2.083 | 2.083 | 2.083 | 2.083 | 2.083 | 100.0% | 1 | | -> duration | 2.083 | 2.083 | 2.083 | 2.083 | 2.083 | 2.083 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.083442 Full duration: 21.118033 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "description": "rally tests creating types" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 056ce900-86ca-4a74-89e7-c66d6fbba657 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 1.218 | 1.218 | 1.218 | 1.218 | 1.218 | 1.218 | 100.0% | 1 | | cinder_v2.list_types | 0.053 | 0.053 | 0.053 | 0.053 | 0.053 | 0.053 | 100.0% | 1 | | total | 1.271 | 1.271 | 1.271 | 1.271 | 1.271 | 1.271 | 100.0% | 1 | | -> duration | 1.271 | 1.271 | 1.271 | 1.271 | 1.271 | 1.271 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.271299 Full duration: 19.971988 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 056ce900-86ca-4a74-89e7-c66d6fbba657 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 1.078 | 1.078 | 1.078 | 1.078 | 1.078 | 1.078 | 100.0% | 1 | | cinder_v2.create_encryption_type | 0.203 | 0.203 | 0.203 | 0.203 | 0.203 | 0.203 | 100.0% | 1 | | total | 1.281 | 1.281 | 1.281 | 1.281 | 1.281 | 1.281 | 100.0% | 1 | | -> duration | 1.281 | 1.281 | 1.281 | 1.281 | 1.281 | 1.281 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.280862 Full duration: 19.139156 HINTS: * To plot HTML graphics with this data, run: rally task report 056ce900-86ca-4a74-89e7-c66d6fbba657 --out output.html * To generate a JUnit report, run: rally task export 056ce900-86ca-4a74-89e7-c66d6fbba657 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 056ce900-86ca-4a74-89e7-c66d6fbba657 --json --out output.json 2018-04-13 01:47:24,391 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '056ce900-86ca-4a74-89e7-c66d6fbba657'] 2018-04-13 01:47:25,717 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-13 01:47:25,717 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '056ce900-86ca-4a74-89e7-c66d6fbba657', '--out', u'/home/opnfv/functest/results/rally/opnfv-cinder.html'] 2018-04-13 01:47:25,721 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2018-04-13 01:47:25,722 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2018-04-13 01:47:25,722 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-heat.yaml 2018-04-13 01:47:25,722 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-13 01:47:25,731 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-13 01:47:25,732 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['heat'], 'concurrency': 4, 'netid': 'dff22389-329d-4e74-870b-1f978f68baf8', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-01300eb5-e678-450d-88e8-10123e6cf791', 'flavor_name': 'rally-tiny-01300eb5-e678-450d-88e8-10123e6cf791', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-01300eb5-e678-450d-88e8-10123e6cf791', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-13 01:49:38,628 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : cc531818-ace2-4431-81bb-196d3999b402 2018-04-13 01:49:38,628 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'cc531818-ace2-4431-81bb-196d3999b402'] 2018-04-13 01:49:39,906 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task cc531818-ace2-4431-81bb-196d3999b402: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task cc531818-ace2-4431-81bb-196d3999b402 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 7.329 | 7.329 | 7.329 | 7.329 | 7.329 | 7.329 | 100.0% | 1 | | heat.update_stack | 2.521 | 2.521 | 2.521 | 2.521 | 2.521 | 2.521 | 100.0% | 1 | | heat.delete_stack | 3.585 | 3.585 | 3.585 | 3.585 | 3.585 | 3.585 | 100.0% | 1 | | total | 13.435 | 13.435 | 13.435 | 13.435 | 13.435 | 13.435 | 100.0% | 1 | | -> duration | 9.435 | 9.435 | 9.435 | 9.435 | 9.435 | 9.435 | 100.0% | 1 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.435045 Full duration: 32.11155 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task cc531818-ace2-4431-81bb-196d3999b402 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 6.116 | 6.116 | 6.116 | 6.116 | 6.116 | 6.116 | 100.0% | 1 | | heat.check_stack | 0.445 | 0.445 | 0.445 | 0.445 | 0.445 | 0.445 | 100.0% | 1 | | heat.delete_stack | 1.412 | 1.412 | 1.412 | 1.412 | 1.412 | 1.412 | 100.0% | 1 | | total | 7.974 | 7.974 | 7.974 | 7.974 | 7.974 | 7.974 | 100.0% | 1 | | -> duration | 5.974 | 5.974 | 5.974 | 5.974 | 5.974 | 5.974 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.973529 Full duration: 27.512921 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task cc531818-ace2-4431-81bb-196d3999b402 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 5.322 | 5.322 | 5.322 | 5.322 | 5.322 | 5.322 | 100.0% | 1 | | heat.suspend_stack | 0.413 | 0.413 | 0.413 | 0.413 | 0.413 | 0.413 | 100.0% | 1 | | heat.resume_stack | 1.508 | 1.508 | 1.508 | 1.508 | 1.508 | 1.508 | 100.0% | 1 | | heat.delete_stack | 2.525 | 2.525 | 2.525 | 2.525 | 2.525 | 2.525 | 100.0% | 1 | | total | 9.769 | 9.769 | 9.769 | 9.769 | 9.769 | 9.769 | 100.0% | 1 | | -> duration | 7.769 | 7.769 | 7.769 | 7.769 | 7.769 | 7.769 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.76862 Full duration: 28.196124 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task cc531818-ace2-4431-81bb-196d3999b402 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 1.036 | 1.036 | 1.036 | 1.036 | 1.036 | 1.036 | 100.0% | 1 | | total | 1.036 | 1.036 | 1.036 | 1.036 | 1.036 | 1.036 | 100.0% | 1 | | -> duration | 1.036 | 1.036 | 1.036 | 1.036 | 1.036 | 1.036 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.036247 Full duration: 16.657732 HINTS: * To plot HTML graphics with this data, run: rally task report cc531818-ace2-4431-81bb-196d3999b402 --out output.html * To generate a JUnit report, run: rally task export cc531818-ace2-4431-81bb-196d3999b402 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report cc531818-ace2-4431-81bb-196d3999b402 --json --out output.json 2018-04-13 01:49:39,906 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'cc531818-ace2-4431-81bb-196d3999b402'] 2018-04-13 01:49:41,178 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-13 01:49:41,178 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'cc531818-ace2-4431-81bb-196d3999b402', '--out', u'/home/opnfv/functest/results/rally/opnfv-heat.html'] 2018-04-13 01:49:41,182 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2018-04-13 01:49:41,183 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2018-04-13 01:49:41,183 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-keystone.yaml 2018-04-13 01:49:41,183 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-13 01:49:41,193 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-13 01:49:41,194 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['keystone'], 'concurrency': 4, 'netid': 'dff22389-329d-4e74-870b-1f978f68baf8', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-01300eb5-e678-450d-88e8-10123e6cf791', 'flavor_name': 'rally-tiny-01300eb5-e678-450d-88e8-10123e6cf791', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-01300eb5-e678-450d-88e8-10123e6cf791', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-13 01:54:24,542 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : ef013262-5196-46db-9464-6a51bdd1babe 2018-04-13 01:54:24,542 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'ef013262-5196-46db-9464-6a51bdd1babe'] 2018-04-13 01:54:25,881 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task ef013262-5196-46db-9464-6a51bdd1babe: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ef013262-5196-46db-9464-6a51bdd1babe has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.882 | 0.882 | 0.882 | 0.882 | 0.882 | 0.882 | 100.0% | 1 | | keystone_v3.add_role | 0.211 | 0.211 | 0.211 | 0.211 | 0.211 | 0.211 | 100.0% | 1 | | keystone_v3.revoke_role | 0.223 | 0.223 | 0.223 | 0.223 | 0.223 | 0.223 | 100.0% | 1 | | total | 1.315 | 1.315 | 1.315 | 1.315 | 1.315 | 1.315 | 100.0% | 1 | | -> duration | 1.315 | 1.315 | 1.315 | 1.315 | 1.315 | 1.315 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.315189 Full duration: 22.572929 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ef013262-5196-46db-9464-6a51bdd1babe has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.862 | 0.862 | 0.862 | 0.862 | 0.862 | 0.862 | 100.0% | 1 | | keystone_v3.add_role | 0.193 | 0.193 | 0.193 | 0.193 | 0.193 | 0.193 | 100.0% | 1 | | keystone_v3.list_roles | 0.2 | 0.2 | 0.2 | 0.2 | 0.2 | 0.2 | 100.0% | 1 | | total | 1.255 | 1.255 | 1.255 | 1.255 | 1.255 | 1.255 | 100.0% | 1 | | -> duration | 1.255 | 1.255 | 1.255 | 1.255 | 1.255 | 1.255 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.254886 Full duration: 22.576351 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ef013262-5196-46db-9464-6a51bdd1babe has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 1.454 | 1.454 | 1.454 | 1.454 | 1.454 | 1.454 | 100.0% | 1 | | keystone_v3.list_projects | 0.162 | 0.162 | 0.162 | 0.162 | 0.162 | 0.162 | 100.0% | 1 | | total | 1.616 | 1.616 | 1.616 | 1.616 | 1.616 | 1.616 | 100.0% | 1 | | -> duration | 1.616 | 1.616 | 1.616 | 1.616 | 1.616 | 1.616 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.615618 Full duration: 22.450549 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ef013262-5196-46db-9464-6a51bdd1babe has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.854 | 0.854 | 0.854 | 0.854 | 0.854 | 0.854 | 100.0% | 1 | | keystone_v3.delete_role | 0.182 | 0.182 | 0.182 | 0.182 | 0.182 | 0.182 | 100.0% | 1 | | total | 1.036 | 1.036 | 1.036 | 1.036 | 1.036 | 1.036 | 100.0% | 1 | | -> duration | 1.036 | 1.036 | 1.036 | 1.036 | 1.036 | 1.036 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.036067 Full duration: 18.630577 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ef013262-5196-46db-9464-6a51bdd1babe has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.83 | 0.83 | 0.83 | 0.83 | 0.83 | 0.83 | 100.0% | 1 | | keystone_v3.delete_service | 0.063 | 0.063 | 0.063 | 0.063 | 0.063 | 0.063 | 100.0% | 1 | | total | 0.893 | 0.893 | 0.893 | 0.893 | 0.893 | 0.893 | 100.0% | 1 | | -> duration | 0.893 | 0.893 | 0.893 | 0.893 | 0.893 | 0.893 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.892876 Full duration: 19.279048 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ef013262-5196-46db-9464-6a51bdd1babe has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 1.161 | 1.161 | 1.161 | 1.161 | 1.161 | 1.161 | 100.0% | 1 | | keystone_v3.create_user | 0.5 | 0.5 | 0.5 | 0.5 | 0.5 | 0.5 | 100.0% | 1 | | -> keystone_v3.list_roles | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 100.0% | 1 | | -> keystone_v3.add_role | 0.079 | 0.079 | 0.079 | 0.079 | 0.079 | 0.079 | 100.0% | 1 | | keystone_v3.create_role | 0.184 | 0.184 | 0.184 | 0.184 | 0.184 | 0.184 | 100.0% | 1 | | keystone_v3.get_project | 0.033 | 0.033 | 0.033 | 0.033 | 0.033 | 0.033 | 100.0% | 1 | | keystone_v3.get_user | 0.175 | 0.175 | 0.175 | 0.175 | 0.175 | 0.175 | 100.0% | 1 | | keystone_v3.get_role | 0.16 | 0.16 | 0.16 | 0.16 | 0.16 | 0.16 | 100.0% | 1 | | keystone_v3.list_services | 0.146 | 0.146 | 0.146 | 0.146 | 0.146 | 0.146 | 100.0% | 1 | | keystone_v3.get_services | 0.175 | 0.175 | 0.175 | 0.175 | 0.175 | 0.175 | 100.0% | 1 | | total | 2.765 | 2.765 | 2.765 | 2.765 | 2.765 | 2.765 | 100.0% | 1 | | -> duration | 2.765 | 2.765 | 2.765 | 2.765 | 2.765 | 2.765 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.765031 Full duration: 29.513471 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ef013262-5196-46db-9464-6a51bdd1babe has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 1.138 | 1.138 | 1.138 | 1.138 | 1.138 | 1.138 | 100.0% | 1 | | keystone_v3.update_project | 0.188 | 0.188 | 0.188 | 0.188 | 0.188 | 0.188 | 100.0% | 1 | | keystone_v3.delete_project | 0.132 | 0.132 | 0.132 | 0.132 | 0.132 | 0.132 | 100.0% | 1 | | total | 1.458 | 1.458 | 1.458 | 1.458 | 1.458 | 1.458 | 100.0% | 1 | | -> duration | 1.458 | 1.458 | 1.458 | 1.458 | 1.458 | 1.458 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.458158 Full duration: 20.031287 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task ef013262-5196-46db-9464-6a51bdd1babe has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 1.246 | 1.246 | 1.246 | 1.246 | 1.246 | 1.246 | 100.0% | 1 | | total | 1.301 | 1.301 | 1.301 | 1.301 | 1.301 | 1.301 | 100.0% | 1 | | -> duration | 1.301 | 1.301 | 1.301 | 1.301 | 1.301 | 1.301 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.301177 Full duration: 22.079854 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task ef013262-5196-46db-9464-6a51bdd1babe has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 1.204 | 1.204 | 1.204 | 1.204 | 1.204 | 1.204 | 100.0% | 1 | | total | 1.204 | 1.204 | 1.204 | 1.204 | 1.204 | 1.204 | 100.0% | 1 | | -> duration | 1.204 | 1.204 | 1.204 | 1.204 | 1.204 | 1.204 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.204398 Full duration: 21.81713 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task ef013262-5196-46db-9464-6a51bdd1babe has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 1.184 | 1.184 | 1.184 | 1.184 | 1.184 | 1.184 | 100.0% | 1 | | keystone_v3.list_users | 0.062 | 0.062 | 0.062 | 0.062 | 0.062 | 0.062 | 100.0% | 1 | | total | 1.421 | 1.421 | 1.421 | 1.421 | 1.421 | 1.421 | 100.0% | 1 | | -> duration | 1.421 | 1.421 | 1.421 | 1.421 | 1.421 | 1.421 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.420696 Full duration: 23.01579 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "users_per_tenant": 10 }, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task ef013262-5196-46db-9464-6a51bdd1babe has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 1.161 | 1.161 | 1.161 | 1.161 | 1.161 | 1.161 | 100.0% | 1 | | keystone_v3.create_users | 7.892 | 7.892 | 7.892 | 7.892 | 7.892 | 7.892 | 100.0% | 1 | | -> keystone_v3.create_user (x10) | 7.892 | 7.892 | 7.892 | 7.892 | 7.892 | 7.892 | 100.0% | 1 | | --> keystone_v3.list_roles (x10) | 1.482 | 1.482 | 1.482 | 1.482 | 1.482 | 1.482 | 100.0% | 1 | | --> keystone_v3.add_role (x10) | 1.823 | 1.823 | 1.823 | 1.823 | 1.823 | 1.823 | 100.0% | 1 | | total | 10.903 | 10.903 | 10.903 | 10.903 | 10.903 | 10.903 | 100.0% | 1 | | -> duration | 10.903 | 10.903 | 10.903 | 10.903 | 10.903 | 10.903 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.902887 Full duration: 35.106949 HINTS: * To plot HTML graphics with this data, run: rally task report ef013262-5196-46db-9464-6a51bdd1babe --out output.html * To generate a JUnit report, run: rally task export ef013262-5196-46db-9464-6a51bdd1babe --type junit --to output.xml * To get raw JSON output of task results, run: rally task report ef013262-5196-46db-9464-6a51bdd1babe --json --out output.json 2018-04-13 01:54:25,882 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'ef013262-5196-46db-9464-6a51bdd1babe'] 2018-04-13 01:54:27,240 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-13 01:54:27,241 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'ef013262-5196-46db-9464-6a51bdd1babe', '--out', u'/home/opnfv/functest/results/rally/opnfv-keystone.html'] 2018-04-13 01:54:27,246 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2018-04-13 01:54:27,247 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2018-04-13 01:54:27,247 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-neutron.yaml 2018-04-13 01:54:27,247 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-13 01:54:27,257 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-13 01:54:27,257 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['neutron'], 'concurrency': 4, 'netid': 'dff22389-329d-4e74-870b-1f978f68baf8', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-01300eb5-e678-450d-88e8-10123e6cf791', 'flavor_name': 'rally-tiny-01300eb5-e678-450d-88e8-10123e6cf791', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-01300eb5-e678-450d-88e8-10123e6cf791', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-13 02:04:30,767 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 88a8af86-2583-4bd4-a79c-92f57a71eedd 2018-04-13 02:04:30,768 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '88a8af86-2583-4bd4-a79c-92f57a71eedd'] 2018-04-13 02:04:32,239 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 88a8af86-2583-4bd4-a79c-92f57a71eedd: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } } } -------------------------------------------------------------------------------- Task 88a8af86-2583-4bd4-a79c-92f57a71eedd has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.632 | 1.632 | 1.632 | 1.632 | 1.632 | 1.632 | 100.0% | 1 | | neutron.delete_network | 1.126 | 1.126 | 1.126 | 1.126 | 1.126 | 1.126 | 100.0% | 1 | | total | 2.758 | 2.758 | 2.758 | 2.758 | 2.758 | 2.758 | 100.0% | 1 | | -> duration | 2.758 | 2.758 | 2.758 | 2.758 | 2.758 | 2.758 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.758063 Full duration: 25.158213 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "port": -1 } } } } -------------------------------------------------------------------------------- Task 88a8af86-2583-4bd4-a79c-92f57a71eedd has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 3.292 | 3.292 | 3.292 | 3.292 | 3.292 | 3.292 | 100.0% | 1 | | neutron.delete_port | 0.838 | 0.838 | 0.838 | 0.838 | 0.838 | 0.838 | 100.0% | 1 | | total | 4.13 | 4.13 | 4.13 | 4.13 | 4.13 | 4.13 | 100.0% | 1 | | -> duration | 4.13 | 4.13 | 4.13 | 4.13 | 4.13 | 4.13 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.130245 Full duration: 64.302194 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "router_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1, "router": -1 } } } } -------------------------------------------------------------------------------- Task 88a8af86-2583-4bd4-a79c-92f57a71eedd has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.643 | 1.643 | 1.643 | 1.643 | 1.643 | 1.643 | 100.0% | 1 | | neutron.create_subnet | 1.081 | 1.081 | 1.081 | 1.081 | 1.081 | 1.081 | 100.0% | 1 | | neutron.create_router | 5.286 | 5.286 | 5.286 | 5.286 | 5.286 | 5.286 | 100.0% | 1 | | neutron.add_interface_router | 4.644 | 4.644 | 4.644 | 4.644 | 4.644 | 4.644 | 100.0% | 1 | | neutron.remove_interface_router | 2.371 | 2.371 | 2.371 | 2.371 | 2.371 | 2.371 | 100.0% | 1 | | neutron.delete_router | 5.75 | 5.75 | 5.75 | 5.75 | 5.75 | 5.75 | 100.0% | 1 | | total | 20.776 | 20.776 | 20.776 | 20.776 | 20.776 | 20.776 | 100.0% | 1 | | -> duration | 20.776 | 20.776 | 20.776 | 20.776 | 20.776 | 20.776 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.775756 Full duration: 83.121352 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1 } } } } -------------------------------------------------------------------------------- Task 88a8af86-2583-4bd4-a79c-92f57a71eedd has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 2.038 | 2.038 | 2.038 | 2.038 | 2.038 | 2.038 | 100.0% | 1 | | neutron.delete_subnet | 1.136 | 1.136 | 1.136 | 1.136 | 1.136 | 1.136 | 100.0% | 1 | | total | 3.174 | 3.174 | 3.174 | 3.174 | 3.174 | 3.174 | 100.0% | 1 | | -> duration | 3.174 | 3.174 | 3.174 | 3.174 | 3.174 | 3.174 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.174362 Full duration: 61.979376 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } } } -------------------------------------------------------------------------------- Task 88a8af86-2583-4bd4-a79c-92f57a71eedd has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.606 | 1.606 | 1.606 | 1.606 | 1.606 | 1.606 | 100.0% | 1 | | neutron.list_networks | 0.199 | 0.199 | 0.199 | 0.199 | 0.199 | 0.199 | 100.0% | 1 | | total | 1.806 | 1.806 | 1.806 | 1.806 | 1.806 | 1.806 | 100.0% | 1 | | -> duration | 1.806 | 1.806 | 1.806 | 1.806 | 1.806 | 1.806 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.805725 Full duration: 27.59874 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "port": -1 } } } } -------------------------------------------------------------------------------- Task 88a8af86-2583-4bd4-a79c-92f57a71eedd has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.69 | 2.69 | 2.69 | 2.69 | 2.69 | 2.69 | 100.0% | 1 | | neutron.list_ports | 0.179 | 0.179 | 0.179 | 0.179 | 0.179 | 0.179 | 100.0% | 1 | | total | 2.869 | 2.869 | 2.869 | 2.869 | 2.869 | 2.869 | 100.0% | 1 | | -> duration | 2.869 | 2.869 | 2.869 | 2.869 | 2.869 | 2.869 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.868619 Full duration: 59.544705 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "router_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } } } -------------------------------------------------------------------------------- Task 88a8af86-2583-4bd4-a79c-92f57a71eedd has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.515 | 1.515 | 1.515 | 1.515 | 1.515 | 1.515 | 100.0% | 1 | | neutron.create_subnet | 0.766 | 0.766 | 0.766 | 0.766 | 0.766 | 0.766 | 100.0% | 1 | | neutron.create_router | 4.628 | 4.628 | 4.628 | 4.628 | 4.628 | 4.628 | 100.0% | 1 | | neutron.add_interface_router | 3.452 | 3.452 | 3.452 | 3.452 | 3.452 | 3.452 | 100.0% | 1 | | neutron.list_routers | 0.174 | 0.174 | 0.174 | 0.174 | 0.174 | 0.174 | 100.0% | 1 | | total | 10.535 | 10.535 | 10.535 | 10.535 | 10.535 | 10.535 | 100.0% | 1 | | -> duration | 10.535 | 10.535 | 10.535 | 10.535 | 10.535 | 10.535 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.535473 Full duration: 82.589207 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1 } } } } -------------------------------------------------------------------------------- Task 88a8af86-2583-4bd4-a79c-92f57a71eedd has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.656 | 1.656 | 1.656 | 1.656 | 1.656 | 1.656 | 100.0% | 1 | | neutron.create_subnet | 0.799 | 0.799 | 0.799 | 0.799 | 0.799 | 0.799 | 100.0% | 1 | | neutron.list_subnets | 0.12 | 0.12 | 0.12 | 0.12 | 0.12 | 0.12 | 100.0% | 1 | | total | 2.574 | 2.574 | 2.574 | 2.574 | 2.574 | 2.574 | 100.0% | 1 | | -> duration | 2.574 | 2.574 | 2.574 | 2.574 | 2.574 | 2.574 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.574477 Full duration: 66.449595 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } } } -------------------------------------------------------------------------------- Task 88a8af86-2583-4bd4-a79c-92f57a71eedd has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.417 | 1.417 | 1.417 | 1.417 | 1.417 | 1.417 | 100.0% | 1 | | neutron.delete_security_group | 0.248 | 0.248 | 0.248 | 0.248 | 0.248 | 0.248 | 100.0% | 1 | | total | 1.664 | 1.664 | 1.664 | 1.664 | 1.664 | 1.664 | 100.0% | 1 | | -> duration | 1.664 | 1.664 | 1.664 | 1.664 | 1.664 | 1.664 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.664353 Full duration: 24.21546 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } } } -------------------------------------------------------------------------------- Task 88a8af86-2583-4bd4-a79c-92f57a71eedd has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.428 | 1.428 | 1.428 | 1.428 | 1.428 | 1.428 | 100.0% | 1 | | neutron.create_security_group_rule | 0.257 | 0.257 | 0.257 | 0.257 | 0.257 | 0.257 | 100.0% | 1 | | neutron.delete_security_group_rule | 0.151 | 0.151 | 0.151 | 0.151 | 0.151 | 0.151 | 100.0% | 1 | | neutron.delete_security_group | 0.201 | 0.201 | 0.201 | 0.201 | 0.201 | 0.201 | 100.0% | 1 | | total | 2.036 | 2.036 | 2.036 | 2.036 | 2.036 | 2.036 | 100.0% | 1 | | -> duration | 2.036 | 2.036 | 2.036 | 2.036 | 2.036 | 2.036 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.036461 Full duration: 23.413228 -------------------------------------------------------------------------------- test scenario NeutronNetworks.set_and_clear_router_gateway args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": { "router:external": true } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "router": -1 } }, "roles": [ "admin" ] } } -------------------------------------------------------------------------------- Task 88a8af86-2583-4bd4-a79c-92f57a71eedd has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.591 | 1.591 | 1.591 | 1.591 | 1.591 | 1.591 | 100.0% | 1 | | neutron.create_router | 5.415 | 5.415 | 5.415 | 5.415 | 5.415 | 5.415 | 100.0% | 1 | | neutron.add_gateway_router | 2.376 | 2.376 | 2.376 | 2.376 | 2.376 | 2.376 | 100.0% | 1 | | neutron.remove_gateway_router | 1.51 | 1.51 | 1.51 | 1.51 | 1.51 | 1.51 | 100.0% | 1 | | total | 10.892 | 10.892 | 10.892 | 10.892 | 10.892 | 10.892 | 100.0% | 1 | | -> duration | 10.892 | 10.892 | 10.892 | 10.892 | 10.892 | 10.892 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.891928 Full duration: 48.58042 HINTS: * To plot HTML graphics with this data, run: rally task report 88a8af86-2583-4bd4-a79c-92f57a71eedd --out output.html * To generate a JUnit report, run: rally task export 88a8af86-2583-4bd4-a79c-92f57a71eedd --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 88a8af86-2583-4bd4-a79c-92f57a71eedd --json --out output.json 2018-04-13 02:04:32,239 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '88a8af86-2583-4bd4-a79c-92f57a71eedd'] 2018-04-13 02:04:33,658 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-13 02:04:33,659 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '88a8af86-2583-4bd4-a79c-92f57a71eedd', '--out', u'/home/opnfv/functest/results/rally/opnfv-neutron.html'] 2018-04-13 02:04:33,665 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2018-04-13 02:04:33,665 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2018-04-13 02:04:33,666 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-nova.yaml 2018-04-13 02:04:33,666 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-13 02:04:33,675 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-13 02:04:33,676 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['nova'], 'concurrency': 4, 'netid': 'dff22389-329d-4e74-870b-1f978f68baf8', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-01300eb5-e678-450d-88e8-10123e6cf791', 'flavor_name': 'rally-tiny-01300eb5-e678-450d-88e8-10123e6cf791', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-01300eb5-e678-450d-88e8-10123e6cf791', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-13 02:16:28,506 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : c0cdb765-d521-4ca5-8e54-d956acdd61bc 2018-04-13 02:16:28,507 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'c0cdb765-d521-4ca5-8e54-d956acdd61bc'] 2018-04-13 02:16:29,955 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task c0cdb765-d521-4ca5-8e54-d956acdd61bc: aborted -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_live_migrate_server args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-01300eb5-e678-450d-88e8-10123e6cf791" }, "image": { "name": "Cirros-0.4.0-01300eb5-e678-450d-88e8-10123e6cf791" }, "block_migration": false, "nics": [ { "net-id": "dff22389-329d-4e74-870b-1f978f68baf8" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task c0cdb765-d521-4ca5-8e54-d956acdd61bc has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 12.925 | 12.925 | 12.925 | 12.925 | 12.925 | 12.925 | 100.0% | 1 | | nova.find_host_to_migrate | 2.012 | 2.012 | 2.012 | 2.012 | 2.012 | 2.012 | 100.0% | 1 | | nova.live_migrate | 14.61 | 14.61 | 14.61 | 14.61 | 14.61 | 14.61 | 100.0% | 1 | | nova.delete_server | 3.11 | 3.11 | 3.11 | 3.11 | 3.11 | 3.11 | 100.0% | 1 | | total | 32.657 | 32.657 | 32.657 | 32.657 | 32.657 | 32.657 | 100.0% | 1 | | -> duration | 31.657 | 31.657 | 31.657 | 31.657 | 31.657 | 31.657 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 31.657243 Full duration: 47.990373 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_attach_created_volume_and_live_migrate args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-01300eb5-e678-450d-88e8-10123e6cf791" }, "image": { "name": "Cirros-0.4.0-01300eb5-e678-450d-88e8-10123e6cf791" }, "size": 10, "block_migration": false, "boot_server_kwargs": { "nics": [ { "net-id": "dff22389-329d-4e74-870b-1f978f68baf8" } ] } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task c0cdb765-d521-4ca5-8e54-d956acdd61bc has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 10.993 | 10.993 | 10.993 | 10.993 | 10.993 | 10.993 | 100.0% | 1 | | cinder_v2.create_volume | 2.998 | 2.998 | 2.998 | 2.998 | 2.998 | 2.998 | 100.0% | 1 | | nova.attach_volume | 5.111 | 5.111 | 5.111 | 5.111 | 5.111 | 5.111 | 100.0% | 1 | | nova.find_host_to_migrate | 1.632 | 1.632 | 1.632 | 1.632 | 1.632 | 1.632 | 100.0% | 1 | | nova.live_migrate | 14.048 | 14.048 | 14.048 | 14.048 | 14.048 | 14.048 | 100.0% | 1 | | nova.detach_volume | 1.817 | 1.817 | 1.817 | 1.817 | 1.817 | 1.817 | 100.0% | 1 | | cinder_v2.delete_volume | 2.642 | 2.642 | 2.642 | 2.642 | 2.642 | 2.642 | 100.0% | 1 | | nova.delete_server | 3.125 | 3.125 | 3.125 | 3.125 | 3.125 | 3.125 | 100.0% | 1 | | total | 42.367 | 42.367 | 42.367 | 42.367 | 42.367 | 42.367 | 100.0% | 1 | | -> duration | 41.367 | 41.367 | 41.367 | 41.367 | 41.367 | 41.367 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 41.36668 Full duration: 62.056292 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume_and_live_migrate args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-01300eb5-e678-450d-88e8-10123e6cf791" }, "image": { "name": "Cirros-0.4.0-01300eb5-e678-450d-88e8-10123e6cf791" }, "block_migration": false, "volume_size": 10, "force_delete": false, "nics": [ { "net-id": "dff22389-329d-4e74-870b-1f978f68baf8" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task c0cdb765-d521-4ca5-8e54-d956acdd61bc has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 6.399 | 6.399 | 6.399 | 6.399 | 6.399 | 6.399 | 100.0% | 1 | | nova.boot_server | 9.915 | 9.915 | 9.915 | 9.915 | 9.915 | 9.915 | 100.0% | 1 | | nova.find_host_to_migrate | 1.438 | 1.438 | 1.438 | 1.438 | 1.438 | 1.438 | 100.0% | 1 | | nova.live_migrate | 14.944 | 14.944 | 14.944 | 14.944 | 14.944 | 14.944 | 100.0% | 1 | | nova.delete_server | 5.277 | 5.277 | 5.277 | 5.277 | 5.277 | 5.277 | 100.0% | 1 | | total | 37.974 | 37.974 | 37.974 | 37.974 | 37.974 | 37.974 | 100.0% | 1 | | -> duration | 36.974 | 36.974 | 36.974 | 36.974 | 36.974 | 36.974 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 36.973748 Full duration: 58.66485 -------------------------------------------------------------------------------- test scenario NovaKeypair.boot_and_delete_server_with_keypair args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-01300eb5-e678-450d-88e8-10123e6cf791" }, "image": { "name": "Cirros-0.4.0-01300eb5-e678-450d-88e8-10123e6cf791" }, "server_kwargs": { "nics": [ { "net-id": "dff22389-329d-4e74-870b-1f978f68baf8" } ] } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } } } -------------------------------------------------------------------------------- Task c0cdb765-d521-4ca5-8e54-d956acdd61bc has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 1.613 | 1.613 | 1.613 | 1.613 | 1.613 | 1.613 | 100.0% | 1 | | nova.boot_server | 10.544 | 10.544 | 10.544 | 10.544 | 10.544 | 10.544 | 100.0% | 1 | | nova.delete_server | 3.038 | 3.038 | 3.038 | 3.038 | 3.038 | 3.038 | 100.0% | 1 | | nova.delete_keypair | 0.13 | 0.13 | 0.13 | 0.13 | 0.13 | 0.13 | 100.0% | 1 | | total | 15.326 | 15.326 | 15.326 | 15.326 | 15.326 | 15.326 | 100.0% | 1 | | -> duration | 14.326 | 14.326 | 14.326 | 14.326 | 14.326 | 14.326 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.325912 Full duration: 63.937899 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume_and_delete args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-01300eb5-e678-450d-88e8-10123e6cf791" }, "image": { "name": "Cirros-0.4.0-01300eb5-e678-450d-88e8-10123e6cf791" }, "volume_size": 5, "nics": [ { "net-id": "dff22389-329d-4e74-870b-1f978f68baf8" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 }, "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } } } -------------------------------------------------------------------------------- Task c0cdb765-d521-4ca5-8e54-d956acdd61bc has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 6.973 | 6.973 | 6.973 | 6.973 | 6.973 | 6.973 | 100.0% | 1 | | nova.boot_server | 10.97 | 10.97 | 10.97 | 10.97 | 10.97 | 10.97 | 100.0% | 1 | | nova.delete_server | 4.983 | 4.983 | 4.983 | 4.983 | 4.983 | 4.983 | 100.0% | 1 | | total | 22.927 | 22.927 | 22.927 | 22.927 | 22.927 | 22.927 | 100.0% | 1 | | -> duration | 21.927 | 21.927 | 21.927 | 21.927 | 21.927 | 21.927 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.92694 Full duration: 75.092056 -------------------------------------------------------------------------------- test scenario NovaServers.pause_and_unpause_server args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-01300eb5-e678-450d-88e8-10123e6cf791" }, "image": { "name": "Cirros-0.4.0-01300eb5-e678-450d-88e8-10123e6cf791" }, "force_delete": false, "nics": [ { "net-id": "dff22389-329d-4e74-870b-1f978f68baf8" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } } } -------------------------------------------------------------------------------- Task c0cdb765-d521-4ca5-8e54-d956acdd61bc has 1 error(s) -------------------------------------------------------------------------------- TimeoutException: Rally tired waiting for Server s_rally_da1ee929_YwsV6yzE:0a11c03c-8686-4b75-82c7-78bf07d89c3e to become ('ACTIVE') current status SHUTOFF Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally/plugins/openstack/scenarios/nova/servers.py", line 655, in run self._unpause_server(server) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 87, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally/plugins/openstack/scenarios/nova/utils.py", line 326, in _unpause_server check_interval=CONF.openstack.nova_server_unpause_poll_interval File "/usr/lib/python2.7/site-packages/rally/task/utils.py", line 251, in wait_for_status resource_status=get_status(resource, status_attr)) TimeoutException: Rally tired waiting for Server s_rally_da1ee929_YwsV6yzE:0a11c03c-8686-4b75-82c7-78bf07d89c3e to become ('ACTIVE') current status SHUTOFF -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 11.593 | 11.593 | 11.593 | 11.593 | 11.593 | 11.593 | 100.0% | 1 | | nova.pause_server | 2.779 | 2.779 | 2.779 | 2.779 | 2.779 | 2.779 | 100.0% | 1 | | nova.unpause_server | 302.443 | 302.443 | 302.443 | 302.443 | 302.443 | 302.443 | 0.0% | 1 | | total | 316.815 | 316.815 | 316.815 | 316.815 | 316.815 | 316.815 | 0.0% | 1 | | -> duration | 311.815 | 311.815 | 311.815 | 311.815 | 311.815 | 311.815 | 0.0% | 1 | | -> idle_duration | 5.0 | 5.0 | 5.0 | 5.0 | 5.0 | 5.0 | 0.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 311.815414 Full duration: 369.481417 HINTS: * To plot HTML graphics with this data, run: rally task report c0cdb765-d521-4ca5-8e54-d956acdd61bc --out output.html * To generate a JUnit report, run: rally task export c0cdb765-d521-4ca5-8e54-d956acdd61bc --type junit --to output.xml * To get raw JSON output of task results, run: rally task report c0cdb765-d521-4ca5-8e54-d956acdd61bc --json --out output.json 2018-04-13 02:16:29,956 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'c0cdb765-d521-4ca5-8e54-d956acdd61bc'] 2018-04-13 02:16:31,363 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-13 02:16:31,363 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'c0cdb765-d521-4ca5-8e54-d956acdd61bc', '--out', u'/home/opnfv/functest/results/rally/opnfv-nova.html'] 2018-04-13 02:16:31,370 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2018-04-13 02:16:31,370 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2018-04-13 02:16:31,370 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-quotas.yaml 2018-04-13 02:16:31,371 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-13 02:16:31,380 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-13 02:16:31,380 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['quotas'], 'concurrency': 4, 'netid': 'dff22389-329d-4e74-870b-1f978f68baf8', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-01300eb5-e678-450d-88e8-10123e6cf791', 'flavor_name': 'rally-tiny-01300eb5-e678-450d-88e8-10123e6cf791', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-01300eb5-e678-450d-88e8-10123e6cf791', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-13 02:17:46,354 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 8df74b22-cf7c-4f3b-81a3-a6fcc8104a0d 2018-04-13 02:17:46,354 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '8df74b22-cf7c-4f3b-81a3-a6fcc8104a0d'] 2018-04-13 02:17:47,747 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 8df74b22-cf7c-4f3b-81a3-a6fcc8104a0d: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 8df74b22-cf7c-4f3b-81a3-a6fcc8104a0d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.236 | 1.236 | 1.236 | 1.236 | 1.236 | 1.236 | 100.0% | 1 | | quotas.delete_quotas | 0.066 | 0.066 | 0.066 | 0.066 | 0.066 | 0.066 | 100.0% | 1 | | total | 1.302 | 1.302 | 1.302 | 1.302 | 1.302 | 1.302 | 100.0% | 1 | | -> duration | 1.302 | 1.302 | 1.302 | 1.302 | 1.302 | 1.302 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.301995 Full duration: 14.047112 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 8df74b22-cf7c-4f3b-81a3-a6fcc8104a0d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.243 | 1.243 | 1.243 | 1.243 | 1.243 | 1.243 | 100.0% | 1 | | total | 1.244 | 1.244 | 1.244 | 1.244 | 1.244 | 1.244 | 100.0% | 1 | | -> duration | 1.244 | 1.244 | 1.244 | 1.244 | 1.244 | 1.244 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.243571 Full duration: 13.64175 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 8df74b22-cf7c-4f3b-81a3-a6fcc8104a0d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.406 | 0.406 | 0.406 | 0.406 | 0.406 | 0.406 | 100.0% | 1 | | total | 1.133 | 1.133 | 1.133 | 1.133 | 1.133 | 1.133 | 100.0% | 1 | | -> duration | 1.133 | 1.133 | 1.133 | 1.133 | 1.133 | 1.133 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.132643 Full duration: 13.150221 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 8df74b22-cf7c-4f3b-81a3-a6fcc8104a0d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.221 | 1.221 | 1.221 | 1.221 | 1.221 | 1.221 | 100.0% | 1 | | total | 1.221 | 1.221 | 1.221 | 1.221 | 1.221 | 1.221 | 100.0% | 1 | | -> duration | 1.221 | 1.221 | 1.221 | 1.221 | 1.221 | 1.221 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.221217 Full duration: 13.52682 HINTS: * To plot HTML graphics with this data, run: rally task report 8df74b22-cf7c-4f3b-81a3-a6fcc8104a0d --out output.html * To generate a JUnit report, run: rally task export 8df74b22-cf7c-4f3b-81a3-a6fcc8104a0d --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 8df74b22-cf7c-4f3b-81a3-a6fcc8104a0d --json --out output.json 2018-04-13 02:17:47,748 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '8df74b22-cf7c-4f3b-81a3-a6fcc8104a0d'] 2018-04-13 02:17:49,096 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-13 02:17:49,096 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '8df74b22-cf7c-4f3b-81a3-a6fcc8104a0d', '--out', u'/home/opnfv/functest/results/rally/opnfv-quotas.html'] 2018-04-13 02:17:49,102 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2018-04-13 02:17:49,104 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 01:13 | 6 | 100.00% | | glance | 01:34 | 4 | 100.00% | | cinder | 04:12 | 10 | 100.00% | | heat | 01:44 | 4 | 100.00% | | keystone | 04:17 | 11 | 100.00% | | neutron | 09:26 | 11 | 100.00% | | nova | 11:17 | 6 | 83.33% | | quotas | 00:54 | 4 | 100.00% | | | | | | | TOTAL: | 00:34:41 | 56 | 98.21% | +----------------+------------+----------------+-----------+ 2018-04-13 02:17:49,104 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_sanity' success_rate is 98.21% 2018-04-13 02:18:05,498 - xtesting.energy.energy - DEBUG - Stopping recording 2018-04-13 02:18:07,483 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-13 02:18:07,483 - xtesting.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | rally_sanity | functest | 39:41 | FAIL | +----------------------+------------------+------------------+----------------+ 2018-04-13 02:18:07,486 - xtesting.ci.run_tests - ERROR - The test case 'rally_sanity' failed. 2018-04-13 02:18:07,486 - xtesting.ci.run_tests - INFO - Running test case 'refstack_defcore'... 2018-04-13 02:18:07,553 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-13 02:18:10,764 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-04-13 02:18:10.575 10692 INFO rally.deployment.engine [-] Deployment 4b829987-490f-4b73-9f5d-16d895a9083a | Starting: Destroy cloud and free allocated resources. 2018-04-13 02:18:10.588 10692 INFO rally.deployment.engine [-] Deployment 4b829987-490f-4b73-9f5d-16d895a9083a | Completed: Destroy cloud and free allocated resources. 2018-04-13 02:18:10.603 10692 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=c05e9d53-f80a-4baf-a22f-d715e17117cc). 2018-04-13 02:18:10.607 10692 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-04-13 02:18:14,007 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-04-13 02:18:13.820 10695 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=4b248bb4-7614-489b-82ca-d8c089d4132e) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 4b248bb4-7614-489b-82ca-d8c089d4132e | 2018-04-13T02:18:13 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 4b248bb4-7614-489b-82ca-d8c089d4132e ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-13 02:18:18,869 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+-------------------+-----------+ | Service | Service Type | Status | +-------------+-------------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | nfv-orchestration | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+-------------------+-----------+ 2018-04-13 02:18:18,870 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-04-13 02:18:22,105 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-04-13 02:18:21.825 10701 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=c05e9d53-f80a-4baf-a22f-d715e17117cc). 2018-04-13 02:18:21.977 10701 INFO rally.api [-] Verifier has been successfully deleted! 2018-04-13 02:18:26,326 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-04-13 02:18:24.978 10704 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-04-13 02:18:25.030 10704 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-04-13 02:18:26.162 10704 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=1345e01d-ac78-4502-b31b-5a0c74a3cf99) has been successfully created! Using verifier 'opnfv-tempest' (UUID=1345e01d-ac78-4502-b31b-5a0c74a3cf99) as the default verifier for the future CLI operations. 2018-04-13 02:18:30,450 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-04-13 02:18:32,894 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-04-13 02:18:38,931 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-04-13 02:18:47,374 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-04-13 02:18:45.957 10723 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=1345e01d-ac78-4502-b31b-5a0c74a3cf99) for deployment 'opnfv-rally' (UUID=4b248bb4-7614-489b-82ca-d8c089d4132e). 2018-04-13 02:18:47.213 10723 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=1345e01d-ac78-4502-b31b-5a0c74a3cf99) has been successfully configured for deployment 'opnfv-rally' (UUID=4b248bb4-7614-489b-82ca-d8c089d4132e)! 2018-04-13 02:18:47,374 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-04-13 02:18:47,374 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-04-13 02:18:47,376 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-04-13 02:18:47,881 - functest.opnfv_tests.openstack.tempest.tempest - ERROR - Error with run Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/tempest/tempest.py", line 272, in run self.generate_test_list() File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/refstack/refstack.py", line 41, in generate_test_list nfile = parser.get_normalized_test_list(Refstack.defcorelist) File "/usr/lib/python2.7/site-packages/refstack_client/list_parser.py", line 203, in get_normalized_test_list tempest_test_ids = self._get_tempest_test_ids() File "/usr/lib/python2.7/site-packages/refstack_client/list_parser.py", line 58, in _get_tempest_test_ids ' '.join(cmd)) CalledProcessError: Command '/src/tempest/tools/with_venv.sh testr list-tests' returned non-zero exit status 3 2018-04-13 02:18:56,820 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-13 02:18:56,820 - xtesting.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | refstack_defcore | functest | 00:26 | FAIL | +--------------------------+------------------+------------------+----------------+ 2018-04-13 02:18:56,823 - xtesting.ci.run_tests - ERROR - The test case 'refstack_defcore' failed. 2018-04-13 02:18:56,823 - xtesting.ci.run_tests - INFO - Running test case 'patrole'... 2018-04-13 02:18:56,890 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-13 02:19:00,083 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-04-13 02:18:59.901 10731 INFO rally.deployment.engine [-] Deployment 4b248bb4-7614-489b-82ca-d8c089d4132e | Starting: Destroy cloud and free allocated resources. 2018-04-13 02:18:59.913 10731 INFO rally.deployment.engine [-] Deployment 4b248bb4-7614-489b-82ca-d8c089d4132e | Completed: Destroy cloud and free allocated resources. 2018-04-13 02:18:59.926 10731 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=1345e01d-ac78-4502-b31b-5a0c74a3cf99). 2018-04-13 02:18:59.930 10731 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-04-13 02:19:03,396 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-04-13 02:19:03.238 10734 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=891fc195-79bd-47d4-9934-e0c265108630) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 891fc195-79bd-47d4-9934-e0c265108630 | 2018-04-13T02:19:03 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 891fc195-79bd-47d4-9934-e0c265108630 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-13 02:19:08,278 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+-------------------+-----------+ | Service | Service Type | Status | +-------------+-------------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | nfv-orchestration | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+-------------------+-----------+ 2018-04-13 02:19:08,279 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-04-13 02:19:11,397 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-04-13 02:19:11.198 10740 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=1345e01d-ac78-4502-b31b-5a0c74a3cf99). 2018-04-13 02:19:11.260 10740 INFO rally.api [-] Verifier has been successfully deleted! 2018-04-13 02:19:15,791 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-04-13 02:19:14.440 10743 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-04-13 02:19:14.491 10743 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-04-13 02:19:15.631 10743 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=53f9f5ca-cced-44f0-ab15-741b18bcaf7c) has been successfully created! Using verifier 'opnfv-tempest' (UUID=53f9f5ca-cced-44f0-ab15-741b18bcaf7c) as the default verifier for the future CLI operations. 2018-04-13 02:19:19,943 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-04-13 02:19:22,843 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-04-13 02:19:28,095 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-04-13 02:19:36,633 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-04-13 02:19:35.205 10762 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=53f9f5ca-cced-44f0-ab15-741b18bcaf7c) for deployment 'opnfv-rally' (UUID=891fc195-79bd-47d4-9934-e0c265108630). 2018-04-13 02:19:36.486 10762 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=53f9f5ca-cced-44f0-ab15-741b18bcaf7c) has been successfully configured for deployment 'opnfv-rally' (UUID=891fc195-79bd-47d4-9934-e0c265108630)! 2018-04-13 02:19:36,634 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-04-13 02:19:36,634 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-04-13 02:19:36,635 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-04-13 02:19:36,639 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-04-13 02:19:37,196 - functest.opnfv_tests.openstack.tempest.tempest - ERROR - Error with run Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/tempest/tempest.py", line 272, in run self.generate_test_list() File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/tempest/tempest.py", line 119, in generate_test_list output = subprocess.check_output(cmd, shell=True) File "/usr/lib/python2.7/subprocess.py", line 219, in check_output raise CalledProcessError(retcode, cmd, output=output) CalledProcessError: Command '(cd /root/.rally/verification/verifier-53f9f5ca-cced-44f0-ab15-741b18bcaf7c/repo; testr list-tests '(?!.*test_networks_multiprovider_rbac)(?=patrole_tempest_plugin.tests.api.(image|network|volume))' >/home/opnfv/functest/results/patrole/tempest-list.txt 2>/dev/null)' returned non-zero exit status 3 2018-04-13 02:19:44,888 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-13 02:19:44,889 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | patrole | functest | 00:24 | FAIL | +-------------------+------------------+------------------+----------------+ 2018-04-13 02:19:44,891 - xtesting.ci.run_tests - ERROR - The test case 'patrole' failed. 2018-04-13 02:19:44,891 - xtesting.ci.run_tests - INFO - Running test case 'snaps_smoke'... 2018-04-13 02:19:46,242 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-04-13 03:34:30,184 - xtesting.core.unit - DEBUG - test_add_rule (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_delete_group (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_admin_user_to_new_project (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_new_user_to_admin_project (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_with_one_complex_rule (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_with_one_simple_rule (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_with_several_rules (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_without_rules (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_remove_rule_by_id (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_remove_rule_by_setting (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_delete_image (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_image_clean_file (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_image_clean_url (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_image_clean_url_properties (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_same_image (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_same_image_new_settings (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_bad_image_file (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests) ... ok test_bad_image_image_type (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests) ... ok test_bad_image_name (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests) ... ok test_bad_image_url (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests) ... ok test_create_three_part_image_from_file_3_creators (snaps.openstack.tests.create_image_tests.CreateMultiPartImageTests) ... ok test_create_three_part_image_from_url (snaps.openstack.tests.create_image_tests.CreateMultiPartImageTests) ... ok test_create_three_part_image_from_url_3_creators (snaps.openstack.tests.create_image_tests.CreateMultiPartImageTests) ... ok test_create_delete_keypair (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_from_file (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_large_key (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_only (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_save_both (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_save_pub_only (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_exist_files_delete (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_keypair_exist_files_keep (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_keypair_gen_files_delete_1 (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_keypair_gen_files_delete_2 (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_keypair_gen_files_keep (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_delete_network (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_network_router_admin_user_to_new_project (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_network_router_new_user_to_admin_project (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_network_with_router (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_network_without_router (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_networks_same_name (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_delete_router (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_admin_state_True (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_admin_state_false (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_admin_user_to_new_project (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_external_network (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_new_user_as_admin_project (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_private_network (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_vanilla (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_with_ext_port (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... FAIL test_create_router_admin_ports (snaps.openstack.tests.create_router_tests.CreateRouterNegativeTests) ... ok test_create_router_invalid_gateway_name (snaps.openstack.tests.create_router_tests.CreateRouterNegativeTests) ... ok test_create_router_noname (snaps.openstack.tests.create_router_tests.CreateRouterNegativeTests) ... ok test_create_delete_qos (snaps.openstack.tests.create_qos_tests.CreateQoSTests) ... ok test_create_qos (snaps.openstack.tests.create_qos_tests.CreateQoSTests) ... ok test_create_same_qos (snaps.openstack.tests.create_qos_tests.CreateQoSTests) ... ok test_create_delete_volume_type (snaps.openstack.tests.create_volume_type_tests.CreateSimpleVolumeTypeSuccessTests) ... ok test_create_same_volume_type (snaps.openstack.tests.create_volume_type_tests.CreateSimpleVolumeTypeSuccessTests) ... ok test_create_volume_type (snaps.openstack.tests.create_volume_type_tests.CreateSimpleVolumeTypeSuccessTests) ... ok test_volume_type_with_encryption (snaps.openstack.tests.create_volume_type_tests.CreateVolumeTypeComplexTests) ... ok test_volume_type_with_qos (snaps.openstack.tests.create_volume_type_tests.CreateVolumeTypeComplexTests) ... ok test_volume_type_with_qos_and_encryption (snaps.openstack.tests.create_volume_type_tests.CreateVolumeTypeComplexTests) ... ok test_create_delete_volume (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeSuccessTests) ... ok test_create_same_volume (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeSuccessTests) ... ok test_create_volume_simple (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeSuccessTests) ... ok test_create_volume_bad_image (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeFailureTests) ... ok test_create_volume_bad_size (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeFailureTests) ... ok test_create_volume_bad_type (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeFailureTests) ... ok test_bad_volume_type (snaps.openstack.tests.create_volume_tests.CreateVolumeWithTypeTests) ... ok test_valid_volume_type (snaps.openstack.tests.create_volume_tests.CreateVolumeWithTypeTests) ... ok test_bad_image_name (snaps.openstack.tests.create_volume_tests.CreateVolumeWithImageTests) ... ok test_valid_volume_image (snaps.openstack.tests.create_volume_tests.CreateVolumeWithImageTests) ... ok test_check_vm_ip_dhcp (snaps.openstack.tests.create_instance_tests.SimpleHealthCheck) ... ok test_ping_via_router (snaps.openstack.tests.create_instance_tests.CreateInstanceTwoNetTests) ... ok test_create_admin_instance (snaps.openstack.tests.create_instance_tests.CreateInstanceSimpleTests) ... ok test_create_delete_instance (snaps.openstack.tests.create_instance_tests.CreateInstanceSimpleTests) ... ok test_set_allowed_address_pairs (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_allowed_address_pairs_bad_ip (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_allowed_address_pairs_bad_mac (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_invalid_ip_one_subnet (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_invalid_mac (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_mac_and_ip (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_valid_ip_one_subnet (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_valid_mac (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_one_port_two_ip_one_subnet (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_one_port_two_ip_two_subnets (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_add_invalid_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_add_same_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_add_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_remove_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_remove_security_group_never_added (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_deploy_vm_to_each_compute_node (snaps.openstack.tests.create_instance_tests.CreateInstanceOnComputeHost) ... ok test_create_instance_from_three_part_image (snaps.openstack.tests.create_instance_tests.CreateInstanceFromThreePartImage) ... ok test_create_instance_with_one_volume (snaps.openstack.tests.create_instance_tests.CreateInstanceVolumeTests) ... ok test_create_instance_with_two_volumes (snaps.openstack.tests.create_instance_tests.CreateInstanceVolumeTests) ... ok test_create_delete_stack (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_create_same_stack (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_create_stack_short_timeout (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_create_stack_template_dict (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_create_stack_template_file (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_retrieve_network_creators (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_retrieve_vm_inst_creators (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_retrieve_volume_creator (snaps.openstack.tests.create_stack_tests.CreateStackVolumeTests) ... ok test_retrieve_volume_type_creator (snaps.openstack.tests.create_stack_tests.CreateStackVolumeTests) ... ok test_retrieve_flavor_creator (snaps.openstack.tests.create_stack_tests.CreateStackFlavorTests) ... ok test_retrieve_keypair_creator (snaps.openstack.tests.create_stack_tests.CreateStackKeypairTests) ... ok test_retrieve_security_group_creator (snaps.openstack.tests.create_stack_tests.CreateStackSecurityGroupTests) ... ok test_bad_stack_file (snaps.openstack.tests.create_stack_tests.CreateStackNegativeTests) ... ok test_missing_dependencies (snaps.openstack.tests.create_stack_tests.CreateStackNegativeTests) ... ok test_single_port_static (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_after_active (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_after_init (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_after_reboot (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_before_active (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_reverse_engineer (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_second_creator (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_connect_via_ssh_heat_vm (snaps.openstack.tests.create_stack_tests.CreateStackFloatingIpTests) ... ok test_connect_via_ssh_heat_vm_derived (snaps.openstack.tests.create_stack_tests.CreateStackFloatingIpTests) ... ok test_apply_simple_playbook (snaps.provisioning.tests.ansible_utils_tests.AnsibleProvisioningTests) ... ok test_apply_template_playbook (snaps.provisioning.tests.ansible_utils_tests.AnsibleProvisioningTests) ... ok ====================================================================== FAIL: test_create_router_with_ext_port (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/snaps/openstack/tests/create_router_tests.py", line 419, in test_create_router_with_ext_port self.assertEqual(ext_net.id, port.network_id) AssertionError: u'692a6675-25fd-485a-96bc-82c5af77a802' != u'1dea3a59-6ffe-4c9c-b435-bc5b673590ff' - 692a6675-25fd-485a-96bc-82c5af77a802 + 1dea3a59-6ffe-4c9c-b435-bc5b673590ff ---------------------------------------------------------------------- Ran 119 tests in 4483.899s FAILED (failures=1) 2018-04-13 03:34:31,085 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-13 03:34:31,086 - xtesting.ci.run_tests - INFO - Test result: +---------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +---------------------+------------------+------------------+----------------+ | snaps_smoke | functest | 74:44 | FAIL | +---------------------+------------------+------------------+----------------+ 2018-04-13 03:34:31,089 - xtesting.ci.run_tests - ERROR - The test case 'snaps_smoke' failed. 2018-04-13 03:34:31,089 - xtesting.ci.run_tests - INFO - Running test case 'neutron_trunk'... 2018-04-13 03:34:31,158 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-13 03:34:34,678 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-04-13 03:34:34.512 10904 INFO rally.deployment.engine [-] Deployment 891fc195-79bd-47d4-9934-e0c265108630 | Starting: Destroy cloud and free allocated resources. 2018-04-13 03:34:34.534 10904 INFO rally.deployment.engine [-] Deployment 891fc195-79bd-47d4-9934-e0c265108630 | Completed: Destroy cloud and free allocated resources. 2018-04-13 03:34:34.549 10904 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=53f9f5ca-cced-44f0-ab15-741b18bcaf7c). 2018-04-13 03:34:34.553 10904 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-04-13 03:34:38,004 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-04-13 03:34:37.876 10907 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=4a032c8e-ef34-4eb6-b9cf-1fa321c10656) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 4a032c8e-ef34-4eb6-b9cf-1fa321c10656 | 2018-04-13T03:34:37 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 4a032c8e-ef34-4eb6-b9cf-1fa321c10656 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-13 03:34:43,433 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+-------------------+-----------+ | Service | Service Type | Status | +-------------+-------------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | nfv-orchestration | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+-------------------+-----------+ 2018-04-13 03:34:43,434 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-04-13 03:34:47,188 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-04-13 03:34:46.888 10913 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=53f9f5ca-cced-44f0-ab15-741b18bcaf7c). 2018-04-13 03:34:47.076 10913 INFO rally.api [-] Verifier has been successfully deleted! 2018-04-13 03:34:51,994 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-04-13 03:34:50.461 10916 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-04-13 03:34:50.510 10916 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-04-13 03:34:51.854 10916 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=7cdd3bc4-c928-451a-aebe-3a4406c81a72) has been successfully created! Using verifier 'opnfv-tempest' (UUID=7cdd3bc4-c928-451a-aebe-3a4406c81a72) as the default verifier for the future CLI operations. 2018-04-13 03:34:56,646 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-04-13 03:34:59,604 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-04-13 03:35:05,230 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-04-13 03:35:14,867 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-04-13 03:35:12.907 10935 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=7cdd3bc4-c928-451a-aebe-3a4406c81a72) for deployment 'opnfv-rally' (UUID=4a032c8e-ef34-4eb6-b9cf-1fa321c10656). 2018-04-13 03:35:14.719 10935 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=7cdd3bc4-c928-451a-aebe-3a4406c81a72) has been successfully configured for deployment 'opnfv-rally' (UUID=4a032c8e-ef34-4eb6-b9cf-1fa321c10656)! 2018-04-13 03:35:14,867 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-04-13 03:35:14,867 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-04-13 03:35:14,869 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-04-13 03:35:14,875 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-04-13 03:35:15,468 - functest.opnfv_tests.openstack.tempest.tempest - ERROR - Error with run Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/tempest/tempest.py", line 272, in run self.generate_test_list() File "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/tempest/tempest.py", line 119, in generate_test_list output = subprocess.check_output(cmd, shell=True) File "/usr/lib/python2.7/subprocess.py", line 219, in check_output raise CalledProcessError(retcode, cmd, output=output) CalledProcessError: Command '(cd /root/.rally/verification/verifier-7cdd3bc4-c928-451a-aebe-3a4406c81a72/repo; testr list-tests 'neutron.tests.tempest.(api|scenario).test_trunk' >/home/opnfv/functest/results/neutron_trunk/test_list.txt 2>/dev/null)' returned non-zero exit status 3 2018-04-13 03:35:25,395 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-13 03:35:25,396 - xtesting.ci.run_tests - INFO - Test result: +-----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------+------------------+------------------+----------------+ | neutron_trunk | functest | 00:28 | FAIL | +-----------------------+------------------+------------------+----------------+ 2018-04-13 03:35:25,398 - xtesting.ci.run_tests - ERROR - The test case 'neutron_trunk' failed. 2018-04-13 03:35:25,399 - xtesting.ci.run_tests - INFO - Xtesting report: +------------------------------+------------------+---------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +------------------------------+------------------+---------------+------------------+----------------+ | vping_ssh | functest | smoke | 01:12 | PASS | | vping_userdata | functest | smoke | 01:01 | PASS | | tempest_smoke_serial | functest | smoke | 00:24 | FAIL | | rally_sanity | functest | smoke | 39:41 | FAIL | | refstack_defcore | functest | smoke | 00:26 | FAIL | | patrole | functest | smoke | 00:24 | FAIL | | snaps_smoke | functest | smoke | 74:44 | FAIL | | neutron_trunk | functest | smoke | 00:28 | FAIL | | odl | functest | smoke | 00:00 | SKIP | | odl_netvirt | functest | smoke | 00:00 | SKIP | +------------------------------+------------------+---------------+------------------+----------------+ 2018-04-13 03:35:25,403 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR 2018-04-13 03:37:03,577 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+-----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+-----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-compass-virtual-daily-master-212 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | compass | | DEPLOY_SCENARIO | os-nosdn-nofeature-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | huawei-virtual2 | +--------------------------------------+-----------------------------------------------------------+ 2018-04-13 03:37:03,580 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Ansible managed export LC_ALL=C # COMMON CINDER ENVS export CINDER_ENDPOINT_TYPE=publicURL # COMMON NOVA ENVS export NOVA_ENDPOINT_TYPE=publicURL # COMMON OPENSTACK ENVS export OS_ENDPOINT_TYPE=publicURL export OS_INTERFACE=publicURL export OS_USERNAME=admin export OS_PASSWORD='4d4508f971f692567' export OS_PROJECT_NAME=admin export OS_TENANT_NAME=admin export OS_AUTH_URL=https://192.16.1.222:5000/v3 export OS_NO_CACHE=1 export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_REGION_NAME=RegionOne # For openstackclient export OS_IDENTITY_API_VERSION=3 export OS_AUTH_VERSION=3 export OS_AUTH_TYPE=password export SDN_CONTROLLER_IP=192.16.1.222 export OS_CACERT=/home/opnfv/functest/conf/os_cacert 2018-04-13 03:37:03,580 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-04-13 03:37:03,580 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+-----------------+---------------------+-------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+-----------------+---------------------+-------------------+ +---------------+---------------+-----------------+---------------------+-------------------+ 2018-04-13 03:37:03,581 - xtesting.ci.run_tests - INFO - Xtesting report: +-----------------------------+------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-----------------------------+------------------------+------------------+------------------+----------------+ | doctor-notification | doctor | features | 00:00 | SKIP | | bgpvpn | sdnvpn | features | 00:00 | SKIP | | functest-odl-sfc | sfc | features | 00:00 | SKIP | | barometercollectd | barometer | features | 00:00 | SKIP | | fds | fastdatastacks | features | 00:00 | SKIP | +-----------------------------+------------------------+------------------+------------------+----------------+ 2018-04-13 03:37:03,583 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK