2018-04-15 17:21:48,559 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+-----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+-----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-compass-virtual-daily-master-229 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | compass | | DEPLOY_SCENARIO | os-nosdn-kvm-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | huawei-virtual2 | +--------------------------------------+-----------------------------------------------------------+ 2018-04-15 17:21:48,562 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Ansible managed export LC_ALL=C # COMMON CINDER ENVS export CINDER_ENDPOINT_TYPE=publicURL # COMMON NOVA ENVS export NOVA_ENDPOINT_TYPE=publicURL # COMMON OPENSTACK ENVS export OS_ENDPOINT_TYPE=publicURL export OS_INTERFACE=publicURL export OS_USERNAME=admin export OS_PASSWORD='b6f47c30cdcb66779d0a161309da97a' export OS_PROJECT_NAME=admin export OS_TENANT_NAME=admin export OS_AUTH_URL=https://192.16.1.222:5000/v3 export OS_NO_CACHE=1 export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_REGION_NAME=RegionOne # For openstackclient export OS_IDENTITY_API_VERSION=3 export OS_AUTH_VERSION=3 export OS_AUTH_TYPE=password export SDN_CONTROLLER_IP=192.16.1.222 export OS_CACERT=/home/opnfv/functest/conf/os_cacert 2018-04-15 17:21:48,562 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-04-15 17:21:48,563 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------------+---------------+-------------------------------------------+-------------------------------------------------+------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------------+---------------+-------------------------------------------+-------------------------------------------------+------------------------------------+ | healthcheck | 0 | (merge)|(verify)|(daily)|(weekly) | First tier to be executed to verify the | connection_check api_check | | | | | basic operations in the VIM. | snaps_health_check | +---------------------+---------------+-------------------------------------------+-------------------------------------------------+------------------------------------+ 2018-04-15 17:21:48,564 - xtesting.ci.run_tests - INFO - Running tier 'healthcheck' 2018-04-15 17:21:48,564 - xtesting.ci.run_tests - INFO - Running test case 'connection_check'... 2018-04-15 17:21:51,446 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-04-15 17:22:11,053 - xtesting.core.unit - DEBUG - test_glance_connect_fail (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_glance_connect_success (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_keystone_connect_fail (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_keystone_connect_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_neutron_connect_fail (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_neutron_connect_success (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_retrieve_ext_network_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_nova_connect_fail (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_connect_success (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_get_hypervisor_hosts (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_heat_connect_fail (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_heat_connect_success (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_cinder_connect_fail (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok test_cinder_connect_success (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok ---------------------------------------------------------------------- Ran 14 tests in 19.601s OK 2018-04-15 17:22:11,622 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-15 17:22:11,622 - xtesting.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | connection_check | functest | 00:20 | PASS | +--------------------------+------------------+------------------+----------------+ 2018-04-15 17:22:11,624 - xtesting.ci.run_tests - INFO - Running test case 'api_check'... 2018-04-15 17:22:14,432 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-04-15 17:36:35,959 - xtesting.core.unit - DEBUG - test_create_project_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_user_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_credentials (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_service (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_with_each_interface (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_grant_user_role_to_project (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_admin_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user_2x (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_2x (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_bad_domain (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_quota_override (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_update_quotas (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_sec_grp_one_user (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_project_sec_grp_two_users (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_image_minimal_file (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_image_minimal_url (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_network (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_add_interface_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_missing_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip_to_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_network_object (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_simple (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_with_public_interface (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_delete_simple_sec_grp (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_rules (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_one_rule (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_get_sec_grp_by_id (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_floating_ips (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsFloatingIpTests) ... ok test_create_delete_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_key_from_file (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_delete_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_instance (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceTests) ... ok test_add_remove_volume (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_attach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_detach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_create_clean_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_delete_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_all_settings (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_existing (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_create_stack_x2 (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_get_settings_from_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateComplexStackTests) ... ok test_create_flavor_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsFlavorTests) ... ok test_create_keypair_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsKeypairTests) ... ok test_create_security_group_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsSecurityGroupTests) ... ok test_create_delete_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_back (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_both (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_front (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_delete_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_simple_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_delete_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_simple_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_bad_key_size (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_delete_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_simple_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_all_attrs (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_invalid_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos_and_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok ---------------------------------------------------------------------- Ran 84 tests in 861.496s OK 2018-04-15 17:36:36,523 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-15 17:36:36,523 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | api_check | functest | 14:21 | PASS | +-------------------+------------------+------------------+----------------+ 2018-04-15 17:36:36,525 - xtesting.ci.run_tests - INFO - Running test case 'snaps_health_check'... 2018-04-15 17:36:38,165 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-04-15 17:37:30,545 - xtesting.core.unit - DEBUG - test_check_vm_ip_dhcp (snaps.openstack.tests.create_instance_tests.SimpleHealthCheck) ... ok ---------------------------------------------------------------------- Ran 1 test in 52.378s OK 2018-04-15 17:37:31,111 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-15 17:37:31,111 - xtesting.ci.run_tests - INFO - Test result: +----------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------------+------------------+------------------+----------------+ | snaps_health_check | functest | 00:52 | PASS | +----------------------------+------------------+------------------+----------------+ 2018-04-15 17:37:31,116 - xtesting.ci.run_tests - INFO - Xtesting report: +----------------------------+------------------+---------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------------+------------------+---------------------+------------------+----------------+ | connection_check | functest | healthcheck | 00:20 | PASS | | api_check | functest | healthcheck | 14:21 | PASS | | snaps_health_check | functest | healthcheck | 00:52 | PASS | +----------------------------+------------------+---------------------+------------------+----------------+ 2018-04-15 17:37:31,119 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-04-15 17:38:15,036 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+-----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+-----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-compass-virtual-daily-master-229 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | compass | | DEPLOY_SCENARIO | os-nosdn-kvm-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | huawei-virtual2 | +--------------------------------------+-----------------------------------------------------------+ 2018-04-15 17:38:15,039 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Ansible managed export LC_ALL=C # COMMON CINDER ENVS export CINDER_ENDPOINT_TYPE=publicURL # COMMON NOVA ENVS export NOVA_ENDPOINT_TYPE=publicURL # COMMON OPENSTACK ENVS export OS_ENDPOINT_TYPE=publicURL export OS_INTERFACE=publicURL export OS_USERNAME=admin export OS_PASSWORD='b6f47c30cdcb66779d0a161309da97a' export OS_PROJECT_NAME=admin export OS_TENANT_NAME=admin export OS_AUTH_URL=https://192.16.1.222:5000/v3 export OS_NO_CACHE=1 export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_REGION_NAME=RegionOne # For openstackclient export OS_IDENTITY_API_VERSION=3 export OS_AUTH_VERSION=3 export OS_AUTH_TYPE=password export SDN_CONTROLLER_IP=192.16.1.222 export OS_CACERT=/home/opnfv/functest/conf/os_cacert 2018-04-15 17:38:15,039 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-04-15 17:38:15,040 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+--------------------------+------------------------------------------+-------------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+--------------------------+------------------------------------------+-------------------------------------------+ | smoke | 1 | (daily)|(weekly) | Set of basic Functional tests to | vping_ssh vping_userdata | | | | | validate the OPNFV scenarios. | tempest_smoke_serial rally_sanity | | | | | | patrole snaps_smoke neutron_trunk | +---------------+---------------+--------------------------+------------------------------------------+-------------------------------------------+ 2018-04-15 17:38:15,041 - xtesting.ci.run_tests - INFO - Running tier 'smoke' 2018-04-15 17:38:15,041 - xtesting.ci.run_tests - INFO - Running test case 'vping_ssh'... 2018-04-15 17:38:16,807 - xtesting.energy.energy - INFO - API recorder available at : http://energy.opnfv.fr/resources/recorders/environment/huawei-virtual2 2018-04-15 17:38:16,807 - xtesting.energy.energy - DEBUG - Getting current scenario 2018-04-15 17:38:17,914 - xtesting.energy.energy - INFO - No current running scenario at http://energy.opnfv.fr/resources/recorders/environment/huawei-virtual2 2018-04-15 17:38:17,914 - xtesting.energy.energy - DEBUG - Starting recording 2018-04-15 17:38:17,914 - xtesting.energy.energy - DEBUG - Submitting scenario (vping_ssh/running) 2018-04-15 17:38:18,681 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup 2018-04-15 17:38:18,681 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-04-15 17:38:18' 2018-04-15 17:38:18,681 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--82bbab51-491b-4f41-a0c9-2f627b98e6eb' 2018-04-15 17:38:20,965 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-82bbab51-491b-4f41-a0c9-2f627b98e6eb' 2018-04-15 17:38:24,815 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-82bbab51-491b-4f41-a0c9-2f627b98e6eb' 2018-04-15 17:38:42,229 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-82bbab51-491b-4f41-a0c9-2f627b98e6eb' 2018-04-15 17:38:43,624 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating keypair with name: 'vPing-keypair-82bbab51-491b-4f41-a0c9-2f627b98e6eb' 2018-04-15 17:38:45,063 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-82bbab51-491b-4f41-a0c9-2f627b98e6eb' 2018-04-15 17:38:52,872 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Security group with name: 'vPing-sg-82bbab51-491b-4f41-a0c9-2f627b98e6eb' 2018-04-15 17:38:56,869 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-82bbab51-491b-4f41-a0c9-2f627b98e6eb' 2018-04-15 17:39:21,546 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution 2018-04-15 17:39:32,440 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Trying to transfer ping.sh 2018-04-15 17:39:32,521 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping... 2018-04-15 17:39:33,531 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected! 2018-04-15 17:39:33,532 - xtesting.energy.energy - DEBUG - Stopping recording 2018-04-15 17:39:34,949 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-15 17:39:34,950 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | vping_ssh | functest | 01:15 | PASS | +-------------------+------------------+------------------+----------------+ 2018-04-15 17:40:00,214 - xtesting.ci.run_tests - INFO - Running test case 'vping_userdata'... 2018-04-15 17:40:00,281 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup 2018-04-15 17:40:00,281 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-04-15 17:40:00' 2018-04-15 17:40:00,281 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--0abb934c-ac6d-4fee-8292-1a15fab6d984' 2018-04-15 17:40:02,458 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-0abb934c-ac6d-4fee-8292-1a15fab6d984' 2018-04-15 17:40:04,990 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-0abb934c-ac6d-4fee-8292-1a15fab6d984' 2018-04-15 17:40:20,273 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-0abb934c-ac6d-4fee-8292-1a15fab6d984' 2018-04-15 17:40:21,695 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-0abb934c-ac6d-4fee-8292-1a15fab6d984' 2018-04-15 17:40:29,623 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-0abb934c-ac6d-4fee-8292-1a15fab6d984' 2018-04-15 17:40:37,721 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution 2018-04-15 17:40:46,883 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping... 2018-04-15 17:40:49,131 - functest.opnfv_tests.openstack.vping.vping_base - DEBUG - Pinging 192.168.130.11. Waiting for response... 2018-04-15 17:41:02,038 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected! 2018-04-15 17:41:02,612 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-15 17:41:02,612 - xtesting.ci.run_tests - INFO - Test result: +------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------+------------------+------------------+----------------+ | vping_userdata | functest | 01:02 | PASS | +------------------------+------------------+------------------+----------------+ 2018-04-15 17:41:26,381 - xtesting.ci.run_tests - INFO - Running test case 'tempest_smoke_serial'... 2018-04-15 17:41:26,450 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-15 17:41:34,178 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | ad13d72c-e2bf-486c-8fc4-229cd183f337 | 2018-04-15T17:41:34.021956 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: ad13d72c-e2bf-486c-8fc4-229cd183f337 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-15 17:41:39,450 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+-------------------+-----------+ | Service | Service Type | Status | +-------------+-------------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | nfv-orchestration | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+-------------------+-----------+ 2018-04-15 17:41:39,451 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-04-15 17:41:48,152 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide Using verifier 'opnfv-tempest' (UUID=daf1a719-e543-4a2f-9ee5-fafbe6552124) as the default verifier for the future CLI operations. 2018-04-15 17:41:52,849 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-04-15 17:41:55,480 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-04-15 17:42:00,785 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-04-15 17:42:09,322 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-04-15 17:42:09,322 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-04-15 17:42:09,323 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-04-15 17:42:09,324 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-04-15 17:42:09,326 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-04-15 17:42:13,296 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-daf1a719-e543-4a2f-9ee5-fafbe6552124/repo; stestr list '^tempest\.(api|scenario).*\[.*\bsmoke\b.*\]$' >/home/opnfv/functest/results/tempest/test_list.txt 2>/dev/null) 2018-04-15 17:42:13,297 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Applying tempest blacklist... 2018-04-15 17:42:13,299 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Tempest blacklist file does not exist. 2018-04-15 17:42:13,300 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/tempest/test_list.txt', '--concurrency', '1']'. 2018-04-15 18:03:01,358 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Verification UUID: 1b3cefab-6d5a-44d9-9320-fe0dcc394059 2018-04-15 18:03:01,509 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '1b3cefab-6d5a-44d9-9320-fe0dcc394059']'. 2018-04-15 18:03:03,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-04-15 18:03:03,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-04-15 18:03:03,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-15 18:03:03,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 1b3cefab-6d5a-44d9-9320-fe0dcc394059 | 2018-04-15 18:03:03,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | failed | 2018-04-15 18:03:03,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-04-15 17:42:16 | 2018-04-15 18:03:03,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-04-15 18:03:01 | 2018-04-15 18:03:03,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:20:45 | 2018-04-15 18:03:03,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | concurrency: 1 | 2018-04-15 18:03:03,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | | load_list: (value is too long, use 'detailed' flag to display it) | 2018-04-15 18:03:03,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-04-15 18:03:03,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: daf1a719-e543-4a2f-9ee5-fafbe6552124) | 2018-04-15 18:03:03,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-04-15 18:03:03,044 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: ad13d72c-e2bf-486c-8fc4-229cd183f337) | 2018-04-15 18:03:03,045 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 109 | 2018-04-15 18:03:03,045 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 1205.986 | 2018-04-15 18:03:03,045 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 89 | 2018-04-15 18:03:03,045 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 19 | 2018-04-15 18:03:03,045 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-04-15 18:03:03,045 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-04-15 18:03:03,046 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 1 | 2018-04-15 18:03:03,046 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-15 18:03:03,046 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-04-15 18:03:03,047 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest tempest_smoke_serial success_rate is 98.8888888889% 2018-04-15 18:03:11,933 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-15 18:03:11,933 - xtesting.ci.run_tests - INFO - Test result: +------------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------------+------------------+------------------+----------------+ | tempest_smoke_serial | functest | 21:18 | FAIL | +------------------------------+------------------+------------------+----------------+ 2018-04-15 18:03:11,936 - xtesting.ci.run_tests - ERROR - The test case 'tempest_smoke_serial' failed. 2018-04-15 18:03:11,936 - xtesting.ci.run_tests - INFO - Running test case 'rally_sanity'... 2018-04-15 18:03:12,004 - xtesting.energy.energy - DEBUG - Getting current scenario 2018-04-15 18:03:16,146 - xtesting.energy.energy - INFO - No current running scenario at http://energy.opnfv.fr/resources/recorders/environment/huawei-virtual2 2018-04-15 18:03:16,146 - xtesting.energy.energy - DEBUG - Starting recording 2018-04-15 18:03:16,146 - xtesting.energy.energy - DEBUG - Submitting scenario (rally_sanity/running) 2018-04-15 18:03:17,223 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-15 18:03:20,954 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-04-15 18:03:24,635 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 72957236-d776-4070-8897-1de319624cfa | 2018-04-15T18:03:24.499904 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 72957236-d776-4070-8897-1de319624cfa ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-15 18:03:30,097 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+-------------------+-----------+ | Service | Service Type | Status | +-------------+-------------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | nfv-orchestration | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+-------------------+-----------+ 2018-04-15 18:03:30,098 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating the test name... 2018-04-15 18:03:32,571 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating image 'Cirros-0.4.0-15af60bc-4fc9-4b79-9dab-6b935f38aa06'... 2018-04-15 18:03:35,876 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating network 'rally-net-15af60bc-4fc9-4b79-9dab-6b935f38aa06'... 2018-04-15 18:03:38,962 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating router 'rally-router-15af60bc-4fc9-4b79-9dab-6b935f38aa06'... 2018-04-15 18:03:54,071 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-tiny-15af60bc-4fc9-4b79-9dab-6b935f38aa06'... 2018-04-15 18:03:55,411 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-mini-15af60bc-4fc9-4b79-9dab-6b935f38aa06'... 2018-04-15 18:03:56,604 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2018-04-15 18:03:56,605 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-authenticate.yaml 2018-04-15 18:03:56,605 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-15 18:03:56,615 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-15 18:03:56,616 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['authenticate'], 'concurrency': 4, 'netid': '07721f22-fd39-45c8-befb-ab9cb864c1e6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'flavor_name': 'rally-tiny-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-15 18:05:39,744 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 52ff0932-e347-4a09-b4ed-072433d82117 2018-04-15 18:05:39,744 - functest.opnfv_tests.openstack.rally.rally - DEBUG - /home/opnfv/functest/results/rally does not exist, we create it. 2018-04-15 18:05:39,744 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '52ff0932-e347-4a09-b4ed-072433d82117'] 2018-04-15 18:05:40,998 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 52ff0932-e347-4a09-b4ed-072433d82117: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 52ff0932-e347-4a09-b4ed-072433d82117 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.835 | 0.835 | 0.835 | 0.835 | 0.835 | 0.835 | 100.0% | 1 | | total | 0.835 | 0.835 | 0.835 | 0.835 | 0.835 | 0.835 | 100.0% | 1 | | -> duration | 0.835 | 0.835 | 0.835 | 0.835 | 0.835 | 0.835 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.834961 Full duration: 14.225778 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 52ff0932-e347-4a09-b4ed-072433d82117 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 1.097 | 1.097 | 1.097 | 1.097 | 1.097 | 1.097 | 100.0% | 1 | | total | 1.799 | 1.799 | 1.799 | 1.799 | 1.799 | 1.799 | 100.0% | 1 | | -> duration | 1.799 | 1.799 | 1.799 | 1.799 | 1.799 | 1.799 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.799274 Full duration: 13.258008 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 52ff0932-e347-4a09-b4ed-072433d82117 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.791 | 0.791 | 0.791 | 0.791 | 0.791 | 0.791 | 100.0% | 1 | | total | 1.439 | 1.439 | 1.439 | 1.439 | 1.439 | 1.439 | 100.0% | 1 | | -> duration | 1.439 | 1.439 | 1.439 | 1.439 | 1.439 | 1.439 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.43868 Full duration: 12.205329 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 52ff0932-e347-4a09-b4ed-072433d82117 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 1.359 | 1.359 | 1.359 | 1.359 | 1.359 | 1.359 | 100.0% | 1 | | total | 2.068 | 2.068 | 2.068 | 2.068 | 2.068 | 2.068 | 100.0% | 1 | | -> duration | 2.068 | 2.068 | 2.068 | 2.068 | 2.068 | 2.068 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.067634 Full duration: 13.351696 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 52ff0932-e347-4a09-b4ed-072433d82117 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.816 | 0.816 | 0.816 | 0.816 | 0.816 | 0.816 | 100.0% | 1 | | total | 1.523 | 1.523 | 1.523 | 1.523 | 1.523 | 1.523 | 100.0% | 1 | | -> duration | 1.523 | 1.523 | 1.523 | 1.523 | 1.523 | 1.523 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.523189 Full duration: 13.708627 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 52ff0932-e347-4a09-b4ed-072433d82117 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.499 | 0.499 | 0.499 | 0.499 | 0.499 | 0.499 | 100.0% | 1 | | total | 1.387 | 1.387 | 1.387 | 1.387 | 1.387 | 1.387 | 100.0% | 1 | | -> duration | 1.387 | 1.387 | 1.387 | 1.387 | 1.387 | 1.387 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.387362 Full duration: 13.37487 HINTS: * To plot HTML graphics with this data, run: rally task report 52ff0932-e347-4a09-b4ed-072433d82117 --out output.html * To generate a JUnit report, run: rally task export 52ff0932-e347-4a09-b4ed-072433d82117 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 52ff0932-e347-4a09-b4ed-072433d82117 --json --out output.json 2018-04-15 18:05:40,999 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '52ff0932-e347-4a09-b4ed-072433d82117'] 2018-04-15 18:05:42,270 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-15 18:05:42,271 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '52ff0932-e347-4a09-b4ed-072433d82117', '--out', u'/home/opnfv/functest/results/rally/opnfv-authenticate.html'] 2018-04-15 18:05:42,275 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2018-04-15 18:05:42,275 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2018-04-15 18:05:42,276 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-glance.yaml 2018-04-15 18:05:42,276 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-15 18:05:42,287 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-15 18:05:42,287 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['glance'], 'concurrency': 4, 'netid': '07721f22-fd39-45c8-befb-ab9cb864c1e6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'flavor_name': 'rally-tiny-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-15 18:07:46,144 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : d6bf3c7d-cace-4fab-95e1-854d64b94288 2018-04-15 18:07:46,144 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'd6bf3c7d-cace-4fab-95e1-854d64b94288'] 2018-04-15 18:07:47,422 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task d6bf3c7d-cace-4fab-95e1-854d64b94288: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d6bf3c7d-cace-4fab-95e1-854d64b94288 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.623 | 3.623 | 3.623 | 3.623 | 3.623 | 3.623 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.104 | 0.104 | 0.104 | 0.104 | 0.104 | 0.104 | 100.0% | 1 | | -> glance_v2.upload_data | 1.025 | 1.025 | 1.025 | 1.025 | 1.025 | 1.025 | 100.0% | 1 | | glance_v2.delete_image | 0.805 | 0.805 | 0.805 | 0.805 | 0.805 | 0.805 | 100.0% | 1 | | total | 4.428 | 4.428 | 4.428 | 4.428 | 4.428 | 4.428 | 100.0% | 1 | | -> duration | 4.428 | 4.428 | 4.428 | 4.428 | 4.428 | 4.428 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.428121 Full duration: 18.497567 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d6bf3c7d-cace-4fab-95e1-854d64b94288 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.517 | 3.517 | 3.517 | 3.517 | 3.517 | 3.517 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.076 | 0.076 | 0.076 | 0.076 | 0.076 | 0.076 | 100.0% | 1 | | -> glance_v2.upload_data | 1.044 | 1.044 | 1.044 | 1.044 | 1.044 | 1.044 | 100.0% | 1 | | glance_v2.list_images | 0.068 | 0.068 | 0.068 | 0.068 | 0.068 | 0.068 | 100.0% | 1 | | total | 3.586 | 3.586 | 3.586 | 3.586 | 3.586 | 3.586 | 100.0% | 1 | | -> duration | 3.586 | 3.586 | 3.586 | 3.586 | 3.586 | 3.586 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.585778 Full duration: 20.539704 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d6bf3c7d-cace-4fab-95e1-854d64b94288 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.392 | 0.392 | 0.392 | 0.392 | 0.392 | 0.392 | 100.0% | 1 | | total | 0.392 | 0.392 | 0.392 | 0.392 | 0.392 | 0.392 | 100.0% | 1 | | -> duration | 0.392 | 0.392 | 0.392 | 0.392 | 0.392 | 0.392 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.392332 Full duration: 12.427149 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 } } }, "args": { "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "container_format": "bare", "disk_format": "qcow2", "number_instances": 2, "nics": [ { "net-id": "07721f22-fd39-45c8-befb-ab9cb864c1e6" } ], "flavor": { "name": "rally-tiny-15af60bc-4fc9-4b79-9dab-6b935f38aa06" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d6bf3c7d-cace-4fab-95e1-854d64b94288 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.802 | 3.802 | 3.802 | 3.802 | 3.802 | 3.802 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.118 | 0.118 | 0.118 | 0.118 | 0.118 | 0.118 | 100.0% | 1 | | -> glance_v2.upload_data | 1.259 | 1.259 | 1.259 | 1.259 | 1.259 | 1.259 | 100.0% | 1 | | nova.boot_servers | 15.92 | 15.92 | 15.92 | 15.92 | 15.92 | 15.92 | 100.0% | 1 | | total | 19.722 | 19.722 | 19.722 | 19.722 | 19.722 | 19.722 | 100.0% | 1 | | -> duration | 18.722 | 18.722 | 18.722 | 18.722 | 18.722 | 18.722 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 18.722477 Full duration: 47.905337 HINTS: * To plot HTML graphics with this data, run: rally task report d6bf3c7d-cace-4fab-95e1-854d64b94288 --out output.html * To generate a JUnit report, run: rally task export d6bf3c7d-cace-4fab-95e1-854d64b94288 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report d6bf3c7d-cace-4fab-95e1-854d64b94288 --json --out output.json 2018-04-15 18:07:47,422 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'd6bf3c7d-cace-4fab-95e1-854d64b94288'] 2018-04-15 18:07:48,740 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-15 18:07:48,740 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'd6bf3c7d-cace-4fab-95e1-854d64b94288', '--out', u'/home/opnfv/functest/results/rally/opnfv-glance.html'] 2018-04-15 18:07:48,745 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2018-04-15 18:07:48,746 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2018-04-15 18:07:48,746 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-cinder.yaml 2018-04-15 18:07:48,746 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-15 18:07:48,755 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-15 18:07:48,756 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['cinder'], 'concurrency': 4, 'netid': '07721f22-fd39-45c8-befb-ab9cb864c1e6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'flavor_name': 'rally-tiny-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-15 18:12:37,752 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 3eeced1c-48e3-4a3a-b4f8-5c3bbb77e5aa 2018-04-15 18:12:37,753 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '3eeced1c-48e3-4a3a-b4f8-5c3bbb77e5aa'] 2018-04-15 18:12:39,065 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 3eeced1c-48e3-4a3a-b4f8-5c3bbb77e5aa: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "volumes": { "volumes_per_tenant": 1, "size": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "force": false }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3eeced1c-48e3-4a3a-b4f8-5c3bbb77e5aa has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_snapshot | 3.437 | 3.437 | 3.437 | 3.437 | 3.437 | 3.437 | 100.0% | 1 | | cinder_v2.delete_snapshot | 2.317 | 2.317 | 2.317 | 2.317 | 2.317 | 2.317 | 100.0% | 1 | | total | 5.754 | 5.754 | 5.754 | 5.754 | 5.754 | 5.754 | 100.0% | 1 | | -> duration | 5.754 | 5.754 | 5.754 | 5.754 | 5.754 | 5.754 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.753933 Full duration: 33.359348 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "size": { "max": 1, "min": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3eeced1c-48e3-4a3a-b4f8-5c3bbb77e5aa has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 4.841 | 4.841 | 4.841 | 4.841 | 4.841 | 4.841 | 100.0% | 1 | | cinder_v2.delete_volume | 2.302 | 2.302 | 2.302 | 2.302 | 2.302 | 2.302 | 100.0% | 1 | | total | 7.143 | 7.143 | 7.143 | 7.143 | 7.143 | 7.143 | 100.0% | 1 | | -> duration | 7.143 | 7.143 | 7.143 | 7.143 | 7.143 | 7.143 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.143497 Full duration: 26.532527 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "image": { "name": "Cirros-0.4.0-15af60bc-4fc9-4b79-9dab-6b935f38aa06" }, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3eeced1c-48e3-4a3a-b4f8-5c3bbb77e5aa has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 5.85 | 5.85 | 5.85 | 5.85 | 5.85 | 5.85 | 100.0% | 1 | | cinder_v2.delete_volume | 2.293 | 2.293 | 2.293 | 2.293 | 2.293 | 2.293 | 100.0% | 1 | | total | 8.143 | 8.143 | 8.143 | 8.143 | 8.143 | 8.143 | 100.0% | 1 | | -> duration | 8.143 | 8.143 | 8.143 | 8.143 | 8.143 | 8.143 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.143118 Full duration: 27.448319 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3eeced1c-48e3-4a3a-b4f8-5c3bbb77e5aa has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 4.667 | 4.667 | 4.667 | 4.667 | 4.667 | 4.667 | 100.0% | 1 | | cinder_v2.delete_volume | 2.27 | 2.27 | 2.27 | 2.27 | 2.27 | 2.27 | 100.0% | 1 | | total | 6.937 | 6.937 | 6.937 | 6.937 | 6.937 | 6.937 | 100.0% | 1 | | -> duration | 6.937 | 6.937 | 6.937 | 6.937 | 6.937 | 6.937 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.937154 Full duration: 25.255705 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "new_size": 2, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3eeced1c-48e3-4a3a-b4f8-5c3bbb77e5aa has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.981 | 3.981 | 3.981 | 3.981 | 3.981 | 3.981 | 100.0% | 1 | | cinder_v2.extend_volume | 2.977 | 2.977 | 2.977 | 2.977 | 2.977 | 2.977 | 100.0% | 1 | | cinder_v2.delete_volume | 2.306 | 2.306 | 2.306 | 2.306 | 2.306 | 2.306 | 100.0% | 1 | | total | 9.265 | 9.265 | 9.265 | 9.265 | 9.265 | 9.265 | 100.0% | 1 | | -> duration | 9.265 | 9.265 | 9.265 | 9.265 | 9.265 | 9.265 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.264593 Full duration: 26.418035 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "volumes": { "volumes_per_tenant": 1, "size": 1 }, "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 } } }, "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3eeced1c-48e3-4a3a-b4f8-5c3bbb77e5aa has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 4.426 | 4.426 | 4.426 | 4.426 | 4.426 | 4.426 | 100.0% | 1 | | cinder_v2.delete_volume | 2.801 | 2.801 | 2.801 | 2.801 | 2.801 | 2.801 | 100.0% | 1 | | total | 7.228 | 7.228 | 7.228 | 7.228 | 7.228 | 7.228 | 100.0% | 1 | | -> duration | 7.228 | 7.228 | 7.228 | 7.228 | 7.228 | 7.228 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.227698 Full duration: 34.242694 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "write_iops_sec": "10", "consumer": "both", "read_iops_sec": "1000" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3eeced1c-48e3-4a3a-b4f8-5c3bbb77e5aa has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 1.806 | 1.806 | 1.806 | 1.806 | 1.806 | 1.806 | 100.0% | 1 | | cinder_v2.list_qos | 0.038 | 0.038 | 0.038 | 0.038 | 0.038 | 0.038 | 100.0% | 1 | | total | 1.845 | 1.845 | 1.845 | 1.845 | 1.845 | 1.845 | 100.0% | 1 | | -> duration | 1.845 | 1.845 | 1.845 | 1.845 | 1.845 | 1.845 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.84495 Full duration: 20.486488 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "set_read_iops_sec": "1001", "set_consumer": "both", "read_iops_sec": "1000", "set_write_iops_sec": "11", "write_iops_sec": "10", "consumer": "back-end" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3eeced1c-48e3-4a3a-b4f8-5c3bbb77e5aa has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 1.041 | 1.041 | 1.041 | 1.041 | 1.041 | 1.041 | 100.0% | 1 | | cinder_v2.set_qos | 0.083 | 0.083 | 0.083 | 0.083 | 0.083 | 0.083 | 100.0% | 1 | | total | 1.125 | 1.125 | 1.125 | 1.125 | 1.125 | 1.125 | 100.0% | 1 | | -> duration | 1.125 | 1.125 | 1.125 | 1.125 | 1.125 | 1.125 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.124521 Full duration: 18.897204 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "description": "rally tests creating types" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3eeced1c-48e3-4a3a-b4f8-5c3bbb77e5aa has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 2.037 | 2.037 | 2.037 | 2.037 | 2.037 | 2.037 | 100.0% | 1 | | cinder_v2.list_types | 0.071 | 0.071 | 0.071 | 0.071 | 0.071 | 0.071 | 100.0% | 1 | | total | 2.109 | 2.109 | 2.109 | 2.109 | 2.109 | 2.109 | 100.0% | 1 | | -> duration | 2.109 | 2.109 | 2.109 | 2.109 | 2.109 | 2.109 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.108651 Full duration: 19.6285 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "control_location": "front-end", "cipher": "aes-xts-plain64", "description": "rally tests creating types", "key_size": 512, "provider": "LuksEncryptor" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 3eeced1c-48e3-4a3a-b4f8-5c3bbb77e5aa has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 1.232 | 1.232 | 1.232 | 1.232 | 1.232 | 1.232 | 100.0% | 1 | | cinder_v2.create_encryption_type | 0.079 | 0.079 | 0.079 | 0.079 | 0.079 | 0.079 | 100.0% | 1 | | total | 1.311 | 1.311 | 1.311 | 1.311 | 1.311 | 1.311 | 100.0% | 1 | | -> duration | 1.311 | 1.311 | 1.311 | 1.311 | 1.311 | 1.311 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.311048 Full duration: 20.704612 HINTS: * To plot HTML graphics with this data, run: rally task report 3eeced1c-48e3-4a3a-b4f8-5c3bbb77e5aa --out output.html * To generate a JUnit report, run: rally task export 3eeced1c-48e3-4a3a-b4f8-5c3bbb77e5aa --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 3eeced1c-48e3-4a3a-b4f8-5c3bbb77e5aa --json --out output.json 2018-04-15 18:12:39,066 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '3eeced1c-48e3-4a3a-b4f8-5c3bbb77e5aa'] 2018-04-15 18:12:40,427 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-15 18:12:40,427 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '3eeced1c-48e3-4a3a-b4f8-5c3bbb77e5aa', '--out', u'/home/opnfv/functest/results/rally/opnfv-cinder.html'] 2018-04-15 18:12:40,433 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2018-04-15 18:12:40,433 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2018-04-15 18:12:40,433 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-heat.yaml 2018-04-15 18:12:40,434 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-15 18:12:40,444 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-15 18:12:40,444 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['heat'], 'concurrency': 4, 'netid': '07721f22-fd39-45c8-befb-ab9cb864c1e6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'flavor_name': 'rally-tiny-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-15 18:15:15,766 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : ee3e2b8c-193b-42b5-92f4-4d8d39c8ab48 2018-04-15 18:15:15,766 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'ee3e2b8c-193b-42b5-92f4-4d8d39c8ab48'] 2018-04-15 18:15:17,034 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task ee3e2b8c-193b-42b5-92f4-4d8d39c8ab48: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ee3e2b8c-193b-42b5-92f4-4d8d39c8ab48 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 7.826 | 7.826 | 7.826 | 7.826 | 7.826 | 7.826 | 100.0% | 1 | | heat.update_stack | 2.57 | 2.57 | 2.57 | 2.57 | 2.57 | 2.57 | 100.0% | 1 | | heat.delete_stack | 3.574 | 3.574 | 3.574 | 3.574 | 3.574 | 3.574 | 100.0% | 1 | | total | 13.97 | 13.97 | 13.97 | 13.97 | 13.97 | 13.97 | 100.0% | 1 | | -> duration | 9.97 | 9.97 | 9.97 | 9.97 | 9.97 | 9.97 | 100.0% | 1 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.969691 Full duration: 34.204774 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ee3e2b8c-193b-42b5-92f4-4d8d39c8ab48 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 6.527 | 6.527 | 6.527 | 6.527 | 6.527 | 6.527 | 100.0% | 1 | | heat.check_stack | 0.384 | 0.384 | 0.384 | 0.384 | 0.384 | 0.384 | 100.0% | 1 | | heat.delete_stack | 2.494 | 2.494 | 2.494 | 2.494 | 2.494 | 2.494 | 100.0% | 1 | | total | 9.406 | 9.406 | 9.406 | 9.406 | 9.406 | 9.406 | 100.0% | 1 | | -> duration | 7.406 | 7.406 | 7.406 | 7.406 | 7.406 | 7.406 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.405643 Full duration: 28.179801 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "roles": [ "heat_stack_owner" ] }, "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ee3e2b8c-193b-42b5-92f4-4d8d39c8ab48 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 6.171 | 6.171 | 6.171 | 6.171 | 6.171 | 6.171 | 100.0% | 1 | | heat.suspend_stack | 0.494 | 0.494 | 0.494 | 0.494 | 0.494 | 0.494 | 100.0% | 1 | | heat.resume_stack | 1.444 | 1.444 | 1.444 | 1.444 | 1.444 | 1.444 | 100.0% | 1 | | heat.delete_stack | 1.39 | 1.39 | 1.39 | 1.39 | 1.39 | 1.39 | 100.0% | 1 | | total | 9.499 | 9.499 | 9.499 | 9.499 | 9.499 | 9.499 | 100.0% | 1 | | -> duration | 7.499 | 7.499 | 7.499 | 7.499 | 7.499 | 7.499 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.498607 Full duration: 29.741768 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "roles": [ "heat_stack_owner" ] }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task ee3e2b8c-193b-42b5-92f4-4d8d39c8ab48 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 1.708 | 1.708 | 1.708 | 1.708 | 1.708 | 1.708 | 100.0% | 1 | | total | 1.709 | 1.709 | 1.709 | 1.709 | 1.709 | 1.709 | 100.0% | 1 | | -> duration | 1.709 | 1.709 | 1.709 | 1.709 | 1.709 | 1.709 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.708568 Full duration: 19.053267 HINTS: * To plot HTML graphics with this data, run: rally task report ee3e2b8c-193b-42b5-92f4-4d8d39c8ab48 --out output.html * To generate a JUnit report, run: rally task export ee3e2b8c-193b-42b5-92f4-4d8d39c8ab48 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report ee3e2b8c-193b-42b5-92f4-4d8d39c8ab48 --json --out output.json 2018-04-15 18:15:17,035 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'ee3e2b8c-193b-42b5-92f4-4d8d39c8ab48'] 2018-04-15 18:15:18,393 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-15 18:15:18,393 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'ee3e2b8c-193b-42b5-92f4-4d8d39c8ab48', '--out', u'/home/opnfv/functest/results/rally/opnfv-heat.html'] 2018-04-15 18:15:18,398 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2018-04-15 18:15:18,399 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2018-04-15 18:15:18,399 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-keystone.yaml 2018-04-15 18:15:18,399 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-15 18:15:18,408 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-15 18:15:18,409 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['keystone'], 'concurrency': 4, 'netid': '07721f22-fd39-45c8-befb-ab9cb864c1e6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'flavor_name': 'rally-tiny-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-15 18:20:16,230 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : d187c597-ff58-4d8d-a1e0-0f699f83cbb0 2018-04-15 18:20:16,231 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'd187c597-ff58-4d8d-a1e0-0f699f83cbb0'] 2018-04-15 18:20:17,537 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task d187c597-ff58-4d8d-a1e0-0f699f83cbb0: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d187c597-ff58-4d8d-a1e0-0f699f83cbb0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.825 | 0.825 | 0.825 | 0.825 | 0.825 | 0.825 | 100.0% | 1 | | keystone_v3.add_role | 0.246 | 0.246 | 0.246 | 0.246 | 0.246 | 0.246 | 100.0% | 1 | | keystone_v3.revoke_role | 0.256 | 0.256 | 0.256 | 0.256 | 0.256 | 0.256 | 100.0% | 1 | | total | 1.327 | 1.327 | 1.327 | 1.327 | 1.327 | 1.327 | 100.0% | 1 | | -> duration | 1.327 | 1.327 | 1.327 | 1.327 | 1.327 | 1.327 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.326913 Full duration: 23.090827 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d187c597-ff58-4d8d-a1e0-0f699f83cbb0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.933 | 0.933 | 0.933 | 0.933 | 0.933 | 0.933 | 100.0% | 1 | | keystone_v3.add_role | 0.225 | 0.225 | 0.225 | 0.225 | 0.225 | 0.225 | 100.0% | 1 | | keystone_v3.list_roles | 0.206 | 0.206 | 0.206 | 0.206 | 0.206 | 0.206 | 100.0% | 1 | | total | 1.365 | 1.365 | 1.365 | 1.365 | 1.365 | 1.365 | 100.0% | 1 | | -> duration | 1.365 | 1.365 | 1.365 | 1.365 | 1.365 | 1.365 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.364689 Full duration: 22.748897 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d187c597-ff58-4d8d-a1e0-0f699f83cbb0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 1.206 | 1.206 | 1.206 | 1.206 | 1.206 | 1.206 | 100.0% | 1 | | keystone_v3.list_projects | 0.199 | 0.199 | 0.199 | 0.199 | 0.199 | 0.199 | 100.0% | 1 | | total | 1.405 | 1.405 | 1.405 | 1.405 | 1.405 | 1.405 | 100.0% | 1 | | -> duration | 1.405 | 1.405 | 1.405 | 1.405 | 1.405 | 1.405 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.405122 Full duration: 23.32788 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d187c597-ff58-4d8d-a1e0-0f699f83cbb0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.93 | 0.93 | 0.93 | 0.93 | 0.93 | 0.93 | 100.0% | 1 | | keystone_v3.delete_role | 0.187 | 0.187 | 0.187 | 0.187 | 0.187 | 0.187 | 100.0% | 1 | | total | 1.116 | 1.116 | 1.116 | 1.116 | 1.116 | 1.116 | 100.0% | 1 | | -> duration | 1.116 | 1.116 | 1.116 | 1.116 | 1.116 | 1.116 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.116489 Full duration: 20.756417 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d187c597-ff58-4d8d-a1e0-0f699f83cbb0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.958 | 0.958 | 0.958 | 0.958 | 0.958 | 0.958 | 100.0% | 1 | | keystone_v3.delete_service | 0.224 | 0.224 | 0.224 | 0.224 | 0.224 | 0.224 | 100.0% | 1 | | total | 1.183 | 1.183 | 1.183 | 1.183 | 1.183 | 1.183 | 100.0% | 1 | | -> duration | 1.183 | 1.183 | 1.183 | 1.183 | 1.183 | 1.183 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.182683 Full duration: 21.409795 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d187c597-ff58-4d8d-a1e0-0f699f83cbb0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 1.282 | 1.282 | 1.282 | 1.282 | 1.282 | 1.282 | 100.0% | 1 | | keystone_v3.create_user | 0.529 | 0.529 | 0.529 | 0.529 | 0.529 | 0.529 | 100.0% | 1 | | -> keystone_v3.list_roles | 0.051 | 0.051 | 0.051 | 0.051 | 0.051 | 0.051 | 100.0% | 1 | | -> keystone_v3.add_role | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 100.0% | 1 | | keystone_v3.create_role | 0.21 | 0.21 | 0.21 | 0.21 | 0.21 | 0.21 | 100.0% | 1 | | keystone_v3.get_project | 0.175 | 0.175 | 0.175 | 0.175 | 0.175 | 0.175 | 100.0% | 1 | | keystone_v3.get_user | 0.176 | 0.176 | 0.176 | 0.176 | 0.176 | 0.176 | 100.0% | 1 | | keystone_v3.get_role | 0.178 | 0.178 | 0.178 | 0.178 | 0.178 | 0.178 | 100.0% | 1 | | keystone_v3.list_services | 0.172 | 0.172 | 0.172 | 0.172 | 0.172 | 0.172 | 100.0% | 1 | | keystone_v3.get_services | 0.158 | 0.158 | 0.158 | 0.158 | 0.158 | 0.158 | 100.0% | 1 | | total | 3.066 | 3.066 | 3.066 | 3.066 | 3.066 | 3.066 | 100.0% | 1 | | -> duration | 3.066 | 3.066 | 3.066 | 3.066 | 3.066 | 3.066 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.065828 Full duration: 30.462077 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d187c597-ff58-4d8d-a1e0-0f699f83cbb0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 1.244 | 1.244 | 1.244 | 1.244 | 1.244 | 1.244 | 100.0% | 1 | | keystone_v3.update_project | 0.198 | 0.198 | 0.198 | 0.198 | 0.198 | 0.198 | 100.0% | 1 | | keystone_v3.delete_project | 0.264 | 0.264 | 0.264 | 0.264 | 0.264 | 0.264 | 100.0% | 1 | | total | 1.706 | 1.706 | 1.706 | 1.706 | 1.706 | 1.706 | 100.0% | 1 | | -> duration | 1.706 | 1.706 | 1.706 | 1.706 | 1.706 | 1.706 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.70608 Full duration: 21.384319 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d187c597-ff58-4d8d-a1e0-0f699f83cbb0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 1.228 | 1.228 | 1.228 | 1.228 | 1.228 | 1.228 | 100.0% | 1 | | total | 1.414 | 1.414 | 1.414 | 1.414 | 1.414 | 1.414 | 100.0% | 1 | | -> duration | 1.414 | 1.414 | 1.414 | 1.414 | 1.414 | 1.414 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.414387 Full duration: 23.372379 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d187c597-ff58-4d8d-a1e0-0f699f83cbb0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 1.237 | 1.237 | 1.237 | 1.237 | 1.237 | 1.237 | 100.0% | 1 | | total | 1.237 | 1.237 | 1.237 | 1.237 | 1.237 | 1.237 | 100.0% | 1 | | -> duration | 1.237 | 1.237 | 1.237 | 1.237 | 1.237 | 1.237 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.23743 Full duration: 22.703258 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d187c597-ff58-4d8d-a1e0-0f699f83cbb0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 1.431 | 1.431 | 1.431 | 1.431 | 1.431 | 1.431 | 100.0% | 1 | | keystone_v3.list_users | 0.067 | 0.067 | 0.067 | 0.067 | 0.067 | 0.067 | 100.0% | 1 | | total | 1.721 | 1.721 | 1.721 | 1.721 | 1.721 | 1.721 | 100.0% | 1 | | -> duration | 1.721 | 1.721 | 1.721 | 1.721 | 1.721 | 1.721 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.72072 Full duration: 23.890157 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": {}, "args": { "users_per_tenant": 10 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d187c597-ff58-4d8d-a1e0-0f699f83cbb0 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 1.204 | 1.204 | 1.204 | 1.204 | 1.204 | 1.204 | 100.0% | 1 | | keystone_v3.create_users | 8.563 | 8.563 | 8.563 | 8.563 | 8.563 | 8.563 | 100.0% | 1 | | -> keystone_v3.create_user (x10) | 8.563 | 8.563 | 8.563 | 8.563 | 8.563 | 8.563 | 100.0% | 1 | | --> keystone_v3.list_roles (x10) | 1.543 | 1.543 | 1.543 | 1.543 | 1.543 | 1.543 | 100.0% | 1 | | --> keystone_v3.add_role (x10) | 2.12 | 2.12 | 2.12 | 2.12 | 2.12 | 2.12 | 100.0% | 1 | | total | 11.693 | 11.693 | 11.693 | 11.693 | 11.693 | 11.693 | 100.0% | 1 | | -> duration | 11.693 | 11.693 | 11.693 | 11.693 | 11.693 | 11.693 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.692766 Full duration: 36.712412 HINTS: * To plot HTML graphics with this data, run: rally task report d187c597-ff58-4d8d-a1e0-0f699f83cbb0 --out output.html * To generate a JUnit report, run: rally task export d187c597-ff58-4d8d-a1e0-0f699f83cbb0 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report d187c597-ff58-4d8d-a1e0-0f699f83cbb0 --json --out output.json 2018-04-15 18:20:17,538 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'd187c597-ff58-4d8d-a1e0-0f699f83cbb0'] 2018-04-15 18:20:18,839 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-15 18:20:18,839 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'd187c597-ff58-4d8d-a1e0-0f699f83cbb0', '--out', u'/home/opnfv/functest/results/rally/opnfv-keystone.html'] 2018-04-15 18:20:18,844 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2018-04-15 18:20:18,844 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2018-04-15 18:20:18,844 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-neutron.yaml 2018-04-15 18:20:18,844 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-15 18:20:18,854 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-15 18:20:18,855 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['neutron'], 'concurrency': 4, 'netid': '07721f22-fd39-45c8-befb-ab9cb864c1e6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'flavor_name': 'rally-tiny-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-15 18:30:25,227 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 7d8baabb-5c55-4127-bc4e-b79933dff5a5 2018-04-15 18:30:25,227 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '7d8baabb-5c55-4127-bc4e-b79933dff5a5'] 2018-04-15 18:30:26,734 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 7d8baabb-5c55-4127-bc4e-b79933dff5a5: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7d8baabb-5c55-4127-bc4e-b79933dff5a5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.678 | 1.678 | 1.678 | 1.678 | 1.678 | 1.678 | 100.0% | 1 | | neutron.delete_network | 1.025 | 1.025 | 1.025 | 1.025 | 1.025 | 1.025 | 100.0% | 1 | | total | 2.703 | 2.703 | 2.703 | 2.703 | 2.703 | 2.703 | 100.0% | 1 | | -> duration | 2.703 | 2.703 | 2.703 | 2.703 | 2.703 | 2.703 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.702811 Full duration: 25.701398 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "neutron": { "network": -1, "port": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": {} }, "args": { "network_create_args": {}, "ports_per_network": 1, "port_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7d8baabb-5c55-4127-bc4e-b79933dff5a5 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.709 | 2.709 | 2.709 | 2.709 | 2.709 | 2.709 | 100.0% | 1 | | neutron.delete_port | 1.245 | 1.245 | 1.245 | 1.245 | 1.245 | 1.245 | 100.0% | 1 | | total | 3.954 | 3.954 | 3.954 | 3.954 | 3.954 | 3.954 | 100.0% | 1 | | -> duration | 3.954 | 3.954 | 3.954 | 3.954 | 3.954 | 3.954 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.954467 Full duration: 58.856467 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "router": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": {} }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 1, "router_create_args": {}, "subnet_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7d8baabb-5c55-4127-bc4e-b79933dff5a5 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.658 | 1.658 | 1.658 | 1.658 | 1.658 | 1.658 | 100.0% | 1 | | neutron.create_subnet | 1.182 | 1.182 | 1.182 | 1.182 | 1.182 | 1.182 | 100.0% | 1 | | neutron.create_router | 5.707 | 5.707 | 5.707 | 5.707 | 5.707 | 5.707 | 100.0% | 1 | | neutron.add_interface_router | 3.061 | 3.061 | 3.061 | 3.061 | 3.061 | 3.061 | 100.0% | 1 | | neutron.remove_interface_router | 2.71 | 2.71 | 2.71 | 2.71 | 2.71 | 2.71 | 100.0% | 1 | | neutron.delete_router | 5.646 | 5.646 | 5.646 | 5.646 | 5.646 | 5.646 | 100.0% | 1 | | total | 19.964 | 19.964 | 19.964 | 19.964 | 19.964 | 19.964 | 100.0% | 1 | | -> duration | 19.964 | 19.964 | 19.964 | 19.964 | 19.964 | 19.964 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 19.964289 Full duration: 82.83274 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "network": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": {} }, "args": { "network_create_args": {}, "subnet_create_args": {}, "subnets_per_network": 1, "subnet_cidr_start": "1.1.0.0/30" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7d8baabb-5c55-4127-bc4e-b79933dff5a5 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 1.916 | 1.916 | 1.916 | 1.916 | 1.916 | 1.916 | 100.0% | 1 | | neutron.delete_subnet | 0.98 | 0.98 | 0.98 | 0.98 | 0.98 | 0.98 | 100.0% | 1 | | total | 2.896 | 2.896 | 2.896 | 2.896 | 2.896 | 2.896 | 100.0% | 1 | | -> duration | 2.896 | 2.896 | 2.896 | 2.896 | 2.896 | 2.896 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.895939 Full duration: 58.787852 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "network": -1 } } }, "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7d8baabb-5c55-4127-bc4e-b79933dff5a5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.579 | 1.579 | 1.579 | 1.579 | 1.579 | 1.579 | 100.0% | 1 | | neutron.list_networks | 0.251 | 0.251 | 0.251 | 0.251 | 0.251 | 0.251 | 100.0% | 1 | | total | 1.83 | 1.83 | 1.83 | 1.83 | 1.83 | 1.83 | 100.0% | 1 | | -> duration | 1.83 | 1.83 | 1.83 | 1.83 | 1.83 | 1.83 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.830058 Full duration: 28.042854 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "neutron": { "network": -1, "port": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": {} }, "args": { "network_create_args": {}, "ports_per_network": 1, "port_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7d8baabb-5c55-4127-bc4e-b79933dff5a5 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 2.786 | 2.786 | 2.786 | 2.786 | 2.786 | 2.786 | 100.0% | 1 | | neutron.list_ports | 0.169 | 0.169 | 0.169 | 0.169 | 0.169 | 0.169 | 100.0% | 1 | | total | 2.955 | 2.955 | 2.955 | 2.955 | 2.955 | 2.955 | 100.0% | 1 | | -> duration | 2.955 | 2.955 | 2.955 | 2.955 | 2.955 | 2.955 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.955385 Full duration: 63.09653 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "network": -1, "router": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": {} }, "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnets_per_network": 1, "router_create_args": {}, "subnet_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7d8baabb-5c55-4127-bc4e-b79933dff5a5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.601 | 1.601 | 1.601 | 1.601 | 1.601 | 1.601 | 100.0% | 1 | | neutron.create_subnet | 0.882 | 0.882 | 0.882 | 0.882 | 0.882 | 0.882 | 100.0% | 1 | | neutron.create_router | 4.555 | 4.555 | 4.555 | 4.555 | 4.555 | 4.555 | 100.0% | 1 | | neutron.add_interface_router | 3.637 | 3.637 | 3.637 | 3.637 | 3.637 | 3.637 | 100.0% | 1 | | neutron.list_routers | 0.177 | 0.177 | 0.177 | 0.177 | 0.177 | 0.177 | 100.0% | 1 | | total | 10.853 | 10.853 | 10.853 | 10.853 | 10.853 | 10.853 | 100.0% | 1 | | -> duration | 10.853 | 10.853 | 10.853 | 10.853 | 10.853 | 10.853 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.852622 Full duration: 86.789884 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "neutron": { "subnet": -1, "network": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": {} }, "args": { "network_create_args": {}, "subnet_create_args": {}, "subnets_per_network": 1, "subnet_cidr_start": "1.1.0.0/30" }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7d8baabb-5c55-4127-bc4e-b79933dff5a5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.478 | 1.478 | 1.478 | 1.478 | 1.478 | 1.478 | 100.0% | 1 | | neutron.create_subnet | 0.956 | 0.956 | 0.956 | 0.956 | 0.956 | 0.956 | 100.0% | 1 | | neutron.list_subnets | 0.122 | 0.122 | 0.122 | 0.122 | 0.122 | 0.122 | 100.0% | 1 | | total | 2.556 | 2.556 | 2.556 | 2.556 | 2.556 | 2.556 | 100.0% | 1 | | -> duration | 2.556 | 2.556 | 2.556 | 2.556 | 2.556 | 2.556 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.556282 Full duration: 65.357509 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7d8baabb-5c55-4127-bc4e-b79933dff5a5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.595 | 1.595 | 1.595 | 1.595 | 1.595 | 1.595 | 100.0% | 1 | | neutron.delete_security_group | 0.327 | 0.327 | 0.327 | 0.327 | 0.327 | 0.327 | 100.0% | 1 | | total | 1.922 | 1.922 | 1.922 | 1.922 | 1.922 | 1.922 | 100.0% | 1 | | -> duration | 1.922 | 1.922 | 1.922 | 1.922 | 1.922 | 1.922 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.922133 Full duration: 25.173797 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "quotas": { "neutron": { "security_group": -1 } } }, "args": {}, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7d8baabb-5c55-4127-bc4e-b79933dff5a5 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.491 | 1.491 | 1.491 | 1.491 | 1.491 | 1.491 | 100.0% | 1 | | neutron.create_security_group_rule | 0.251 | 0.251 | 0.251 | 0.251 | 0.251 | 0.251 | 100.0% | 1 | | neutron.delete_security_group_rule | 0.164 | 0.164 | 0.164 | 0.164 | 0.164 | 0.164 | 100.0% | 1 | | neutron.delete_security_group | 0.177 | 0.177 | 0.177 | 0.177 | 0.177 | 0.177 | 100.0% | 1 | | total | 2.084 | 2.084 | 2.084 | 2.084 | 2.084 | 2.084 | 100.0% | 1 | | -> duration | 2.084 | 2.084 | 2.084 | 2.084 | 2.084 | 2.084 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.083914 Full duration: 26.042224 -------------------------------------------------------------------------------- test scenario NeutronNetworks.set_and_clear_router_gateway args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "roles": [ "admin" ], "quotas": { "neutron": { "router": -1, "network": -1 } } }, "args": { "network_create_args": { "router:external": true } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task 7d8baabb-5c55-4127-bc4e-b79933dff5a5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.648 | 1.648 | 1.648 | 1.648 | 1.648 | 1.648 | 100.0% | 1 | | neutron.create_router | 5.596 | 5.596 | 5.596 | 5.596 | 5.596 | 5.596 | 100.0% | 1 | | neutron.add_gateway_router | 2.58 | 2.58 | 2.58 | 2.58 | 2.58 | 2.58 | 100.0% | 1 | | neutron.remove_gateway_router | 1.871 | 1.871 | 1.871 | 1.871 | 1.871 | 1.871 | 100.0% | 1 | | total | 11.696 | 11.696 | 11.696 | 11.696 | 11.696 | 11.696 | 100.0% | 1 | | -> duration | 11.696 | 11.696 | 11.696 | 11.696 | 11.696 | 11.696 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.695657 Full duration: 52.142417 HINTS: * To plot HTML graphics with this data, run: rally task report 7d8baabb-5c55-4127-bc4e-b79933dff5a5 --out output.html * To generate a JUnit report, run: rally task export 7d8baabb-5c55-4127-bc4e-b79933dff5a5 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 7d8baabb-5c55-4127-bc4e-b79933dff5a5 --json --out output.json 2018-04-15 18:30:26,735 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '7d8baabb-5c55-4127-bc4e-b79933dff5a5'] 2018-04-15 18:30:28,224 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-15 18:30:28,224 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '7d8baabb-5c55-4127-bc4e-b79933dff5a5', '--out', u'/home/opnfv/functest/results/rally/opnfv-neutron.html'] 2018-04-15 18:30:28,230 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2018-04-15 18:30:28,230 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2018-04-15 18:30:28,231 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-nova.yaml 2018-04-15 18:30:28,231 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-15 18:30:28,240 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-15 18:30:28,241 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['nova'], 'concurrency': 4, 'netid': '07721f22-fd39-45c8-befb-ab9cb864c1e6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'flavor_name': 'rally-tiny-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-15 18:40:20,598 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : e99ca84e-f5d2-4666-921e-8c3249a662a5 2018-04-15 18:40:20,599 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'e99ca84e-f5d2-4666-921e-8c3249a662a5'] 2018-04-15 18:40:22,101 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task e99ca84e-f5d2-4666-921e-8c3249a662a5: finished -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_live_migrate_server args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "block_migration": false, "flavor": { "name": "rally-tiny-15af60bc-4fc9-4b79-9dab-6b935f38aa06" }, "image": { "name": "Cirros-0.4.0-15af60bc-4fc9-4b79-9dab-6b935f38aa06" }, "nics": [ { "net-id": "07721f22-fd39-45c8-befb-ab9cb864c1e6" } ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e99ca84e-f5d2-4666-921e-8c3249a662a5 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 12.82 | 12.82 | 12.82 | 12.82 | 12.82 | 12.82 | 100.0% | 1 | | nova.live_migrate | 16.773 | 16.773 | 16.773 | 16.773 | 16.773 | 16.773 | 100.0% | 1 | | nova.delete_server | 5.519 | 5.519 | 5.519 | 5.519 | 5.519 | 5.519 | 100.0% | 1 | | total | 35.113 | 35.113 | 35.113 | 35.113 | 35.113 | 35.113 | 100.0% | 1 | | -> duration | 34.113 | 34.113 | 34.113 | 34.113 | 34.113 | 34.113 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 34.113305 Full duration: 50.35768 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_attach_created_volume_and_live_migrate args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "block_migration": false, "flavor": { "name": "rally-tiny-15af60bc-4fc9-4b79-9dab-6b935f38aa06" }, "boot_server_kwargs": { "nics": [ { "net-id": "07721f22-fd39-45c8-befb-ab9cb864c1e6" } ] }, "image": { "name": "Cirros-0.4.0-15af60bc-4fc9-4b79-9dab-6b935f38aa06" }, "size": 10 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e99ca84e-f5d2-4666-921e-8c3249a662a5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 11.936 | 11.936 | 11.936 | 11.936 | 11.936 | 11.936 | 100.0% | 1 | | cinder_v2.create_volume | 2.766 | 2.766 | 2.766 | 2.766 | 2.766 | 2.766 | 100.0% | 1 | | nova.attach_volume | 5.407 | 5.407 | 5.407 | 5.407 | 5.407 | 5.407 | 100.0% | 1 | | nova.live_migrate | 18.071 | 18.071 | 18.071 | 18.071 | 18.071 | 18.071 | 100.0% | 1 | | nova.detach_volume | 2.099 | 2.099 | 2.099 | 2.099 | 2.099 | 2.099 | 100.0% | 1 | | cinder_v2.delete_volume | 2.691 | 2.691 | 2.691 | 2.691 | 2.691 | 2.691 | 100.0% | 1 | | nova.delete_server | 3.212 | 3.212 | 3.212 | 3.212 | 3.212 | 3.212 | 100.0% | 1 | | total | 46.182 | 46.182 | 46.182 | 46.182 | 46.182 | 46.182 | 100.0% | 1 | | -> duration | 45.182 | 45.182 | 45.182 | 45.182 | 45.182 | 45.182 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 45.181982 Full duration: 67.088785 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume_and_live_migrate args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "volume_size": 10, "nics": [ { "net-id": "07721f22-fd39-45c8-befb-ab9cb864c1e6" } ], "image": { "name": "Cirros-0.4.0-15af60bc-4fc9-4b79-9dab-6b935f38aa06" }, "block_migration": false, "force_delete": false, "flavor": { "name": "rally-tiny-15af60bc-4fc9-4b79-9dab-6b935f38aa06" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e99ca84e-f5d2-4666-921e-8c3249a662a5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 6.618 | 6.618 | 6.618 | 6.618 | 6.618 | 6.618 | 100.0% | 1 | | nova.boot_server | 10.585 | 10.585 | 10.585 | 10.585 | 10.585 | 10.585 | 100.0% | 1 | | nova.live_migrate | 13.985 | 13.985 | 13.985 | 13.985 | 13.985 | 13.985 | 100.0% | 1 | | nova.delete_server | 5.859 | 5.859 | 5.859 | 5.859 | 5.859 | 5.859 | 100.0% | 1 | | total | 37.047 | 37.047 | 37.047 | 37.047 | 37.047 | 37.047 | 100.0% | 1 | | -> duration | 36.047 | 36.047 | 36.047 | 36.047 | 36.047 | 36.047 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 36.047065 Full duration: 57.632953 -------------------------------------------------------------------------------- test scenario NovaKeypair.boot_and_delete_server_with_keypair args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "key_pairs": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "server_kwargs": { "nics": [ { "net-id": "07721f22-fd39-45c8-befb-ab9cb864c1e6" } ] }, "flavor": { "name": "rally-tiny-15af60bc-4fc9-4b79-9dab-6b935f38aa06" }, "image": { "name": "Cirros-0.4.0-15af60bc-4fc9-4b79-9dab-6b935f38aa06" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e99ca84e-f5d2-4666-921e-8c3249a662a5 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 1.307 | 1.307 | 1.307 | 1.307 | 1.307 | 1.307 | 100.0% | 1 | | nova.boot_server | 10.221 | 10.221 | 10.221 | 10.221 | 10.221 | 10.221 | 100.0% | 1 | | nova.delete_server | 2.874 | 2.874 | 2.874 | 2.874 | 2.874 | 2.874 | 100.0% | 1 | | nova.delete_keypair | 0.087 | 0.087 | 0.087 | 0.087 | 0.087 | 0.087 | 100.0% | 1 | | total | 14.49 | 14.49 | 14.49 | 14.49 | 14.49 | 14.49 | 100.0% | 1 | | -> duration | 13.49 | 13.49 | 13.49 | 13.49 | 13.49 | 13.49 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.490414 Full duration: 65.598803 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume_and_delete args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "cinder": { "gigabytes": -1, "volumes": -1, "snapshots": -1 }, "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "volume_size": 5, "flavor": { "name": "rally-tiny-15af60bc-4fc9-4b79-9dab-6b935f38aa06" }, "image": { "name": "Cirros-0.4.0-15af60bc-4fc9-4b79-9dab-6b935f38aa06" }, "nics": [ { "net-id": "07721f22-fd39-45c8-befb-ab9cb864c1e6" } ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e99ca84e-f5d2-4666-921e-8c3249a662a5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 6.589 | 6.589 | 6.589 | 6.589 | 6.589 | 6.589 | 100.0% | 1 | | nova.boot_server | 11.168 | 11.168 | 11.168 | 11.168 | 11.168 | 11.168 | 100.0% | 1 | | nova.delete_server | 3.341 | 3.341 | 3.341 | 3.341 | 3.341 | 3.341 | 100.0% | 1 | | total | 21.098 | 21.098 | 21.098 | 21.098 | 21.098 | 21.098 | 100.0% | 1 | | -> duration | 20.098 | 20.098 | 20.098 | 20.098 | 20.098 | 20.098 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 20.098398 Full duration: 79.233397 -------------------------------------------------------------------------------- test scenario NovaServers.pause_and_unpause_server args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "quotas": { "nova": { "ram": -1, "floating_ips": -1, "security_group_rules": -1, "instances": -1, "cores": -1, "security_groups": -1 }, "neutron": { "subnet": -1, "network": -1, "port": -1 } }, "users": { "users_per_tenant": 1, "tenants": 1 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" } }, "args": { "force_delete": false, "flavor": { "name": "rally-tiny-15af60bc-4fc9-4b79-9dab-6b935f38aa06" }, "image": { "name": "Cirros-0.4.0-15af60bc-4fc9-4b79-9dab-6b935f38aa06" }, "nics": [ { "net-id": "07721f22-fd39-45c8-befb-ab9cb864c1e6" } ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e99ca84e-f5d2-4666-921e-8c3249a662a5 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 12.834 | 12.834 | 12.834 | 12.834 | 12.834 | 12.834 | 100.0% | 1 | | nova.pause_server | 3.192 | 3.192 | 3.192 | 3.192 | 3.192 | 3.192 | 100.0% | 1 | | nova.unpause_server | 3.211 | 3.211 | 3.211 | 3.211 | 3.211 | 3.211 | 100.0% | 1 | | nova.delete_server | 3.17 | 3.17 | 3.17 | 3.17 | 3.17 | 3.17 | 100.0% | 1 | | total | 22.407 | 22.407 | 22.407 | 22.407 | 22.407 | 22.407 | 100.0% | 1 | | -> duration | 17.407 | 17.407 | 17.407 | 17.407 | 17.407 | 17.407 | 100.0% | 1 | | -> idle_duration | 5.0 | 5.0 | 5.0 | 5.0 | 5.0 | 5.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.407318 Full duration: 72.063183 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_migrate_server args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "nics": [ { "net-id": "07721f22-fd39-45c8-befb-ab9cb864c1e6" } ], "flavor": { "name": "rally-tiny-15af60bc-4fc9-4b79-9dab-6b935f38aa06" }, "image": { "name": "Cirros-0.4.0-15af60bc-4fc9-4b79-9dab-6b935f38aa06" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e99ca84e-f5d2-4666-921e-8c3249a662a5 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 11.905 | 11.905 | 11.905 | 11.905 | 11.905 | 11.905 | 100.0% | 1 | | nova.migrate | 36.843 | 36.843 | 36.843 | 36.843 | 36.843 | 36.843 | 100.0% | 1 | | nova.resize_confirm | 2.964 | 2.964 | 2.964 | 2.964 | 2.964 | 2.964 | 100.0% | 1 | | nova.delete_server | 2.749 | 2.749 | 2.749 | 2.749 | 2.749 | 2.749 | 100.0% | 1 | | total | 54.462 | 54.462 | 54.462 | 54.462 | 54.462 | 54.462 | 100.0% | 1 | | -> duration | 53.462 | 53.462 | 53.462 | 53.462 | 53.462 | 53.462 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 53.461833 Full duration: 70.590016 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_and_list_interfaces args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 }, "network": {} }, "args": { "flavor": { "name": "rally-tiny-15af60bc-4fc9-4b79-9dab-6b935f38aa06" }, "auto_assign_nic": true, "image": { "name": "Cirros-0.4.0-15af60bc-4fc9-4b79-9dab-6b935f38aa06" } }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e99ca84e-f5d2-4666-921e-8c3249a662a5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 13.098 | 13.098 | 13.098 | 13.098 | 13.098 | 13.098 | 100.0% | 1 | | nova.list_interfaces | 0.202 | 0.202 | 0.202 | 0.202 | 0.202 | 0.202 | 100.0% | 1 | | total | 13.3 | 13.3 | 13.3 | 13.3 | 13.3 | 13.3 | 100.0% | 1 | | -> duration | 12.3 | 12.3 | 12.3 | 12.3 | 12.3 | 12.3 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 12.300256 Full duration: 69.320907 -------------------------------------------------------------------------------- test scenario NovaServerGroups.create_and_delete_server_group args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "policies": [ "affinity" ] }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task e99ca84e-f5d2-4666-921e-8c3249a662a5 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_server_group | 1.199 | 1.199 | 1.199 | 1.199 | 1.199 | 1.199 | 100.0% | 1 | | nova.delete_server_group | 0.072 | 0.072 | 0.072 | 0.072 | 0.072 | 0.072 | 100.0% | 1 | | total | 1.271 | 1.271 | 1.271 | 1.271 | 1.271 | 1.271 | 100.0% | 1 | | -> duration | 1.271 | 1.271 | 1.271 | 1.271 | 1.271 | 1.271 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.271044 Full duration: 17.682981 HINTS: * To plot HTML graphics with this data, run: rally task report e99ca84e-f5d2-4666-921e-8c3249a662a5 --out output.html * To generate a JUnit report, run: rally task export e99ca84e-f5d2-4666-921e-8c3249a662a5 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report e99ca84e-f5d2-4666-921e-8c3249a662a5 --json --out output.json 2018-04-15 18:40:22,102 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'e99ca84e-f5d2-4666-921e-8c3249a662a5'] 2018-04-15 18:40:23,535 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-15 18:40:23,535 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'e99ca84e-f5d2-4666-921e-8c3249a662a5', '--out', u'/home/opnfv/functest/results/rally/opnfv-nova.html'] 2018-04-15 18:40:23,540 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" OK. 2018-04-15 18:40:23,540 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2018-04-15 18:40:23,540 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-quotas.yaml 2018-04-15 18:40:23,541 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-04-15 18:40:23,550 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-04-15 18:40:23,551 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'ext-net', 'service_list': ['quotas'], 'concurrency': 4, 'netid': '07721f22-fd39-45c8-befb-ab9cb864c1e6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'flavor_name': 'rally-tiny-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-15af60bc-4fc9-4b79-9dab-6b935f38aa06', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-04-15 18:41:47,884 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : d8c1d2d4-fee9-406e-9626-d72dbd472f6b 2018-04-15 18:41:47,884 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'd8c1d2d4-fee9-406e-9626-d72dbd472f6b'] 2018-04-15 18:41:49,284 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task d8c1d2d4-fee9-406e-9626-d72dbd472f6b: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d8c1d2d4-fee9-406e-9626-d72dbd472f6b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.248 | 1.248 | 1.248 | 1.248 | 1.248 | 1.248 | 100.0% | 1 | | quotas.delete_quotas | 0.06 | 0.06 | 0.06 | 0.06 | 0.06 | 0.06 | 100.0% | 1 | | total | 1.309 | 1.309 | 1.309 | 1.309 | 1.309 | 1.309 | 100.0% | 1 | | -> duration | 1.309 | 1.309 | 1.309 | 1.309 | 1.309 | 1.309 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.308624 Full duration: 14.603161 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d8c1d2d4-fee9-406e-9626-d72dbd472f6b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.3 | 1.3 | 1.3 | 1.3 | 1.3 | 1.3 | 100.0% | 1 | | total | 1.3 | 1.3 | 1.3 | 1.3 | 1.3 | 1.3 | 100.0% | 1 | | -> duration | 1.3 | 1.3 | 1.3 | 1.3 | 1.3 | 1.3 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.300042 Full duration: 14.302599 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d8c1d2d4-fee9-406e-9626-d72dbd472f6b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.486 | 0.486 | 0.486 | 0.486 | 0.486 | 0.486 | 100.0% | 1 | | total | 1.224 | 1.224 | 1.224 | 1.224 | 1.224 | 1.224 | 100.0% | 1 | | -> duration | 1.224 | 1.224 | 1.224 | 1.224 | 1.224 | 1.224 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.224448 Full duration: 15.348074 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "contexts": { "users": { "users_per_tenant": 1, "tenants": 1 } }, "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "hooks": [] } -------------------------------------------------------------------------------- Task d8c1d2d4-fee9-406e-9626-d72dbd472f6b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.45 | 1.45 | 1.45 | 1.45 | 1.45 | 1.45 | 100.0% | 1 | | total | 1.45 | 1.45 | 1.45 | 1.45 | 1.45 | 1.45 | 100.0% | 1 | | -> duration | 1.45 | 1.45 | 1.45 | 1.45 | 1.45 | 1.45 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.450454 Full duration: 14.882595 HINTS: * To plot HTML graphics with this data, run: rally task report d8c1d2d4-fee9-406e-9626-d72dbd472f6b --out output.html * To generate a JUnit report, run: rally task export d8c1d2d4-fee9-406e-9626-d72dbd472f6b --type junit --to output.xml * To get raw JSON output of task results, run: rally task report d8c1d2d4-fee9-406e-9626-d72dbd472f6b --json --out output.json 2018-04-15 18:41:49,286 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'd8c1d2d4-fee9-406e-9626-d72dbd472f6b'] 2018-04-15 18:41:50,756 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-04-15 18:41:50,756 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'd8c1d2d4-fee9-406e-9626-d72dbd472f6b', '--out', u'/home/opnfv/functest/results/rally/opnfv-quotas.html'] 2018-04-15 18:41:50,762 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2018-04-15 18:41:50,764 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 01:20 | 6 | 100.00% | | glance | 01:39 | 4 | 100.00% | | cinder | 04:12 | 10 | 100.00% | | heat | 01:51 | 4 | 100.00% | | keystone | 04:29 | 11 | 100.00% | | neutron | 09:32 | 11 | 100.00% | | nova | 09:09 | 9 | 100.00% | | quotas | 00:59 | 4 | 100.00% | | | | | | | TOTAL: | 00:33:15 | 59 | 100.00% | +----------------+------------+----------------+-----------+ 2018-04-15 18:41:50,764 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_sanity' success_rate is 100.00% 2018-04-15 18:42:07,747 - xtesting.energy.energy - DEBUG - Stopping recording 2018-04-15 18:42:09,377 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-15 18:42:09,377 - xtesting.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | rally_sanity | functest | 38:51 | PASS | +----------------------+------------------+------------------+----------------+ 2018-04-15 18:42:09,380 - xtesting.ci.run_tests - INFO - Running test case 'patrole'... 2018-04-15 18:42:09,447 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-15 18:42:13,571 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-04-15 18:42:17,635 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | ea3336a2-1e17-462f-98a7-0490fd47ac18 | 2018-04-15T18:42:17.480446 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: ea3336a2-1e17-462f-98a7-0490fd47ac18 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-15 18:42:23,649 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+-------------------+-----------+ | Service | Service Type | Status | +-------------+-------------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | nfv-orchestration | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+-------------------+-----------+ 2018-04-15 18:42:23,650 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-04-15 18:42:27,801 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-04-15 18:42:33,437 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide Using verifier 'opnfv-tempest' (UUID=fe6fd327-2abd-4692-8a1a-6470b7dcfe6f) as the default verifier for the future CLI operations. 2018-04-15 18:42:38,732 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-04-15 18:42:41,918 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-04-15 18:42:47,773 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-04-15 18:42:56,979 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-04-15 18:42:56,979 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-04-15 18:42:56,980 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-04-15 18:42:56,981 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-04-15 18:42:56,986 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-04-15 18:43:01,880 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-fe6fd327-2abd-4692-8a1a-6470b7dcfe6f/repo; stestr list '(?!.*test_networks_multiprovider_rbac)(?=patrole_tempest_plugin.tests.api.(image|network))' >/home/opnfv/functest/results/patrole/tempest-list.txt 2>/dev/null) 2018-04-15 18:43:01,881 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/patrole/tempest-list.txt']'. 2018-04-15 18:46:59,770 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Verification UUID: d3bf6985-0a78-43ee-be91-9395cebebd73 2018-04-15 18:46:59,911 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', 'd3bf6985-0a78-43ee-be91-9395cebebd73']'. 2018-04-15 18:47:01,400 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-04-15 18:47:01,401 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-04-15 18:47:01,401 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-15 18:47:01,401 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | d3bf6985-0a78-43ee-be91-9395cebebd73 | 2018-04-15 18:47:01,401 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | finished | 2018-04-15 18:47:01,401 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-04-15 18:43:05 | 2018-04-15 18:47:01,401 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-04-15 18:46:59 | 2018-04-15 18:47:01,402 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:03:54 | 2018-04-15 18:47:01,402 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-04-15 18:47:01,402 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-04-15 18:47:01,402 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: fe6fd327-2abd-4692-8a1a-6470b7dcfe6f) | 2018-04-15 18:47:01,403 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-04-15 18:47:01,403 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: ea3336a2-1e17-462f-98a7-0490fd47ac18) | 2018-04-15 18:47:01,403 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 136 | 2018-04-15 18:47:01,403 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 180.937 | 2018-04-15 18:47:01,403 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 133 | 2018-04-15 18:47:01,403 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 3 | 2018-04-15 18:47:01,403 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-04-15 18:47:01,403 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-04-15 18:47:01,403 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 0 | 2018-04-15 18:47:01,403 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-15 18:47:01,403 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-04-15 18:47:01,404 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest patrole success_rate is 100.0% 2018-04-15 18:47:10,059 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-15 18:47:10,059 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | patrole | functest | 04:31 | PASS | +-------------------+------------------+------------------+----------------+ 2018-04-15 18:47:10,062 - xtesting.ci.run_tests - INFO - Running test case 'snaps_smoke'... 2018-04-15 18:47:11,609 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-04-15 20:06:54,981 - xtesting.core.unit - DEBUG - test_add_rule (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_delete_group (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_admin_user_to_new_project (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_new_user_to_admin_project (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_with_one_complex_rule (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_with_one_simple_rule (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_with_several_rules (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_without_rules (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_remove_rule_by_id (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_remove_rule_by_setting (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_delete_image (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_image_clean_file (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_image_clean_url (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_image_clean_url_properties (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_same_image (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_same_image_new_settings (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_bad_image_file (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests) ... ok test_bad_image_image_type (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests) ... ok test_bad_image_name (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests) ... ok test_bad_image_url (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests) ... ok test_create_three_part_image_from_file_3_creators (snaps.openstack.tests.create_image_tests.CreateMultiPartImageTests) ... ok test_create_three_part_image_from_url (snaps.openstack.tests.create_image_tests.CreateMultiPartImageTests) ... ok test_create_three_part_image_from_url_3_creators (snaps.openstack.tests.create_image_tests.CreateMultiPartImageTests) ... ok test_create_delete_keypair (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_from_file (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_large_key (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_only (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_save_both (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_save_pub_only (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_exist_files_delete (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_keypair_exist_files_keep (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_keypair_gen_files_delete_1 (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_keypair_gen_files_delete_2 (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_keypair_gen_files_keep (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_delete_network (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_network_router_admin_user_to_new_project (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_network_router_new_user_to_admin_project (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_network_with_router (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_network_without_router (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_networks_same_name (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_delete_router (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_admin_state_True (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_admin_state_false (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_admin_user_to_new_project (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_external_network (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_new_user_as_admin_project (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_private_network (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_vanilla (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_with_ext_port (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... FAIL test_create_router_admin_ports (snaps.openstack.tests.create_router_tests.CreateRouterNegativeTests) ... ok test_create_router_invalid_gateway_name (snaps.openstack.tests.create_router_tests.CreateRouterNegativeTests) ... ok test_create_router_noname (snaps.openstack.tests.create_router_tests.CreateRouterNegativeTests) ... ok test_create_delete_qos (snaps.openstack.tests.create_qos_tests.CreateQoSTests) ... ok test_create_qos (snaps.openstack.tests.create_qos_tests.CreateQoSTests) ... ok test_create_same_qos (snaps.openstack.tests.create_qos_tests.CreateQoSTests) ... ok test_create_delete_volume_type (snaps.openstack.tests.create_volume_type_tests.CreateSimpleVolumeTypeSuccessTests) ... ok test_create_same_volume_type (snaps.openstack.tests.create_volume_type_tests.CreateSimpleVolumeTypeSuccessTests) ... ok test_create_volume_type (snaps.openstack.tests.create_volume_type_tests.CreateSimpleVolumeTypeSuccessTests) ... ok test_volume_type_with_encryption (snaps.openstack.tests.create_volume_type_tests.CreateVolumeTypeComplexTests) ... ok test_volume_type_with_qos (snaps.openstack.tests.create_volume_type_tests.CreateVolumeTypeComplexTests) ... ok test_volume_type_with_qos_and_encryption (snaps.openstack.tests.create_volume_type_tests.CreateVolumeTypeComplexTests) ... ok test_create_delete_volume (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeSuccessTests) ... ok test_create_same_volume (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeSuccessTests) ... ok test_create_volume_simple (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeSuccessTests) ... ok test_create_volume_bad_image (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeFailureTests) ... ok test_create_volume_bad_size (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeFailureTests) ... ok test_create_volume_bad_type (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeFailureTests) ... ok test_bad_volume_type (snaps.openstack.tests.create_volume_tests.CreateVolumeWithTypeTests) ... ok test_valid_volume_type (snaps.openstack.tests.create_volume_tests.CreateVolumeWithTypeTests) ... ok test_bad_image_name (snaps.openstack.tests.create_volume_tests.CreateVolumeWithImageTests) ... ok test_valid_volume_image (snaps.openstack.tests.create_volume_tests.CreateVolumeWithImageTests) ... ok test_check_vm_ip_dhcp (snaps.openstack.tests.create_instance_tests.SimpleHealthCheck) ... ok test_ping_via_router (snaps.openstack.tests.create_instance_tests.CreateInstanceTwoNetTests) ... ok test_create_admin_instance (snaps.openstack.tests.create_instance_tests.CreateInstanceSimpleTests) ... ok test_create_delete_instance (snaps.openstack.tests.create_instance_tests.CreateInstanceSimpleTests) ... ok test_set_allowed_address_pairs (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_allowed_address_pairs_bad_ip (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_allowed_address_pairs_bad_mac (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_invalid_ip_one_subnet (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_invalid_mac (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_mac_and_ip (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_valid_ip_one_subnet (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_valid_mac (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_one_port_two_ip_one_subnet (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_one_port_two_ip_two_subnets (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_add_invalid_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_add_same_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_add_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_remove_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_remove_security_group_never_added (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_deploy_vm_to_each_compute_node (snaps.openstack.tests.create_instance_tests.CreateInstanceOnComputeHost) ... ok test_create_instance_from_three_part_image (snaps.openstack.tests.create_instance_tests.CreateInstanceFromThreePartImage) ... ok test_create_instance_with_one_volume (snaps.openstack.tests.create_instance_tests.CreateInstanceVolumeTests) ... ok test_create_instance_with_two_volumes (snaps.openstack.tests.create_instance_tests.CreateInstanceVolumeTests) ... ok test_create_delete_stack (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_create_same_stack (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_create_stack_short_timeout (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_create_stack_template_dict (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_create_stack_template_file (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_retrieve_network_creators (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_retrieve_vm_inst_creators (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_retrieve_volume_creator (snaps.openstack.tests.create_stack_tests.CreateStackVolumeTests) ... ok test_retrieve_volume_type_creator (snaps.openstack.tests.create_stack_tests.CreateStackVolumeTests) ... ok test_retrieve_flavor_creator (snaps.openstack.tests.create_stack_tests.CreateStackFlavorTests) ... ok test_retrieve_keypair_creator (snaps.openstack.tests.create_stack_tests.CreateStackKeypairTests) ... ok test_retrieve_security_group_creator (snaps.openstack.tests.create_stack_tests.CreateStackSecurityGroupTests) ... ok test_bad_stack_file (snaps.openstack.tests.create_stack_tests.CreateStackNegativeTests) ... ok test_missing_dependencies (snaps.openstack.tests.create_stack_tests.CreateStackNegativeTests) ... ok test_single_port_static (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_after_active (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_after_init (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_after_reboot (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_before_active (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_reverse_engineer (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_second_creator (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_connect_via_ssh_heat_vm (snaps.openstack.tests.create_stack_tests.CreateStackFloatingIpTests) ... ok test_connect_via_ssh_heat_vm_derived (snaps.openstack.tests.create_stack_tests.CreateStackFloatingIpTests) ... ok test_apply_simple_playbook (snaps.provisioning.tests.ansible_utils_tests.AnsibleProvisioningTests) ... ok test_apply_template_playbook (snaps.provisioning.tests.ansible_utils_tests.AnsibleProvisioningTests) ... ok ====================================================================== FAIL: test_create_router_with_ext_port (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/snaps/openstack/tests/create_router_tests.py", line 419, in test_create_router_with_ext_port self.assertEqual(ext_net.id, port.network_id) AssertionError: u'13120893-ec38-45e4-844c-a0a9b1c953a5' != u'da126216-378f-4c97-87b4-ff923f35b3df' - 13120893-ec38-45e4-844c-a0a9b1c953a5 + da126216-378f-4c97-87b4-ff923f35b3df ---------------------------------------------------------------------- Ran 119 tests in 4783.318s FAILED (failures=1) 2018-04-15 20:06:55,839 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-15 20:06:55,840 - xtesting.ci.run_tests - INFO - Test result: +---------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +---------------------+------------------+------------------+----------------+ | snaps_smoke | functest | 79:43 | FAIL | +---------------------+------------------+------------------+----------------+ 2018-04-15 20:06:55,843 - xtesting.ci.run_tests - ERROR - The test case 'snaps_smoke' failed. 2018-04-15 20:06:55,843 - xtesting.ci.run_tests - INFO - Running test case 'neutron_trunk'... 2018-04-15 20:06:55,937 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-04-15 20:07:00,105 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-04-15 20:07:04,227 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally +--------------------------------------+----------------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+----------------------------+-------------+------------------+--------+ | 40d59577-eb7b-4557-84dd-15885f7fe71a | 2018-04-15T20:07:04.051325 | opnfv-rally | deploy->finished | | +--------------------------------------+----------------------------+-------------+------------------+--------+ Using deployment: 40d59577-eb7b-4557-84dd-15885f7fe71a ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-04-15 20:07:10,651 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+-------------------+-----------+ | Service | Service Type | Status | +-------------+-------------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | nfv-orchestration | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+-------------------+-----------+ 2018-04-15 20:07:10,652 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-04-15 20:07:15,050 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-04-15 20:07:20,991 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide Using verifier 'opnfv-tempest' (UUID=8ae19e98-da8c-4e9c-97fb-5cd45df5ee2a) as the default verifier for the future CLI operations. 2018-04-15 20:07:26,346 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-04-15 20:07:29,794 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-04-15 20:07:35,892 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-04-15 20:07:45,847 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-04-15 20:07:45,847 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-04-15 20:07:45,848 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-04-15 20:07:45,853 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-04-15 20:07:45,859 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-04-15 20:07:50,123 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-8ae19e98-da8c-4e9c-97fb-5cd45df5ee2a/repo; stestr list 'neutron_tempest_plugin.(api|scenario).test_trunk' >/home/opnfv/functest/results/neutron_trunk/test_list.txt 2>/dev/null) 2018-04-15 20:07:50,123 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Applying tempest blacklist... 2018-04-15 20:07:50,125 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Tempest blacklist file does not exist. 2018-04-15 20:07:50,125 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/neutron_trunk/test_list.txt']'. 2018-04-15 20:11:15,849 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Verification UUID: 9335a873-d2c8-42e3-9bbe-a4a225be9b13 2018-04-15 20:11:16,049 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '9335a873-d2c8-42e3-9bbe-a4a225be9b13']'. 2018-04-15 20:11:17,411 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-04-15 20:11:17,411 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-04-15 20:11:17,411 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-15 20:11:17,411 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 9335a873-d2c8-42e3-9bbe-a4a225be9b13 | 2018-04-15 20:11:17,411 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | failed | 2018-04-15 20:11:17,411 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-04-15 20:07:54 | 2018-04-15 20:11:17,411 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-04-15 20:11:15 | 2018-04-15 20:11:17,411 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:03:21 | 2018-04-15 20:11:17,411 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-04-15 20:11:17,411 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-04-15 20:11:17,412 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: 8ae19e98-da8c-4e9c-97fb-5cd45df5ee2a) | 2018-04-15 20:11:17,412 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-04-15 20:11:17,412 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 40d59577-eb7b-4557-84dd-15885f7fe71a) | 2018-04-15 20:11:17,412 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 52 | 2018-04-15 20:11:17,412 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 180.508 | 2018-04-15 20:11:17,412 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 41 | 2018-04-15 20:11:17,412 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 9 | 2018-04-15 20:11:17,412 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-04-15 20:11:17,412 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-04-15 20:11:17,412 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 2 | 2018-04-15 20:11:17,412 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-04-15 20:11:17,412 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +------------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-04-15 20:11:17,415 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest neutron_trunk success_rate is 95.3488372093% 2018-04-15 20:11:26,408 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-04-15 20:11:26,409 - xtesting.ci.run_tests - INFO - Test result: +-----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------+------------------+------------------+----------------+ | neutron_trunk | functest | 03:59 | FAIL | +-----------------------+------------------+------------------+----------------+ 2018-04-15 20:11:26,411 - xtesting.ci.run_tests - ERROR - The test case 'neutron_trunk' failed. 2018-04-15 20:11:26,412 - xtesting.ci.run_tests - INFO - Xtesting report: +------------------------------+------------------+---------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +------------------------------+------------------+---------------+------------------+----------------+ | vping_ssh | functest | smoke | 01:15 | PASS | | vping_userdata | functest | smoke | 01:02 | PASS | | tempest_smoke_serial | functest | smoke | 21:18 | FAIL | | rally_sanity | functest | smoke | 38:51 | PASS | | patrole | functest | smoke | 04:31 | PASS | | snaps_smoke | functest | smoke | 79:43 | FAIL | | neutron_trunk | functest | smoke | 03:59 | FAIL | | refstack_defcore | functest | smoke | 00:00 | SKIP | | odl | functest | smoke | 00:00 | SKIP | | odl_netvirt | functest | smoke | 00:00 | SKIP | +------------------------------+------------------+---------------+------------------+----------------+ 2018-04-15 20:11:26,416 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR 2018-04-15 20:12:04,278 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+-----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+-----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-compass-virtual-daily-master-229 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | compass | | DEPLOY_SCENARIO | os-nosdn-kvm-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | huawei-virtual2 | +--------------------------------------+-----------------------------------------------------------+ 2018-04-15 20:12:04,281 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Ansible managed export LC_ALL=C # COMMON CINDER ENVS export CINDER_ENDPOINT_TYPE=publicURL # COMMON NOVA ENVS export NOVA_ENDPOINT_TYPE=publicURL # COMMON OPENSTACK ENVS export OS_ENDPOINT_TYPE=publicURL export OS_INTERFACE=publicURL export OS_USERNAME=admin export OS_PASSWORD='b6f47c30cdcb66779d0a161309da97a' export OS_PROJECT_NAME=admin export OS_TENANT_NAME=admin export OS_AUTH_URL=https://192.16.1.222:5000/v3 export OS_NO_CACHE=1 export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_REGION_NAME=RegionOne # For openstackclient export OS_IDENTITY_API_VERSION=3 export OS_AUTH_VERSION=3 export OS_AUTH_TYPE=password export SDN_CONTROLLER_IP=192.16.1.222 export OS_CACERT=/home/opnfv/functest/conf/os_cacert 2018-04-15 20:12:04,281 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-04-15 20:12:04,281 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+-----------------+---------------------+-------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+-----------------+---------------------+-------------------+ +---------------+---------------+-----------------+---------------------+-------------------+ 2018-04-15 20:12:04,282 - xtesting.ci.run_tests - INFO - Xtesting report: +-----------------------------+------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-----------------------------+------------------------+------------------+------------------+----------------+ | doctor-notification | doctor | features | 00:00 | SKIP | | bgpvpn | sdnvpn | features | 00:00 | SKIP | | functest-odl-sfc | sfc | features | 00:00 | SKIP | | barometercollectd | barometer | features | 00:00 | SKIP | | fds | fastdatastacks | features | 00:00 | SKIP | +-----------------------------+------------------------+------------------+------------------+----------------+ 2018-04-15 20:12:04,284 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK