2018-02-24 06:45:50,133 - functest.ci.check_deployment - DEBUG - 172.30.9.25:5000 is reachable! 2018-02-24 06:45:50,133 - functest.ci.check_deployment - INFO - Connectivity to OS_AUTH_URL http://172.30.9.25:5000/v3 ...OK 2018-02-24 06:45:50,504 - functest.ci.check_deployment - INFO - Got token ...OK 2018-02-24 06:45:50,954 - functest.ci.check_deployment - DEBUG - 172.30.9.25:5000 is reachable! 2018-02-24 06:45:50,954 - functest.ci.check_deployment - INFO - Connectivity to the public endpoint http://172.30.9.25:5000 ...OK 2018-02-24 06:45:51,404 - functest.ci.check_deployment - DEBUG - 172.30.9.25:8774 is reachable! 2018-02-24 06:45:51,405 - functest.ci.check_deployment - INFO - Connectivity to endpoint 'compute' http://172.30.9.25:8774/v2.1 ...OK 2018-02-24 06:45:51,788 - functest.ci.check_deployment - DEBUG - 172.30.9.25:9696 is reachable! 2018-02-24 06:45:51,788 - functest.ci.check_deployment - INFO - Connectivity to endpoint 'network' http://172.30.9.25:9696 ...OK 2018-02-24 06:45:52,224 - functest.ci.check_deployment - DEBUG - 172.30.9.25:9292 is reachable! 2018-02-24 06:45:52,224 - functest.ci.check_deployment - INFO - Connectivity to endpoint 'image' http://172.30.9.25:9292 ...OK 2018-02-24 06:45:53,428 - functest.ci.check_deployment - INFO - Nova service ...OK 2018-02-24 06:45:54,285 - functest.ci.check_deployment - INFO - Neutron service ...OK 2018-02-24 06:45:54,316 - functest.ci.check_deployment - INFO - Glance service ...OK 2018-02-24 06:45:55,692 - functest.ci.check_deployment - INFO - External network found: external 2018-02-24 06:45:58,182 - functest.ci.run_tests - DEBUG - Sourcing the credential file... 2018-02-24 06:45:58,182 - functest.ci.run_tests - INFO - Sourcing env file /home/opnfv/functest/conf/env_file 2018-02-24 06:45:58,184 - functest.ci.run_tests - DEBUG - Test args: all 2018-02-24 06:45:58,185 - functest.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ | healthcheck | 0 | (daily)|(weekly) | First tier to be executed to verify the | connection_check api_check | | | | | basic operations in the VIM. | snaps_health_check | +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ 2018-02-24 06:45:58,187 - functest.ci.run_tests - INFO - Running tier 'healthcheck' 2018-02-24 06:45:58,187 - functest.ci.run_tests - INFO - Running test case 'connection_check'... 2018-02-24 06:45:59,409 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-02-24 06:46:13,781 - functest.core.unit - DEBUG - test_glance_connect_fail (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_glance_connect_success (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_keystone_connect_fail (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_keystone_connect_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_neutron_connect_fail (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_neutron_connect_success (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_retrieve_ext_network_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_nova_connect_fail (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_connect_success (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_get_hypervisor_hosts (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_heat_connect_fail (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_heat_connect_success (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_cinder_connect_fail (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok test_cinder_connect_success (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok ---------------------------------------------------------------------- Ran 14 tests in 7.272s OK 2018-02-24 06:46:13,916 - functest.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-02-24 06:46:13,917 - functest.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | connection_check | functest | 00:07 | PASS | +--------------------------+------------------+------------------+----------------+ 2018-02-24 06:46:13,921 - functest.ci.run_tests - INFO - Running test case 'api_check'... 2018-02-24 06:46:14,598 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-02-24 06:56:41,550 - functest.core.unit - DEBUG - test_create_project_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_user_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_credentials (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_service (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_with_each_interface (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_grant_user_role_to_project (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_admin_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user_2x (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_2x (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_bad_domain (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_update_quotas (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_sec_grp_one_user (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_project_sec_grp_two_users (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_image_minimal_file (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_image_minimal_url (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_network (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_add_interface_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_missing_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip_to_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_network_object (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_simple (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_with_public_interface (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_delete_simple_sec_grp (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_rules (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_one_rule (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_get_sec_grp_by_id (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_floating_ips (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsFloatingIpTests) ... ok test_create_delete_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_key_from_file (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_delete_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_instance (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceTests) ... ok test_add_remove_volume (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_attach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_detach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_create_clean_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_delete_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_all_settings (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_existing (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_create_stack_x2 (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_get_settings_from_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateComplexStackTests) ... ok test_create_flavor_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsFlavorTests) ... ok test_create_keypair_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsKeypairTests) ... ok test_create_security_group_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsSecurityGroupTests) ... ok test_create_delete_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_back (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_both (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_front (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_delete_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_simple_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_delete_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_simple_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_bad_key_size (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_delete_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_simple_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_all_attrs (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_invalid_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos_and_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok ---------------------------------------------------------------------- Ran 83 tests in 586.261s OK 2018-02-24 06:56:41,677 - functest.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-02-24 06:56:41,678 - functest.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | api_check | functest | 09:46 | PASS | +-------------------+------------------+------------------+----------------+ 2018-02-24 06:56:41,682 - functest.ci.run_tests - INFO - Running test case 'snaps_health_check'... 2018-02-24 06:56:42,365 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-02-24 06:57:18,701 - functest.core.unit - DEBUG - test_check_vm_ip_dhcp (snaps.openstack.tests.create_instance_tests.SimpleHealthCheck) ... ok ---------------------------------------------------------------------- Ran 1 test in 35.878s OK 2018-02-24 06:57:18,812 - functest.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-02-24 06:57:18,813 - functest.ci.run_tests - INFO - Test result: +----------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------------+------------------+------------------+----------------+ | snaps_health_check | functest | 00:36 | PASS | +----------------------------+------------------+------------------+----------------+ 2018-02-24 06:57:18,817 - functest.ci.run_tests - INFO - Deployment description: +-------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+----------------------------------------------------------+ | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-nofeature-noha | | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-799 | | CI_LOOP | daily | +-------------------------+----------------------------------------------------------+ 2018-02-24 06:57:18,819 - functest.ci.run_tests - INFO - FUNCTEST REPORT: +----------------------------+------------------+---------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------------+------------------+---------------------+------------------+----------------+ | connection_check | functest | healthcheck | 00:07 | PASS | | api_check | functest | healthcheck | 09:46 | PASS | | snaps_health_check | functest | healthcheck | 00:36 | PASS | +----------------------------+------------------+---------------------+------------------+----------------+ 2018-02-24 06:57:18,822 - functest.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-02-24 06:57:21,452 - functest.ci.run_tests - DEBUG - Sourcing the credential file... 2018-02-24 06:57:21,452 - functest.ci.run_tests - INFO - Sourcing env file /home/opnfv/functest/conf/env_file 2018-02-24 06:57:21,453 - functest.ci.run_tests - DEBUG - Test args: all 2018-02-24 06:57:21,454 - functest.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+--------------------------+------------------------------------------+-------------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+--------------------------+------------------------------------------+-------------------------------------------+ | smoke | 1 | (daily)|(weekly) | Set of basic Functional tests to | vping_ssh vping_userdata | | | | | validate the OPNFV scenarios. | tempest_smoke_serial rally_sanity | | | | | | refstack_defcore odl snaps_smoke | +---------------+---------------+--------------------------+------------------------------------------+-------------------------------------------+ 2018-02-24 06:57:21,455 - functest.ci.run_tests - INFO - Running tier 'smoke' 2018-02-24 06:57:21,455 - functest.ci.run_tests - INFO - Running test case 'vping_ssh'... 2018-02-24 06:57:22,300 - functest.energy.energy - INFO - API recorder available at : http://energy.opnfv.fr/resources/recorders/environment/lf-pod1 2018-02-24 06:57:22,300 - functest.energy.energy - DEBUG - Getting current scenario 2018-02-24 06:57:22,785 - functest.energy.energy - DEBUG - Starting recording 2018-02-24 06:57:22,785 - functest.energy.energy - DEBUG - Submitting scenario (vping_ssh/running) 2018-02-24 06:57:23,224 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup 2018-02-24 06:57:23,224 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-02-24 06:57:23' 2018-02-24 06:57:23,224 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--570d8367-a452-456c-92b2-8ba4d0c97b12' 2018-02-24 06:57:25,394 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-570d8367-a452-456c-92b2-8ba4d0c97b12' 2018-02-24 06:57:28,072 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-570d8367-a452-456c-92b2-8ba4d0c97b12' 2018-02-24 06:57:36,005 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-570d8367-a452-456c-92b2-8ba4d0c97b12' 2018-02-24 06:57:37,227 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating keypair with name: 'vPing-keypair-570d8367-a452-456c-92b2-8ba4d0c97b12' 2018-02-24 06:57:38,352 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-570d8367-a452-456c-92b2-8ba4d0c97b12' 2018-02-24 06:57:43,189 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Security group with name: 'vPing-sg-570d8367-a452-456c-92b2-8ba4d0c97b12' 2018-02-24 06:57:46,008 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-570d8367-a452-456c-92b2-8ba4d0c97b12' 2018-02-24 06:58:02,023 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution 2018-02-24 06:58:07,943 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Trying to transfer ping.sh 2018-02-24 06:58:08,080 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping... 2018-02-24 06:58:09,087 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected! 2018-02-24 06:58:25,567 - functest.energy.energy - DEBUG - Restoring previous scenario (refstack_defcore/running) 2018-02-24 06:58:25,568 - functest.energy.energy - DEBUG - Submitting scenario (refstack_defcore/running) 2018-02-24 06:58:26,117 - functest.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-02-24 06:58:26,117 - functest.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | vping_ssh | functest | 00:46 | PASS | +-------------------+------------------+------------------+----------------+ 2018-02-24 06:58:26,122 - functest.ci.run_tests - INFO - Running test case 'vping_userdata'... 2018-02-24 06:58:26,204 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup 2018-02-24 06:58:26,204 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-02-24 06:58:26' 2018-02-24 06:58:26,204 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--352bf478-dfc4-4981-9e83-07135cfff204' 2018-02-24 06:58:28,620 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-352bf478-dfc4-4981-9e83-07135cfff204' 2018-02-24 06:58:30,548 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-352bf478-dfc4-4981-9e83-07135cfff204' 2018-02-24 06:58:35,262 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-352bf478-dfc4-4981-9e83-07135cfff204' 2018-02-24 06:58:36,373 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-352bf478-dfc4-4981-9e83-07135cfff204' 2018-02-24 06:58:41,253 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-352bf478-dfc4-4981-9e83-07135cfff204' 2018-02-24 06:58:45,862 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution 2018-02-24 06:58:54,635 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping... 2018-02-24 06:58:56,875 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected! 2018-02-24 06:59:16,701 - functest.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-02-24 06:59:16,702 - functest.ci.run_tests - INFO - Test result: +------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------+------------------+------------------+----------------+ | vping_userdata | functest | 00:31 | PASS | +------------------------+------------------+------------------+----------------+ 2018-02-24 06:59:16,706 - functest.ci.run_tests - INFO - Running test case 'tempest_smoke_serial'... 2018-02-24 06:59:16,790 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-02-24 06:59:18,802 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment create --fromenv --name=opnfv-rally' 2018-02-24 06:59:21,001 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment check' 2018-02-24 06:59:24,255 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-02-24 06:59:26,455 - functest.utils.functest_utils - DEBUG - Executing command: 'rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide' 2018-02-24 06:59:32,272 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-02-24 06:59:34,455 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating image for Tempest suite 2018-02-24 06:59:37,593 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Configuring the verifier... 2018-02-24 06:59:37,593 - functest.utils.functest_utils - DEBUG - Executing command: 'rally verify configure-verifier' 2018-02-24 06:59:40,348 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-02-24 06:59:40,348 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-02-24 06:59:40,351 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-02-24 06:59:40,355 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-02-24 06:59:40,355 - functest.utils.functest_utils - DEBUG - Executing command: 'cd /root/.rally/verification/verifier-f7317f11-93d5-45c2-813b-c1fbe9f902ce/repo;testr list-tests 'tempest\.(api|scenario).*\[.*\bsmoke\b.*\]' > /home/opnfv/functest/results/tempest/test_raw_list.txt;cd -;' 2018-02-24 06:59:42,366 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Applying tempest blacklist... 2018-02-24 06:59:42,367 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Tempest blacklist file does not exist. 2018-02-24 06:59:42,367 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', '/home/opnfv/functest/results/tempest/test_list.txt', '--concurrency', '1']'. 2018-02-24 06:59:44,395 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 06:59:44.394 61 INFO rally.api [-] Starting verification (UUID=696fab8c-ace9-4dff-90b5-eaa1fe40cc8b) for deployment 'opnfv-rally' (UUID=63654a51-15f4-43b7-9cc8-7f2b48d1dd81) by verifier 'opnfv-tempest' (UUID=f7317f11-93d5-45c2-813b-c1fbe9f902ce). 2018-02-24 06:59:44,395 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: 696fab8c-ace9-4dff-90b5-eaa1fe40cc8b 2018-02-24 06:59:51,289 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 06:59:51.288 61 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor ... success [0.162s] 2018-02-24 06:59:51,340 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 06:59:51.340 61 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.052s] 2018-02-24 06:59:57,189 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 06:59:57.188 61 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create ... success [0.953s] 2018-02-24 06:59:59,089 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 06:59:59.088 61 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list ... success [1.899s] 2018-02-24 07:00:07,272 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:00:07.271 61 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete ... success [2.428s] 2018-02-24 07:00:19,737 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:00:19.736 61 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip ... success [7.574s] 2018-02-24 07:00:46,514 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:00:46.514 61 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers ... success [0.074s] 2018-02-24 07:00:46,517 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:00:46.517 61 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details ... success [0.002s] 2018-02-24 07:01:11,197 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:01:11.196 61 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.071s] 2018-02-24 07:01:11,198 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:01:11.198 61 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.002s] 2018-02-24 07:01:35,163 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:01:35.162 61 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.084s] 2018-02-24 07:01:35,165 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:01:35.165 61 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.002s] 2018-02-24 07:03:22,189 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:03:22.189 61 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [83.804s] 2018-02-24 07:03:41,508 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:03:41.507 61 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses ... success [0.060s] 2018-02-24 07:03:41,607 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:03:41.607 61 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network ... success [0.099s] 2018-02-24 07:03:48,773 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:03:48.772 61 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_get_version_details ... success [0.633s] 2018-02-24 07:03:48,782 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:03:48.782 61 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.010s] 2018-02-24 07:03:50,041 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:03:50.041 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_services.ServicesTestJSON ... skip: Identity api v2 is not enabled 2018-02-24 07:03:50,042 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:03:50.042 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_users.UsersTestJSON ... skip: Identity api v2 is not enabled 2018-02-24 07:03:53,598 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:03:53.598 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete ... success [0.269s] 2018-02-24 07:03:58,628 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:03:58.628 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists ... success [0.077s] 2018-02-24 07:04:03,969 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:04:03.969 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain ... success [0.531s] 2018-02-24 07:04:10,784 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:04:10.784 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint ... success [0.400s] 2018-02-24 07:04:19,372 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:04:19.372 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete ... success [2.996s] 2018-02-24 07:04:24,741 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:04:24.740 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy ... success [0.313s] 2018-02-24 07:04:29,729 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:04:29.728 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id ... success [0.175s] 2018-02-24 07:04:35,807 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:04:35.807 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list ... success [0.390s] 2018-02-24 07:04:42,100 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:04:42.100 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service ... success [0.428s] 2018-02-24 07:04:49,443 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:04:49.443 61 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all ... success [2.615s] 2018-02-24 07:04:51,566 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:04:51.566 61 INFO opnfv-tempest [-] {0} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery ... skip: Identity api v2 is not enabled 2018-02-24 07:04:53,441 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:04:53.440 61 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.066s] 2018-02-24 07:04:53,513 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:04:53.513 61 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.072s] 2018-02-24 07:04:53,584 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:04:53.583 61 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.070s] 2018-02-24 07:04:53,590 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:04:53.590 61 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions ... success [0.006s] 2018-02-24 07:04:57,170 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:04:57.170 61 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.385s] 2018-02-24 07:04:58,052 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:04:58.052 61 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file ... success [0.881s] 2018-02-24 07:04:58,997 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:04:58.997 61 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [0.944s] 2018-02-24 07:05:04,549 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:05:04.548 61 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_versions.VersionsTest.test_list_versions ... success [0.007s] 2018-02-24 07:05:08,869 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:05:08.869 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions ... success [1.435s] 2018-02-24 07:05:19,199 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:05:19.198 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address ... success [2.184s] 2018-02-24 07:05:21,938 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:05:21.938 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip ... success [2.738s] 2018-02-24 07:05:32,511 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:05:32.511 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network ... success [2.758s] 2018-02-24 07:05:35,293 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:05:35.293 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port ... success [2.781s] 2018-02-24 07:05:41,466 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:05:41.465 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet ... success [6.172s] 2018-02-24 07:05:50,097 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:05:50.096 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network ... success [2.238s] 2018-02-24 07:05:53,104 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:05:53.104 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port ... success [3.005s] 2018-02-24 07:05:58,083 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:05:58.083 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet ... success [4.979s] 2018-02-24 07:06:10,290 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:06:10.290 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet ... success [3.390s] 2018-02-24 07:06:10,493 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:06:10.493 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility ... success [0.203s] 2018-02-24 07:06:10,600 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:06:10.600 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks ... success [0.106s] 2018-02-24 07:06:10,788 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:06:10.788 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets ... success [0.187s] 2018-02-24 07:06:10,886 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:06:10.886 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network ... success [0.098s] 2018-02-24 07:06:11,078 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:06:11.077 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet ... success [0.191s] 2018-02-24 07:06:23,477 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:06:23.476 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [4.775s] 2018-02-24 07:06:23,871 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:06:23.871 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.395s] 2018-02-24 07:06:24,116 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:06:24.116 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.245s] 2018-02-24 07:06:24,168 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:06:24.168 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.051s] 2018-02-24 07:06:24,408 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:06:24.408 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.240s] 2018-02-24 07:06:24,597 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:06:24.596 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.188s] 2018-02-24 07:06:34,653 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:06:34.652 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools ... success [3.355s] 2018-02-24 07:06:39,541 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:06:39.541 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups ... success [4.888s] 2018-02-24 07:06:41,065 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:06:41.065 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port ... success [1.523s] 2018-02-24 07:06:41,116 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:06:41.116 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports ... success [0.051s] 2018-02-24 07:06:41,166 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:06:41.166 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port ... success [0.049s] 2018-02-24 07:06:51,041 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:06:51.041 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [3.244s] 2018-02-24 07:06:55,669 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:06:55.668 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups ... success [4.627s] 2018-02-24 07:06:57,174 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:06:57.174 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [1.504s] 2018-02-24 07:06:57,363 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:06:57.362 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.189s] 2018-02-24 07:06:57,414 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:06:57.413 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.051s] 2018-02-24 07:07:09,695 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:07:09.695 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces ... success [7.739s] 2018-02-24 07:07:14,220 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:07:14.219 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id ... success [4.523s] 2018-02-24 07:07:18,115 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:07:18.115 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id ... success [3.894s] 2018-02-24 07:07:20,668 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:07:20.668 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router ... success [2.552s] 2018-02-24 07:07:37,568 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:07:37.568 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [7.553s] 2018-02-24 07:07:42,224 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:07:42.223 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [4.655s] 2018-02-24 07:07:46,074 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:07:46.073 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [3.849s] 2018-02-24 07:07:48,787 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:07:48.786 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [2.712s] 2018-02-24 07:07:59,881 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:07:59.880 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group ... success [1.302s] 2018-02-24 07:08:01,249 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:08:01.248 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule ... success [1.365s] 2018-02-24 07:08:01,289 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:08:01.289 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups ... success [0.043s] 2018-02-24 07:08:05,409 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:08:05.408 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.274s] 2018-02-24 07:08:07,051 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:08:07.050 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.640s] 2018-02-24 07:08:07,092 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:08:07.091 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.044s] 2018-02-24 07:08:10,534 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:08:10.534 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [0.651s] 2018-02-24 07:08:13,533 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:08:13.532 61 INFO opnfv-tempest [-] {0} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.006s] 2018-02-24 07:08:14,600 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:08:14.600 61 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest ... skip: AccountQuotasTest skipped as swift is not available 2018-02-24 07:08:14,602 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:08:14.602 61 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_services.AccountTest ... skip: AccountTest skipped as swift is not available 2018-02-24 07:08:14,604 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:08:14.604 61 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest ... skip: ContainerQuotasTest skipped as swift is not available 2018-02-24 07:08:14,606 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:08:14.606 61 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest ... skip: ContainerTest skipped as swift is not available 2018-02-24 07:08:14,607 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:08:14.606 61 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_object_services.ObjectTest ... skip: ObjectTest skipped as swift is not available 2018-02-24 07:08:16,409 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:08:16.409 61 INFO opnfv-tempest [-] {0} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.012s] 2018-02-24 07:08:29,268 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:08:29.267 61 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_attach_detach_volume_to_instance ... success [8.159s] 2018-02-24 07:08:40,969 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:08:40.969 61 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [6.976s] 2018-02-24 07:08:52,654 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:08:52.654 61 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [11.683s] 2018-02-24 07:09:00,621 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:09:00.621 61 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.040s] 2018-02-24 07:11:31,375 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:11:31.375 61 INFO opnfv-tempest [-] {0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops ... fail [144.793s] 2018-02-24 07:11:57,375 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:11:57.375 61 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops ... success [17.535s] 2018-02-24 07:12:32,262 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-02-24 07:12:32.262 61 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_multinode.TestServerMultinode.test_schedule_to_all_nodes ... success [19.554s] 2018-02-24 07:12:44,411 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '696fab8c-ace9-4dff-90b5-eaa1fe40cc8b']'. 2018-02-24 07:12:45,228 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-02-24 07:12:45,228 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-02-24 07:12:45,228 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-02-24 07:12:45,228 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 696fab8c-ace9-4dff-90b5-eaa1fe40cc8b | 2018-02-24 07:12:45,228 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | failed | 2018-02-24 07:12:45,229 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-02-24 06:59:44 | 2018-02-24 07:12:45,229 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-02-24 07:12:44 | 2018-02-24 07:12:45,229 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:13:00 | 2018-02-24 07:12:45,229 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | concurrency: 1 | 2018-02-24 07:12:45,229 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | | load_list: (value is too long, use 'detailed' flag to display it) | 2018-02-24 07:12:45,229 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-02-24 07:12:45,229 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: f7317f11-93d5-45c2-813b-c1fbe9f902ce) | 2018-02-24 07:12:45,229 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-02-24 07:12:45,229 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 63654a51-15f4-43b7-9cc8-7f2b48d1dd81) | 2018-02-24 07:12:45,229 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 109 | 2018-02-24 07:12:45,230 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 763.015 | 2018-02-24 07:12:45,230 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 89 | 2018-02-24 07:12:45,230 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 19 | 2018-02-24 07:12:45,230 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-02-24 07:12:45,230 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-02-24 07:12:45,230 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 1 | 2018-02-24 07:12:45,230 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-02-24 07:12:45,230 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-02-24 07:12:45,334 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest tempest_smoke_serial success_rate is 98.8888888889% 2018-02-24 07:12:49,863 - functest.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-02-24 07:12:49,863 - functest.ci.run_tests - INFO - Test result: +------------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------------+------------------+------------------+----------------+ | tempest_smoke_serial | functest | 13:17 | FAIL | +------------------------------+------------------+------------------+----------------+ 2018-02-24 07:12:49,865 - functest.ci.run_tests - ERROR - The test case 'tempest_smoke_serial' failed. 2018-02-24 07:12:49,865 - functest.ci.run_tests - INFO - Running test case 'rally_sanity'... 2018-02-24 07:12:49,903 - functest.energy.energy - DEBUG - Getting current scenario 2018-02-24 07:12:50,398 - functest.energy.energy - DEBUG - Starting recording 2018-02-24 07:12:50,398 - functest.energy.energy - DEBUG - Submitting scenario (rally_sanity/running) 2018-02-24 07:12:50,814 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-02-24 07:12:53,123 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment create --fromenv --name=opnfv-rally' 2018-02-24 07:12:55,248 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment check' 2018-02-24 07:12:58,097 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating the test name... 2018-02-24 07:12:59,362 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating image 'Cirros-0.4.0-73db9143-60f3-461d-acde-b69cc2704254'... 2018-02-24 07:13:01,998 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating network 'rally-net-73db9143-60f3-461d-acde-b69cc2704254'... 2018-02-24 07:13:04,195 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating router 'rally-router-73db9143-60f3-461d-acde-b69cc2704254'... 2018-02-24 07:13:08,037 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-tiny-73db9143-60f3-461d-acde-b69cc2704254'... 2018-02-24 07:13:09,083 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-mini-73db9143-60f3-461d-acde-b69cc2704254'... 2018-02-24 07:13:10,183 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2018-02-24 07:13:10,184 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-authenticate.yaml 2018-02-24 07:13:10,185 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-02-24 07:13:10,228 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-02-24 07:13:10,234 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['authenticate'], 'concurrency': 4, 'netid': '21fa9ee9-391c-4b14-8e03-b37ca78f6ef1', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-73db9143-60f3-461d-acde-b69cc2704254', 'flavor_name': 'rally-tiny-73db9143-60f3-461d-acde-b69cc2704254', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-73db9143-60f3-461d-acde-b69cc2704254', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-02-24 07:14:09,960 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 0118df12-7964-484c-961b-a7b909436c69 2018-02-24 07:14:09,960 - functest.opnfv_tests.openstack.rally.rally - DEBUG - /home/opnfv/functest/results/rally does not exist, we create it. 2018-02-24 07:14:09,962 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '0118df12-7964-484c-961b-a7b909436c69'] 2018-02-24 07:14:10,928 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 0118df12-7964-484c-961b-a7b909436c69: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 0118df12-7964-484c-961b-a7b909436c69 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.467 | 0.467 | 0.467 | 0.467 | 0.467 | 0.467 | 100.0% | 1 | | total | 0.467 | 0.467 | 0.467 | 0.467 | 0.467 | 0.467 | 100.0% | 1 | | -> duration | 0.467 | 0.467 | 0.467 | 0.467 | 0.467 | 0.467 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.467492 Full duration: 6.829073 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 0118df12-7964-484c-961b-a7b909436c69 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.323 | 0.323 | 0.323 | 0.323 | 0.323 | 0.323 | 100.0% | 1 | | total | 0.755 | 0.755 | 0.755 | 0.755 | 0.755 | 0.755 | 100.0% | 1 | | -> duration | 0.755 | 0.755 | 0.755 | 0.755 | 0.755 | 0.755 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.75486 Full duration: 6.88283 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 0118df12-7964-484c-961b-a7b909436c69 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.205 | 0.205 | 0.205 | 0.205 | 0.205 | 0.205 | 100.0% | 1 | | total | 0.621 | 0.621 | 0.621 | 0.621 | 0.621 | 0.621 | 100.0% | 1 | | -> duration | 0.621 | 0.621 | 0.621 | 0.621 | 0.621 | 0.621 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.620827 Full duration: 6.785825 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 0118df12-7964-484c-961b-a7b909436c69 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.363 | 0.363 | 0.363 | 0.363 | 0.363 | 0.363 | 100.0% | 1 | | total | 0.772 | 0.772 | 0.772 | 0.772 | 0.772 | 0.772 | 100.0% | 1 | | -> duration | 0.772 | 0.772 | 0.772 | 0.772 | 0.772 | 0.772 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.771922 Full duration: 6.715743 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 0118df12-7964-484c-961b-a7b909436c69 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.357 | 0.357 | 0.357 | 0.357 | 0.357 | 0.357 | 100.0% | 1 | | total | 0.746 | 0.746 | 0.746 | 0.746 | 0.746 | 0.746 | 100.0% | 1 | | -> duration | 0.746 | 0.746 | 0.746 | 0.746 | 0.746 | 0.746 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.745889 Full duration: 6.764313 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 0118df12-7964-484c-961b-a7b909436c69 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.196 | 0.196 | 0.196 | 0.196 | 0.196 | 0.196 | 100.0% | 1 | | total | 0.635 | 0.635 | 0.635 | 0.635 | 0.635 | 0.635 | 100.0% | 1 | | -> duration | 0.635 | 0.635 | 0.635 | 0.635 | 0.635 | 0.635 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.635376 Full duration: 6.908996 HINTS: * To plot HTML graphics with this data, run: rally task report 0118df12-7964-484c-961b-a7b909436c69 --out output.html * To generate a JUnit report, run: rally task export 0118df12-7964-484c-961b-a7b909436c69 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 0118df12-7964-484c-961b-a7b909436c69 --json --out output.json 2018-02-24 07:14:10,929 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '0118df12-7964-484c-961b-a7b909436c69'] 2018-02-24 07:14:11,870 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-02-24 07:14:11,870 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '0118df12-7964-484c-961b-a7b909436c69', '--out', '/home/opnfv/functest/results/rally/opnfv-authenticate.html'] 2018-02-24 07:14:11,878 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2018-02-24 07:14:11,878 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2018-02-24 07:14:11,879 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-glance.yaml 2018-02-24 07:14:11,879 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-02-24 07:14:11,922 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-02-24 07:14:11,924 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['glance'], 'concurrency': 4, 'netid': '21fa9ee9-391c-4b14-8e03-b37ca78f6ef1', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-73db9143-60f3-461d-acde-b69cc2704254', 'flavor_name': 'rally-tiny-73db9143-60f3-461d-acde-b69cc2704254', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-73db9143-60f3-461d-acde-b69cc2704254', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-02-24 07:15:33,015 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 277c2943-0f04-401a-ae74-41933fd38002 2018-02-24 07:15:33,015 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '277c2943-0f04-401a-ae74-41933fd38002'] 2018-02-24 07:15:33,990 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 277c2943-0f04-401a-ae74-41933fd38002: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 277c2943-0f04-401a-ae74-41933fd38002 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.497 | 3.497 | 3.497 | 3.497 | 3.497 | 3.497 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.122 | 0.122 | 0.122 | 0.122 | 0.122 | 0.122 | 100.0% | 1 | | -> glance_v2.upload_data | 1.126 | 1.126 | 1.126 | 1.126 | 1.126 | 1.126 | 100.0% | 1 | | glance_v2.delete_image | 1.111 | 1.111 | 1.111 | 1.111 | 1.111 | 1.111 | 100.0% | 1 | | total | 4.608 | 4.608 | 4.608 | 4.608 | 4.608 | 4.608 | 100.0% | 1 | | -> duration | 4.608 | 4.608 | 4.608 | 4.608 | 4.608 | 4.608 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.608413 Full duration: 12.344231 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 277c2943-0f04-401a-ae74-41933fd38002 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.242 | 3.242 | 3.242 | 3.242 | 3.242 | 3.242 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 100.0% | 1 | | -> glance_v2.upload_data | 0.948 | 0.948 | 0.948 | 0.948 | 0.948 | 0.948 | 100.0% | 1 | | glance_v2.list_images | 0.033 | 0.033 | 0.033 | 0.033 | 0.033 | 0.033 | 100.0% | 1 | | total | 3.275 | 3.275 | 3.275 | 3.275 | 3.275 | 3.275 | 100.0% | 1 | | -> duration | 3.275 | 3.275 | 3.275 | 3.275 | 3.275 | 3.275 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.275038 Full duration: 13.742091 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 277c2943-0f04-401a-ae74-41933fd38002 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.181 | 0.181 | 0.181 | 0.181 | 0.181 | 0.181 | 100.0% | 1 | | total | 0.181 | 0.181 | 0.181 | 0.181 | 0.181 | 0.181 | 100.0% | 1 | | -> duration | 0.181 | 0.181 | 0.181 | 0.181 | 0.181 | 0.181 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.181455 Full duration: 7.145189 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally-tiny-73db9143-60f3-461d-acde-b69cc2704254" }, "number_instances": 2, "nics": [ { "net-id": "21fa9ee9-391c-4b14-8e03-b37ca78f6ef1" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } } } -------------------------------------------------------------------------------- Task 277c2943-0f04-401a-ae74-41933fd38002 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.014 | 3.014 | 3.014 | 3.014 | 3.014 | 3.014 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.043 | 0.043 | 0.043 | 0.043 | 0.043 | 0.043 | 100.0% | 1 | | -> glance_v2.upload_data | 0.71 | 0.71 | 0.71 | 0.71 | 0.71 | 0.71 | 100.0% | 1 | | nova.boot_servers | 8.678 | 8.678 | 8.678 | 8.678 | 8.678 | 8.678 | 100.0% | 1 | | total | 11.693 | 11.693 | 11.693 | 11.693 | 11.693 | 11.693 | 100.0% | 1 | | -> duration | 10.693 | 10.693 | 10.693 | 10.693 | 10.693 | 10.693 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.692521 Full duration: 31.048298 HINTS: * To plot HTML graphics with this data, run: rally task report 277c2943-0f04-401a-ae74-41933fd38002 --out output.html * To generate a JUnit report, run: rally task export 277c2943-0f04-401a-ae74-41933fd38002 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 277c2943-0f04-401a-ae74-41933fd38002 --json --out output.json 2018-02-24 07:15:33,991 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '277c2943-0f04-401a-ae74-41933fd38002'] 2018-02-24 07:15:34,875 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-02-24 07:15:34,876 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '277c2943-0f04-401a-ae74-41933fd38002', '--out', '/home/opnfv/functest/results/rally/opnfv-glance.html'] 2018-02-24 07:15:34,883 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2018-02-24 07:15:34,883 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "ceilometer" ... 2018-02-24 07:15:34,883 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-ceilometer.yaml 2018-02-24 07:15:34,883 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-02-24 07:15:34,901 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-02-24 07:15:34,901 - functest.opnfv_tests.openstack.rally.rally - INFO - No tests for scenario "ceilometer" 2018-02-24 07:15:34,901 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2018-02-24 07:15:34,901 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-cinder.yaml 2018-02-24 07:15:34,902 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-02-24 07:15:34,918 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-02-24 07:15:34,921 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['cinder'], 'concurrency': 4, 'netid': '21fa9ee9-391c-4b14-8e03-b37ca78f6ef1', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-73db9143-60f3-461d-acde-b69cc2704254', 'flavor_name': 'rally-tiny-73db9143-60f3-461d-acde-b69cc2704254', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-73db9143-60f3-461d-acde-b69cc2704254', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-02-24 07:18:34,378 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : d8b405b2-a2a4-4a53-919b-9fe69ccd9c8b 2018-02-24 07:18:34,379 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'd8b405b2-a2a4-4a53-919b-9fe69ccd9c8b'] 2018-02-24 07:18:35,318 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task d8b405b2-a2a4-4a53-919b-9fe69ccd9c8b: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "force": false }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task d8b405b2-a2a4-4a53-919b-9fe69ccd9c8b has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_snapshot | 3.248 | 3.248 | 3.248 | 3.248 | 3.248 | 3.248 | 100.0% | 1 | | cinder_v2.delete_snapshot | 2.425 | 2.425 | 2.425 | 2.425 | 2.425 | 2.425 | 100.0% | 1 | | total | 5.674 | 5.674 | 5.674 | 5.674 | 5.674 | 5.674 | 100.0% | 1 | | -> duration | 5.674 | 5.674 | 5.674 | 5.674 | 5.674 | 5.674 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.673597 Full duration: 21.423991 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": { "max": 1, "min": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task d8b405b2-a2a4-4a53-919b-9fe69ccd9c8b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 2.916 | 2.916 | 2.916 | 2.916 | 2.916 | 2.916 | 100.0% | 1 | | cinder_v2.delete_volume | 2.447 | 2.447 | 2.447 | 2.447 | 2.447 | 2.447 | 100.0% | 1 | | total | 5.363 | 5.363 | 5.363 | 5.363 | 5.363 | 5.363 | 100.0% | 1 | | -> duration | 5.363 | 5.363 | 5.363 | 5.363 | 5.363 | 5.363 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.36306 Full duration: 14.799064 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "image": { "name": "Cirros-0.4.0-73db9143-60f3-461d-acde-b69cc2704254" }, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task d8b405b2-a2a4-4a53-919b-9fe69ccd9c8b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 7.739 | 7.739 | 7.739 | 7.739 | 7.739 | 7.739 | 100.0% | 1 | | cinder_v2.delete_volume | 2.309 | 2.309 | 2.309 | 2.309 | 2.309 | 2.309 | 100.0% | 1 | | total | 10.049 | 10.049 | 10.049 | 10.049 | 10.049 | 10.049 | 100.0% | 1 | | -> duration | 10.049 | 10.049 | 10.049 | 10.049 | 10.049 | 10.049 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.048541 Full duration: 20.034299 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task d8b405b2-a2a4-4a53-919b-9fe69ccd9c8b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.042 | 3.042 | 3.042 | 3.042 | 3.042 | 3.042 | 100.0% | 1 | | cinder_v2.delete_volume | 2.313 | 2.313 | 2.313 | 2.313 | 2.313 | 2.313 | 100.0% | 1 | | total | 5.356 | 5.356 | 5.356 | 5.356 | 5.356 | 5.356 | 100.0% | 1 | | -> duration | 5.356 | 5.356 | 5.356 | 5.356 | 5.356 | 5.356 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.355625 Full duration: 14.546941 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "new_size": 2, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task d8b405b2-a2a4-4a53-919b-9fe69ccd9c8b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.131 | 3.131 | 3.131 | 3.131 | 3.131 | 3.131 | 100.0% | 1 | | cinder_v2.extend_volume | 2.328 | 2.328 | 2.328 | 2.328 | 2.328 | 2.328 | 100.0% | 1 | | cinder_v2.delete_volume | 2.474 | 2.474 | 2.474 | 2.474 | 2.474 | 2.474 | 100.0% | 1 | | total | 7.934 | 7.934 | 7.934 | 7.934 | 7.934 | 7.934 | 100.0% | 1 | | -> duration | 7.934 | 7.934 | 7.934 | 7.934 | 7.934 | 7.934 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.934063 Full duration: 17.11683 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task d8b405b2-a2a4-4a53-919b-9fe69ccd9c8b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.14 | 3.14 | 3.14 | 3.14 | 3.14 | 3.14 | 100.0% | 1 | | cinder_v2.delete_volume | 2.463 | 2.463 | 2.463 | 2.463 | 2.463 | 2.463 | 100.0% | 1 | | total | 5.603 | 5.603 | 5.603 | 5.603 | 5.603 | 5.603 | 100.0% | 1 | | -> duration | 5.603 | 5.603 | 5.603 | 5.603 | 5.603 | 5.603 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.603277 Full duration: 21.411696 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task d8b405b2-a2a4-4a53-919b-9fe69ccd9c8b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 0.573 | 0.573 | 0.573 | 0.573 | 0.573 | 0.573 | 100.0% | 1 | | cinder_v2.list_qos | 0.162 | 0.162 | 0.162 | 0.162 | 0.162 | 0.162 | 100.0% | 1 | | total | 0.736 | 0.736 | 0.736 | 0.736 | 0.736 | 0.736 | 100.0% | 1 | | -> duration | 0.736 | 0.736 | 0.736 | 0.736 | 0.736 | 0.736 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.7357 Full duration: 11.565169 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task d8b405b2-a2a4-4a53-919b-9fe69ccd9c8b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 0.576 | 0.576 | 0.576 | 0.576 | 0.576 | 0.576 | 100.0% | 1 | | cinder_v2.set_qos | 0.181 | 0.181 | 0.181 | 0.181 | 0.181 | 0.181 | 100.0% | 1 | | total | 0.757 | 0.757 | 0.757 | 0.757 | 0.757 | 0.757 | 100.0% | 1 | | -> duration | 0.757 | 0.757 | 0.757 | 0.757 | 0.757 | 0.757 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.756954 Full duration: 11.089136 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "description": "rally tests creating types" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task d8b405b2-a2a4-4a53-919b-9fe69ccd9c8b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.574 | 0.574 | 0.574 | 0.574 | 0.574 | 0.574 | 100.0% | 1 | | cinder_v2.list_types | 0.161 | 0.161 | 0.161 | 0.161 | 0.161 | 0.161 | 100.0% | 1 | | total | 0.735 | 0.735 | 0.735 | 0.735 | 0.735 | 0.735 | 100.0% | 1 | | -> duration | 0.735 | 0.735 | 0.735 | 0.735 | 0.735 | 0.735 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.735221 Full duration: 10.991521 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task d8b405b2-a2a4-4a53-919b-9fe69ccd9c8b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.689 | 0.689 | 0.689 | 0.689 | 0.689 | 0.689 | 100.0% | 1 | | cinder_v2.create_encryption_type | 0.203 | 0.203 | 0.203 | 0.203 | 0.203 | 0.203 | 100.0% | 1 | | total | 0.893 | 0.893 | 0.893 | 0.893 | 0.893 | 0.893 | 100.0% | 1 | | -> duration | 0.893 | 0.893 | 0.893 | 0.893 | 0.893 | 0.893 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.893077 Full duration: 11.622606 HINTS: * To plot HTML graphics with this data, run: rally task report d8b405b2-a2a4-4a53-919b-9fe69ccd9c8b --out output.html * To generate a JUnit report, run: rally task export d8b405b2-a2a4-4a53-919b-9fe69ccd9c8b --type junit --to output.xml * To get raw JSON output of task results, run: rally task report d8b405b2-a2a4-4a53-919b-9fe69ccd9c8b --json --out output.json 2018-02-24 07:18:35,319 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'd8b405b2-a2a4-4a53-919b-9fe69ccd9c8b'] 2018-02-24 07:18:36,368 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-02-24 07:18:36,368 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'd8b405b2-a2a4-4a53-919b-9fe69ccd9c8b', '--out', '/home/opnfv/functest/results/rally/opnfv-cinder.html'] 2018-02-24 07:18:36,375 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2018-02-24 07:18:36,375 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2018-02-24 07:18:36,375 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-heat.yaml 2018-02-24 07:18:36,376 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-02-24 07:18:36,394 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-02-24 07:18:36,395 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['heat'], 'concurrency': 4, 'netid': '21fa9ee9-391c-4b14-8e03-b37ca78f6ef1', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-73db9143-60f3-461d-acde-b69cc2704254', 'flavor_name': 'rally-tiny-73db9143-60f3-461d-acde-b69cc2704254', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-73db9143-60f3-461d-acde-b69cc2704254', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-02-24 07:19:50,384 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 766cc78d-053b-4124-9c06-18df655b0cf4 2018-02-24 07:19:50,385 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '766cc78d-053b-4124-9c06-18df655b0cf4'] 2018-02-24 07:19:51,343 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 766cc78d-053b-4124-9c06-18df655b0cf4: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task 766cc78d-053b-4124-9c06-18df655b0cf4 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.312 | 4.312 | 4.312 | 4.312 | 4.312 | 4.312 | 100.0% | 1 | | heat.update_stack | 2.531 | 2.531 | 2.531 | 2.531 | 2.531 | 2.531 | 100.0% | 1 | | heat.delete_stack | 2.621 | 2.621 | 2.621 | 2.621 | 2.621 | 2.621 | 100.0% | 1 | | total | 9.464 | 9.464 | 9.464 | 9.464 | 9.464 | 9.464 | 100.0% | 1 | | -> duration | 5.464 | 5.464 | 5.464 | 5.464 | 5.464 | 5.464 | 100.0% | 1 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.463906 Full duration: 16.957404 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task 766cc78d-053b-4124-9c06-18df655b0cf4 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.46 | 4.46 | 4.46 | 4.46 | 4.46 | 4.46 | 100.0% | 1 | | heat.check_stack | 1.379 | 1.379 | 1.379 | 1.379 | 1.379 | 1.379 | 100.0% | 1 | | heat.delete_stack | 1.345 | 1.345 | 1.345 | 1.345 | 1.345 | 1.345 | 100.0% | 1 | | total | 7.185 | 7.185 | 7.185 | 7.185 | 7.185 | 7.185 | 100.0% | 1 | | -> duration | 5.185 | 5.185 | 5.185 | 5.185 | 5.185 | 5.185 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.184808 Full duration: 16.025497 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task 766cc78d-053b-4124-9c06-18df655b0cf4 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.279 | 4.279 | 4.279 | 4.279 | 4.279 | 4.279 | 100.0% | 1 | | heat.suspend_stack | 1.678 | 1.678 | 1.678 | 1.678 | 1.678 | 1.678 | 100.0% | 1 | | heat.resume_stack | 1.287 | 1.287 | 1.287 | 1.287 | 1.287 | 1.287 | 100.0% | 1 | | heat.delete_stack | 2.364 | 2.364 | 2.364 | 2.364 | 2.364 | 2.364 | 100.0% | 1 | | total | 9.608 | 9.608 | 9.608 | 9.608 | 9.608 | 9.608 | 100.0% | 1 | | -> duration | 7.608 | 7.608 | 7.608 | 7.608 | 7.608 | 7.608 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.608377 Full duration: 17.104557 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task 766cc78d-053b-4124-9c06-18df655b0cf4 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.566 | 0.566 | 0.566 | 0.566 | 0.566 | 0.566 | 100.0% | 1 | | total | 0.566 | 0.566 | 0.566 | 0.566 | 0.566 | 0.566 | 100.0% | 1 | | -> duration | 0.566 | 0.566 | 0.566 | 0.566 | 0.566 | 0.566 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.565729 Full duration: 7.635241 HINTS: * To plot HTML graphics with this data, run: rally task report 766cc78d-053b-4124-9c06-18df655b0cf4 --out output.html * To generate a JUnit report, run: rally task export 766cc78d-053b-4124-9c06-18df655b0cf4 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 766cc78d-053b-4124-9c06-18df655b0cf4 --json --out output.json 2018-02-24 07:19:51,344 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '766cc78d-053b-4124-9c06-18df655b0cf4'] 2018-02-24 07:19:52,304 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-02-24 07:19:52,305 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '766cc78d-053b-4124-9c06-18df655b0cf4', '--out', '/home/opnfv/functest/results/rally/opnfv-heat.html'] 2018-02-24 07:19:52,311 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2018-02-24 07:19:52,312 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2018-02-24 07:19:52,312 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-keystone.yaml 2018-02-24 07:19:52,312 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-02-24 07:19:52,353 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-02-24 07:19:52,356 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['keystone'], 'concurrency': 4, 'netid': '21fa9ee9-391c-4b14-8e03-b37ca78f6ef1', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-73db9143-60f3-461d-acde-b69cc2704254', 'flavor_name': 'rally-tiny-73db9143-60f3-461d-acde-b69cc2704254', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-73db9143-60f3-461d-acde-b69cc2704254', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-02-24 07:22:50,002 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 45f68325-9eed-4dfe-aa3a-35bb420af9aa 2018-02-24 07:22:50,002 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '45f68325-9eed-4dfe-aa3a-35bb420af9aa'] 2018-02-24 07:22:50,959 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 45f68325-9eed-4dfe-aa3a-35bb420af9aa: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 45f68325-9eed-4dfe-aa3a-35bb420af9aa has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.476 | 0.476 | 0.476 | 0.476 | 0.476 | 0.476 | 100.0% | 1 | | keystone_v3.add_role | 0.104 | 0.104 | 0.104 | 0.104 | 0.104 | 0.104 | 100.0% | 1 | | keystone_v3.revoke_role | 0.12 | 0.12 | 0.12 | 0.12 | 0.12 | 0.12 | 100.0% | 1 | | total | 0.701 | 0.701 | 0.701 | 0.701 | 0.701 | 0.701 | 100.0% | 1 | | -> duration | 0.701 | 0.701 | 0.701 | 0.701 | 0.701 | 0.701 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.700717 Full duration: 13.693537 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 45f68325-9eed-4dfe-aa3a-35bb420af9aa has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.469 | 0.469 | 0.469 | 0.469 | 0.469 | 0.469 | 100.0% | 1 | | keystone_v3.add_role | 0.11 | 0.11 | 0.11 | 0.11 | 0.11 | 0.11 | 100.0% | 1 | | keystone_v3.list_roles | 0.093 | 0.093 | 0.093 | 0.093 | 0.093 | 0.093 | 100.0% | 1 | | total | 0.672 | 0.672 | 0.672 | 0.672 | 0.672 | 0.672 | 100.0% | 1 | | -> duration | 0.672 | 0.672 | 0.672 | 0.672 | 0.672 | 0.672 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.67221 Full duration: 13.595474 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 45f68325-9eed-4dfe-aa3a-35bb420af9aa has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.571 | 0.571 | 0.571 | 0.571 | 0.571 | 0.571 | 100.0% | 1 | | keystone_v3.list_projects | 0.078 | 0.078 | 0.078 | 0.078 | 0.078 | 0.078 | 100.0% | 1 | | total | 0.649 | 0.649 | 0.649 | 0.649 | 0.649 | 0.649 | 100.0% | 1 | | -> duration | 0.649 | 0.649 | 0.649 | 0.649 | 0.649 | 0.649 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.648877 Full duration: 13.081899 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 45f68325-9eed-4dfe-aa3a-35bb420af9aa has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.473 | 0.473 | 0.473 | 0.473 | 0.473 | 0.473 | 100.0% | 1 | | keystone_v3.delete_role | 0.107 | 0.107 | 0.107 | 0.107 | 0.107 | 0.107 | 100.0% | 1 | | total | 0.581 | 0.581 | 0.581 | 0.581 | 0.581 | 0.581 | 100.0% | 1 | | -> duration | 0.581 | 0.581 | 0.581 | 0.581 | 0.581 | 0.581 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.580956 Full duration: 11.247551 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 45f68325-9eed-4dfe-aa3a-35bb420af9aa has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.492 | 0.492 | 0.492 | 0.492 | 0.492 | 0.492 | 100.0% | 1 | | keystone_v3.delete_service | 0.181 | 0.181 | 0.181 | 0.181 | 0.181 | 0.181 | 100.0% | 1 | | total | 0.672 | 0.672 | 0.672 | 0.672 | 0.672 | 0.672 | 100.0% | 1 | | -> duration | 0.672 | 0.672 | 0.672 | 0.672 | 0.672 | 0.672 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.672354 Full duration: 11.28107 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 45f68325-9eed-4dfe-aa3a-35bb420af9aa has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.625 | 0.625 | 0.625 | 0.625 | 0.625 | 0.625 | 100.0% | 1 | | keystone_v3.create_user | 0.423 | 0.423 | 0.423 | 0.423 | 0.423 | 0.423 | 100.0% | 1 | | -> keystone_v3.list_roles | 0.073 | 0.073 | 0.073 | 0.073 | 0.073 | 0.073 | 100.0% | 1 | | -> keystone_v3.add_role | 0.109 | 0.109 | 0.109 | 0.109 | 0.109 | 0.109 | 100.0% | 1 | | keystone_v3.create_role | 0.081 | 0.081 | 0.081 | 0.081 | 0.081 | 0.081 | 100.0% | 1 | | keystone_v3.get_project | 0.086 | 0.086 | 0.086 | 0.086 | 0.086 | 0.086 | 100.0% | 1 | | keystone_v3.get_user | 0.087 | 0.087 | 0.087 | 0.087 | 0.087 | 0.087 | 100.0% | 1 | | keystone_v3.get_role | 0.077 | 0.077 | 0.077 | 0.077 | 0.077 | 0.077 | 100.0% | 1 | | keystone_v3.list_services | 0.079 | 0.079 | 0.079 | 0.079 | 0.079 | 0.079 | 100.0% | 1 | | keystone_v3.get_services | 0.078 | 0.078 | 0.078 | 0.078 | 0.078 | 0.078 | 100.0% | 1 | | total | 1.62 | 1.62 | 1.62 | 1.62 | 1.62 | 1.62 | 100.0% | 1 | | -> duration | 1.62 | 1.62 | 1.62 | 1.62 | 1.62 | 1.62 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.620303 Full duration: 19.175408 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 45f68325-9eed-4dfe-aa3a-35bb420af9aa has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.636 | 0.636 | 0.636 | 0.636 | 0.636 | 0.636 | 100.0% | 1 | | keystone_v3.update_project | 0.095 | 0.095 | 0.095 | 0.095 | 0.095 | 0.095 | 100.0% | 1 | | keystone_v3.delete_project | 0.125 | 0.125 | 0.125 | 0.125 | 0.125 | 0.125 | 100.0% | 1 | | total | 0.857 | 0.857 | 0.857 | 0.857 | 0.857 | 0.857 | 100.0% | 1 | | -> duration | 0.857 | 0.857 | 0.857 | 0.857 | 0.857 | 0.857 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.856941 Full duration: 11.512821 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task 45f68325-9eed-4dfe-aa3a-35bb420af9aa has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.655 | 0.655 | 0.655 | 0.655 | 0.655 | 0.655 | 100.0% | 1 | | total | 0.746 | 0.746 | 0.746 | 0.746 | 0.746 | 0.746 | 100.0% | 1 | | -> duration | 0.746 | 0.746 | 0.746 | 0.746 | 0.746 | 0.746 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.745502 Full duration: 13.570433 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task 45f68325-9eed-4dfe-aa3a-35bb420af9aa has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.62 | 0.62 | 0.62 | 0.62 | 0.62 | 0.62 | 100.0% | 1 | | total | 0.62 | 0.62 | 0.62 | 0.62 | 0.62 | 0.62 | 100.0% | 1 | | -> duration | 0.62 | 0.62 | 0.62 | 0.62 | 0.62 | 0.62 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.619909 Full duration: 13.191228 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task 45f68325-9eed-4dfe-aa3a-35bb420af9aa has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.637 | 0.637 | 0.637 | 0.637 | 0.637 | 0.637 | 100.0% | 1 | | keystone_v3.list_users | 0.093 | 0.093 | 0.093 | 0.093 | 0.093 | 0.093 | 100.0% | 1 | | total | 0.819 | 0.819 | 0.819 | 0.819 | 0.819 | 0.819 | 100.0% | 1 | | -> duration | 0.819 | 0.819 | 0.819 | 0.819 | 0.819 | 0.819 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.818852 Full duration: 13.848482 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "users_per_tenant": 10 }, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task 45f68325-9eed-4dfe-aa3a-35bb420af9aa has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.627 | 0.627 | 0.627 | 0.627 | 0.627 | 0.627 | 100.0% | 1 | | keystone_v3.create_users | 4.31 | 4.31 | 4.31 | 4.31 | 4.31 | 4.31 | 100.0% | 1 | | -> keystone_v3.create_user (x10) | 4.309 | 4.309 | 4.309 | 4.309 | 4.309 | 4.309 | 100.0% | 1 | | --> keystone_v3.list_roles (x10) | 0.768 | 0.768 | 0.768 | 0.768 | 0.768 | 0.768 | 100.0% | 1 | | --> keystone_v3.add_role (x10) | 1.143 | 1.143 | 1.143 | 1.143 | 1.143 | 1.143 | 100.0% | 1 | | total | 5.992 | 5.992 | 5.992 | 5.992 | 5.992 | 5.992 | 100.0% | 1 | | -> duration | 5.992 | 5.992 | 5.992 | 5.992 | 5.992 | 5.992 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.992479 Full duration: 23.951097 HINTS: * To plot HTML graphics with this data, run: rally task report 45f68325-9eed-4dfe-aa3a-35bb420af9aa --out output.html * To generate a JUnit report, run: rally task export 45f68325-9eed-4dfe-aa3a-35bb420af9aa --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 45f68325-9eed-4dfe-aa3a-35bb420af9aa --json --out output.json 2018-02-24 07:22:50,959 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '45f68325-9eed-4dfe-aa3a-35bb420af9aa'] 2018-02-24 07:22:51,981 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-02-24 07:22:51,982 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '45f68325-9eed-4dfe-aa3a-35bb420af9aa', '--out', '/home/opnfv/functest/results/rally/opnfv-keystone.html'] 2018-02-24 07:22:51,990 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2018-02-24 07:22:51,990 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2018-02-24 07:22:51,990 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-neutron.yaml 2018-02-24 07:22:51,990 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-02-24 07:22:52,028 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-02-24 07:22:52,035 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['neutron'], 'concurrency': 4, 'netid': '21fa9ee9-391c-4b14-8e03-b37ca78f6ef1', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-73db9143-60f3-461d-acde-b69cc2704254', 'flavor_name': 'rally-tiny-73db9143-60f3-461d-acde-b69cc2704254', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-73db9143-60f3-461d-acde-b69cc2704254', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-02-24 07:27:00,603 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : bf0a18d5-7ee0-4830-aaa7-7678cd1bd0ad 2018-02-24 07:27:00,603 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'bf0a18d5-7ee0-4830-aaa7-7678cd1bd0ad'] 2018-02-24 07:27:01,567 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task bf0a18d5-7ee0-4830-aaa7-7678cd1bd0ad: aborted -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } } } -------------------------------------------------------------------------------- Task bf0a18d5-7ee0-4830-aaa7-7678cd1bd0ad has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.134 | 1.134 | 1.134 | 1.134 | 1.134 | 1.134 | 100.0% | 1 | | neutron.delete_network | 0.759 | 0.759 | 0.759 | 0.759 | 0.759 | 0.759 | 100.0% | 1 | | total | 1.893 | 1.893 | 1.893 | 1.893 | 1.893 | 1.893 | 100.0% | 1 | | -> duration | 1.893 | 1.893 | 1.893 | 1.893 | 1.893 | 1.893 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.893244 Full duration: 14.148052 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "port": -1 } } } } -------------------------------------------------------------------------------- Task bf0a18d5-7ee0-4830-aaa7-7678cd1bd0ad has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.321 | 1.321 | 1.321 | 1.321 | 1.321 | 1.321 | 100.0% | 1 | | neutron.delete_port | 0.444 | 0.444 | 0.444 | 0.444 | 0.444 | 0.444 | 100.0% | 1 | | total | 1.765 | 1.765 | 1.765 | 1.765 | 1.765 | 1.765 | 100.0% | 1 | | -> duration | 1.765 | 1.765 | 1.765 | 1.765 | 1.765 | 1.765 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.765381 Full duration: 24.138159 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "router_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1, "router": -1 } } } } -------------------------------------------------------------------------------- Task bf0a18d5-7ee0-4830-aaa7-7678cd1bd0ad has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.738 | 0.738 | 0.738 | 0.738 | 0.738 | 0.738 | 100.0% | 1 | | neutron.create_subnet | 0.537 | 0.537 | 0.537 | 0.537 | 0.537 | 0.537 | 100.0% | 1 | | neutron.create_router | 0.151 | 0.151 | 0.151 | 0.151 | 0.151 | 0.151 | 100.0% | 1 | | neutron.add_interface_router | 1.442 | 1.442 | 1.442 | 1.442 | 1.442 | 1.442 | 100.0% | 1 | | neutron.remove_interface_router | 0.979 | 0.979 | 0.979 | 0.979 | 0.979 | 0.979 | 100.0% | 1 | | neutron.delete_router | 0.265 | 0.265 | 0.265 | 0.265 | 0.265 | 0.265 | 100.0% | 1 | | total | 4.114 | 4.114 | 4.114 | 4.114 | 4.114 | 4.114 | 100.0% | 1 | | -> duration | 4.114 | 4.114 | 4.114 | 4.114 | 4.114 | 4.114 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.113513 Full duration: 32.733827 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1 } } } } -------------------------------------------------------------------------------- Task bf0a18d5-7ee0-4830-aaa7-7678cd1bd0ad has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 1.067 | 1.067 | 1.067 | 1.067 | 1.067 | 1.067 | 100.0% | 1 | | neutron.delete_subnet | 0.394 | 0.394 | 0.394 | 0.394 | 0.394 | 0.394 | 100.0% | 1 | | total | 1.461 | 1.461 | 1.461 | 1.461 | 1.461 | 1.461 | 100.0% | 1 | | -> duration | 1.461 | 1.461 | 1.461 | 1.461 | 1.461 | 1.461 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.46123 Full duration: 23.943337 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } } } -------------------------------------------------------------------------------- Task bf0a18d5-7ee0-4830-aaa7-7678cd1bd0ad has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.091 | 1.091 | 1.091 | 1.091 | 1.091 | 1.091 | 100.0% | 1 | | neutron.list_networks | 0.239 | 0.239 | 0.239 | 0.239 | 0.239 | 0.239 | 100.0% | 1 | | total | 1.331 | 1.331 | 1.331 | 1.331 | 1.331 | 1.331 | 100.0% | 1 | | -> duration | 1.331 | 1.331 | 1.331 | 1.331 | 1.331 | 1.331 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.330893 Full duration: 15.830916 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "port": -1 } } } } -------------------------------------------------------------------------------- Task bf0a18d5-7ee0-4830-aaa7-7678cd1bd0ad has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.423 | 1.423 | 1.423 | 1.423 | 1.423 | 1.423 | 100.0% | 1 | | neutron.list_ports | 0.126 | 0.126 | 0.126 | 0.126 | 0.126 | 0.126 | 100.0% | 1 | | total | 1.549 | 1.549 | 1.549 | 1.549 | 1.549 | 1.549 | 100.0% | 1 | | -> duration | 1.549 | 1.549 | 1.549 | 1.549 | 1.549 | 1.549 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.549462 Full duration: 23.783459 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "router_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } } } -------------------------------------------------------------------------------- Task bf0a18d5-7ee0-4830-aaa7-7678cd1bd0ad has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.802 | 0.802 | 0.802 | 0.802 | 0.802 | 0.802 | 100.0% | 1 | | neutron.create_subnet | 0.593 | 0.593 | 0.593 | 0.593 | 0.593 | 0.593 | 100.0% | 1 | | neutron.create_router | 0.145 | 0.145 | 0.145 | 0.145 | 0.145 | 0.145 | 100.0% | 1 | | neutron.add_interface_router | 1.285 | 1.285 | 1.285 | 1.285 | 1.285 | 1.285 | 100.0% | 1 | | neutron.list_routers | 0.071 | 0.071 | 0.071 | 0.071 | 0.071 | 0.071 | 100.0% | 1 | | total | 2.897 | 2.897 | 2.897 | 2.897 | 2.897 | 2.897 | 100.0% | 1 | | -> duration | 2.897 | 2.897 | 2.897 | 2.897 | 2.897 | 2.897 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.89742 Full duration: 31.594724 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1 } } } } -------------------------------------------------------------------------------- Task bf0a18d5-7ee0-4830-aaa7-7678cd1bd0ad has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.766 | 0.766 | 0.766 | 0.766 | 0.766 | 0.766 | 100.0% | 1 | | neutron.create_subnet | 0.628 | 0.628 | 0.628 | 0.628 | 0.628 | 0.628 | 100.0% | 1 | | neutron.list_subnets | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 100.0% | 1 | | total | 1.478 | 1.478 | 1.478 | 1.478 | 1.478 | 1.478 | 100.0% | 1 | | -> duration | 1.478 | 1.478 | 1.478 | 1.478 | 1.478 | 1.478 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.478474 Full duration: 30.032204 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } } } -------------------------------------------------------------------------------- Task bf0a18d5-7ee0-4830-aaa7-7678cd1bd0ad has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.982 | 0.982 | 0.982 | 0.982 | 0.982 | 0.982 | 100.0% | 1 | | neutron.delete_security_group | 0.21 | 0.21 | 0.21 | 0.21 | 0.21 | 0.21 | 100.0% | 1 | | total | 1.192 | 1.192 | 1.192 | 1.192 | 1.192 | 1.192 | 100.0% | 1 | | -> duration | 1.192 | 1.192 | 1.192 | 1.192 | 1.192 | 1.192 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.191915 Full duration: 13.120211 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } } } -------------------------------------------------------------------------------- Task bf0a18d5-7ee0-4830-aaa7-7678cd1bd0ad has 1 error(s) -------------------------------------------------------------------------------- Conflict: Security Group fb5415d9-ac72-438f-b5fc-d97faefa525a cannot perform precommit_delete due to Callback networking_odl.common.callback.OdlSecurityGroupsHandler.sg_callback_precommit-4944351 failed with "argument of type 'NoneType' is not iterable". Neutron server returns request_ids: ['req-b9472324-ddea-41dd-914d-3aec6268f2d9'] Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally/plugins/openstack/scenarios/neutron/security_groups.py", line 236, in run self._delete_security_group(security_group) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 87, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally/plugins/openstack/scenarios/neutron/utils.py", line 631, in _delete_security_group security_group["security_group"]["id"]) File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 962, in delete_security_group return self.delete(self.security_group_path % (security_group)) File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 348, in delete headers=headers, params=params) File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 329, in retry_request headers=headers, params=params) File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 292, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 268, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 92, in exception_handler_v20 request_ids=request_ids) Conflict: Security Group fb5415d9-ac72-438f-b5fc-d97faefa525a cannot perform precommit_delete due to Callback networking_odl.common.callback.OdlSecurityGroupsHandler.sg_callback_precommit-4944351 failed with "argument of type 'NoneType' is not iterable". Neutron server returns request_ids: ['req-b9472324-ddea-41dd-914d-3aec6268f2d9'] -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 1.031 | 1.031 | 1.031 | 1.031 | 1.031 | 1.031 | 100.0% | 1 | | neutron.create_security_group_rule | 0.215 | 0.215 | 0.215 | 0.215 | 0.215 | 0.215 | 100.0% | 1 | | neutron.delete_security_group_rule | 0.102 | 0.102 | 0.102 | 0.102 | 0.102 | 0.102 | 100.0% | 1 | | neutron.delete_security_group | 0.267 | 0.267 | 0.267 | 0.267 | 0.267 | 0.267 | 0.0% | 1 | | total | 1.615 | 1.615 | 1.615 | 1.615 | 1.615 | 1.615 | 0.0% | 1 | | -> duration | 1.615 | 1.615 | 1.615 | 1.615 | 1.615 | 1.615 | 0.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0% | 1 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.614524 Full duration: 15.4221 HINTS: * To plot HTML graphics with this data, run: rally task report bf0a18d5-7ee0-4830-aaa7-7678cd1bd0ad --out output.html * To generate a JUnit report, run: rally task export bf0a18d5-7ee0-4830-aaa7-7678cd1bd0ad --type junit --to output.xml * To get raw JSON output of task results, run: rally task report bf0a18d5-7ee0-4830-aaa7-7678cd1bd0ad --json --out output.json 2018-02-24 07:27:01,568 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'bf0a18d5-7ee0-4830-aaa7-7678cd1bd0ad'] 2018-02-24 07:27:02,580 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-02-24 07:27:02,581 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'bf0a18d5-7ee0-4830-aaa7-7678cd1bd0ad', '--out', '/home/opnfv/functest/results/rally/opnfv-neutron.html'] 2018-02-24 07:27:02,589 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed. 2018-02-24 07:27:02,589 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2018-02-24 07:27:02,590 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-nova.yaml 2018-02-24 07:27:02,590 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-02-24 07:27:02,631 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-02-24 07:27:02,636 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['nova'], 'concurrency': 4, 'netid': '21fa9ee9-391c-4b14-8e03-b37ca78f6ef1', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-73db9143-60f3-461d-acde-b69cc2704254', 'flavor_name': 'rally-tiny-73db9143-60f3-461d-acde-b69cc2704254', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-73db9143-60f3-461d-acde-b69cc2704254', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-02-24 07:30:01,475 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : befbfd0f-e57b-45f8-910f-bd0d8f4d3abe 2018-02-24 07:30:01,475 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'befbfd0f-e57b-45f8-910f-bd0d8f4d3abe'] 2018-02-24 07:30:02,350 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task befbfd0f-e57b-45f8-910f-bd0d8f4d3abe: aborted -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_live_migrate_server args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-73db9143-60f3-461d-acde-b69cc2704254" }, "image": { "name": "Cirros-0.4.0-73db9143-60f3-461d-acde-b69cc2704254" }, "block_migration": false, "nics": [ { "net-id": "21fa9ee9-391c-4b14-8e03-b37ca78f6ef1" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task befbfd0f-e57b-45f8-910f-bd0d8f4d3abe has 1 error(s) -------------------------------------------------------------------------------- RallyException: Live Migration failed: Migration complete but instance did not change host: overcloud-novacompute-1.opnfvlf.org Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally/plugins/openstack/scenarios/nova/servers.py", line 722, in run block_migration, disk_over_commit) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 87, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally/plugins/openstack/scenarios/nova/utils.py", line 770, in _live_migrate "but instance did not change host: %s" % host_pre_migrate) RallyException: Live Migration failed: Migration complete but instance did not change host: overcloud-novacompute-1.opnfvlf.org -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 8.613 | 8.613 | 8.613 | 8.613 | 8.613 | 8.613 | 100.0% | 1 | | nova.find_host_to_migrate | 0.86 | 0.86 | 0.86 | 0.86 | 0.86 | 0.86 | 100.0% | 1 | | nova.live_migrate | 134.608 | 134.608 | 134.608 | 134.608 | 134.608 | 134.608 | 0.0% | 1 | | total | 144.081 | 144.081 | 144.081 | 144.081 | 144.081 | 144.081 | 0.0% | 1 | | -> duration | 143.081 | 143.081 | 143.081 | 143.081 | 143.081 | 143.081 | 0.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 143.08102 Full duration: 157.543929 HINTS: * To plot HTML graphics with this data, run: rally task report befbfd0f-e57b-45f8-910f-bd0d8f4d3abe --out output.html * To generate a JUnit report, run: rally task export befbfd0f-e57b-45f8-910f-bd0d8f4d3abe --type junit --to output.xml * To get raw JSON output of task results, run: rally task report befbfd0f-e57b-45f8-910f-bd0d8f4d3abe --json --out output.json 2018-02-24 07:30:02,350 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'befbfd0f-e57b-45f8-910f-bd0d8f4d3abe'] 2018-02-24 07:30:03,232 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-02-24 07:30:03,233 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'befbfd0f-e57b-45f8-910f-bd0d8f4d3abe', '--out', '/home/opnfv/functest/results/rally/opnfv-nova.html'] 2018-02-24 07:30:03,240 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2018-02-24 07:30:03,241 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2018-02-24 07:30:03,241 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-quotas.yaml 2018-02-24 07:30:03,241 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-02-24 07:30:03,282 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-02-24 07:30:03,283 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['quotas'], 'concurrency': 4, 'netid': '21fa9ee9-391c-4b14-8e03-b37ca78f6ef1', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-73db9143-60f3-461d-acde-b69cc2704254', 'flavor_name': 'rally-tiny-73db9143-60f3-461d-acde-b69cc2704254', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-73db9143-60f3-461d-acde-b69cc2704254', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-02-24 07:30:51,779 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : ea07d6d1-2944-4780-9c40-1fd701b8035d 2018-02-24 07:30:51,779 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'ea07d6d1-2944-4780-9c40-1fd701b8035d'] 2018-02-24 07:30:52,668 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task ea07d6d1-2944-4780-9c40-1fd701b8035d: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ea07d6d1-2944-4780-9c40-1fd701b8035d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.784 | 0.784 | 0.784 | 0.784 | 0.784 | 0.784 | 100.0% | 1 | | quotas.delete_quotas | 0.196 | 0.196 | 0.196 | 0.196 | 0.196 | 0.196 | 100.0% | 1 | | total | 0.981 | 0.981 | 0.981 | 0.981 | 0.981 | 0.981 | 100.0% | 1 | | -> duration | 0.981 | 0.981 | 0.981 | 0.981 | 0.981 | 0.981 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.980646 Full duration: 8.228059 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ea07d6d1-2944-4780-9c40-1fd701b8035d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.655 | 0.655 | 0.655 | 0.655 | 0.655 | 0.655 | 100.0% | 1 | | total | 0.655 | 0.655 | 0.655 | 0.655 | 0.655 | 0.655 | 100.0% | 1 | | -> duration | 0.655 | 0.655 | 0.655 | 0.655 | 0.655 | 0.655 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.654647 Full duration: 7.812302 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ea07d6d1-2944-4780-9c40-1fd701b8035d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.266 | 0.266 | 0.266 | 0.266 | 0.266 | 0.266 | 100.0% | 1 | | total | 0.655 | 0.655 | 0.655 | 0.655 | 0.655 | 0.655 | 100.0% | 1 | | -> duration | 0.655 | 0.655 | 0.655 | 0.655 | 0.655 | 0.655 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.654865 Full duration: 7.712066 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ea07d6d1-2944-4780-9c40-1fd701b8035d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.917 | 0.917 | 0.917 | 0.917 | 0.917 | 0.917 | 100.0% | 1 | | total | 0.917 | 0.917 | 0.917 | 0.917 | 0.917 | 0.917 | 100.0% | 1 | | -> duration | 0.917 | 0.917 | 0.917 | 0.917 | 0.917 | 0.917 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.916689 Full duration: 8.173479 HINTS: * To plot HTML graphics with this data, run: rally task report ea07d6d1-2944-4780-9c40-1fd701b8035d --out output.html * To generate a JUnit report, run: rally task export ea07d6d1-2944-4780-9c40-1fd701b8035d --type junit --to output.xml * To get raw JSON output of task results, run: rally task report ea07d6d1-2944-4780-9c40-1fd701b8035d --json --out output.json 2018-02-24 07:30:52,669 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'ea07d6d1-2944-4780-9c40-1fd701b8035d'] 2018-02-24 07:30:53,595 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-02-24 07:30:53,595 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'ea07d6d1-2944-4780-9c40-1fd701b8035d', '--out', '/home/opnfv/functest/results/rally/opnfv-quotas.html'] 2018-02-24 07:30:53,603 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2018-02-24 07:30:53,607 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:40 | 6 | 100.00% | | glance | 01:04 | 4 | 100.00% | | cinder | 02:34 | 10 | 100.00% | | heat | 00:57 | 4 | 100.00% | | keystone | 02:38 | 11 | 100.00% | | neutron | 03:44 | 10 | 90.00% | | nova | 02:37 | 1 | 0.00% | | quotas | 00:31 | 4 | 100.00% | | | | | | | TOTAL: | 00:14:49 | 50 | 96.00% | +----------------+------------+----------------+-----------+ 2018-02-24 07:30:53,607 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_sanity' success_rate is 96.00% 2018-02-24 07:30:59,657 - functest.energy.energy - DEBUG - Restoring previous scenario (refstack_defcore/running) 2018-02-24 07:30:59,657 - functest.energy.energy - DEBUG - Submitting scenario (refstack_defcore/running) 2018-02-24 07:31:00,232 - functest.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-02-24 07:31:00,232 - functest.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | rally_sanity | functest | 18:09 | FAIL | +----------------------+------------------+------------------+----------------+ 2018-02-24 07:31:00,234 - functest.ci.run_tests - ERROR - The test case 'rally_sanity' failed. 2018-02-24 07:31:00,234 - functest.ci.run_tests - INFO - Running test case 'refstack_defcore'... 2018-02-24 07:31:00,272 - functest.energy.energy - DEBUG - Getting current scenario 2018-02-24 07:31:00,742 - functest.energy.energy - DEBUG - Starting recording 2018-02-24 07:31:00,742 - functest.energy.energy - DEBUG - Submitting scenario (refstack_defcore/running) 2018-02-24 07:31:01,161 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-02-24 07:31:03,420 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment create --fromenv --name=opnfv-rally' 2018-02-24 07:31:05,654 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment check' 2018-02-24 07:31:08,775 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-02-24 07:31:11,011 - functest.utils.functest_utils - DEBUG - Executing command: 'rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide' 2018-02-24 07:31:16,866 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating project and user for Tempest suite 2018-02-24 07:31:19,407 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-02-24 07:31:23,241 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating image for Tempest suite 2018-02-24 07:31:25,660 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating 2nd image for Tempest suite 2018-02-24 07:31:27,874 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating flavor for Tempest suite 2018-02-24 07:31:28,952 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating 2nd flavor for Tempest suite 2018-02-24 07:31:29,994 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Configuring the verifier... 2018-02-24 07:31:29,994 - functest.utils.functest_utils - DEBUG - Executing command: 'rally verify configure-verifier' 2018-02-24 07:31:32,758 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-02-24 07:31:32,759 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-02-24 07:31:32,761 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-02-24 07:31:32,763 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters for defcore... 2018-02-24 07:31:32,765 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add needed params into test_accounts.yaml... 2018-02-24 07:31:32,773 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - Starting Refstack_defcore test case: '['refstack-client', 'test', '-c', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/refstack_client/refstack_tempest.conf', '-v', '--test-list', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/refstack_client/defcore.txt']'. 2018-02-24 07:56:52,892 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors [0.186807s] ... ok 2018-02-24 07:56:52,892 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail [0.057110s] ... ok 2018-02-24 07:56:52,892 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image [14.236698s] ... ok 2018-02-24 07:56:52,892 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name [0.384442s] ... ok 2018-02-24 07:56:52,892 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user [0.200261s] ... ok 2018-02-24 07:56:52,892 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name [187.280378s] ... FAILED 2018-02-24 07:56:52,892 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers [0.071994s] ... ok 2018-02-24 07:56:52,893 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail [0.354089s] ... ok 2018-02-24 07:56:52,893 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus [187.399937s] ... FAILED 2018-02-24 07:56:52,893 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details [0.001201s] ... ok 2018-02-24 07:56:52,893 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name [187.239815s] ... FAILED 2018-02-24 07:56:52,893 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers [0.075474s] ... ok 2018-02-24 07:56:52,893 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail [1.006990s] ... ok 2018-02-24 07:56:52,893 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus [187.634631s] ... FAILED 2018-02-24 07:56:52,893 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details [0.001564s] ... ok 2018-02-24 07:56:52,893 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server [7.512559s] ... ok 2018-02-24 07:56:52,893 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action [0.071672s] ... ok 2018-02-24 07:56:52,893 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions [2.021891s] ... ok 2018-02-24 07:56:52,893 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor [0.216673s] ... ok 2018-02-24 07:56:52,894 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image [0.360052s] ... ok 2018-02-24 07:56:52,894 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name [0.310918s] ... ok 2018-02-24 07:56:52,894 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status [0.249478s] ... ok 2018-02-24 07:56:52,894 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results [0.209424s] ... ok 2018-02-24 07:56:52,894 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_active_status [0.067113s] ... ok 2018-02-24 07:56:52,894 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor [0.070879s] ... ok 2018-02-24 07:56:52,894 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image [0.068147s] ... ok 2018-02-24 07:56:52,894 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit [0.065401s] ... ok 2018-02-24 07:56:52,894 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name [0.063385s] ... ok 2018-02-24 07:56:52,894 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard [0.132912s] ... ok 2018-02-24 07:56:52,894 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date [0.062213s] ... ok 2018-02-24 07:56:52,895 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date [0.010941s] ... ok 2018-02-24 07:56:52,895 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count [0.135002s] ... ok 2018-02-24 07:56:52,895 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value [0.011330s] ... ok 2018-02-24 07:56:52,895 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string [0.010532s] ... ok 2018-02-24 07:56:52,895 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor [0.032388s] ... ok 2018-02-24 07:56:52,895 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image [0.059790s] ... ok 2018-02-24 07:56:52,895 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name [0.061662s] ... ok 2018-02-24 07:56:52,895 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted [0.408392s] ... ok 2018-02-24 07:56:52,895 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing [0.014483s] ... ok 2018-02-24 07:56:52,895 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server [0.065329s] ... ok 2018-02-24 07:56:52,895 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server [17.201850s] ... ok 2018-02-24 07:56:52,895 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard [68.923237s] ... ok 2018-02-24 07:56:52,896 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server [25.257601s] ... ok 2018-02-24 07:56:52,896 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server [15.985465s] ... ok 2018-02-24 07:56:52,896 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item [0.346445s] ... ok 2018-02-24 07:56:52,896 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item [0.203333s] ... ok 2018-02-24 07:56:52,896 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata [0.198048s] ... ok 2018-02-24 07:56:52,896 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata [0.752633s] ... ok 2018-02-24 07:56:52,896 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item [0.360734s] ... ok 2018-02-24 07:56:52,896 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata [0.343438s] ... ok 2018-02-24 07:56:52,896 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password [1.802533s] ... ok 2018-02-24 07:56:52,896 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair [8.431548s] ... ok 2018-02-24 07:56:52,896 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name [13.234269s] ... ok 2018-02-24 07:56:52,897 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address [6.784445s] ... ok 2018-02-24 07:56:52,897 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name [56.848170s] ... ok 2018-02-24 07:56:52,897 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name [1.128997s] ... ok 2018-02-24 07:56:52,897 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit [1.019769s] ... ok 2018-02-24 07:56:52,897 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 [1.109752s] ... ok 2018-02-24 07:56:52,897 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor [1.400349s] ... ok 2018-02-24 07:56:52,897 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image [1.256063s] ... ok 2018-02-24 07:56:52,897 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid [1.852292s] ... ok 2018-02-24 07:56:52,897 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit [0.223860s] ... ok 2018-02-24 07:56:52,897 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id [0.219278s] ... ok 2018-02-24 07:56:52,897 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server [0.232312s] ... ok 2018-02-24 07:56:52,897 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address [0.980171s] ... ok 2018-02-24 07:56:52,898 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server [0.239504s] ... ok 2018-02-24 07:56:52,898 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_deleted_server [0.391561s] ... ok 2018-02-24 07:56:52,898 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server [0.370206s] ... ok 2018-02-24 07:56:52,898 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank [1.138819s] ... ok 2018-02-24 07:56:52,898 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server [0.223267s] ... ok 2018-02-24 07:56:52,898 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server [0.434861s] ... ok 2018-02-24 07:56:52,898 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 [0.223915s] ... ok 2018-02-24 07:56:52,898 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name [0.221367s] ... ok 2018-02-24 07:56:52,898 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas [0.288481s] ... ok 2018-02-24 07:56:52,898 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas [0.335839s] ... ok 2018-02-24 07:56:52,898 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.test_versions.TestVersions.test_list_api_versions [0.011837s] ... ok 2018-02-24 07:56:52,898 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_list_get_volume_attachments [25.922064s] ... ok 2018-02-24 07:56:52,899 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types [0.148276s] ... ok 2018-02-24 07:56:52,899 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources [0.073602s] ... ok 2018-02-24 07:56:52,899 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses [0.070153s] ... ok 2018-02-24 07:56:52,899 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token [0.305936s] ... ok 2018-02-24 07:56:52,899 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image [0.709832s] ... ok 2018-02-24 07:56:52,899 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image [2.196243s] ... ok 2018-02-24 07:56:52,899 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_image_schema [0.010673s] ... ok 2018-02-24 07:56:52,899 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_images_schema [0.155932s] ... ok 2018-02-24 07:56:52,899 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_container_format [0.575009s] ... ok 2018-02-24 07:56:52,899 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_disk_format [0.031130s] ... ok 2018-02-24 07:56:52,899 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_limit [0.028048s] ... ok 2018-02-24 07:56:52,900 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_min_max_size [0.182875s] ... ok 2018-02-24 07:56:52,900 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_size [0.186980s] ... ok 2018-02-24 07:56:52,900 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_status [0.042226s] ... ok 2018-02-24 07:56:52,900 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_visibility [0.551123s] ... ok 2018-02-24 07:56:52,900 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_no_params [0.045995s] ... ok 2018-02-24 07:56:52,900 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id [0.145353s] ... ok 2018-02-24 07:56:52,900 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image [0.014238s] ... ok 2018-02-24 07:56:52,900 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image [0.715512s] ... ok 2018-02-24 07:56:52,900 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id [0.009132s] ... ok 2018-02-24 07:56:52,900 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image [0.012530s] ... ok 2018-02-24 07:56:52,900 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image [0.832752s] ... ok 2018-02-24 07:56:52,900 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag [0.361333s] ... ok 2018-02-24 07:56:52,901 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image [0.022148s] ... ok 2018-02-24 07:56:52,901 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes [3.851522s] ... ok 2018-02-24 07:56:52,901 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools [4.118306s] ... ok 2018-02-24 07:56:52,901 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled [3.823866s] ... ok 2018-02-24 07:56:52,901 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw [3.379884s] ... ok 2018-02-24 07:56:52,901 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools [3.618538s] ... ok 2018-02-24 07:56:52,901 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers [3.608147s] ... ok 2018-02-24 07:56:52,901 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway [2.440225s] ... ok 2018-02-24 07:56:52,901 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet [3.571640s] ... ok 2018-02-24 07:56:52,901 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet [2.520142s] ... ok 2018-02-24 07:56:52,901 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_list_networks [0.130600s] ... ok 2018-02-24 07:56:52,902 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields [0.098936s] ... ok 2018-02-24 07:56:52,902 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets [0.055800s] ... ok 2018-02-24 07:56:52,902 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields [0.222723s] ... ok 2018-02-24 07:56:52,902 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_show_network [0.103156s] ... ok 2018-02-24 07:56:52,902 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_show_network_fields [0.099713s] ... ok 2018-02-24 07:56:52,902 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet [0.047844s] ... ok 2018-02-24 07:56:52,902 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields [0.050704s] ... ok 2018-02-24 07:56:52,902 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp [3.017204s] ... ok 2018-02-24 07:56:52,902 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port [2.647736s] ... ok 2018-02-24 07:56:52,902 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools [3.096187s] ... ok 2018-02-24 07:56:52,902 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port [1.647265s] ... ok 2018-02-24 07:56:52,902 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_ports.PortsTestJSON.test_list_ports [0.058597s] ... ok 2018-02-24 07:56:52,902 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields [0.046511s] ... ok 2018-02-24 07:56:52,903 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_ports.PortsTestJSON.test_show_port [0.182196s] ... ok 2018-02-24 07:56:52,903 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields [0.041155s] ... ok 2018-02-24 07:56:52,903 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group [1.473240s] ... ok 2018-02-24 07:56:52,903 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args [0.958413s] ... ok 2018-02-24 07:56:52,903 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code [2.897407s] ... ok 2018-02-24 07:56:52,903 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value [0.649608s] ... ok 2018-02-24 07:56:52,903 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id [1.468333s] ... ok 2018-02-24 07:56:52,903 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix [0.680971s] ... ok 2018-02-24 07:56:52,903 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule [1.420077s] ... ok 2018-02-24 07:56:52,903 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups [0.050691s] ... ok 2018-02-24 07:56:52,903 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails [0.152302s] ... ok 2018-02-24 07:56:52,903 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails [1.136439s] ... ok 2018-02-24 07:56:52,904 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype [0.604521s] ... ok 2018-02-24 07:56:52,904 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol [0.581789s] ... ok 2018-02-24 07:56:52,904 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix [0.765605s] ... ok 2018-02-24 07:56:52,904 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports [1.169660s] ... ok 2018-02-24 07:56:52,904 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid [0.834848s] ... ok 2018-02-24 07:56:52,904 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group [0.089075s] ... ok 2018-02-24 07:56:52,904 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group [0.021079s] ... ok 2018-02-24 07:56:52,904 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group [0.016593s] ... ok 2018-02-24 07:56:52,904 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule [0.015317s] ... ok 2018-02-24 07:56:52,904 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools [0.532544s] ... ok 2018-02-24 07:56:52,904 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON.test_get_availability_zone_list [0.144361s] ... ok 2018-02-24 07:56:52,904 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions [0.149261s] ... ok 2018-02-24 07:56:52,905 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata [0.651678s] ... ok 2018-02-24 07:56:52,905 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item [0.256136s] ... ok 2018-02-24 07:56:52,905 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata [1.245814s] ... ok 2018-02-24 07:56:52,905 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item [0.364108s] ... ok 2018-02-24 07:56:52,905 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_reserve_unreserve_volume [0.624884s] ... ok 2018-02-24 07:56:52,905 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_bootable [0.193773s] ... ok 2018-02-24 07:56:52,905 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_readonly_update [0.332374s] ... ok 2018-02-24 07:56:52,905 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_upload [29.760274s] ... ok 2018-02-24 07:56:52,905 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete [5.956139s] ... ok 2018-02-24 07:56:52,905 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_as_clone [6.907814s] ... ok 2018-02-24 07:56:52,905 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image [9.968907s] ... ok 2018-02-24 07:56:52,905 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list [0.040681s] ... ok 2018-02-24 07:56:52,905 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name [0.041241s] ... ok 2018-02-24 07:56:52,906 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name [0.051234s] ... ok 2018-02-24 07:56:52,906 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination [0.395212s] ... ok 2018-02-24 07:56:52,906 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params [0.101669s] ... ok 2018-02-24 07:56:52,906 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination [0.359988s] ... ok 2018-02-24 07:56:52,906 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status [0.040479s] ... ok 2018-02-24 07:56:52,906 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status [0.049379s] ... ok 2018-02-24 07:56:52,906 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata [0.052194s] ... ok 2018-02-24 07:56:52,906 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details [0.047530s] ... ok 2018-02-24 07:56:52,906 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata [0.040937s] ... ok 2018-02-24 07:56:52,906 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone [0.376930s] ... ok 2018-02-24 07:56:52,906 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status [0.076332s] ... ok 2018-02-24 07:56:52,906 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone [0.175586s] ... ok 2018-02-24 07:56:52,907 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status [0.046411s] ... ok 2018-02-24 07:56:52,907 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size [0.149805s] ... ok 2018-02-24 07:56:52,907 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id [0.155671s] ... ok 2018-02-24 07:56:52,907 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid [0.170651s] ... ok 2018-02-24 07:56:52,907 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type [0.154890s] ... ok 2018-02-24 07:56:52,907 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative [0.141007s] ... ok 2018-02-24 07:56:52,907 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero [0.148852s] ... ok 2018-02-24 07:56:52,907 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size [0.044867s] ... ok 2018-02-24 07:56:52,907 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id [0.033025s] ... ok 2018-02-24 07:56:52,907 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id [0.008769s] ... ok 2018-02-24 07:56:52,907 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id [0.034444s] ... ok 2018-02-24 07:56:52,907 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id [0.009299s] ... ok 2018-02-24 07:56:52,908 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status [0.043792s] ... ok 2018-02-24 07:56:52,908 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name [0.047994s] ... ok 2018-02-24 07:56:52,908 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status [0.035110s] ... ok 2018-02-24 07:56:52,908 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name [0.040913s] ... ok 2018-02-24 07:56:52,908 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_negative_volume_status [0.169698s] ... ok 2018-02-24 07:56:52,908 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_nonexistent_volume_id [0.033464s] ... ok 2018-02-24 07:56:52,908 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_unreserve_volume_with_nonexistent_volume_id [0.035359s] ... ok 2018-02-24 07:56:52,908 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id [0.009519s] ... ok 2018-02-24 07:56:52,908 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id [0.035039s] ... ok 2018-02-24 07:56:52,908 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id [0.034578s] ... ok 2018-02-24 07:56:52,908 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id [0.031970s] ... ok 2018-02-24 07:56:52,908 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id [0.031896s] ... ok 2018-02-24 07:56:52,908 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete [3.183427s] ... ok 2018-02-24 07:56:52,909 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot [6.281932s] ... ok 2018-02-24 07:56:52,909 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_details_with_params [0.284969s] ... ok 2018-02-24 07:56:52,909 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_with_params [0.201360s] ... ok 2018-02-24 07:56:52,909 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_with_nonexistent_volume_id [0.170281s] ... ok 2018-02-24 07:56:52,909 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_without_passing_volume_id [0.183695s] ... ok 2018-02-24 07:56:52,914 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - Ran: 203 tests in 1516.0000 sec. 2018-02-24 07:56:52,917 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - - Passed: 199 2018-02-24 07:56:52,921 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - - Skipped: 0 2018-02-24 07:56:52,924 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - - Failed: 4 2018-02-24 07:56:52,928 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - Testcase refstack_defcore success_rate is 98.0295566502% 2018-02-24 07:56:59,492 - functest.energy.energy - DEBUG - Restoring previous scenario (refstack_defcore/running) 2018-02-24 07:56:59,493 - functest.energy.energy - DEBUG - Submitting scenario (refstack_defcore/running) 2018-02-24 07:57:00,104 - functest.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-02-24 07:57:00,104 - functest.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | refstack_defcore | functest | 25:58 | FAIL | +--------------------------+------------------+------------------+----------------+ 2018-02-24 07:57:00,109 - functest.ci.run_tests - ERROR - The test case 'refstack_defcore' failed. 2018-02-24 07:57:00,109 - functest.ci.run_tests - INFO - Running test case 'odl'... 2018-02-24 07:57:17,861 - functest.core.robotframework - INFO - ============================================================================== Basic & Neutron ============================================================================== Basic & Neutron.Basic ============================================================================== Basic & Neutron.Basic.Restconf Modules :: Test suite to verify Restconf is OK. ============================================================================== Get Controller Modules :: Get the restconf modules, check 200 stat... | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Basic.Restconf Modules :: Test suite to verify Res... | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Basic & Neutron.Basic | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Basic & Neutron.Neutron :: Test suite for Neutron Plugin ============================================================================== Basic & Neutron.Neutron.Reachability ============================================================================== Get the complete list of networks :: Get the complete list of netw... | PASS | ------------------------------------------------------------------------------ Get the complete list of subnets :: Get the complete list of subnets | PASS | ------------------------------------------------------------------------------ Get the complete list of ports :: Get the complete list of ports | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Reachability | PASS | 3 critical tests, 3 passed, 0 failed 3 tests total, 3 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Networks :: Checking Network created in OpenStack a... ============================================================================== Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS | ------------------------------------------------------------------------------ Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS | ------------------------------------------------------------------------------ Create Network :: Create new network in OpenStack | PASS | ------------------------------------------------------------------------------ Check Network :: Check network created in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Networks :: Checking Network created in Op... | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Subnets :: Checking Subnets created in OpenStack ar... ============================================================================== Check OpenStack Subnets :: Checking OpenStack Neutron for known su... | PASS | ------------------------------------------------------------------------------ Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS | ------------------------------------------------------------------------------ Create New subnet :: Create new subnet in OpenStack | PASS | ------------------------------------------------------------------------------ Check New subnet :: Check new subnet created in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Subnets :: Checking Subnets created in Ope... | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Ports :: Checking Port created in OpenStack are pus... ============================================================================== Check OpenStack ports :: Checking OpenStack Neutron for known ports | PASS | ------------------------------------------------------------------------------ Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS | ------------------------------------------------------------------------------ Create New Port :: Create new port in OpenStack | PASS | ------------------------------------------------------------------------------ Check New Port :: Check new port created in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Ports :: Checking Port created in OpenStac... | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Delete Ports :: Checking Port deleted in OpenStack ... ============================================================================== Delete New Port :: Delete previously created port in OpenStack | PASS | ------------------------------------------------------------------------------ Check Port Deleted :: Check port deleted in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Delete Ports :: Checking Port deleted in O... | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Delete Subnets :: Checking Subnets deleted in OpenS... ============================================================================== Delete New subnet :: Delete previously created subnet in OpenStack | PASS | ------------------------------------------------------------------------------ Check New subnet deleted :: Check subnet deleted in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Delete Subnets :: Checking Subnets deleted... | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Delete Networks :: Checking Network deleted in Open... ============================================================================== Delete Network :: Delete network in OpenStack | PASS | ------------------------------------------------------------------------------ Check Network deleted :: Check network deleted in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Delete Networks :: Checking Network delete... | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Basic & Neutron.Neutron :: Test suite for Neutron Plugin | PASS | 21 critical tests, 21 passed, 0 failed 21 tests total, 21 passed, 0 failed ============================================================================== Basic & Neutron | PASS | 22 critical tests, 22 passed, 0 failed 22 tests total, 22 passed, 0 failed ============================================================================== Output: /home/opnfv/functest/results/odl/output.xml 2018-02-24 07:57:17,861 - functest.core.robotframework - INFO - Results were successfully generated 2018-02-24 07:57:17,891 - functest.core.robotframework - INFO - Results were successfully parsed 2018-02-24 07:57:18,003 - functest.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-02-24 07:57:18,004 - functest.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | odl | functest | 00:17 | PASS | +-------------------+------------------+------------------+----------------+ 2018-02-24 07:57:18,007 - functest.ci.run_tests - INFO - Running test case 'snaps_smoke'... 2018-02-24 07:57:18,749 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-02-24 09:03:19,662 - functest.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-02-24 09:03:19,662 - functest.ci.run_tests - INFO - Test result: +---------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +---------------------+------------------+------------------+----------------+ | snaps_smoke | functest | 65:05 | FAIL | +---------------------+------------------+------------------+----------------+ 2018-02-24 09:03:19,667 - functest.ci.run_tests - ERROR - The test case 'snaps_smoke' failed. 2018-02-24 09:03:19,667 - functest.ci.run_tests - INFO - Deployment description: +-------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+----------------------------------------------------------+ | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-nofeature-noha | | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-799 | | CI_LOOP | daily | +-------------------------+----------------------------------------------------------+ 2018-02-24 09:03:19,670 - functest.ci.run_tests - INFO - FUNCTEST REPORT: +------------------------------+------------------+---------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +------------------------------+------------------+---------------+------------------+----------------+ | vping_ssh | functest | smoke | 00:46 | PASS | | vping_userdata | functest | smoke | 00:31 | PASS | | tempest_smoke_serial | functest | smoke | 13:17 | FAIL | | rally_sanity | functest | smoke | 18:09 | FAIL | | refstack_defcore | functest | smoke | 25:58 | FAIL | | odl | functest | smoke | 00:17 | PASS | | snaps_smoke | functest | smoke | 65:05 | FAIL | | odl_netvirt | functest | smoke | 00:00 | SKIP | +------------------------------+------------------+---------------+------------------+----------------+ 2018-02-24 09:03:19,676 - functest.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR 2018-02-24 09:03:22,906 - functest.ci.run_tests - DEBUG - Sourcing the credential file... 2018-02-24 09:03:22,907 - functest.ci.run_tests - INFO - Sourcing env file /home/opnfv/functest/conf/env_file 2018-02-24 09:03:22,907 - functest.ci.run_tests - DEBUG - Test args: all 2018-02-24 09:03:22,908 - functest.ci.run_tests - INFO - TESTS TO BE EXECUTED: +------------------+---------------+--------------------------+-------------------------------------------+-----------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +------------------+---------------+--------------------------+-------------------------------------------+-----------------------------+ | features | 2 | (daily)|(weekly) | Test suites from feature projects | doctor-notification | | | | | integrated in functest | | +------------------+---------------+--------------------------+-------------------------------------------+-----------------------------+ 2018-02-24 09:03:22,909 - functest.ci.run_tests - INFO - Running tier 'features' 2018-02-24 09:03:22,909 - functest.ci.run_tests - INFO - Running test case 'doctor-notification'... 2018-02-24 09:06:22,078 - functest.core.feature - ERROR - Execute command: doctor-test failed 2018-02-24 09:06:22,079 - functest.core.feature - INFO - Test result is stored in '/home/opnfv/functest/results/doctor-notification.log' 2018-02-24 09:06:22,200 - functest.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-02-24 09:06:22,200 - functest.ci.run_tests - INFO - Test result: +-----------------------------+-----------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------------+-----------------+------------------+----------------+ | doctor-notification | doctor | 02:59 | FAIL | +-----------------------------+-----------------+------------------+----------------+ 2018-02-24 09:06:22,204 - functest.ci.run_tests - ERROR - The test case 'doctor-notification' failed. 2018-02-24 09:06:22,204 - functest.ci.run_tests - INFO - Deployment description: +-------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+----------------------------------------------------------+ | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-nofeature-noha | | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-799 | | CI_LOOP | daily | +-------------------------+----------------------------------------------------------+ 2018-02-24 09:06:22,207 - functest.ci.run_tests - INFO - FUNCTEST REPORT: +-----------------------------+------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-----------------------------+------------------------+------------------+------------------+----------------+ | doctor-notification | doctor | features | 02:59 | FAIL | | bgpvpn | sdnvpn | features | 00:00 | SKIP | | functest-odl-sfc | sfc | features | 00:00 | SKIP | | barometercollectd | barometer | features | 00:00 | SKIP | | fds | fastdatastacks | features | 00:00 | SKIP | +-----------------------------+------------------------+------------------+------------------+----------------+ 2018-02-24 09:06:22,211 - functest.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-02-24 09:06:24,544 - functest.ci.run_tests - DEBUG - Sourcing the credential file... 2018-02-24 09:06:24,544 - functest.ci.run_tests - INFO - Sourcing env file /home/opnfv/functest/conf/env_file 2018-02-24 09:06:24,545 - functest.ci.run_tests - DEBUG - Test args: all 2018-02-24 09:06:24,546 - functest.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+-----------------+---------------------+-------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+-----------------+---------------------+-------------------+ +---------------+---------------+-----------------+---------------------+-------------------+ 2018-02-24 09:06:24,546 - functest.ci.run_tests - INFO - Deployment description: +-------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+----------------------------------------------------------+ | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-nofeature-noha | | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-799 | | CI_LOOP | daily | +-------------------------+----------------------------------------------------------+ 2018-02-24 09:06:24,548 - functest.ci.run_tests - INFO - FUNCTEST REPORT: +---------------------------------+-------------------+--------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +---------------------------------+-------------------+--------------+------------------+----------------+ | cloudify_ims | functest | vnf | 00:00 | SKIP | | vyos_vrouter | functest | vnf | 00:00 | SKIP | | orchestra_openims | orchestra | vnf | 00:00 | SKIP | | orchestra_clearwaterims | orchestra | vnf | 00:00 | SKIP | | juju_epc | functest | vnf | 00:00 | SKIP | +---------------------------------+-------------------+--------------+------------------+----------------+ 2018-02-24 09:06:24,551 - functest.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-02-24 09:06:26,869 - functest.ci.run_tests - DEBUG - Sourcing the credential file... 2018-02-24 09:06:26,869 - functest.ci.run_tests - INFO - Sourcing env file /home/opnfv/functest/conf/env_file 2018-02-24 09:06:26,869 - functest.ci.run_tests - DEBUG - Test args: all 2018-02-24 09:06:26,870 - functest.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+-----------------+---------------------+-------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+-----------------+---------------------+-------------------+ +---------------+---------------+-----------------+---------------------+-------------------+ 2018-02-24 09:06:26,870 - functest.ci.run_tests - INFO - Deployment description: +-------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +-------------------------+----------------------------------------------------------+ | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-nofeature-noha | | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-799 | | CI_LOOP | daily | +-------------------------+----------------------------------------------------------+ 2018-02-24 09:06:26,871 - functest.ci.run_tests - INFO - FUNCTEST REPORT: +-----------------------+-----------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-----------------------+-----------------+------------------+------------------+----------------+ | parser-basics | parser | features | 00:00 | SKIP | +-----------------------+-----------------+------------------+------------------+----------------+ 2018-02-24 09:06:26,871 - functest.ci.run_tests - INFO - Execution exit value: Result.EX_OK