2018-03-06 08:47:00,004 - functest.ci.check_deployment - DEBUG - 172.30.9.28:5000 is reachable! 2018-03-06 08:47:00,004 - functest.ci.check_deployment - INFO - Connectivity to OS_AUTH_URL http://172.30.9.28:5000/v3 ...OK 2018-03-06 08:47:00,477 - functest.ci.check_deployment - INFO - Got token ...OK 2018-03-06 08:47:00,858 - functest.ci.check_deployment - DEBUG - 172.30.9.28:5000 is reachable! 2018-03-06 08:47:00,858 - functest.ci.check_deployment - INFO - Connectivity to the public endpoint http://172.30.9.28:5000 ...OK 2018-03-06 08:47:01,307 - functest.ci.check_deployment - DEBUG - 172.30.9.28:8774 is reachable! 2018-03-06 08:47:01,307 - functest.ci.check_deployment - INFO - Connectivity to endpoint 'compute' http://172.30.9.28:8774/v2.1 ...OK 2018-03-06 08:47:01,779 - functest.ci.check_deployment - DEBUG - 172.30.9.28:9696 is reachable! 2018-03-06 08:47:01,779 - functest.ci.check_deployment - INFO - Connectivity to endpoint 'network' http://172.30.9.28:9696 ...OK 2018-03-06 08:47:02,156 - functest.ci.check_deployment - DEBUG - 172.30.9.28:9292 is reachable! 2018-03-06 08:47:02,156 - functest.ci.check_deployment - INFO - Connectivity to endpoint 'image' http://172.30.9.28:9292 ...OK 2018-03-06 08:47:03,585 - functest.ci.check_deployment - INFO - Nova service ...OK 2018-03-06 08:47:05,393 - functest.ci.check_deployment - INFO - Neutron service ...OK 2018-03-06 08:47:05,493 - functest.ci.check_deployment - INFO - Glance service ...OK 2018-03-06 08:47:07,849 - functest.ci.check_deployment - INFO - External network found: external 2018-03-06 08:47:18,453 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-837 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-03-06 08:47:18,455 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=fxqFAJme2xsaE32nRYFKE8d9j export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.28,192.30.9.3 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.28:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.3 2018-03-06 08:47:18,455 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-03-06 08:47:18,456 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ | healthcheck | 0 | (daily)|(weekly) | First tier to be executed to verify the | connection_check api_check | | | | | basic operations in the VIM. | snaps_health_check | +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ 2018-03-06 08:47:18,457 - xtesting.ci.run_tests - INFO - Running tier 'healthcheck' 2018-03-06 08:47:18,457 - xtesting.ci.run_tests - INFO - Running test case 'connection_check'... 2018-03-06 08:47:21,589 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-03-06 08:47:30,761 - xtesting.core.unit - DEBUG - test_glance_connect_fail (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_glance_connect_success (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_keystone_connect_fail (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_keystone_connect_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_neutron_connect_fail (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_neutron_connect_success (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_retrieve_ext_network_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_nova_connect_fail (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_connect_success (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_get_hypervisor_hosts (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_heat_connect_fail (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_heat_connect_success (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_cinder_connect_fail (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok test_cinder_connect_success (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok ---------------------------------------------------------------------- Ran 14 tests in 9.169s OK 2018-03-06 08:47:30,882 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-06 08:47:30,882 - xtesting.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | connection_check | functest | 00:09 | PASS | +--------------------------+------------------+------------------+----------------+ 2018-03-06 08:47:30,886 - xtesting.ci.run_tests - INFO - Running test case 'api_check'... 2018-03-06 08:47:31,813 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-03-06 09:00:53,498 - xtesting.core.unit - DEBUG - test_create_project_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_user_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_credentials (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_service (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_with_each_interface (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_grant_user_role_to_project (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_admin_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user_2x (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_2x (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_bad_domain (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_update_quotas (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_sec_grp_one_user (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_project_sec_grp_two_users (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_image_minimal_file (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_image_minimal_url (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_network (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_add_interface_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_missing_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip_to_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_network_object (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_simple (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_with_public_interface (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_delete_simple_sec_grp (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_rules (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_one_rule (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_get_sec_grp_by_id (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_floating_ips (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsFloatingIpTests) ... ok test_create_delete_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_key_from_file (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_delete_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_instance (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceTests) ... ok test_add_remove_volume (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_attach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_detach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_create_clean_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_delete_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_all_settings (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_existing (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_create_stack_x2 (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_get_settings_from_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateComplexStackTests) ... ok test_create_flavor_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsFlavorTests) ... ok test_create_keypair_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsKeypairTests) ... ok test_create_security_group_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsSecurityGroupTests) ... ok test_create_delete_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_back (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_both (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_front (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_delete_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_simple_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_delete_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_simple_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_bad_key_size (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_delete_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_simple_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_all_attrs (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_invalid_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos_and_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok ---------------------------------------------------------------------- Ran 83 tests in 801.675s OK 2018-03-06 09:00:53,619 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-06 09:00:53,619 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | api_check | functest | 13:22 | PASS | +-------------------+------------------+------------------+----------------+ 2018-03-06 09:00:53,623 - xtesting.ci.run_tests - INFO - Running test case 'snaps_health_check'... 2018-03-06 09:00:54,578 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-03-06 09:01:41,135 - xtesting.core.unit - DEBUG - test_check_vm_ip_dhcp (snaps.openstack.tests.create_instance_tests.SimpleHealthCheck) ... ok ---------------------------------------------------------------------- Ran 1 test in 46.556s OK 2018-03-06 09:01:41,241 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-06 09:01:41,242 - xtesting.ci.run_tests - INFO - Test result: +----------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------------+------------------+------------------+----------------+ | snaps_health_check | functest | 00:47 | PASS | +----------------------------+------------------+------------------+----------------+ 2018-03-06 09:01:41,246 - xtesting.ci.run_tests - INFO - Xtesting report: +----------------------------+------------------+---------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------------+------------------+---------------------+------------------+----------------+ | connection_check | functest | healthcheck | 00:09 | PASS | | api_check | functest | healthcheck | 13:22 | PASS | | snaps_health_check | functest | healthcheck | 00:47 | PASS | +----------------------------+------------------+---------------------+------------------+----------------+ 2018-03-06 09:01:41,249 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-03-06 09:02:01,310 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-837 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-03-06 09:02:01,312 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=fxqFAJme2xsaE32nRYFKE8d9j export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.28,192.30.9.3 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.28:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.3 2018-03-06 09:02:01,312 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-03-06 09:02:01,313 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+--------------------------+------------------------------------------+---------------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+--------------------------+------------------------------------------+---------------------------------------------+ | smoke | 1 | (daily)|(weekly) | Set of basic Functional tests to | vping_userdata tempest_smoke_serial | | | | | validate the OPNFV scenarios. | rally_sanity refstack_defcore odl | | | | | | snaps_smoke | +---------------+---------------+--------------------------+------------------------------------------+---------------------------------------------+ 2018-03-06 09:02:01,314 - xtesting.ci.run_tests - INFO - Running tier 'smoke' 2018-03-06 09:02:01,314 - xtesting.ci.run_tests - INFO - Running test case 'vping_userdata'... 2018-03-06 09:02:01,830 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup 2018-03-06 09:02:01,830 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-03-06 09:02:01' 2018-03-06 09:02:01,830 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--143d44f2-b4b2-45ea-986e-66a78009f72f' 2018-03-06 09:02:05,071 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-143d44f2-b4b2-45ea-986e-66a78009f72f' 2018-03-06 09:02:08,703 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-143d44f2-b4b2-45ea-986e-66a78009f72f' 2018-03-06 09:02:17,538 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-143d44f2-b4b2-45ea-986e-66a78009f72f' 2018-03-06 09:02:20,215 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-143d44f2-b4b2-45ea-986e-66a78009f72f' 2018-03-06 09:02:28,748 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-143d44f2-b4b2-45ea-986e-66a78009f72f' 2018-03-06 09:02:37,127 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution 2018-03-06 09:02:44,634 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping... 2018-03-06 09:02:47,405 - functest.opnfv_tests.openstack.vping.vping_base - DEBUG - Pinging 192.168.130.12. Waiting for response... 2018-03-06 09:03:13,600 - functest.opnfv_tests.openstack.vping.vping_base - DEBUG - Pinging 192.168.130.12. Waiting for response... 2018-03-06 09:03:40,136 - functest.opnfv_tests.openstack.vping.vping_base - DEBUG - Pinging 192.168.130.12. Waiting for response... 2018-03-06 09:03:42,828 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected! 2018-03-06 09:04:00,399 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-06 09:04:00,400 - xtesting.ci.run_tests - INFO - Test result: +------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------+------------------+------------------+----------------+ | vping_userdata | functest | 01:41 | PASS | +------------------------+------------------+------------------+----------------+ 2018-03-06 09:04:00,404 - xtesting.ci.run_tests - INFO - Running test case 'tempest_smoke_serial'... 2018-03-06 09:04:00,523 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-03-06 09:04:03,824 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment create --fromenv --name=opnfv-rally' 2018-03-06 09:04:06,241 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment check' 2018-03-06 09:04:09,398 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-03-06 09:04:11,365 - functest.utils.functest_utils - DEBUG - Executing command: 'rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide' 2018-03-06 09:04:18,019 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-03-06 09:04:21,055 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating image for Tempest suite 2018-03-06 09:04:24,294 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Configuring the verifier... 2018-03-06 09:04:24,294 - functest.utils.functest_utils - DEBUG - Executing command: 'rally verify configure-verifier' 2018-03-06 09:04:27,269 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-03-06 09:04:27,270 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-03-06 09:04:27,272 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-03-06 09:04:27,286 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-03-06 09:04:27,286 - functest.utils.functest_utils - DEBUG - Executing command: 'cd /root/.rally/verification/verifier-c135e746-f29e-42bf-a144-6b2f8544cf1a/repo;testr list-tests 'tempest\.(api|scenario).*\[.*\bsmoke\b.*\]' > /home/opnfv/functest/results/tempest/test_raw_list.txt;cd -;' 2018-03-06 09:04:29,580 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Applying tempest blacklist... 2018-03-06 09:04:29,588 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Tempest blacklist file does not exist. 2018-03-06 09:04:29,588 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/tempest/test_list.txt', '--concurrency', '1']'. 2018-03-06 09:04:31,466 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:04:31.464 57 INFO rally.api [-] Starting verification (UUID=a7d1505e-ff51-4f4f-ba88-25bfd9998da8) for deployment 'opnfv-rally' (UUID=b658dba2-7cf9-47e5-b552-3eb46bbd8483) by verifier 'opnfv-tempest' (UUID=c135e746-f29e-42bf-a144-6b2f8544cf1a). 2018-03-06 09:04:31,466 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: a7d1505e-ff51-4f4f-ba88-25bfd9998da8 2018-03-06 09:04:37,971 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:04:37.970 57 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor ... success [0.182s] 2018-03-06 09:04:38,028 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:04:38.028 57 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.057s] 2018-03-06 09:04:44,340 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:04:44.339 57 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create ... success [1.612s] 2018-03-06 09:04:47,920 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:04:47.920 57 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list ... success [3.579s] 2018-03-06 09:05:01,057 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:05:01.056 57 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete ... success [5.806s] 2018-03-06 09:05:18,002 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:05:18.002 57 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip ... success [10.475s] 2018-03-06 09:05:51,492 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:05:51.491 57 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers ... success [0.069s] 2018-03-06 09:05:51,494 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:05:51.493 57 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details ... success [0.001s] 2018-03-06 09:06:22,027 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:06:22.027 57 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.086s] 2018-03-06 09:06:22,029 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:06:22.028 57 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s] 2018-03-06 09:06:52,844 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:06:52.844 57 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.096s] 2018-03-06 09:06:52,845 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:06:52.845 57 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s] 2018-03-06 09:08:30,120 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:08:30.120 57 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [69.147s] 2018-03-06 09:08:52,490 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:08:52.490 57 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses ... success [0.050s] 2018-03-06 09:08:52,591 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:08:52.590 57 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network ... success [0.100s] 2018-03-06 09:09:00,593 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:09:00.592 57 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_get_version_details ... success [0.668s] 2018-03-06 09:09:00,602 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:09:00.601 57 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.009s] 2018-03-06 09:09:02,087 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:09:02.087 57 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_services.ServicesTestJSON ... skip: Identity api v2 is not enabled 2018-03-06 09:09:02,088 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:09:02.088 57 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_users.UsersTestJSON ... skip: Identity api v2 is not enabled 2018-03-06 09:09:06,056 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:09:06.056 57 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete ... success [0.387s] 2018-03-06 09:09:12,126 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:09:12.126 57 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists ... success [0.079s] 2018-03-06 09:09:18,965 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:09:18.965 57 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain ... success [0.782s] 2018-03-06 09:09:26,481 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:09:26.481 57 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint ... success [0.453s] 2018-03-06 09:09:36,039 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:09:36.038 57 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete ... success [3.022s] 2018-03-06 09:09:42,419 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:09:42.418 57 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy ... success [0.371s] 2018-03-06 09:09:48,377 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:09:48.376 57 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id ... success [0.206s] 2018-03-06 09:09:55,717 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:09:55.716 57 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list ... success [0.545s] 2018-03-06 09:10:02,823 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:10:02.823 57 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service ... success [0.441s] 2018-03-06 09:10:10,965 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:10:10.965 57 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all ... success [2.827s] 2018-03-06 09:10:13,560 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:10:13.560 57 INFO opnfv-tempest [-] {0} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery ... skip: Identity api v2 is not enabled 2018-03-06 09:10:15,489 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:10:15.488 57 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.074s] 2018-03-06 09:10:15,567 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:10:15.567 57 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.075s] 2018-03-06 09:10:15,643 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:10:15.643 57 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.077s] 2018-03-06 09:10:15,650 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:10:15.650 57 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions ... success [0.007s] 2018-03-06 09:10:19,737 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:10:19.737 57 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.810s] 2018-03-06 09:10:21,487 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:10:21.487 57 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file ... success [1.750s] 2018-03-06 09:10:23,626 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:10:23.626 57 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [2.138s] 2018-03-06 09:10:30,592 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:10:30.592 57 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_versions.VersionsTest.test_list_versions ... success [0.006s] 2018-03-06 09:10:37,979 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:10:37.978 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions ... success [3.946s] 2018-03-06 09:10:52,131 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:10:52.130 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address ... success [2.685s] 2018-03-06 09:10:55,221 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:10:55.221 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip ... success [3.090s] 2018-03-06 09:11:06,702 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:11:06.701 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network ... success [2.768s] 2018-03-06 09:11:10,236 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:11:10.236 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port ... success [3.533s] 2018-03-06 09:11:18,919 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:11:18.919 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet ... success [8.682s] 2018-03-06 09:11:28,784 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:11:28.784 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network ... success [2.931s] 2018-03-06 09:11:32,351 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:11:32.350 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port ... success [3.565s] 2018-03-06 09:11:38,899 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:11:38.898 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet ... success [6.548s] 2018-03-06 09:11:54,632 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:11:54.631 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet ... success [6.537s] 2018-03-06 09:11:55,074 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:11:55.074 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility ... success [0.442s] 2018-03-06 09:11:55,494 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:11:55.493 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks ... success [0.419s] 2018-03-06 09:11:55,694 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:11:55.693 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets ... success [0.199s] 2018-03-06 09:11:55,957 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:11:55.957 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network ... success [0.263s] 2018-03-06 09:11:56,148 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:11:56.148 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet ... success [0.191s] 2018-03-06 09:12:12,120 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:12:12.120 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [7.140s] 2018-03-06 09:12:12,655 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:12:12.655 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.535s] 2018-03-06 09:12:12,903 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:12:12.902 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.247s] 2018-03-06 09:12:13,108 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:12:13.108 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.204s] 2018-03-06 09:12:13,418 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:12:13.418 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.309s] 2018-03-06 09:12:13,623 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:12:13.623 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.205s] 2018-03-06 09:12:28,017 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:12:28.016 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools ... success [5.677s] 2018-03-06 09:12:33,435 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:12:33.435 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups ... success [5.418s] 2018-03-06 09:12:35,324 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:12:35.324 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port ... success [1.888s] 2018-03-06 09:12:35,403 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:12:35.403 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports ... success [0.079s] 2018-03-06 09:12:35,605 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:12:35.605 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port ... success [0.201s] 2018-03-06 09:12:48,047 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:12:48.047 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [4.703s] 2018-03-06 09:12:54,540 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:12:54.539 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups ... success [6.492s] 2018-03-06 09:12:56,471 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:12:56.471 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [1.930s] 2018-03-06 09:12:56,673 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:12:56.672 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.201s] 2018-03-06 09:12:56,734 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:12:56.733 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.061s] 2018-03-06 09:13:11,356 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:13:11.356 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces ... success [9.008s] 2018-03-06 09:13:16,656 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:13:16.655 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id ... success [5.299s] 2018-03-06 09:13:20,861 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:13:20.861 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id ... success [4.204s] 2018-03-06 09:13:23,834 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:13:23.834 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router ... success [2.972s] 2018-03-06 09:13:49,609 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:13:49.609 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [9.358s] 2018-03-06 09:13:54,900 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:13:54.900 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [5.291s] 2018-03-06 09:13:59,544 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:13:59.544 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [4.643s] 2018-03-06 09:14:03,041 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:14:03.040 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [3.495s] 2018-03-06 09:14:20,386 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:14:20.385 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group ... success [1.818s] 2018-03-06 09:14:22,427 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:14:22.426 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule ... success [2.038s] 2018-03-06 09:14:22,625 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:14:22.625 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups ... success [0.201s] 2018-03-06 09:14:27,447 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:14:27.447 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.666s] 2018-03-06 09:14:29,881 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:14:29.880 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [2.431s] 2018-03-06 09:14:30,072 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:14:30.072 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.193s] 2018-03-06 09:14:34,628 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:14:34.628 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.264s] 2018-03-06 09:14:38,130 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:14:38.130 57 INFO opnfv-tempest [-] {0} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.006s] 2018-03-06 09:14:39,653 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:14:39.653 57 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest ... skip: AccountQuotasTest skipped as swift is not available 2018-03-06 09:14:39,655 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:14:39.655 57 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_services.AccountTest ... skip: AccountTest skipped as swift is not available 2018-03-06 09:14:39,656 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:14:39.655 57 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest ... skip: ContainerQuotasTest skipped as swift is not available 2018-03-06 09:14:39,657 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:14:39.656 57 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest ... skip: ContainerTest skipped as swift is not available 2018-03-06 09:14:39,657 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:14:39.657 57 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_object_services.ObjectTest ... skip: ObjectTest skipped as swift is not available 2018-03-06 09:14:41,667 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:14:41.666 57 INFO opnfv-tempest [-] {0} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.012s] 2018-03-06 09:14:59,078 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:14:59.078 57 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_attach_detach_volume_to_instance ... success [11.717s] 2018-03-06 09:15:10,210 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:15:10.210 57 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [6.125s] 2018-03-06 09:15:24,683 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:15:24.683 57 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [14.471s] 2018-03-06 09:15:34,358 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:15:34.358 57 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.177s] 2018-03-06 09:16:37,696 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:16:37.696 57 INFO opnfv-tempest [-] {0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops ... success [56.692s] 2018-03-06 09:18:14,367 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:18:14.366 57 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops ... success [88.142s] 2018-03-06 09:18:58,154 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-06 09:18:58.154 57 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_multinode.TestServerMultinode.test_schedule_to_all_nodes ... success [24.069s] 2018-03-06 09:19:13,922 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', 'a7d1505e-ff51-4f4f-ba88-25bfd9998da8']'. 2018-03-06 09:19:14,814 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-03-06 09:19:14,814 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-03-06 09:19:14,814 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-06 09:19:14,814 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | a7d1505e-ff51-4f4f-ba88-25bfd9998da8 | 2018-03-06 09:19:14,814 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | finished | 2018-03-06 09:19:14,814 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-03-06 09:04:31 | 2018-03-06 09:19:14,814 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-03-06 09:19:13 | 2018-03-06 09:19:14,814 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:14:42 | 2018-03-06 09:19:14,814 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | concurrency: 1 | 2018-03-06 09:19:14,814 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | | load_list: (value is too long, use 'detailed' flag to display it) | 2018-03-06 09:19:14,814 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-03-06 09:19:14,814 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: c135e746-f29e-42bf-a144-6b2f8544cf1a) | 2018-03-06 09:19:14,814 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-03-06 09:19:14,814 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: b658dba2-7cf9-47e5-b552-3eb46bbd8483) | 2018-03-06 09:19:14,814 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 109 | 2018-03-06 09:19:14,815 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 862.367 | 2018-03-06 09:19:14,815 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 90 | 2018-03-06 09:19:14,815 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 19 | 2018-03-06 09:19:14,815 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-03-06 09:19:14,815 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-03-06 09:19:14,815 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 0 | 2018-03-06 09:19:14,815 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-06 09:19:14,815 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-03-06 09:19:14,865 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest tempest_smoke_serial success_rate is 100.0% 2018-03-06 09:19:20,105 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-06 09:19:20,105 - xtesting.ci.run_tests - INFO - Test result: +------------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------------+------------------+------------------+----------------+ | tempest_smoke_serial | functest | 15:02 | PASS | +------------------------------+------------------+------------------+----------------+ 2018-03-06 09:19:20,109 - xtesting.ci.run_tests - INFO - Running test case 'rally_sanity'... 2018-03-06 09:19:20,778 - xtesting.energy.energy - INFO - API recorder available at : http://energy.opnfv.fr/resources/recorders/environment/lf-pod1 2018-03-06 09:19:20,778 - xtesting.energy.energy - DEBUG - Getting current scenario 2018-03-06 09:19:21,407 - xtesting.energy.energy - DEBUG - Starting recording 2018-03-06 09:19:21,407 - xtesting.energy.energy - DEBUG - Submitting scenario (rally_sanity/running) 2018-03-06 09:19:21,825 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-03-06 09:19:24,162 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment create --fromenv --name=opnfv-rally' 2018-03-06 09:19:26,490 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment check' 2018-03-06 09:19:29,628 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating the test name... 2018-03-06 09:19:31,130 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating image 'Cirros-0.4.0-e784bc05-196f-4255-bde7-140c90894ec0'... 2018-03-06 09:19:34,539 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating network 'rally-net-e784bc05-196f-4255-bde7-140c90894ec0'... 2018-03-06 09:19:37,685 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating router 'rally-router-e784bc05-196f-4255-bde7-140c90894ec0'... 2018-03-06 09:19:44,873 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-tiny-e784bc05-196f-4255-bde7-140c90894ec0'... 2018-03-06 09:19:45,522 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-mini-e784bc05-196f-4255-bde7-140c90894ec0'... 2018-03-06 09:19:46,138 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2018-03-06 09:19:46,139 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-authenticate.yaml 2018-03-06 09:19:46,140 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-06 09:19:46,181 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-06 09:19:46,197 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['authenticate'], 'concurrency': 4, 'netid': 'ea11d414-ea4b-4af7-aab2-1adf0209cd2e', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-e784bc05-196f-4255-bde7-140c90894ec0', 'flavor_name': 'rally-tiny-e784bc05-196f-4255-bde7-140c90894ec0', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-e784bc05-196f-4255-bde7-140c90894ec0', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-06 09:20:46,254 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 941755e0-5670-4ffa-a67a-6428b576d0c9 2018-03-06 09:20:46,255 - functest.opnfv_tests.openstack.rally.rally - DEBUG - /home/opnfv/functest/results/rally does not exist, we create it. 2018-03-06 09:20:46,257 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '941755e0-5670-4ffa-a67a-6428b576d0c9'] 2018-03-06 09:20:47,238 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 941755e0-5670-4ffa-a67a-6428b576d0c9: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 941755e0-5670-4ffa-a67a-6428b576d0c9 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.476 | 0.476 | 0.476 | 0.476 | 0.476 | 0.476 | 100.0% | 1 | | total | 0.476 | 0.476 | 0.476 | 0.476 | 0.476 | 0.476 | 100.0% | 1 | | -> duration | 0.476 | 0.476 | 0.476 | 0.476 | 0.476 | 0.476 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.476285 Full duration: 7.338878 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 941755e0-5670-4ffa-a67a-6428b576d0c9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.338 | 0.338 | 0.338 | 0.338 | 0.338 | 0.338 | 100.0% | 1 | | total | 0.774 | 0.774 | 0.774 | 0.774 | 0.774 | 0.774 | 100.0% | 1 | | -> duration | 0.774 | 0.774 | 0.774 | 0.774 | 0.774 | 0.774 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.773514 Full duration: 7.739603 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 941755e0-5670-4ffa-a67a-6428b576d0c9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.537 | 0.537 | 0.537 | 0.537 | 0.537 | 0.537 | 100.0% | 1 | | total | 0.968 | 0.968 | 0.968 | 0.968 | 0.968 | 0.968 | 100.0% | 1 | | -> duration | 0.968 | 0.968 | 0.968 | 0.968 | 0.968 | 0.968 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.967807 Full duration: 7.754553 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 941755e0-5670-4ffa-a67a-6428b576d0c9 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.812 | 0.812 | 0.812 | 0.812 | 0.812 | 0.812 | 100.0% | 1 | | total | 1.235 | 1.235 | 1.235 | 1.235 | 1.235 | 1.235 | 100.0% | 1 | | -> duration | 1.235 | 1.235 | 1.235 | 1.235 | 1.235 | 1.235 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.235201 Full duration: 7.89526 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 941755e0-5670-4ffa-a67a-6428b576d0c9 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.667 | 0.667 | 0.667 | 0.667 | 0.667 | 0.667 | 100.0% | 1 | | total | 1.074 | 1.074 | 1.074 | 1.074 | 1.074 | 1.074 | 100.0% | 1 | | -> duration | 1.074 | 1.074 | 1.074 | 1.074 | 1.074 | 1.074 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.073786 Full duration: 7.812618 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 941755e0-5670-4ffa-a67a-6428b576d0c9 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.212 | 0.212 | 0.212 | 0.212 | 0.212 | 0.212 | 100.0% | 1 | | total | 0.657 | 0.657 | 0.657 | 0.657 | 0.657 | 0.657 | 100.0% | 1 | | -> duration | 0.657 | 0.657 | 0.657 | 0.657 | 0.657 | 0.657 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.657468 Full duration: 7.334991 HINTS: * To plot HTML graphics with this data, run: rally task report 941755e0-5670-4ffa-a67a-6428b576d0c9 --out output.html * To generate a JUnit report, run: rally task export 941755e0-5670-4ffa-a67a-6428b576d0c9 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 941755e0-5670-4ffa-a67a-6428b576d0c9 --json --out output.json 2018-03-06 09:20:47,239 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '941755e0-5670-4ffa-a67a-6428b576d0c9'] 2018-03-06 09:20:48,199 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-06 09:20:48,199 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '941755e0-5670-4ffa-a67a-6428b576d0c9', '--out', u'/home/opnfv/functest/results/rally/opnfv-authenticate.html'] 2018-03-06 09:20:48,205 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2018-03-06 09:20:48,205 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2018-03-06 09:20:48,206 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-glance.yaml 2018-03-06 09:20:48,206 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-06 09:20:48,228 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-06 09:20:48,241 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['glance'], 'concurrency': 4, 'netid': 'ea11d414-ea4b-4af7-aab2-1adf0209cd2e', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-e784bc05-196f-4255-bde7-140c90894ec0', 'flavor_name': 'rally-tiny-e784bc05-196f-4255-bde7-140c90894ec0', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-e784bc05-196f-4255-bde7-140c90894ec0', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-06 09:22:27,803 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : b9402b01-74a1-49af-bc10-ab262c07cfbb 2018-03-06 09:22:27,803 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'b9402b01-74a1-49af-bc10-ab262c07cfbb'] 2018-03-06 09:22:28,688 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task b9402b01-74a1-49af-bc10-ab262c07cfbb: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task b9402b01-74a1-49af-bc10-ab262c07cfbb has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.798 | 4.798 | 4.798 | 4.798 | 4.798 | 4.798 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.564 | 0.564 | 0.564 | 0.564 | 0.564 | 0.564 | 100.0% | 1 | | -> glance_v2.upload_data | 1.678 | 1.678 | 1.678 | 1.678 | 1.678 | 1.678 | 100.0% | 1 | | glance_v2.delete_image | 1.133 | 1.133 | 1.133 | 1.133 | 1.133 | 1.133 | 100.0% | 1 | | total | 5.932 | 5.932 | 5.932 | 5.932 | 5.932 | 5.932 | 100.0% | 1 | | -> duration | 5.932 | 5.932 | 5.932 | 5.932 | 5.932 | 5.932 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.931787 Full duration: 14.277919 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task b9402b01-74a1-49af-bc10-ab262c07cfbb has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 5.105 | 5.105 | 5.105 | 5.105 | 5.105 | 5.105 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.574 | 0.574 | 0.574 | 0.574 | 0.574 | 0.574 | 100.0% | 1 | | -> glance_v2.upload_data | 2.107 | 2.107 | 2.107 | 2.107 | 2.107 | 2.107 | 100.0% | 1 | | glance_v2.list_images | 0.185 | 0.185 | 0.185 | 0.185 | 0.185 | 0.185 | 100.0% | 1 | | total | 5.291 | 5.291 | 5.291 | 5.291 | 5.291 | 5.291 | 100.0% | 1 | | -> duration | 5.291 | 5.291 | 5.291 | 5.291 | 5.291 | 5.291 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.290601 Full duration: 16.970334 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task b9402b01-74a1-49af-bc10-ab262c07cfbb has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.34 | 0.34 | 0.34 | 0.34 | 0.34 | 0.34 | 100.0% | 1 | | total | 0.34 | 0.34 | 0.34 | 0.34 | 0.34 | 0.34 | 100.0% | 1 | | -> duration | 0.34 | 0.34 | 0.34 | 0.34 | 0.34 | 0.34 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.33971 Full duration: 7.907172 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally-tiny-e784bc05-196f-4255-bde7-140c90894ec0" }, "number_instances": 2, "nics": [ { "net-id": "ea11d414-ea4b-4af7-aab2-1adf0209cd2e" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } } } -------------------------------------------------------------------------------- Task b9402b01-74a1-49af-bc10-ab262c07cfbb has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.42 | 4.42 | 4.42 | 4.42 | 4.42 | 4.42 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.57 | 0.57 | 0.57 | 0.57 | 0.57 | 0.57 | 100.0% | 1 | | -> glance_v2.upload_data | 1.384 | 1.384 | 1.384 | 1.384 | 1.384 | 1.384 | 100.0% | 1 | | nova.boot_servers | 13.587 | 13.587 | 13.587 | 13.587 | 13.587 | 13.587 | 100.0% | 1 | | total | 18.007 | 18.007 | 18.007 | 18.007 | 18.007 | 18.007 | 100.0% | 1 | | -> duration | 17.007 | 17.007 | 17.007 | 17.007 | 17.007 | 17.007 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 17.007353 Full duration: 42.889409 HINTS: * To plot HTML graphics with this data, run: rally task report b9402b01-74a1-49af-bc10-ab262c07cfbb --out output.html * To generate a JUnit report, run: rally task export b9402b01-74a1-49af-bc10-ab262c07cfbb --type junit --to output.xml * To get raw JSON output of task results, run: rally task report b9402b01-74a1-49af-bc10-ab262c07cfbb --json --out output.json 2018-03-06 09:22:28,688 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'b9402b01-74a1-49af-bc10-ab262c07cfbb'] 2018-03-06 09:22:29,499 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-06 09:22:29,500 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'b9402b01-74a1-49af-bc10-ab262c07cfbb', '--out', u'/home/opnfv/functest/results/rally/opnfv-glance.html'] 2018-03-06 09:22:29,507 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2018-03-06 09:22:29,507 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "ceilometer" ... 2018-03-06 09:22:29,507 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-ceilometer.yaml 2018-03-06 09:22:29,507 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-06 09:22:29,545 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-06 09:22:29,558 - functest.opnfv_tests.openstack.rally.rally - INFO - No tests for scenario "ceilometer" 2018-03-06 09:22:29,558 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2018-03-06 09:22:29,558 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-cinder.yaml 2018-03-06 09:22:29,558 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-06 09:22:29,587 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-06 09:22:29,595 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['cinder'], 'concurrency': 4, 'netid': 'ea11d414-ea4b-4af7-aab2-1adf0209cd2e', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-e784bc05-196f-4255-bde7-140c90894ec0', 'flavor_name': 'rally-tiny-e784bc05-196f-4255-bde7-140c90894ec0', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-e784bc05-196f-4255-bde7-140c90894ec0', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-06 09:25:46,574 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 56d56573-71ae-4a1b-a4a1-69e5b883bba0 2018-03-06 09:25:46,574 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '56d56573-71ae-4a1b-a4a1-69e5b883bba0'] 2018-03-06 09:25:47,598 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 56d56573-71ae-4a1b-a4a1-69e5b883bba0: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "force": false }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 56d56573-71ae-4a1b-a4a1-69e5b883bba0 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_snapshot | 3.233 | 3.233 | 3.233 | 3.233 | 3.233 | 3.233 | 100.0% | 1 | | cinder_v2.delete_snapshot | 2.723 | 2.723 | 2.723 | 2.723 | 2.723 | 2.723 | 100.0% | 1 | | total | 5.955 | 5.955 | 5.955 | 5.955 | 5.955 | 5.955 | 100.0% | 1 | | -> duration | 5.955 | 5.955 | 5.955 | 5.955 | 5.955 | 5.955 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.955468 Full duration: 22.841578 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": { "max": 1, "min": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 56d56573-71ae-4a1b-a4a1-69e5b883bba0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.106 | 3.106 | 3.106 | 3.106 | 3.106 | 3.106 | 100.0% | 1 | | cinder_v2.delete_volume | 2.627 | 2.627 | 2.627 | 2.627 | 2.627 | 2.627 | 100.0% | 1 | | total | 5.733 | 5.733 | 5.733 | 5.733 | 5.733 | 5.733 | 100.0% | 1 | | -> duration | 5.733 | 5.733 | 5.733 | 5.733 | 5.733 | 5.733 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.7332 Full duration: 15.962371 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "image": { "name": "Cirros-0.4.0-e784bc05-196f-4255-bde7-140c90894ec0" }, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 56d56573-71ae-4a1b-a4a1-69e5b883bba0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 8.366 | 8.366 | 8.366 | 8.366 | 8.366 | 8.366 | 100.0% | 1 | | cinder_v2.delete_volume | 2.634 | 2.634 | 2.634 | 2.634 | 2.634 | 2.634 | 100.0% | 1 | | total | 11.0 | 11.0 | 11.0 | 11.0 | 11.0 | 11.0 | 100.0% | 1 | | -> duration | 11.0 | 11.0 | 11.0 | 11.0 | 11.0 | 11.0 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.000468 Full duration: 21.83446 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 56d56573-71ae-4a1b-a4a1-69e5b883bba0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.117 | 3.117 | 3.117 | 3.117 | 3.117 | 3.117 | 100.0% | 1 | | cinder_v2.delete_volume | 2.629 | 2.629 | 2.629 | 2.629 | 2.629 | 2.629 | 100.0% | 1 | | total | 5.747 | 5.747 | 5.747 | 5.747 | 5.747 | 5.747 | 100.0% | 1 | | -> duration | 5.747 | 5.747 | 5.747 | 5.747 | 5.747 | 5.747 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.746564 Full duration: 16.339503 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "new_size": 2, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 56d56573-71ae-4a1b-a4a1-69e5b883bba0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.168 | 3.168 | 3.168 | 3.168 | 3.168 | 3.168 | 100.0% | 1 | | cinder_v2.extend_volume | 2.648 | 2.648 | 2.648 | 2.648 | 2.648 | 2.648 | 100.0% | 1 | | cinder_v2.delete_volume | 2.334 | 2.334 | 2.334 | 2.334 | 2.334 | 2.334 | 100.0% | 1 | | total | 8.15 | 8.15 | 8.15 | 8.15 | 8.15 | 8.15 | 100.0% | 1 | | -> duration | 8.15 | 8.15 | 8.15 | 8.15 | 8.15 | 8.15 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.150452 Full duration: 18.038427 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 56d56573-71ae-4a1b-a4a1-69e5b883bba0 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.214 | 3.214 | 3.214 | 3.214 | 3.214 | 3.214 | 100.0% | 1 | | cinder_v2.delete_volume | 2.326 | 2.326 | 2.326 | 2.326 | 2.326 | 2.326 | 100.0% | 1 | | total | 5.541 | 5.541 | 5.541 | 5.541 | 5.541 | 5.541 | 100.0% | 1 | | -> duration | 5.541 | 5.541 | 5.541 | 5.541 | 5.541 | 5.541 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.540612 Full duration: 22.399792 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 56d56573-71ae-4a1b-a4a1-69e5b883bba0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 0.609 | 0.609 | 0.609 | 0.609 | 0.609 | 0.609 | 100.0% | 1 | | cinder_v2.list_qos | 0.165 | 0.165 | 0.165 | 0.165 | 0.165 | 0.165 | 100.0% | 1 | | total | 0.775 | 0.775 | 0.775 | 0.775 | 0.775 | 0.775 | 100.0% | 1 | | -> duration | 0.775 | 0.775 | 0.775 | 0.775 | 0.775 | 0.775 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.774663 Full duration: 12.914214 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 56d56573-71ae-4a1b-a4a1-69e5b883bba0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 0.614 | 0.614 | 0.614 | 0.614 | 0.614 | 0.614 | 100.0% | 1 | | cinder_v2.set_qos | 0.205 | 0.205 | 0.205 | 0.205 | 0.205 | 0.205 | 100.0% | 1 | | total | 0.819 | 0.819 | 0.819 | 0.819 | 0.819 | 0.819 | 100.0% | 1 | | -> duration | 0.819 | 0.819 | 0.819 | 0.819 | 0.819 | 0.819 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.819104 Full duration: 12.39827 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "description": "rally tests creating types" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 56d56573-71ae-4a1b-a4a1-69e5b883bba0 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.613 | 0.613 | 0.613 | 0.613 | 0.613 | 0.613 | 100.0% | 1 | | cinder_v2.list_types | 0.173 | 0.173 | 0.173 | 0.173 | 0.173 | 0.173 | 100.0% | 1 | | total | 0.787 | 0.787 | 0.787 | 0.787 | 0.787 | 0.787 | 100.0% | 1 | | -> duration | 0.787 | 0.787 | 0.787 | 0.787 | 0.787 | 0.787 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.786554 Full duration: 12.357415 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 56d56573-71ae-4a1b-a4a1-69e5b883bba0 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.626 | 0.626 | 0.626 | 0.626 | 0.626 | 0.626 | 100.0% | 1 | | cinder_v2.create_encryption_type | 0.393 | 0.393 | 0.393 | 0.393 | 0.393 | 0.393 | 100.0% | 1 | | total | 1.02 | 1.02 | 1.02 | 1.02 | 1.02 | 1.02 | 100.0% | 1 | | -> duration | 1.02 | 1.02 | 1.02 | 1.02 | 1.02 | 1.02 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.020044 Full duration: 12.964438 HINTS: * To plot HTML graphics with this data, run: rally task report 56d56573-71ae-4a1b-a4a1-69e5b883bba0 --out output.html * To generate a JUnit report, run: rally task export 56d56573-71ae-4a1b-a4a1-69e5b883bba0 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 56d56573-71ae-4a1b-a4a1-69e5b883bba0 --json --out output.json 2018-03-06 09:25:47,599 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '56d56573-71ae-4a1b-a4a1-69e5b883bba0'] 2018-03-06 09:25:48,561 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-06 09:25:48,562 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '56d56573-71ae-4a1b-a4a1-69e5b883bba0', '--out', u'/home/opnfv/functest/results/rally/opnfv-cinder.html'] 2018-03-06 09:25:48,567 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2018-03-06 09:25:48,568 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2018-03-06 09:25:48,568 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-heat.yaml 2018-03-06 09:25:48,568 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-06 09:25:48,606 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-06 09:25:48,621 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['heat'], 'concurrency': 4, 'netid': 'ea11d414-ea4b-4af7-aab2-1adf0209cd2e', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-e784bc05-196f-4255-bde7-140c90894ec0', 'flavor_name': 'rally-tiny-e784bc05-196f-4255-bde7-140c90894ec0', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-e784bc05-196f-4255-bde7-140c90894ec0', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-06 09:27:11,547 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : f9226ee1-6f48-4b41-a36a-5319eb2bb700 2018-03-06 09:27:11,548 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'f9226ee1-6f48-4b41-a36a-5319eb2bb700'] 2018-03-06 09:27:12,448 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task f9226ee1-6f48-4b41-a36a-5319eb2bb700: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task f9226ee1-6f48-4b41-a36a-5319eb2bb700 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.746 | 4.746 | 4.746 | 4.746 | 4.746 | 4.746 | 100.0% | 1 | | heat.update_stack | 2.762 | 2.762 | 2.762 | 2.762 | 2.762 | 2.762 | 100.0% | 1 | | heat.delete_stack | 2.339 | 2.339 | 2.339 | 2.339 | 2.339 | 2.339 | 100.0% | 1 | | total | 9.847 | 9.847 | 9.847 | 9.847 | 9.847 | 9.847 | 100.0% | 1 | | -> duration | 5.847 | 5.847 | 5.847 | 5.847 | 5.847 | 5.847 | 100.0% | 1 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.846927 Full duration: 19.857547 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task f9226ee1-6f48-4b41-a36a-5319eb2bb700 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.719 | 4.719 | 4.719 | 4.719 | 4.719 | 4.719 | 100.0% | 1 | | heat.check_stack | 0.815 | 0.815 | 0.815 | 0.815 | 0.815 | 0.815 | 100.0% | 1 | | heat.delete_stack | 2.645 | 2.645 | 2.645 | 2.645 | 2.645 | 2.645 | 100.0% | 1 | | total | 8.179 | 8.179 | 8.179 | 8.179 | 8.179 | 8.179 | 100.0% | 1 | | -> duration | 6.179 | 6.179 | 6.179 | 6.179 | 6.179 | 6.179 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.178676 Full duration: 16.631712 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task f9226ee1-6f48-4b41-a36a-5319eb2bb700 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.472 | 4.472 | 4.472 | 4.472 | 4.472 | 4.472 | 100.0% | 1 | | heat.suspend_stack | 0.808 | 0.808 | 0.808 | 0.808 | 0.808 | 0.808 | 100.0% | 1 | | heat.resume_stack | 1.529 | 1.529 | 1.529 | 1.529 | 1.529 | 1.529 | 100.0% | 1 | | heat.delete_stack | 1.599 | 1.599 | 1.599 | 1.599 | 1.599 | 1.599 | 100.0% | 1 | | total | 8.408 | 8.408 | 8.408 | 8.408 | 8.408 | 8.408 | 100.0% | 1 | | -> duration | 6.408 | 6.408 | 6.408 | 6.408 | 6.408 | 6.408 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.408337 Full duration: 18.22176 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task f9226ee1-6f48-4b41-a36a-5319eb2bb700 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.595 | 0.595 | 0.595 | 0.595 | 0.595 | 0.595 | 100.0% | 1 | | total | 0.595 | 0.595 | 0.595 | 0.595 | 0.595 | 0.595 | 100.0% | 1 | | -> duration | 0.595 | 0.595 | 0.595 | 0.595 | 0.595 | 0.595 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.594935 Full duration: 8.507054 HINTS: * To plot HTML graphics with this data, run: rally task report f9226ee1-6f48-4b41-a36a-5319eb2bb700 --out output.html * To generate a JUnit report, run: rally task export f9226ee1-6f48-4b41-a36a-5319eb2bb700 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report f9226ee1-6f48-4b41-a36a-5319eb2bb700 --json --out output.json 2018-03-06 09:27:12,449 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'f9226ee1-6f48-4b41-a36a-5319eb2bb700'] 2018-03-06 09:27:13,220 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-06 09:27:13,220 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'f9226ee1-6f48-4b41-a36a-5319eb2bb700', '--out', u'/home/opnfv/functest/results/rally/opnfv-heat.html'] 2018-03-06 09:27:13,227 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2018-03-06 09:27:13,228 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2018-03-06 09:27:13,228 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-keystone.yaml 2018-03-06 09:27:13,228 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-06 09:27:13,267 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-06 09:27:13,279 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['keystone'], 'concurrency': 4, 'netid': 'ea11d414-ea4b-4af7-aab2-1adf0209cd2e', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-e784bc05-196f-4255-bde7-140c90894ec0', 'flavor_name': 'rally-tiny-e784bc05-196f-4255-bde7-140c90894ec0', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-e784bc05-196f-4255-bde7-140c90894ec0', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-06 09:30:29,356 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : a2c730d8-0fb9-4d6e-a01c-c7bf2de3fb08 2018-03-06 09:30:29,356 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'a2c730d8-0fb9-4d6e-a01c-c7bf2de3fb08'] 2018-03-06 09:30:30,230 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task a2c730d8-0fb9-4d6e-a01c-c7bf2de3fb08: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task a2c730d8-0fb9-4d6e-a01c-c7bf2de3fb08 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.5 | 0.5 | 0.5 | 0.5 | 0.5 | 0.5 | 100.0% | 1 | | keystone_v3.add_role | 0.123 | 0.123 | 0.123 | 0.123 | 0.123 | 0.123 | 100.0% | 1 | | keystone_v3.revoke_role | 0.137 | 0.137 | 0.137 | 0.137 | 0.137 | 0.137 | 100.0% | 1 | | total | 0.76 | 0.76 | 0.76 | 0.76 | 0.76 | 0.76 | 100.0% | 1 | | -> duration | 0.76 | 0.76 | 0.76 | 0.76 | 0.76 | 0.76 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.760086 Full duration: 14.686155 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task a2c730d8-0fb9-4d6e-a01c-c7bf2de3fb08 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.492 | 0.492 | 0.492 | 0.492 | 0.492 | 0.492 | 100.0% | 1 | | keystone_v3.add_role | 0.129 | 0.129 | 0.129 | 0.129 | 0.129 | 0.129 | 100.0% | 1 | | keystone_v3.list_roles | 0.098 | 0.098 | 0.098 | 0.098 | 0.098 | 0.098 | 100.0% | 1 | | total | 0.72 | 0.72 | 0.72 | 0.72 | 0.72 | 0.72 | 100.0% | 1 | | -> duration | 0.72 | 0.72 | 0.72 | 0.72 | 0.72 | 0.72 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.719598 Full duration: 14.524582 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task a2c730d8-0fb9-4d6e-a01c-c7bf2de3fb08 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.672 | 0.672 | 0.672 | 0.672 | 0.672 | 0.672 | 100.0% | 1 | | keystone_v3.list_projects | 0.076 | 0.076 | 0.076 | 0.076 | 0.076 | 0.076 | 100.0% | 1 | | total | 0.748 | 0.748 | 0.748 | 0.748 | 0.748 | 0.748 | 100.0% | 1 | | -> duration | 0.748 | 0.748 | 0.748 | 0.748 | 0.748 | 0.748 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.74843 Full duration: 14.578249 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task a2c730d8-0fb9-4d6e-a01c-c7bf2de3fb08 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.594 | 0.594 | 0.594 | 0.594 | 0.594 | 0.594 | 100.0% | 1 | | keystone_v3.delete_role | 0.109 | 0.109 | 0.109 | 0.109 | 0.109 | 0.109 | 100.0% | 1 | | total | 0.703 | 0.703 | 0.703 | 0.703 | 0.703 | 0.703 | 100.0% | 1 | | -> duration | 0.703 | 0.703 | 0.703 | 0.703 | 0.703 | 0.703 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.70262 Full duration: 12.28913 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task a2c730d8-0fb9-4d6e-a01c-c7bf2de3fb08 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.584 | 0.584 | 0.584 | 0.584 | 0.584 | 0.584 | 100.0% | 1 | | keystone_v3.delete_service | 0.108 | 0.108 | 0.108 | 0.108 | 0.108 | 0.108 | 100.0% | 1 | | total | 0.693 | 0.693 | 0.693 | 0.693 | 0.693 | 0.693 | 100.0% | 1 | | -> duration | 0.693 | 0.693 | 0.693 | 0.693 | 0.693 | 0.693 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.693089 Full duration: 12.559353 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task a2c730d8-0fb9-4d6e-a01c-c7bf2de3fb08 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.675 | 0.675 | 0.675 | 0.675 | 0.675 | 0.675 | 100.0% | 1 | | keystone_v3.create_user | 0.494 | 0.494 | 0.494 | 0.494 | 0.494 | 0.494 | 100.0% | 1 | | -> keystone_v3.list_roles | 0.086 | 0.086 | 0.086 | 0.086 | 0.086 | 0.086 | 100.0% | 1 | | -> keystone_v3.add_role | 0.132 | 0.132 | 0.132 | 0.132 | 0.132 | 0.132 | 100.0% | 1 | | keystone_v3.create_role | 0.111 | 0.111 | 0.111 | 0.111 | 0.111 | 0.111 | 100.0% | 1 | | keystone_v3.get_project | 0.088 | 0.088 | 0.088 | 0.088 | 0.088 | 0.088 | 100.0% | 1 | | keystone_v3.get_user | 0.106 | 0.106 | 0.106 | 0.106 | 0.106 | 0.106 | 100.0% | 1 | | keystone_v3.get_role | 0.082 | 0.082 | 0.082 | 0.082 | 0.082 | 0.082 | 100.0% | 1 | | keystone_v3.list_services | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 100.0% | 1 | | keystone_v3.get_services | 0.09 | 0.09 | 0.09 | 0.09 | 0.09 | 0.09 | 100.0% | 1 | | total | 1.839 | 1.839 | 1.839 | 1.839 | 1.839 | 1.839 | 100.0% | 1 | | -> duration | 1.839 | 1.839 | 1.839 | 1.839 | 1.839 | 1.839 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.839066 Full duration: 19.694929 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task a2c730d8-0fb9-4d6e-a01c-c7bf2de3fb08 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.667 | 0.667 | 0.667 | 0.667 | 0.667 | 0.667 | 100.0% | 1 | | keystone_v3.update_project | 0.192 | 0.192 | 0.192 | 0.192 | 0.192 | 0.192 | 100.0% | 1 | | keystone_v3.delete_project | 0.163 | 0.163 | 0.163 | 0.163 | 0.163 | 0.163 | 100.0% | 1 | | total | 1.023 | 1.023 | 1.023 | 1.023 | 1.023 | 1.023 | 100.0% | 1 | | -> duration | 1.023 | 1.023 | 1.023 | 1.023 | 1.023 | 1.023 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.023013 Full duration: 12.651472 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task a2c730d8-0fb9-4d6e-a01c-c7bf2de3fb08 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.678 | 0.678 | 0.678 | 0.678 | 0.678 | 0.678 | 100.0% | 1 | | total | 0.771 | 0.771 | 0.771 | 0.771 | 0.771 | 0.771 | 100.0% | 1 | | -> duration | 0.771 | 0.771 | 0.771 | 0.771 | 0.771 | 0.771 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.770846 Full duration: 14.636353 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task a2c730d8-0fb9-4d6e-a01c-c7bf2de3fb08 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.673 | 0.673 | 0.673 | 0.673 | 0.673 | 0.673 | 100.0% | 1 | | total | 0.673 | 0.673 | 0.673 | 0.673 | 0.673 | 0.673 | 100.0% | 1 | | -> duration | 0.673 | 0.673 | 0.673 | 0.673 | 0.673 | 0.673 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.673097 Full duration: 14.531074 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task a2c730d8-0fb9-4d6e-a01c-c7bf2de3fb08 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.767 | 0.767 | 0.767 | 0.767 | 0.767 | 0.767 | 100.0% | 1 | | keystone_v3.list_users | 0.107 | 0.107 | 0.107 | 0.107 | 0.107 | 0.107 | 100.0% | 1 | | total | 1.053 | 1.053 | 1.053 | 1.053 | 1.053 | 1.053 | 100.0% | 1 | | -> duration | 1.053 | 1.053 | 1.053 | 1.053 | 1.053 | 1.053 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.05275 Full duration: 14.83754 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "users_per_tenant": 10 }, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task a2c730d8-0fb9-4d6e-a01c-c7bf2de3fb08 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.667 | 0.667 | 0.667 | 0.667 | 0.667 | 0.667 | 100.0% | 1 | | keystone_v3.create_users | 4.836 | 4.836 | 4.836 | 4.836 | 4.836 | 4.836 | 100.0% | 1 | | -> keystone_v3.create_user (x10) | 4.835 | 4.835 | 4.835 | 4.835 | 4.835 | 4.835 | 100.0% | 1 | | --> keystone_v3.list_roles (x10) | 0.809 | 0.809 | 0.809 | 0.809 | 0.809 | 0.809 | 100.0% | 1 | | --> keystone_v3.add_role (x10) | 1.238 | 1.238 | 1.238 | 1.238 | 1.238 | 1.238 | 100.0% | 1 | | total | 6.46 | 6.46 | 6.46 | 6.46 | 6.46 | 6.46 | 100.0% | 1 | | -> duration | 6.46 | 6.46 | 6.46 | 6.46 | 6.46 | 6.46 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.460166 Full duration: 22.7644 HINTS: * To plot HTML graphics with this data, run: rally task report a2c730d8-0fb9-4d6e-a01c-c7bf2de3fb08 --out output.html * To generate a JUnit report, run: rally task export a2c730d8-0fb9-4d6e-a01c-c7bf2de3fb08 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report a2c730d8-0fb9-4d6e-a01c-c7bf2de3fb08 --json --out output.json 2018-03-06 09:30:30,230 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'a2c730d8-0fb9-4d6e-a01c-c7bf2de3fb08'] 2018-03-06 09:30:31,128 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-06 09:30:31,128 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'a2c730d8-0fb9-4d6e-a01c-c7bf2de3fb08', '--out', u'/home/opnfv/functest/results/rally/opnfv-keystone.html'] 2018-03-06 09:30:31,136 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2018-03-06 09:30:31,136 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2018-03-06 09:30:31,136 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-neutron.yaml 2018-03-06 09:30:31,137 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-06 09:30:31,178 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-06 09:30:31,190 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['neutron'], 'concurrency': 4, 'netid': 'ea11d414-ea4b-4af7-aab2-1adf0209cd2e', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-e784bc05-196f-4255-bde7-140c90894ec0', 'flavor_name': 'rally-tiny-e784bc05-196f-4255-bde7-140c90894ec0', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-e784bc05-196f-4255-bde7-140c90894ec0', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-06 09:35:20,498 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 1521b927-f681-4cb9-852e-b5e8b0c2f098 2018-03-06 09:35:20,498 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '1521b927-f681-4cb9-852e-b5e8b0c2f098'] 2018-03-06 09:35:21,472 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 1521b927-f681-4cb9-852e-b5e8b0c2f098: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } } } -------------------------------------------------------------------------------- Task 1521b927-f681-4cb9-852e-b5e8b0c2f098 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.007 | 1.007 | 1.007 | 1.007 | 1.007 | 1.007 | 100.0% | 1 | | neutron.delete_network | 0.851 | 0.851 | 0.851 | 0.851 | 0.851 | 0.851 | 100.0% | 1 | | total | 1.858 | 1.858 | 1.858 | 1.858 | 1.858 | 1.858 | 100.0% | 1 | | -> duration | 1.858 | 1.858 | 1.858 | 1.858 | 1.858 | 1.858 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.857973 Full duration: 14.928749 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "port": -1 } } } } -------------------------------------------------------------------------------- Task 1521b927-f681-4cb9-852e-b5e8b0c2f098 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.417 | 1.417 | 1.417 | 1.417 | 1.417 | 1.417 | 100.0% | 1 | | neutron.delete_port | 0.652 | 0.652 | 0.652 | 0.652 | 0.652 | 0.652 | 100.0% | 1 | | total | 2.069 | 2.069 | 2.069 | 2.069 | 2.069 | 2.069 | 100.0% | 1 | | -> duration | 2.069 | 2.069 | 2.069 | 2.069 | 2.069 | 2.069 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.068612 Full duration: 27.869676 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "router_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1, "router": -1 } } } } -------------------------------------------------------------------------------- Task 1521b927-f681-4cb9-852e-b5e8b0c2f098 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.971 | 0.971 | 0.971 | 0.971 | 0.971 | 0.971 | 100.0% | 1 | | neutron.create_subnet | 0.719 | 0.719 | 0.719 | 0.719 | 0.719 | 0.719 | 100.0% | 1 | | neutron.create_router | 0.286 | 0.286 | 0.286 | 0.286 | 0.286 | 0.286 | 100.0% | 1 | | neutron.add_interface_router | 1.575 | 1.575 | 1.575 | 1.575 | 1.575 | 1.575 | 100.0% | 1 | | neutron.remove_interface_router | 0.996 | 0.996 | 0.996 | 0.996 | 0.996 | 0.996 | 100.0% | 1 | | neutron.delete_router | 0.439 | 0.439 | 0.439 | 0.439 | 0.439 | 0.439 | 100.0% | 1 | | total | 4.987 | 4.987 | 4.987 | 4.987 | 4.987 | 4.987 | 100.0% | 1 | | -> duration | 4.987 | 4.987 | 4.987 | 4.987 | 4.987 | 4.987 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.98676 Full duration: 40.564121 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1 } } } } -------------------------------------------------------------------------------- Task 1521b927-f681-4cb9-852e-b5e8b0c2f098 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 1.224 | 1.224 | 1.224 | 1.224 | 1.224 | 1.224 | 100.0% | 1 | | neutron.delete_subnet | 0.628 | 0.628 | 0.628 | 0.628 | 0.628 | 0.628 | 100.0% | 1 | | total | 1.852 | 1.852 | 1.852 | 1.852 | 1.852 | 1.852 | 100.0% | 1 | | -> duration | 1.852 | 1.852 | 1.852 | 1.852 | 1.852 | 1.852 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.85227 Full duration: 28.124901 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } } } -------------------------------------------------------------------------------- Task 1521b927-f681-4cb9-852e-b5e8b0c2f098 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.222 | 1.222 | 1.222 | 1.222 | 1.222 | 1.222 | 100.0% | 1 | | neutron.list_networks | 0.265 | 0.265 | 0.265 | 0.265 | 0.265 | 0.265 | 100.0% | 1 | | total | 1.488 | 1.488 | 1.488 | 1.488 | 1.488 | 1.488 | 100.0% | 1 | | -> duration | 1.488 | 1.488 | 1.488 | 1.488 | 1.488 | 1.488 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.487929 Full duration: 16.823757 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "port": -1 } } } } -------------------------------------------------------------------------------- Task 1521b927-f681-4cb9-852e-b5e8b0c2f098 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.407 | 1.407 | 1.407 | 1.407 | 1.407 | 1.407 | 100.0% | 1 | | neutron.list_ports | 0.251 | 0.251 | 0.251 | 0.251 | 0.251 | 0.251 | 100.0% | 1 | | total | 1.658 | 1.658 | 1.658 | 1.658 | 1.658 | 1.658 | 100.0% | 1 | | -> duration | 1.658 | 1.658 | 1.658 | 1.658 | 1.658 | 1.658 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.658179 Full duration: 32.754651 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "router_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } } } -------------------------------------------------------------------------------- Task 1521b927-f681-4cb9-852e-b5e8b0c2f098 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.819 | 0.819 | 0.819 | 0.819 | 0.819 | 0.819 | 100.0% | 1 | | neutron.create_subnet | 0.867 | 0.867 | 0.867 | 0.867 | 0.867 | 0.867 | 100.0% | 1 | | neutron.create_router | 0.344 | 0.344 | 0.344 | 0.344 | 0.344 | 0.344 | 100.0% | 1 | | neutron.add_interface_router | 1.52 | 1.52 | 1.52 | 1.52 | 1.52 | 1.52 | 100.0% | 1 | | neutron.list_routers | 0.222 | 0.222 | 0.222 | 0.222 | 0.222 | 0.222 | 100.0% | 1 | | total | 3.772 | 3.772 | 3.772 | 3.772 | 3.772 | 3.772 | 100.0% | 1 | | -> duration | 3.772 | 3.772 | 3.772 | 3.772 | 3.772 | 3.772 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.772262 Full duration: 37.919993 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1 } } } } -------------------------------------------------------------------------------- Task 1521b927-f681-4cb9-852e-b5e8b0c2f098 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 11.178406 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } } } -------------------------------------------------------------------------------- Task 1521b927-f681-4cb9-852e-b5e8b0c2f098 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.934 | 0.934 | 0.934 | 0.934 | 0.934 | 0.934 | 100.0% | 1 | | neutron.delete_security_group | 0.462 | 0.462 | 0.462 | 0.462 | 0.462 | 0.462 | 100.0% | 1 | | total | 1.396 | 1.396 | 1.396 | 1.396 | 1.396 | 1.396 | 100.0% | 1 | | -> duration | 1.396 | 1.396 | 1.396 | 1.396 | 1.396 | 1.396 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.396172 Full duration: 14.249361 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } } } -------------------------------------------------------------------------------- Task 1521b927-f681-4cb9-852e-b5e8b0c2f098 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.929 | 0.929 | 0.929 | 0.929 | 0.929 | 0.929 | 100.0% | 1 | | neutron.create_security_group_rule | 0.34 | 0.34 | 0.34 | 0.34 | 0.34 | 0.34 | 100.0% | 1 | | neutron.delete_security_group_rule | 0.393 | 0.393 | 0.393 | 0.393 | 0.393 | 0.393 | 100.0% | 1 | | neutron.delete_security_group | 0.289 | 0.289 | 0.289 | 0.289 | 0.289 | 0.289 | 100.0% | 1 | | total | 1.952 | 1.952 | 1.952 | 1.952 | 1.952 | 1.952 | 100.0% | 1 | | -> duration | 1.952 | 1.952 | 1.952 | 1.952 | 1.952 | 1.952 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.952147 Full duration: 14.990137 -------------------------------------------------------------------------------- test scenario NeutronNetworks.set_and_clear_router_gateway args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": { "router:external": true } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "router": -1 } }, "roles": [ "admin" ] } } -------------------------------------------------------------------------------- Task 1521b927-f681-4cb9-852e-b5e8b0c2f098 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.01 | 1.01 | 1.01 | 1.01 | 1.01 | 1.01 | 100.0% | 1 | | neutron.create_router | 0.32 | 0.32 | 0.32 | 0.32 | 0.32 | 0.32 | 100.0% | 1 | | neutron.add_gateway_router | 1.4 | 1.4 | 1.4 | 1.4 | 1.4 | 1.4 | 100.0% | 1 | | neutron.remove_gateway_router | 0.89 | 0.89 | 0.89 | 0.89 | 0.89 | 0.89 | 100.0% | 1 | | total | 3.621 | 3.621 | 3.621 | 3.621 | 3.621 | 3.621 | 100.0% | 1 | | -> duration | 3.621 | 3.621 | 3.621 | 3.621 | 3.621 | 3.621 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.620901 Full duration: 23.830008 HINTS: * To plot HTML graphics with this data, run: rally task report 1521b927-f681-4cb9-852e-b5e8b0c2f098 --out output.html * To generate a JUnit report, run: rally task export 1521b927-f681-4cb9-852e-b5e8b0c2f098 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 1521b927-f681-4cb9-852e-b5e8b0c2f098 --json --out output.json 2018-03-06 09:35:21,473 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '1521b927-f681-4cb9-852e-b5e8b0c2f098'] 2018-03-06 09:35:22,572 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-06 09:35:22,573 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '1521b927-f681-4cb9-852e-b5e8b0c2f098', '--out', u'/home/opnfv/functest/results/rally/opnfv-neutron.html'] 2018-03-06 09:35:22,580 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2018-03-06 09:35:22,580 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2018-03-06 09:35:22,580 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-nova.yaml 2018-03-06 09:35:22,581 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-06 09:35:22,620 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-06 09:35:22,633 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['nova'], 'concurrency': 4, 'netid': 'ea11d414-ea4b-4af7-aab2-1adf0209cd2e', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-e784bc05-196f-4255-bde7-140c90894ec0', 'flavor_name': 'rally-tiny-e784bc05-196f-4255-bde7-140c90894ec0', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-e784bc05-196f-4255-bde7-140c90894ec0', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-06 09:38:28,766 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : b9171156-4be2-4a6e-aa71-f99f6b96587c 2018-03-06 09:38:28,767 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'b9171156-4be2-4a6e-aa71-f99f6b96587c'] 2018-03-06 09:38:29,688 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task b9171156-4be2-4a6e-aa71-f99f6b96587c: aborted -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_live_migrate_server args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-e784bc05-196f-4255-bde7-140c90894ec0" }, "image": { "name": "Cirros-0.4.0-e784bc05-196f-4255-bde7-140c90894ec0" }, "block_migration": false, "nics": [ { "net-id": "ea11d414-ea4b-4af7-aab2-1adf0209cd2e" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task b9171156-4be2-4a6e-aa71-f99f6b96587c has 1 error(s) -------------------------------------------------------------------------------- RallyException: Live Migration failed: Migration complete but instance did not change host: overcloud-novacompute-1.opnfvlf.org Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally/plugins/openstack/scenarios/nova/servers.py", line 722, in run block_migration, disk_over_commit) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 87, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally/plugins/openstack/scenarios/nova/utils.py", line 770, in _live_migrate "but instance did not change host: %s" % host_pre_migrate) RallyException: Live Migration failed: Migration complete but instance did not change host: overcloud-novacompute-1.opnfvlf.org -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 9.524 | 9.524 | 9.524 | 9.524 | 9.524 | 9.524 | 100.0% | 1 | | nova.find_host_to_migrate | 1.404 | 1.404 | 1.404 | 1.404 | 1.404 | 1.404 | 100.0% | 1 | | nova.live_migrate | 135.444 | 135.444 | 135.444 | 135.444 | 135.444 | 135.444 | 0.0% | 1 | | total | 146.372 | 146.372 | 146.372 | 146.372 | 146.372 | 146.372 | 0.0% | 1 | | -> duration | 145.372 | 145.372 | 145.372 | 145.372 | 145.372 | 145.372 | 0.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 145.372222 Full duration: 161.204698 HINTS: * To plot HTML graphics with this data, run: rally task report b9171156-4be2-4a6e-aa71-f99f6b96587c --out output.html * To generate a JUnit report, run: rally task export b9171156-4be2-4a6e-aa71-f99f6b96587c --type junit --to output.xml * To get raw JSON output of task results, run: rally task report b9171156-4be2-4a6e-aa71-f99f6b96587c --json --out output.json 2018-03-06 09:38:29,688 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'b9171156-4be2-4a6e-aa71-f99f6b96587c'] 2018-03-06 09:38:30,610 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-06 09:38:30,611 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'b9171156-4be2-4a6e-aa71-f99f6b96587c', '--out', u'/home/opnfv/functest/results/rally/opnfv-nova.html'] 2018-03-06 09:38:30,618 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2018-03-06 09:38:30,618 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2018-03-06 09:38:30,618 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-quotas.yaml 2018-03-06 09:38:30,619 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-06 09:38:30,661 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-06 09:38:30,673 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['quotas'], 'concurrency': 4, 'netid': 'ea11d414-ea4b-4af7-aab2-1adf0209cd2e', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-e784bc05-196f-4255-bde7-140c90894ec0', 'flavor_name': 'rally-tiny-e784bc05-196f-4255-bde7-140c90894ec0', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-e784bc05-196f-4255-bde7-140c90894ec0', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-06 09:39:23,505 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 21f25b25-00ba-43ac-a28d-b5fbaae9479a 2018-03-06 09:39:23,506 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '21f25b25-00ba-43ac-a28d-b5fbaae9479a'] 2018-03-06 09:39:24,449 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 21f25b25-00ba-43ac-a28d-b5fbaae9479a: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 21f25b25-00ba-43ac-a28d-b5fbaae9479a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.718 | 0.718 | 0.718 | 0.718 | 0.718 | 0.718 | 100.0% | 1 | | quotas.delete_quotas | 0.278 | 0.278 | 0.278 | 0.278 | 0.278 | 0.278 | 100.0% | 1 | | total | 0.996 | 0.996 | 0.996 | 0.996 | 0.996 | 0.996 | 100.0% | 1 | | -> duration | 0.996 | 0.996 | 0.996 | 0.996 | 0.996 | 0.996 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.996238 Full duration: 8.766233 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 21f25b25-00ba-43ac-a28d-b5fbaae9479a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.688 | 0.688 | 0.688 | 0.688 | 0.688 | 0.688 | 100.0% | 1 | | total | 0.688 | 0.688 | 0.688 | 0.688 | 0.688 | 0.688 | 100.0% | 1 | | -> duration | 0.688 | 0.688 | 0.688 | 0.688 | 0.688 | 0.688 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.688125 Full duration: 8.735625 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 21f25b25-00ba-43ac-a28d-b5fbaae9479a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.345 | 0.345 | 0.345 | 0.345 | 0.345 | 0.345 | 100.0% | 1 | | total | 0.746 | 0.746 | 0.746 | 0.746 | 0.746 | 0.746 | 100.0% | 1 | | -> duration | 0.746 | 0.746 | 0.746 | 0.746 | 0.746 | 0.746 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.745684 Full duration: 8.526812 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 21f25b25-00ba-43ac-a28d-b5fbaae9479a has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.904 | 0.904 | 0.904 | 0.904 | 0.904 | 0.904 | 100.0% | 1 | | total | 0.904 | 0.904 | 0.904 | 0.904 | 0.904 | 0.904 | 100.0% | 1 | | -> duration | 0.904 | 0.904 | 0.904 | 0.904 | 0.904 | 0.904 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.903981 Full duration: 8.809565 HINTS: * To plot HTML graphics with this data, run: rally task report 21f25b25-00ba-43ac-a28d-b5fbaae9479a --out output.html * To generate a JUnit report, run: rally task export 21f25b25-00ba-43ac-a28d-b5fbaae9479a --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 21f25b25-00ba-43ac-a28d-b5fbaae9479a --json --out output.json 2018-03-06 09:39:24,450 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '21f25b25-00ba-43ac-a28d-b5fbaae9479a'] 2018-03-06 09:39:25,292 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-06 09:39:25,292 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '21f25b25-00ba-43ac-a28d-b5fbaae9479a', '--out', u'/home/opnfv/functest/results/rally/opnfv-quotas.html'] 2018-03-06 09:39:25,299 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2018-03-06 09:39:25,303 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:45 | 6 | 100.00% | | glance | 01:22 | 4 | 100.00% | | cinder | 02:48 | 10 | 100.00% | | heat | 01:03 | 4 | 100.00% | | keystone | 02:47 | 11 | 100.00% | | neutron | 04:23 | 10 | 100.00% | | nova | 02:41 | 1 | 0.00% | | quotas | 00:34 | 4 | 100.00% | | | | | | | TOTAL: | 00:16:26 | 50 | 98.00% | +----------------+------------+----------------+-----------+ 2018-03-06 09:39:25,303 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_sanity' success_rate is 98.00% 2018-03-06 09:39:32,771 - xtesting.energy.energy - DEBUG - Restoring previous scenario (refstack_defcore/running) 2018-03-06 09:39:32,771 - xtesting.energy.energy - DEBUG - Submitting scenario (refstack_defcore/running) 2018-03-06 09:39:33,383 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-06 09:39:33,383 - xtesting.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | rally_sanity | functest | 20:11 | FAIL | +----------------------+------------------+------------------+----------------+ 2018-03-06 09:39:33,387 - xtesting.ci.run_tests - ERROR - The test case 'rally_sanity' failed. 2018-03-06 09:39:33,387 - xtesting.ci.run_tests - INFO - Running test case 'refstack_defcore'... 2018-03-06 09:39:33,500 - xtesting.energy.energy - DEBUG - Getting current scenario 2018-03-06 09:39:33,993 - xtesting.energy.energy - DEBUG - Starting recording 2018-03-06 09:39:33,993 - xtesting.energy.energy - DEBUG - Submitting scenario (refstack_defcore/running) 2018-03-06 09:39:34,403 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating project and user for Tempest suite 2018-03-06 09:39:36,208 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-03-06 09:39:40,326 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating image for Tempest suite 2018-03-06 09:39:42,765 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating 2nd image for Tempest suite 2018-03-06 09:39:45,275 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating flavor for Tempest suite 2018-03-06 09:39:45,920 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating 2nd flavor for Tempest suite 2018-03-06 09:39:46,532 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-03-06 09:39:48,778 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment create --fromenv --name=opnfv-rally' 2018-03-06 09:39:50,993 - functest.utils.functest_utils - DEBUG - Executing command: 'rally deployment check' 2018-03-06 09:39:54,199 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-03-06 09:39:56,331 - functest.utils.functest_utils - DEBUG - Executing command: 'rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide' 2018-03-06 09:40:02,059 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Configuring the verifier... 2018-03-06 09:40:02,059 - functest.utils.functest_utils - DEBUG - Executing command: 'rally verify configure-verifier' 2018-03-06 09:40:05,040 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-03-06 09:40:05,041 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-03-06 09:40:05,043 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-03-06 09:40:05,046 - functest.opnfv_tests.openstack.refstack_client.refstack_client - DEBUG - Updating selected tempest.conf parameters for defcore... 2018-03-06 09:40:05,048 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add needed params into test_accounts.yaml... 2018-03-06 09:40:05,052 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - Starting Refstack_defcore test case: '['refstack-client', 'test', '-c', u'/home/opnfv/functest/results/refstack/refstack_tempest.conf', '-v', '--test-list', u'/home/opnfv/functest/data/refstack/defcore.txt']'. 2018-03-06 09:51:26,441 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors [0.235681s] ... ok 2018-03-06 09:51:26,442 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail [0.069291s] ... ok 2018-03-06 09:51:26,442 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image [17.666201s] ... ok 2018-03-06 09:51:26,442 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name [1.024246s] ... ok 2018-03-06 09:51:26,442 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user [0.210362s] ... ok 2018-03-06 09:51:26,442 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server [7.708415s] ... ok 2018-03-06 09:51:26,442 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action [0.053219s] ... ok 2018-03-06 09:51:26,442 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions [3.430210s] ... ok 2018-03-06 09:51:26,442 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor [0.652946s] ... ok 2018-03-06 09:51:26,442 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image [0.538689s] ... ok 2018-03-06 09:51:26,443 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name [0.617805s] ... ok 2018-03-06 09:51:26,443 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status [0.701776s] ... ok 2018-03-06 09:51:26,443 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results [0.809599s] ... ok 2018-03-06 09:51:26,443 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_active_status [0.069749s] ... ok 2018-03-06 09:51:26,443 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor [0.076011s] ... ok 2018-03-06 09:51:26,443 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image [0.069770s] ... ok 2018-03-06 09:51:26,443 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit [0.067299s] ... ok 2018-03-06 09:51:26,443 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name [0.073603s] ... ok 2018-03-06 09:51:26,443 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard [0.146465s] ... ok 2018-03-06 09:51:26,444 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date [0.069993s] ... ok 2018-03-06 09:51:26,444 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date [0.012084s] ... ok 2018-03-06 09:51:26,444 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count [0.139402s] ... ok 2018-03-06 09:51:26,444 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value [0.012770s] ... ok 2018-03-06 09:51:26,444 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string [0.013473s] ... ok 2018-03-06 09:51:26,444 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor [0.028754s] ... ok 2018-03-06 09:51:26,444 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image [0.061217s] ... ok 2018-03-06 09:51:26,444 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name [0.080675s] ... ok 2018-03-06 09:51:26,444 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted [0.431582s] ... ok 2018-03-06 09:51:26,444 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing [0.014635s] ... ok 2018-03-06 09:51:26,445 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server [0.071039s] ... ok 2018-03-06 09:51:26,445 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item [0.366258s] ... ok 2018-03-06 09:51:26,445 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item [0.211963s] ... ok 2018-03-06 09:51:26,445 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata [0.208643s] ... ok 2018-03-06 09:51:26,445 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata [0.351026s] ... ok 2018-03-06 09:51:26,445 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item [0.361325s] ... ok 2018-03-06 09:51:26,445 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata [0.386046s] ... ok 2018-03-06 09:51:26,445 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password [3.735119s] ... ok 2018-03-06 09:51:26,445 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair [10.281032s] ... ok 2018-03-06 09:51:26,445 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name [14.451729s] ... ok 2018-03-06 09:51:26,446 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address [9.860981s] ... ok 2018-03-06 09:51:26,446 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name [55.614081s] ... ok 2018-03-06 09:51:26,446 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name [1.173675s] ... ok 2018-03-06 09:51:26,446 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit [1.291356s] ... ok 2018-03-06 09:51:26,446 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 [1.457041s] ... ok 2018-03-06 09:51:26,446 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor [1.494077s] ... ok 2018-03-06 09:51:26,446 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image [1.179603s] ... ok 2018-03-06 09:51:26,446 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid [1.697822s] ... ok 2018-03-06 09:51:26,446 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit [0.817477s] ... ok 2018-03-06 09:51:26,446 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id [0.523563s] ... ok 2018-03-06 09:51:26,447 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server [0.524572s] ... ok 2018-03-06 09:51:26,447 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address [2.118576s] ... ok 2018-03-06 09:51:26,447 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server [0.673409s] ... ok 2018-03-06 09:51:26,447 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_deleted_server [0.381132s] ... ok 2018-03-06 09:51:26,447 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server [1.544087s] ... ok 2018-03-06 09:51:26,447 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank [1.604228s] ... ok 2018-03-06 09:51:26,447 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server [0.544988s] ... ok 2018-03-06 09:51:26,447 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server [0.764530s] ... ok 2018-03-06 09:51:26,447 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 [0.547175s] ... ok 2018-03-06 09:51:26,447 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name [0.408430s] ... ok 2018-03-06 09:51:26,448 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas [0.339638s] ... ok 2018-03-06 09:51:26,448 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas [0.353615s] ... ok 2018-03-06 09:51:26,448 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.compute.test_versions.TestVersions.test_list_api_versions [0.011214s] ... ok 2018-03-06 09:51:26,448 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types [0.076117s] ... ok 2018-03-06 09:51:26,448 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources [0.068907s] ... ok 2018-03-06 09:51:26,448 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses [0.074714s] ... ok 2018-03-06 09:51:26,448 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token [0.315486s] ... ok 2018-03-06 09:51:26,448 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image [0.817221s] ... ok 2018-03-06 09:51:26,448 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image [1.626789s] ... ok 2018-03-06 09:51:26,448 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_image_schema [0.164497s] ... ok 2018-03-06 09:51:26,449 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_images_schema [0.154841s] ... ok 2018-03-06 09:51:26,449 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_container_format [0.195973s] ... ok 2018-03-06 09:51:26,449 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_disk_format [0.035033s] ... ok 2018-03-06 09:51:26,449 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_limit [0.186398s] ... ok 2018-03-06 09:51:26,449 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_min_max_size [0.050589s] ... ok 2018-03-06 09:51:26,449 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_size [0.352767s] ... ok 2018-03-06 09:51:26,449 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_status [0.573874s] ... ok 2018-03-06 09:51:26,449 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_visibility [0.039559s] ... ok 2018-03-06 09:51:26,449 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_no_params [0.185500s] ... ok 2018-03-06 09:51:26,449 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id [0.159768s] ... ok 2018-03-06 09:51:26,450 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image [0.150051s] ... ok 2018-03-06 09:51:26,450 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image [0.751097s] ... ok 2018-03-06 09:51:26,450 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id [0.156205s] ... ok 2018-03-06 09:51:26,450 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image [0.015719s] ... ok 2018-03-06 09:51:26,450 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image [1.089128s] ... ok 2018-03-06 09:51:26,450 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag [0.632339s] ... ok 2018-03-06 09:51:26,450 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image [0.173381s] ... ok 2018-03-06 09:51:26,450 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes [4.292108s] ... ok 2018-03-06 09:51:26,450 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools [4.348717s] ... ok 2018-03-06 09:51:26,450 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled [5.172679s] ... ok 2018-03-06 09:51:26,451 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw [5.629683s] ... ok 2018-03-06 09:51:26,451 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools [3.214681s] ... ok 2018-03-06 09:51:26,451 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers [5.726702s] ... ok 2018-03-06 09:51:26,451 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway [3.970053s] ... ok 2018-03-06 09:51:26,451 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet [5.817790s] ... ok 2018-03-06 09:51:26,451 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet [3.789028s] ... ok 2018-03-06 09:51:26,451 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_list_networks [0.106652s] ... ok 2018-03-06 09:51:26,451 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields [0.630389s] ... ok 2018-03-06 09:51:26,451 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets [0.057075s] ... ok 2018-03-06 09:51:26,451 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields [0.570681s] ... ok 2018-03-06 09:51:26,452 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_show_network [0.254177s] ... ok 2018-03-06 09:51:26,452 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_show_network_fields [0.630114s] ... ok 2018-03-06 09:51:26,452 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet [0.053475s] ... ok 2018-03-06 09:51:26,452 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields [0.071939s] ... ok 2018-03-06 09:51:26,452 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp [5.919464s] ... ok 2018-03-06 09:51:26,452 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port [3.984868s] ... ok 2018-03-06 09:51:26,452 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools [5.860437s] ... ok 2018-03-06 09:51:26,452 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port [1.877674s] ... ok 2018-03-06 09:51:26,452 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_ports.PortsTestJSON.test_list_ports [0.057376s] ... ok 2018-03-06 09:51:26,452 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields [0.572489s] ... ok 2018-03-06 09:51:26,452 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_ports.PortsTestJSON.test_show_port [0.199659s] ... ok 2018-03-06 09:51:26,453 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields [0.197026s] ... ok 2018-03-06 09:51:26,453 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group [1.765955s] ... ok 2018-03-06 09:51:26,453 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args [1.480784s] ... ok 2018-03-06 09:51:26,453 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code [4.138748s] ... ok 2018-03-06 09:51:26,453 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value [1.284357s] ... ok 2018-03-06 09:51:26,453 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id [1.418648s] ... ok 2018-03-06 09:51:26,453 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix [1.487856s] ... ok 2018-03-06 09:51:26,453 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule [2.470195s] ... ok 2018-03-06 09:51:26,453 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups [0.194423s] ... ok 2018-03-06 09:51:26,453 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails [0.168898s] ... ok 2018-03-06 09:51:26,453 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails [1.646650s] ... ok 2018-03-06 09:51:26,454 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype [1.027289s] ... ok 2018-03-06 09:51:26,454 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol [0.962682s] ... ok 2018-03-06 09:51:26,454 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix [1.377973s] ... ok 2018-03-06 09:51:26,454 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports [1.619766s] ... ok 2018-03-06 09:51:26,454 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid [0.789338s] ... ok 2018-03-06 09:51:26,454 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group [0.094716s] ... ok 2018-03-06 09:51:26,454 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group [0.023730s] ... ok 2018-03-06 09:51:26,454 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group [0.017885s] ... ok 2018-03-06 09:51:26,454 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule [0.016731s] ... ok 2018-03-06 09:51:26,454 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools [1.258977s] ... ok 2018-03-06 09:51:26,454 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON.test_get_availability_zone_list [0.164569s] ... ok 2018-03-06 09:51:26,455 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions [0.154465s] ... ok 2018-03-06 09:51:26,455 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata [0.959681s] ... ok 2018-03-06 09:51:26,455 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item [0.520581s] ... ok 2018-03-06 09:51:26,455 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata [1.145217s] ... ok 2018-03-06 09:51:26,455 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item [0.572926s] ... ok 2018-03-06 09:51:26,455 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_reserve_unreserve_volume [0.933896s] ... ok 2018-03-06 09:51:26,455 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_bootable [0.539882s] ... ok 2018-03-06 09:51:26,455 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_readonly_update [0.531001s] ... ok 2018-03-06 09:51:26,455 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_volume_upload [31.848924s] ... ok 2018-03-06 09:51:26,455 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete [7.796508s] ... ok 2018-03-06 09:51:26,456 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_as_clone [11.346730s] ... ok 2018-03-06 09:51:26,456 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image [12.948978s] ... ok 2018-03-06 09:51:26,456 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list [0.044749s] ... ok 2018-03-06 09:51:26,456 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name [0.041459s] ... ok 2018-03-06 09:51:26,456 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name [0.049360s] ... ok 2018-03-06 09:51:26,456 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination [0.575715s] ... ok 2018-03-06 09:51:26,456 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params [0.099922s] ... ok 2018-03-06 09:51:26,456 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination [0.388518s] ... ok 2018-03-06 09:51:26,456 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status [0.174927s] ... ok 2018-03-06 09:51:26,456 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status [0.057053s] ... ok 2018-03-06 09:51:26,456 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata [0.192599s] ... ok 2018-03-06 09:51:26,457 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details [0.052147s] ... ok 2018-03-06 09:51:26,457 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata [0.044534s] ... ok 2018-03-06 09:51:26,457 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone [0.078511s] ... ok 2018-03-06 09:51:26,457 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status [0.078326s] ... ok 2018-03-06 09:51:26,457 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone [0.049584s] ... ok 2018-03-06 09:51:26,457 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status [0.051414s] ... ok 2018-03-06 09:51:26,457 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size [0.162695s] ... ok 2018-03-06 09:51:26,457 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id [0.026873s] ... ok 2018-03-06 09:51:26,457 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid [0.177777s] ... ok 2018-03-06 09:51:26,457 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type [0.170313s] ... ok 2018-03-06 09:51:26,457 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative [0.158921s] ... ok 2018-03-06 09:51:26,458 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero [0.147597s] ... ok 2018-03-06 09:51:26,458 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size [0.195998s] ... ok 2018-03-06 09:51:26,458 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id [0.036197s] ... ok 2018-03-06 09:51:26,458 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id [0.009247s] ... ok 2018-03-06 09:51:26,458 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id [0.186462s] ... ok 2018-03-06 09:51:26,458 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id [0.010153s] ... ok 2018-03-06 09:51:26,458 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status [0.046440s] ... ok 2018-03-06 09:51:26,458 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name [0.046039s] ... ok 2018-03-06 09:51:26,458 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status [0.275015s] ... ok 2018-03-06 09:51:26,458 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name [0.035792s] ... ok 2018-03-06 09:51:26,458 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_negative_volume_status [0.330253s] ... ok 2018-03-06 09:51:26,459 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_nonexistent_volume_id [0.036887s] ... ok 2018-03-06 09:51:26,459 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_unreserve_volume_with_nonexistent_volume_id [0.032334s] ... ok 2018-03-06 09:51:26,459 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id [0.158953s] ... ok 2018-03-06 09:51:26,459 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id [0.039285s] ... ok 2018-03-06 09:51:26,459 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id [0.035970s] ... ok 2018-03-06 09:51:26,459 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id [0.039545s] ... ok 2018-03-06 09:51:26,459 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id [0.039014s] ... ok 2018-03-06 09:51:26,459 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete [3.711958s] ... ok 2018-03-06 09:51:26,459 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot [5.902595s] ... ok 2018-03-06 09:51:26,459 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_details_with_params [0.516200s] ... ok 2018-03-06 09:51:26,459 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_snapshots_list.VolumesSnapshotListTestJSON.test_snapshots_list_with_params [0.216835s] ... ok 2018-03-06 09:51:26,460 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_with_nonexistent_volume_id [0.193792s] ... ok 2018-03-06 09:51:26,460 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - {0} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_without_passing_volume_id [0.197770s] ... ok 2018-03-06 09:51:26,461 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - Ran: 192 tests in 677.0000 sec. 2018-03-06 09:51:26,462 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - - Passed: 188 2018-03-06 09:51:26,464 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - - Skipped: 0 2018-03-06 09:51:26,466 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - - Failed: 4 2018-03-06 09:51:26,470 - functest.opnfv_tests.openstack.refstack_client.refstack_client - INFO - Testcase refstack_defcore success_rate is 97.9166666667% 2018-03-06 09:51:26,470 - xtesting.energy.energy - DEBUG - Restoring previous scenario (refstack_defcore/running) 2018-03-06 09:51:26,470 - xtesting.energy.energy - DEBUG - Submitting scenario (refstack_defcore/running) 2018-03-06 09:51:27,063 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-06 09:51:27,063 - xtesting.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | refstack_defcore | functest | 11:52 | FAIL | +--------------------------+------------------+------------------+----------------+ 2018-03-06 09:51:27,068 - xtesting.ci.run_tests - ERROR - The test case 'refstack_defcore' failed. 2018-03-06 09:51:27,068 - xtesting.ci.run_tests - INFO - Running test case 'odl'... 2018-03-06 09:51:47,589 - xtesting.core.robotframework - INFO - ============================================================================== Basic & Neutron ============================================================================== Basic & Neutron.Basic ============================================================================== Basic & Neutron.Basic.Restconf Modules :: Test suite to verify Restconf is OK. ============================================================================== Get Controller Modules :: Get the restconf modules, check 200 stat... | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Basic.Restconf Modules :: Test suite to verify Res... | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Basic & Neutron.Basic | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Basic & Neutron.Neutron :: Test suite for Neutron Plugin ============================================================================== Basic & Neutron.Neutron.Reachability ============================================================================== Get the complete list of networks :: Get the complete list of netw... | PASS | ------------------------------------------------------------------------------ Get the complete list of subnets :: Get the complete list of subnets | PASS | ------------------------------------------------------------------------------ Get the complete list of ports :: Get the complete list of ports | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Reachability | PASS | 3 critical tests, 3 passed, 0 failed 3 tests total, 3 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Networks :: Checking Network created in OpenStack a... ============================================================================== Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS | ------------------------------------------------------------------------------ Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS | ------------------------------------------------------------------------------ Create Network :: Create new network in OpenStack | PASS | ------------------------------------------------------------------------------ Check Network :: Check network created in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Networks :: Checking Network created in Op... | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Subnets :: Checking Subnets created in OpenStack ar... ============================================================================== Check OpenStack Subnets :: Checking OpenStack Neutron for known su... | PASS | ------------------------------------------------------------------------------ Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS | ------------------------------------------------------------------------------ Create New subnet :: Create new subnet in OpenStack | PASS | ------------------------------------------------------------------------------ Check New subnet :: Check new subnet created in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Subnets :: Checking Subnets created in Ope... | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Ports :: Checking Port created in OpenStack are pus... ============================================================================== Check OpenStack ports :: Checking OpenStack Neutron for known ports | PASS | ------------------------------------------------------------------------------ Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS | ------------------------------------------------------------------------------ Create New Port :: Create new port in OpenStack | PASS | ------------------------------------------------------------------------------ Check New Port :: Check new port created in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Ports :: Checking Port created in OpenStac... | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Delete Ports :: Checking Port deleted in OpenStack ... ============================================================================== Delete New Port :: Delete previously created port in OpenStack | PASS | ------------------------------------------------------------------------------ Check Port Deleted :: Check port deleted in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Delete Ports :: Checking Port deleted in O... | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Delete Subnets :: Checking Subnets deleted in OpenS... ============================================================================== Delete New subnet :: Delete previously created subnet in OpenStack | PASS | ------------------------------------------------------------------------------ Check New subnet deleted :: Check subnet deleted in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Delete Subnets :: Checking Subnets deleted... | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Delete Networks :: Checking Network deleted in Open... ============================================================================== Delete Network :: Delete network in OpenStack | PASS | ------------------------------------------------------------------------------ Check Network deleted :: Check network deleted in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Delete Networks :: Checking Network delete... | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Basic & Neutron.Neutron :: Test suite for Neutron Plugin | PASS | 21 critical tests, 21 passed, 0 failed 21 tests total, 21 passed, 0 failed ============================================================================== Basic & Neutron | PASS | 22 critical tests, 22 passed, 0 failed 22 tests total, 22 passed, 0 failed ============================================================================== Output: /home/opnfv/functest/results/odl/output.xml 2018-03-06 09:51:47,589 - xtesting.core.robotframework - INFO - Results were successfully generated 2018-03-06 09:51:47,637 - xtesting.core.robotframework - INFO - Results were successfully parsed 2018-03-06 09:51:47,759 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-06 09:51:47,760 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | odl | functest | 00:20 | PASS | +-------------------+------------------+------------------+----------------+ 2018-03-06 09:51:47,764 - xtesting.ci.run_tests - INFO - Running test case 'snaps_smoke'... 2018-03-06 09:51:48,707 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-03-06 10:30:53,481 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-06 10:30:53,481 - xtesting.ci.run_tests - INFO - Test result: +---------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +---------------------+------------------+------------------+----------------+ | snaps_smoke | functest | 39:05 | FAIL | +---------------------+------------------+------------------+----------------+ 2018-03-06 10:30:53,485 - xtesting.ci.run_tests - ERROR - The test case 'snaps_smoke' failed. 2018-03-06 10:30:53,485 - xtesting.ci.run_tests - INFO - Xtesting report: +------------------------------+------------------+---------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +------------------------------+------------------+---------------+------------------+----------------+ | vping_userdata | functest | smoke | 01:41 | PASS | | tempest_smoke_serial | functest | smoke | 15:02 | PASS | | rally_sanity | functest | smoke | 20:11 | FAIL | | refstack_defcore | functest | smoke | 11:52 | FAIL | | odl | functest | smoke | 00:20 | PASS | | snaps_smoke | functest | smoke | 39:05 | FAIL | | vping_ssh | functest | smoke | 00:00 | SKIP | | odl_netvirt | functest | smoke | 00:00 | SKIP | +------------------------------+------------------+---------------+------------------+----------------+ 2018-03-06 10:30:53,491 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR 2018-03-06 10:30:56,362 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-837 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-03-06 10:30:56,366 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=fxqFAJme2xsaE32nRYFKE8d9j export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.28,192.30.9.3 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.28:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.3 2018-03-06 10:30:56,366 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-03-06 10:30:56,368 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +------------------+---------------+--------------------------+-------------------------------------------+------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +------------------+---------------+--------------------------+-------------------------------------------+------------------------------------+ | features | 2 | (daily)|(weekly) | Test suites from feature projects | doctor-notification bgpvpn | | | | | integrated in functest | | +------------------+---------------+--------------------------+-------------------------------------------+------------------------------------+ 2018-03-06 10:30:56,370 - xtesting.ci.run_tests - INFO - Running tier 'features' 2018-03-06 10:30:56,370 - xtesting.ci.run_tests - INFO - Running test case 'doctor-notification'... 2018-03-06 10:35:51,210 - xtesting.core.feature - ERROR - Execute command: doctor-test failed 2018-03-06 10:35:51,210 - xtesting.core.feature - INFO - Test result is stored in '/var/lib/xtesting/results/doctor-notification.log' 2018-03-06 10:35:51,334 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-06 10:35:51,335 - xtesting.ci.run_tests - INFO - Test result: +-----------------------------+-----------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------------+-----------------+------------------+----------------+ | doctor-notification | doctor | 04:55 | FAIL | +-----------------------------+-----------------+------------------+----------------+ 2018-03-06 10:35:51,338 - xtesting.ci.run_tests - ERROR - The test case 'doctor-notification' failed. 2018-03-06 10:35:51,338 - xtesting.ci.run_tests - INFO - Running test case 'bgpvpn'... 2018-03-06 10:36:35,154 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-837 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-03-06 10:36:35,157 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=fxqFAJme2xsaE32nRYFKE8d9j export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.28,192.30.9.3 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.28:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.3 2018-03-06 10:36:35,157 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-03-06 10:36:35,157 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+-----------------+---------------------+-------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+-----------------+---------------------+-------------------+ +---------------+---------------+-----------------+---------------------+-------------------+ 2018-03-06 10:36:35,157 - xtesting.ci.run_tests - INFO - Xtesting report: +---------------------------------+-------------------+--------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +---------------------------------+-------------------+--------------+------------------+----------------+ | cloudify_ims | functest | vnf | 00:00 | SKIP | | vyos_vrouter | functest | vnf | 00:00 | SKIP | | orchestra_openims | orchestra | vnf | 00:00 | SKIP | | orchestra_clearwaterims | orchestra | vnf | 00:00 | SKIP | | juju_epc | functest | vnf | 00:00 | SKIP | +---------------------------------+-------------------+--------------+------------------+----------------+ 2018-03-06 10:36:35,159 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-03-06 10:36:37,500 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-837 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-03-06 10:36:37,502 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=fxqFAJme2xsaE32nRYFKE8d9j export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.28,192.30.9.3 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.28:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.3 2018-03-06 10:36:37,502 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-03-06 10:36:37,502 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+-----------------+---------------------+-------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+-----------------+---------------------+-------------------+ +---------------+---------------+-----------------+---------------------+-------------------+ 2018-03-06 10:36:37,503 - xtesting.ci.run_tests - INFO - Xtesting report: +-----------------------+-----------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-----------------------+-----------------+------------------+------------------+----------------+ | parser-basics | parser | features | 00:00 | SKIP | +-----------------------+-----------------+------------------+------------------+----------------+ 2018-03-06 10:36:37,503 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK