2018-05-17 17:20:42,605 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-fraser-123 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-nosdn-bar-noha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-05-17 17:20:42,607 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=B4tCfMreUdWmPBKTPf4n9h22Q export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.26,192.30.9.9 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.26:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export OS_REGION_NAME=regionOne 2018-05-17 17:20:42,607 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-05-17 17:20:42,608 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ | healthcheck | 0 | (daily)|(weekly) | First tier to be executed to verify the | connection_check api_check | | | | | basic operations in the VIM. | snaps_health_check | +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ 2018-05-17 17:20:42,609 - xtesting.ci.run_tests - INFO - Running tier 'healthcheck' 2018-05-17 17:20:42,609 - xtesting.ci.run_tests - INFO - Running test case 'connection_check'... 2018-05-17 17:20:44,394 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-05-17 17:20:54,277 - xtesting.core.unit - DEBUG - test_glance_connect_fail (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_glance_connect_success (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_keystone_connect_fail (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_keystone_connect_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_neutron_connect_fail (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_neutron_connect_success (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_retrieve_ext_network_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_nova_connect_fail (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_connect_success (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_get_hypervisor_hosts (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_heat_connect_fail (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_heat_connect_success (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_cinder_connect_fail (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok test_cinder_connect_success (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok ---------------------------------------------------------------------- Ran 14 tests in 9.874s OK 2018-05-17 17:20:54,402 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-17 17:20:54,403 - xtesting.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | connection_check | functest | 00:10 | PASS | +--------------------------+------------------+------------------+----------------+ 2018-05-17 17:20:54,406 - xtesting.ci.run_tests - INFO - Running test case 'api_check'... 2018-05-17 17:20:55,039 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-05-17 17:33:05,425 - xtesting.core.unit - DEBUG - test_create_project_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_user_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_credentials (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_service (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_with_each_interface (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_grant_user_role_to_project (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_admin_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user_2x (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_2x (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_bad_domain (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_quota_override (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_update_quotas (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_sec_grp_one_user (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_project_sec_grp_two_users (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_image_minimal_file (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_image_minimal_url (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_network (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_add_interface_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_missing_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip_to_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_network_object (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_simple (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_with_public_interface (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_delete_simple_sec_grp (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_rules (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_one_rule (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_get_sec_grp_by_id (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_floating_ips (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsFloatingIpTests) ... ok test_create_delete_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_key_from_file (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_delete_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_instance (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceTests) ... ok test_add_remove_volume (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_attach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_detach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_create_clean_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_delete_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_all_settings (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_existing (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_create_stack_x2 (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_get_settings_from_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateComplexStackTests) ... ok test_create_flavor_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsFlavorTests) ... ok test_create_keypair_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsKeypairTests) ... ok test_create_security_group_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsSecurityGroupTests) ... ok test_create_delete_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_back (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_both (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_front (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_delete_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_simple_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_delete_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_simple_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_bad_key_size (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_delete_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_simple_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_all_attrs (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_invalid_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos_and_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok ---------------------------------------------------------------------- Ran 84 tests in 730.349s OK 2018-05-17 17:33:05,542 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-17 17:33:05,542 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | api_check | functest | 12:10 | PASS | +-------------------+------------------+------------------+----------------+ 2018-05-17 17:33:05,544 - xtesting.ci.run_tests - INFO - Running test case 'snaps_health_check'... 2018-05-17 17:33:06,197 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-05-17 17:33:51,169 - xtesting.core.unit - DEBUG - test_check_vm_ip_dhcp (snaps.openstack.tests.create_instance_tests.SimpleHealthCheck) ... ok ---------------------------------------------------------------------- Ran 1 test in 44.970s OK 2018-05-17 17:33:51,288 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-17 17:33:51,289 - xtesting.ci.run_tests - INFO - Test result: +----------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------------+------------------+------------------+----------------+ | snaps_health_check | functest | 00:45 | PASS | +----------------------------+------------------+------------------+----------------+ 2018-05-17 17:33:51,293 - xtesting.ci.run_tests - INFO - Xtesting report: +----------------------------+------------------+---------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------------+------------------+---------------------+------------------+----------------+ | connection_check | functest | healthcheck | 00:10 | PASS | | api_check | functest | healthcheck | 12:10 | PASS | | snaps_health_check | functest | healthcheck | 00:45 | PASS | +----------------------------+------------------+---------------------+------------------+----------------+ 2018-05-17 17:33:51,296 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-05-17 17:33:54,145 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-fraser-123 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-nosdn-bar-noha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-05-17 17:33:54,148 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=B4tCfMreUdWmPBKTPf4n9h22Q export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.26,192.30.9.9 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.26:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export OS_REGION_NAME=regionOne 2018-05-17 17:33:54,148 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-05-17 17:33:54,149 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+--------------------------+------------------------------------------+----------------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+--------------------------+------------------------------------------+----------------------------------------------+ | smoke | 1 | (daily)|(weekly) | Set of basic Functional tests to | vping_ssh vping_userdata | | | | | validate the OPNFV scenarios. | tempest_smoke_serial rally_sanity | | | | | | refstack_defcore patrole snaps_smoke | | | | | | neutron_trunk | +---------------+---------------+--------------------------+------------------------------------------+----------------------------------------------+ 2018-05-17 17:33:54,151 - xtesting.ci.run_tests - INFO - Running tier 'smoke' 2018-05-17 17:33:54,151 - xtesting.ci.run_tests - INFO - Running test case 'vping_ssh'... 2018-05-17 17:33:54,973 - xtesting.energy.energy - INFO - API recorder available at : http://energy.opnfv.fr/resources/recorders/environment/lf-pod1 2018-05-17 17:33:54,973 - xtesting.energy.energy - DEBUG - Getting current scenario 2018-05-17 17:33:55,421 - xtesting.energy.energy - DEBUG - Starting recording 2018-05-17 17:33:55,422 - xtesting.energy.energy - DEBUG - Submitting scenario (vping_ssh/running) 2018-05-17 17:33:55,858 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup 2018-05-17 17:33:55,858 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-05-17 17:33:55' 2018-05-17 17:33:55,858 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--0c1fdb07-d7b3-4e62-9ed3-6df9cb4ad894' 2018-05-17 17:33:59,891 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-0c1fdb07-d7b3-4e62-9ed3-6df9cb4ad894' 2018-05-17 17:34:02,430 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-0c1fdb07-d7b3-4e62-9ed3-6df9cb4ad894' 2018-05-17 17:34:08,866 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-0c1fdb07-d7b3-4e62-9ed3-6df9cb4ad894' 2018-05-17 17:34:09,688 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating keypair with name: 'vPing-keypair-0c1fdb07-d7b3-4e62-9ed3-6df9cb4ad894' 2018-05-17 17:34:10,343 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-0c1fdb07-d7b3-4e62-9ed3-6df9cb4ad894' 2018-05-17 17:34:15,768 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Security group with name: 'vPing-sg-0c1fdb07-d7b3-4e62-9ed3-6df9cb4ad894' 2018-05-17 17:34:18,890 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-0c1fdb07-d7b3-4e62-9ed3-6df9cb4ad894' 2018-05-17 17:34:39,041 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution 2018-05-17 17:34:41,801 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Trying to transfer ping.sh 2018-05-17 17:34:41,937 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping... 2018-05-17 17:34:54,965 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected! 2018-05-17 17:34:54,965 - xtesting.energy.energy - DEBUG - Restoring previous scenario (default/default) 2018-05-17 17:34:54,966 - xtesting.energy.energy - DEBUG - Submitting scenario (default/default) 2018-05-17 17:34:55,943 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-17 17:34:55,943 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | vping_ssh | functest | 00:59 | PASS | +-------------------+------------------+------------------+----------------+ 2018-05-17 17:35:13,026 - xtesting.ci.run_tests - INFO - Running test case 'vping_userdata'... 2018-05-17 17:35:13,102 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup 2018-05-17 17:35:13,102 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-05-17 17:35:13' 2018-05-17 17:35:13,102 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--66838434-52d1-434d-b232-28938fc660e6' 2018-05-17 17:35:18,740 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-66838434-52d1-434d-b232-28938fc660e6' 2018-05-17 17:35:20,548 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-66838434-52d1-434d-b232-28938fc660e6' 2018-05-17 17:35:26,297 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-66838434-52d1-434d-b232-28938fc660e6' 2018-05-17 17:35:27,078 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-66838434-52d1-434d-b232-28938fc660e6' 2018-05-17 17:35:32,025 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-66838434-52d1-434d-b232-28938fc660e6' 2018-05-17 17:35:37,564 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution 2018-05-17 17:35:49,167 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping... 2018-05-17 17:35:51,395 - functest.opnfv_tests.openstack.vping.vping_base - DEBUG - Pinging 192.168.130.9. Waiting for response... 2018-05-17 17:35:53,944 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected! 2018-05-17 17:35:54,053 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-17 17:35:54,053 - xtesting.ci.run_tests - INFO - Test result: +------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------+------------------+------------------+----------------+ | vping_userdata | functest | 00:41 | PASS | +------------------------+------------------+------------------+----------------+ 2018-05-17 17:36:21,203 - xtesting.ci.run_tests - INFO - Running test case 'tempest_smoke_serial'... 2018-05-17 17:36:21,283 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-05-17 17:36:25,994 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-05-17 17:36:25.665 18 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=a905e092-fbe4-42c9-8cf1-5026ab640493) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | a905e092-fbe4-42c9-8cf1-5026ab640493 | 2018-05-17T17:36:25 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: a905e092-fbe4-42c9-8cf1-5026ab640493 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-05-17 17:36:29,516 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-05-17 17:36:29,516 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-05-17 17:36:35,240 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-05-17 17:36:33.641 27 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-05-17 17:36:33.832 27 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-05-17 17:36:35.002 27 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=3954d143-3e23-4081-bd84-af5fb15e5eb2) has been successfully created! Using verifier 'opnfv-tempest' (UUID=3954d143-3e23-4081-bd84-af5fb15e5eb2) as the default verifier for the future CLI operations. 2018-05-17 17:36:38,236 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-05-17 17:36:40,233 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-05-17 17:36:46,768 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-05-17 17:36:52,005 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-05-17 17:36:51.213 46 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=3954d143-3e23-4081-bd84-af5fb15e5eb2) for deployment 'opnfv-rally' (UUID=a905e092-fbe4-42c9-8cf1-5026ab640493). 2018-05-17 17:36:51.876 46 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=3954d143-3e23-4081-bd84-af5fb15e5eb2) has been successfully configured for deployment 'opnfv-rally' (UUID=a905e092-fbe4-42c9-8cf1-5026ab640493)! 2018-05-17 17:36:52,006 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-05-17 17:36:52,006 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-05-17 17:36:52,008 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-05-17 17:36:52,011 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-05-17 17:36:54,778 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-3954d143-3e23-4081-bd84-af5fb15e5eb2/repo; testr list-tests '^tempest\.(api|scenario).*\[.*\bsmoke\b.*\]$' >/home/opnfv/functest/results/tempest/test_list.txt 2>/dev/null) 2018-05-17 17:36:54,778 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Applying tempest blacklist... 2018-05-17 17:36:54,779 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Tempest blacklist file does not exist. 2018-05-17 17:36:54,779 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/tempest/test_list.txt', '--concurrency', '1']'. 2018-05-17 17:36:56,962 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:36:56.960 55 INFO rally.api [-] Starting verification (UUID=0c524f12-97c7-47cc-92c2-a1d9751e6ec9) for deployment 'opnfv-rally' (UUID=a905e092-fbe4-42c9-8cf1-5026ab640493) by verifier 'opnfv-tempest' (UUID=3954d143-3e23-4081-bd84-af5fb15e5eb2). 2018-05-17 17:36:56,962 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: 0c524f12-97c7-47cc-92c2-a1d9751e6ec9 2018-05-17 17:37:03,496 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:37:03.495 55 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor ... success [0.156s] 2018-05-17 17:37:03,551 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:37:03.551 55 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.056s] 2018-05-17 17:37:10,344 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:37:10.343 55 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create ... success [1.167s] 2018-05-17 17:37:12,632 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:37:12.632 55 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list ... success [2.287s] 2018-05-17 17:37:21,688 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:37:21.687 55 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete ... success [2.757s] 2018-05-17 17:37:40,352 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:37:40.352 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip ... success [13.099s] 2018-05-17 17:38:19,120 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:38:19.120 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers ... success [0.094s] 2018-05-17 17:38:19,121 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:38:19.121 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details ... success [0.001s] 2018-05-17 17:38:47,627 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:38:47.626 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.564s] 2018-05-17 17:38:47,628 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:38:47.628 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s] 2018-05-17 17:39:19,144 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:39:19.144 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.086s] 2018-05-17 17:39:19,146 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:39:19.145 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s] 2018-05-17 17:40:08,243 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:40:08.242 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [18.950s] 2018-05-17 17:40:33,092 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:40:33.091 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses ... success [0.053s] 2018-05-17 17:40:33,186 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:40:33.186 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network ... success [0.095s] 2018-05-17 17:40:40,938 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:40:40.937 55 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_get_version_details ... success [0.624s] 2018-05-17 17:40:40,948 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:40:40.948 55 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.010s] 2018-05-17 17:40:43,018 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:40:43.018 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_services.ServicesTestJSON ... skip: Identity api v2 is not enabled 2018-05-17 17:40:43,019 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:40:43.018 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_users.UsersTestJSON ... skip: Identity api v2 is not enabled 2018-05-17 17:40:46,739 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:40:46.739 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete ... success [0.369s] 2018-05-17 17:40:53,353 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:40:53.353 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists ... success [0.073s] 2018-05-17 17:40:59,487 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:40:59.487 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain ... success [0.738s] 2018-05-17 17:41:07,709 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:41:07.708 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint ... success [0.500s] 2018-05-17 17:41:17,315 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:41:17.315 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete ... success [3.475s] 2018-05-17 17:41:25,026 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:41:25.025 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy ... success [0.917s] 2018-05-17 17:41:30,809 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:41:30.808 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id ... success [0.178s] 2018-05-17 17:41:37,649 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:41:37.649 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list ... success [0.511s] 2018-05-17 17:41:44,329 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:41:44.328 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service ... success [0.428s] 2018-05-17 17:41:52,751 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:41:52.750 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all ... success [2.542s] 2018-05-17 17:41:54,981 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:41:54.981 55 INFO opnfv-tempest [-] {0} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery ... skip: Identity api v2 is not enabled 2018-05-17 17:41:56,940 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:41:56.940 55 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.068s] 2018-05-17 17:41:57,012 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:41:57.012 55 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.072s] 2018-05-17 17:41:57,081 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:41:57.081 55 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.069s] 2018-05-17 17:41:57,088 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:41:57.087 55 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions ... success [0.006s] 2018-05-17 17:42:00,900 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:42:00.899 55 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.721s] 2018-05-17 17:42:02,737 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:42:02.736 55 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file ... success [1.837s] 2018-05-17 17:42:05,554 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:42:05.554 55 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [2.817s] 2018-05-17 17:42:15,542 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:42:15.542 55 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_versions.VersionsTest.test_list_versions ... success [0.006s] 2018-05-17 17:42:21,679 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:42:21.679 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions ... success [2.195s] 2018-05-17 17:42:34,216 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:42:34.215 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address ... success [2.454s] 2018-05-17 17:42:37,991 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:42:37.990 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip ... success [3.774s] 2018-05-17 17:42:50,799 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:42:50.798 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network ... success [4.258s] 2018-05-17 17:42:54,358 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:42:54.357 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port ... success [3.557s] 2018-05-17 17:43:00,366 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:43:00.366 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet ... success [6.008s] 2018-05-17 17:43:08,359 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:43:08.359 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network ... success [2.469s] 2018-05-17 17:43:12,506 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:43:12.505 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port ... success [4.146s] 2018-05-17 17:43:16,882 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:43:16.881 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet ... success [4.375s] 2018-05-17 17:43:32,540 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:43:32.539 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet ... success [4.544s] 2018-05-17 17:43:32,729 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:43:32.729 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility ... success [0.189s] 2018-05-17 17:43:32,838 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:43:32.838 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks ... success [0.108s] 2018-05-17 17:43:32,887 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:43:32.887 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets ... success [0.048s] 2018-05-17 17:43:32,986 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:43:32.985 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network ... success [0.098s] 2018-05-17 17:43:33,035 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:43:33.034 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet ... success [0.049s] 2018-05-17 17:43:43,727 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:43:43.727 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [4.321s] 2018-05-17 17:43:43,906 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:43:43.906 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.179s] 2018-05-17 17:43:44,011 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:43:44.011 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.104s] 2018-05-17 17:43:44,074 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:43:44.074 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.063s] 2018-05-17 17:43:44,186 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:43:44.186 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.112s] 2018-05-17 17:43:44,239 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:43:44.239 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.052s] 2018-05-17 17:43:55,325 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:43:55.325 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools ... success [3.171s] 2018-05-17 17:43:59,522 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:43:59.522 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups ... success [4.197s] 2018-05-17 17:44:01,773 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:44:01.773 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port ... success [2.250s] 2018-05-17 17:44:01,978 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:44:01.978 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports ... success [0.205s] 2018-05-17 17:44:02,027 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:44:02.027 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port ... success [0.049s] 2018-05-17 17:44:12,597 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:44:12.597 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [3.877s] 2018-05-17 17:44:16,536 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:44:16.536 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups ... success [3.938s] 2018-05-17 17:44:19,055 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:44:19.055 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [2.519s] 2018-05-17 17:44:19,121 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:44:19.120 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.065s] 2018-05-17 17:44:19,178 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:44:19.178 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.057s] 2018-05-17 17:44:33,286 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:44:33.285 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces ... success [8.883s] 2018-05-17 17:44:38,293 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:44:38.292 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id ... success [5.007s] 2018-05-17 17:44:42,277 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:44:42.277 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id ... success [3.983s] 2018-05-17 17:44:45,021 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:44:45.020 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router ... success [2.744s] 2018-05-17 17:45:05,231 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:45:05.230 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [9.492s] 2018-05-17 17:45:10,910 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:45:10.909 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [5.679s] 2018-05-17 17:45:14,732 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:45:14.732 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [3.822s] 2018-05-17 17:45:18,716 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:45:18.715 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [3.983s] 2018-05-17 17:45:30,987 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:45:30.987 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group ... success [1.373s] 2018-05-17 17:45:32,296 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:45:32.296 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule ... success [1.306s] 2018-05-17 17:45:32,335 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:45:32.335 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups ... success [0.041s] 2018-05-17 17:45:36,741 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:45:36.740 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.306s] 2018-05-17 17:45:37,995 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:45:37.995 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.252s] 2018-05-17 17:45:38,037 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:45:38.037 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.044s] 2018-05-17 17:45:42,915 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:45:42.915 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [0.589s] 2018-05-17 17:45:45,937 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:45:45.937 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.006s] 2018-05-17 17:45:47,461 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:45:47.461 55 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest ... skip: AccountQuotasTest skipped as swift is not available 2018-05-17 17:45:47,462 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:45:47.462 55 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_services.AccountTest ... skip: AccountTest skipped as swift is not available 2018-05-17 17:45:47,463 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:45:47.463 55 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest ... skip: ContainerQuotasTest skipped as swift is not available 2018-05-17 17:45:47,465 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:45:47.464 55 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest ... skip: ContainerTest skipped as swift is not available 2018-05-17 17:45:47,466 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:45:47.465 55 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_object_services.ObjectTest ... skip: ObjectTest skipped as swift is not available 2018-05-17 17:45:49,854 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:45:49.854 55 INFO opnfv-tempest [-] {0} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.011s] 2018-05-17 17:46:07,584 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:46:07.583 55 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_attach_detach_volume_to_instance ... success [12.809s] 2018-05-17 17:46:21,146 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:46:21.146 55 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [8.362s] 2018-05-17 17:46:35,640 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:46:35.640 55 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [14.491s] 2018-05-17 17:46:45,354 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:46:45.354 55 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.039s] 2018-05-17 17:47:58,536 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:47:58.535 55 INFO opnfv-tempest [-] {0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops ... success [64.784s] 2018-05-17 17:48:42,778 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:48:42.778 55 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops ... success [35.052s] 2018-05-17 17:49:27,354 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 17:49:27.354 55 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_multinode.TestServerMultinode.test_schedule_to_all_nodes ... success [26.009s] 2018-05-17 17:49:39,943 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '0c524f12-97c7-47cc-92c2-a1d9751e6ec9']'. 2018-05-17 17:49:40,966 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-05-17 17:49:40,966 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-05-17 17:49:40,967 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-05-17 17:49:40,967 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 0c524f12-97c7-47cc-92c2-a1d9751e6ec9 | 2018-05-17 17:49:40,967 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | finished | 2018-05-17 17:49:40,967 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-05-17 17:36:56 | 2018-05-17 17:49:40,967 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-05-17 17:49:39 | 2018-05-17 17:49:40,967 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:12:43 | 2018-05-17 17:49:40,967 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | concurrency: 1 | 2018-05-17 17:49:40,967 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | | load_list: (value is too long, use 'detailed' flag to display it) | 2018-05-17 17:49:40,967 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-05-17 17:49:40,967 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: 3954d143-3e23-4081-bd84-af5fb15e5eb2) | 2018-05-17 17:49:40,968 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-05-17 17:49:40,968 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: a905e092-fbe4-42c9-8cf1-5026ab640493) | 2018-05-17 17:49:40,968 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 109 | 2018-05-17 17:49:40,968 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 745.885 | 2018-05-17 17:49:40,968 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 90 | 2018-05-17 17:49:40,968 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 19 | 2018-05-17 17:49:40,968 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-05-17 17:49:40,968 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-05-17 17:49:40,968 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 0 | 2018-05-17 17:49:40,968 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-05-17 17:49:40,968 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-05-17 17:49:41,036 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest tempest_smoke_serial success_rate is 100.0% 2018-05-17 17:49:51,102 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-17 17:49:51,103 - xtesting.ci.run_tests - INFO - Test result: +------------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------------+------------------+------------------+----------------+ | tempest_smoke_serial | functest | 13:13 | PASS | +------------------------------+------------------+------------------+----------------+ 2018-05-17 17:49:51,107 - xtesting.ci.run_tests - INFO - Running test case 'rally_sanity'... 2018-05-17 17:49:51,191 - xtesting.energy.energy - DEBUG - Getting current scenario 2018-05-17 17:49:51,630 - xtesting.energy.energy - DEBUG - Starting recording 2018-05-17 17:49:51,630 - xtesting.energy.energy - DEBUG - Submitting scenario (rally_sanity/running) 2018-05-17 17:49:52,068 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-05-17 17:49:54,570 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-05-17 17:49:54.124 118 INFO rally.deployment.engine [-] Deployment a905e092-fbe4-42c9-8cf1-5026ab640493 | Starting: Destroy cloud and free allocated resources. 2018-05-17 17:49:54.238 118 INFO rally.deployment.engine [-] Deployment a905e092-fbe4-42c9-8cf1-5026ab640493 | Completed: Destroy cloud and free allocated resources. 2018-05-17 17:49:54.281 118 INFO rally.api [-] Deleting all verifications created by verifier 'opnfv-tempest' (UUID=3954d143-3e23-4081-bd84-af5fb15e5eb2) for deployment 'opnfv-rally'. 2018-05-17 17:49:54.298 118 INFO rally.api [-] Deleting verification (UUID=0c524f12-97c7-47cc-92c2-a1d9751e6ec9). 2018-05-17 17:49:54.339 118 INFO rally.api [-] Verification has been successfully deleted! 2018-05-17 17:49:54.340 118 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=3954d143-3e23-4081-bd84-af5fb15e5eb2). 2018-05-17 17:49:54.352 118 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-05-17 17:49:56,993 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-05-17 17:49:56.663 121 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=d883e3e0-ff64-4ad8-89f2-505ea7f4ce82) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | d883e3e0-ff64-4ad8-89f2-505ea7f4ce82 | 2018-05-17T17:49:56 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: d883e3e0-ff64-4ad8-89f2-505ea7f4ce82 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-05-17 17:50:00,225 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-05-17 17:50:00,225 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating the test name... 2018-05-17 17:50:01,440 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating image 'Cirros-0.4.0-a1bd2cb6-0d55-4462-bf74-54086d865fa3'... 2018-05-17 17:50:04,874 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating network 'rally-net-a1bd2cb6-0d55-4462-bf74-54086d865fa3'... 2018-05-17 17:50:07,045 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating router 'rally-router-a1bd2cb6-0d55-4462-bf74-54086d865fa3'... 2018-05-17 17:50:12,250 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-tiny-a1bd2cb6-0d55-4462-bf74-54086d865fa3'... 2018-05-17 17:50:12,845 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-mini-a1bd2cb6-0d55-4462-bf74-54086d865fa3'... 2018-05-17 17:50:13,838 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2018-05-17 17:50:13,838 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-authenticate.yaml 2018-05-17 17:50:13,839 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-05-17 17:50:13,857 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-05-17 17:50:13,858 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['authenticate'], 'concurrency': 4, 'netid': '3fc847d2-5f6a-4853-a522-dec6490a802f', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'flavor_name': 'rally-tiny-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-05-17 17:51:14,647 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 1f2f57d9-795e-4b0d-838b-46c1b5f33a5d 2018-05-17 17:51:14,648 - functest.opnfv_tests.openstack.rally.rally - DEBUG - /home/opnfv/functest/results/rally does not exist, we create it. 2018-05-17 17:51:14,649 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '1f2f57d9-795e-4b0d-838b-46c1b5f33a5d'] 2018-05-17 17:51:15,721 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 1f2f57d9-795e-4b0d-838b-46c1b5f33a5d: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 1f2f57d9-795e-4b0d-838b-46c1b5f33a5d has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.456 | 0.456 | 0.456 | 0.456 | 0.456 | 0.456 | 100.0% | 1 | | total | 0.456 | 0.456 | 0.456 | 0.456 | 0.456 | 0.456 | 100.0% | 1 | | -> duration | 0.456 | 0.456 | 0.456 | 0.456 | 0.456 | 0.456 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.455729 Full duration: 7.750732 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 1f2f57d9-795e-4b0d-838b-46c1b5f33a5d has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.304 | 0.304 | 0.304 | 0.304 | 0.304 | 0.304 | 100.0% | 1 | | total | 0.735 | 0.735 | 0.735 | 0.735 | 0.735 | 0.735 | 100.0% | 1 | | -> duration | 0.735 | 0.735 | 0.735 | 0.735 | 0.735 | 0.735 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.735116 Full duration: 7.731342 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 1f2f57d9-795e-4b0d-838b-46c1b5f33a5d has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.213 | 0.213 | 0.213 | 0.213 | 0.213 | 0.213 | 100.0% | 1 | | total | 0.617 | 0.617 | 0.617 | 0.617 | 0.617 | 0.617 | 100.0% | 1 | | -> duration | 0.617 | 0.617 | 0.617 | 0.617 | 0.617 | 0.617 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.61716 Full duration: 6.897728 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 1f2f57d9-795e-4b0d-838b-46c1b5f33a5d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.389 | 0.389 | 0.389 | 0.389 | 0.389 | 0.389 | 100.0% | 1 | | total | 0.786 | 0.786 | 0.786 | 0.786 | 0.786 | 0.786 | 100.0% | 1 | | -> duration | 0.786 | 0.786 | 0.786 | 0.786 | 0.786 | 0.786 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.785808 Full duration: 7.658862 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 1f2f57d9-795e-4b0d-838b-46c1b5f33a5d has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.351 | 0.351 | 0.351 | 0.351 | 0.351 | 0.351 | 100.0% | 1 | | total | 0.744 | 0.744 | 0.744 | 0.744 | 0.744 | 0.744 | 100.0% | 1 | | -> duration | 0.744 | 0.744 | 0.744 | 0.744 | 0.744 | 0.744 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.744054 Full duration: 7.0692 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 1f2f57d9-795e-4b0d-838b-46c1b5f33a5d has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.196 | 0.196 | 0.196 | 0.196 | 0.196 | 0.196 | 100.0% | 1 | | total | 0.655 | 0.655 | 0.655 | 0.655 | 0.655 | 0.655 | 100.0% | 1 | | -> duration | 0.655 | 0.655 | 0.655 | 0.655 | 0.655 | 0.655 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.655358 Full duration: 7.431894 HINTS: * To plot HTML graphics with this data, run: rally task report 1f2f57d9-795e-4b0d-838b-46c1b5f33a5d --out output.html * To generate a JUnit report, run: rally task export 1f2f57d9-795e-4b0d-838b-46c1b5f33a5d --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 1f2f57d9-795e-4b0d-838b-46c1b5f33a5d --json --out output.json 2018-05-17 17:51:15,722 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '1f2f57d9-795e-4b0d-838b-46c1b5f33a5d'] 2018-05-17 17:51:16,677 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-05-17 17:51:16,677 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '1f2f57d9-795e-4b0d-838b-46c1b5f33a5d', '--out', u'/home/opnfv/functest/results/rally/opnfv-authenticate.html'] 2018-05-17 17:51:16,683 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2018-05-17 17:51:16,683 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2018-05-17 17:51:16,683 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-glance.yaml 2018-05-17 17:51:16,684 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-05-17 17:51:16,690 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-05-17 17:51:16,690 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['glance'], 'concurrency': 4, 'netid': '3fc847d2-5f6a-4853-a522-dec6490a802f', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'flavor_name': 'rally-tiny-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-05-17 17:52:54,231 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : d1247419-e64c-4c5d-8ae2-5538f5f1c1a9 2018-05-17 17:52:54,231 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'd1247419-e64c-4c5d-8ae2-5538f5f1c1a9'] 2018-05-17 17:52:55,252 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task d1247419-e64c-4c5d-8ae2-5538f5f1c1a9: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task d1247419-e64c-4c5d-8ae2-5538f5f1c1a9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.984 | 3.984 | 3.984 | 3.984 | 3.984 | 3.984 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.048 | 0.048 | 0.048 | 0.048 | 0.048 | 0.048 | 100.0% | 1 | | -> glance_v2.upload_data | 1.666 | 1.666 | 1.666 | 1.666 | 1.666 | 1.666 | 100.0% | 1 | | glance_v2.delete_image | 1.942 | 1.942 | 1.942 | 1.942 | 1.942 | 1.942 | 100.0% | 1 | | total | 5.927 | 5.927 | 5.927 | 5.927 | 5.927 | 5.927 | 100.0% | 1 | | -> duration | 5.927 | 5.927 | 5.927 | 5.927 | 5.927 | 5.927 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.926737 Full duration: 13.835059 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task d1247419-e64c-4c5d-8ae2-5538f5f1c1a9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 6.183 | 6.183 | 6.183 | 6.183 | 6.183 | 6.183 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.046 | 0.046 | 0.046 | 0.046 | 0.046 | 0.046 | 100.0% | 1 | | -> glance_v2.upload_data | 3.887 | 3.887 | 3.887 | 3.887 | 3.887 | 3.887 | 100.0% | 1 | | glance_v2.list_images | 0.035 | 0.035 | 0.035 | 0.035 | 0.035 | 0.035 | 100.0% | 1 | | total | 6.218 | 6.218 | 6.218 | 6.218 | 6.218 | 6.218 | 100.0% | 1 | | -> duration | 6.218 | 6.218 | 6.218 | 6.218 | 6.218 | 6.218 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.217922 Full duration: 17.732398 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task d1247419-e64c-4c5d-8ae2-5538f5f1c1a9 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.181 | 0.181 | 0.181 | 0.181 | 0.181 | 0.181 | 100.0% | 1 | | total | 0.181 | 0.181 | 0.181 | 0.181 | 0.181 | 0.181 | 100.0% | 1 | | -> duration | 0.181 | 0.181 | 0.181 | 0.181 | 0.181 | 0.181 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.181377 Full duration: 7.480898 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally-tiny-a1bd2cb6-0d55-4462-bf74-54086d865fa3" }, "number_instances": 2, "nics": [ { "net-id": "3fc847d2-5f6a-4853-a522-dec6490a802f" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } } } -------------------------------------------------------------------------------- Task d1247419-e64c-4c5d-8ae2-5538f5f1c1a9 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 6.244 | 6.244 | 6.244 | 6.244 | 6.244 | 6.244 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 100.0% | 1 | | -> glance_v2.upload_data | 3.878 | 3.878 | 3.878 | 3.878 | 3.878 | 3.878 | 100.0% | 1 | | nova.boot_servers | 15.778 | 15.778 | 15.778 | 15.778 | 15.778 | 15.778 | 100.0% | 1 | | total | 22.023 | 22.023 | 22.023 | 22.023 | 22.023 | 22.023 | 100.0% | 1 | | -> duration | 21.023 | 21.023 | 21.023 | 21.023 | 21.023 | 21.023 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 21.022503 Full duration: 43.852423 HINTS: * To plot HTML graphics with this data, run: rally task report d1247419-e64c-4c5d-8ae2-5538f5f1c1a9 --out output.html * To generate a JUnit report, run: rally task export d1247419-e64c-4c5d-8ae2-5538f5f1c1a9 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report d1247419-e64c-4c5d-8ae2-5538f5f1c1a9 --json --out output.json 2018-05-17 17:52:55,253 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'd1247419-e64c-4c5d-8ae2-5538f5f1c1a9'] 2018-05-17 17:52:56,344 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-05-17 17:52:56,344 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'd1247419-e64c-4c5d-8ae2-5538f5f1c1a9', '--out', u'/home/opnfv/functest/results/rally/opnfv-glance.html'] 2018-05-17 17:52:56,352 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2018-05-17 17:52:56,353 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2018-05-17 17:52:56,353 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-cinder.yaml 2018-05-17 17:52:56,353 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-05-17 17:52:56,370 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-05-17 17:52:56,371 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['cinder'], 'concurrency': 4, 'netid': '3fc847d2-5f6a-4853-a522-dec6490a802f', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'flavor_name': 'rally-tiny-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-05-17 17:56:08,903 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 496213ec-432a-4c4f-8d49-c4c92728341f 2018-05-17 17:56:08,904 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '496213ec-432a-4c4f-8d49-c4c92728341f'] 2018-05-17 17:56:09,959 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 496213ec-432a-4c4f-8d49-c4c92728341f: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "force": false }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 496213ec-432a-4c4f-8d49-c4c92728341f has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_snapshot | 3.034 | 3.034 | 3.034 | 3.034 | 3.034 | 3.034 | 100.0% | 1 | | cinder_v2.delete_snapshot | 2.471 | 2.471 | 2.471 | 2.471 | 2.471 | 2.471 | 100.0% | 1 | | total | 5.506 | 5.506 | 5.506 | 5.506 | 5.506 | 5.506 | 100.0% | 1 | | -> duration | 5.506 | 5.506 | 5.506 | 5.506 | 5.506 | 5.506 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.505555 Full duration: 21.931603 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": { "max": 1, "min": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 496213ec-432a-4c4f-8d49-c4c92728341f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.078 | 3.078 | 3.078 | 3.078 | 3.078 | 3.078 | 100.0% | 1 | | cinder_v2.delete_volume | 2.951 | 2.951 | 2.951 | 2.951 | 2.951 | 2.951 | 100.0% | 1 | | total | 6.029 | 6.029 | 6.029 | 6.029 | 6.029 | 6.029 | 100.0% | 1 | | -> duration | 6.029 | 6.029 | 6.029 | 6.029 | 6.029 | 6.029 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.028563 Full duration: 17.168339 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "image": { "name": "Cirros-0.4.0-a1bd2cb6-0d55-4462-bf74-54086d865fa3" }, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 496213ec-432a-4c4f-8d49-c4c92728341f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 12.043 | 12.043 | 12.043 | 12.043 | 12.043 | 12.043 | 100.0% | 1 | | cinder_v2.delete_volume | 2.336 | 2.336 | 2.336 | 2.336 | 2.336 | 2.336 | 100.0% | 1 | | total | 14.38 | 14.38 | 14.38 | 14.38 | 14.38 | 14.38 | 100.0% | 1 | | -> duration | 14.38 | 14.38 | 14.38 | 14.38 | 14.38 | 14.38 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.379587 Full duration: 24.008125 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 496213ec-432a-4c4f-8d49-c4c92728341f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.199 | 3.199 | 3.199 | 3.199 | 3.199 | 3.199 | 100.0% | 1 | | cinder_v2.delete_volume | 2.447 | 2.447 | 2.447 | 2.447 | 2.447 | 2.447 | 100.0% | 1 | | total | 5.646 | 5.646 | 5.646 | 5.646 | 5.646 | 5.646 | 100.0% | 1 | | -> duration | 5.646 | 5.646 | 5.646 | 5.646 | 5.646 | 5.646 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.64597 Full duration: 15.907155 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "new_size": 2, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 496213ec-432a-4c4f-8d49-c4c92728341f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.212 | 3.212 | 3.212 | 3.212 | 3.212 | 3.212 | 100.0% | 1 | | cinder_v2.extend_volume | 2.57 | 2.57 | 2.57 | 2.57 | 2.57 | 2.57 | 100.0% | 1 | | cinder_v2.delete_volume | 2.584 | 2.584 | 2.584 | 2.584 | 2.584 | 2.584 | 100.0% | 1 | | total | 8.366 | 8.366 | 8.366 | 8.366 | 8.366 | 8.366 | 100.0% | 1 | | -> duration | 8.366 | 8.366 | 8.366 | 8.366 | 8.366 | 8.366 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.366197 Full duration: 17.975307 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 496213ec-432a-4c4f-8d49-c4c92728341f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.166 | 3.166 | 3.166 | 3.166 | 3.166 | 3.166 | 100.0% | 1 | | cinder_v2.delete_volume | 4.541 | 4.541 | 4.541 | 4.541 | 4.541 | 4.541 | 100.0% | 1 | | total | 7.708 | 7.708 | 7.708 | 7.708 | 7.708 | 7.708 | 100.0% | 1 | | -> duration | 7.708 | 7.708 | 7.708 | 7.708 | 7.708 | 7.708 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.707567 Full duration: 25.501756 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 496213ec-432a-4c4f-8d49-c4c92728341f has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 0.623 | 0.623 | 0.623 | 0.623 | 0.623 | 0.623 | 100.0% | 1 | | cinder_v2.list_qos | 0.173 | 0.173 | 0.173 | 0.173 | 0.173 | 0.173 | 100.0% | 1 | | total | 0.796 | 0.796 | 0.796 | 0.796 | 0.796 | 0.796 | 100.0% | 1 | | -> duration | 0.796 | 0.796 | 0.796 | 0.796 | 0.796 | 0.796 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.79642 Full duration: 12.323101 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 496213ec-432a-4c4f-8d49-c4c92728341f has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 0.553 | 0.553 | 0.553 | 0.553 | 0.553 | 0.553 | 100.0% | 1 | | cinder_v2.set_qos | 0.17 | 0.17 | 0.17 | 0.17 | 0.17 | 0.17 | 100.0% | 1 | | total | 0.724 | 0.724 | 0.724 | 0.724 | 0.724 | 0.724 | 100.0% | 1 | | -> duration | 0.724 | 0.724 | 0.724 | 0.724 | 0.724 | 0.724 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.723685 Full duration: 11.91536 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "description": "rally tests creating types" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 496213ec-432a-4c4f-8d49-c4c92728341f has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.583 | 0.583 | 0.583 | 0.583 | 0.583 | 0.583 | 100.0% | 1 | | cinder_v2.list_types | 0.156 | 0.156 | 0.156 | 0.156 | 0.156 | 0.156 | 100.0% | 1 | | total | 0.74 | 0.74 | 0.74 | 0.74 | 0.74 | 0.74 | 100.0% | 1 | | -> duration | 0.74 | 0.74 | 0.74 | 0.74 | 0.74 | 0.74 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.739647 Full duration: 11.949172 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 496213ec-432a-4c4f-8d49-c4c92728341f has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.665 | 0.665 | 0.665 | 0.665 | 0.665 | 0.665 | 100.0% | 1 | | cinder_v2.create_encryption_type | 0.178 | 0.178 | 0.178 | 0.178 | 0.178 | 0.178 | 100.0% | 1 | | total | 0.843 | 0.843 | 0.843 | 0.843 | 0.843 | 0.843 | 100.0% | 1 | | -> duration | 0.843 | 0.843 | 0.843 | 0.843 | 0.843 | 0.843 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.843322 Full duration: 11.078869 HINTS: * To plot HTML graphics with this data, run: rally task report 496213ec-432a-4c4f-8d49-c4c92728341f --out output.html * To generate a JUnit report, run: rally task export 496213ec-432a-4c4f-8d49-c4c92728341f --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 496213ec-432a-4c4f-8d49-c4c92728341f --json --out output.json 2018-05-17 17:56:09,960 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '496213ec-432a-4c4f-8d49-c4c92728341f'] 2018-05-17 17:56:11,055 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-05-17 17:56:11,056 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '496213ec-432a-4c4f-8d49-c4c92728341f', '--out', u'/home/opnfv/functest/results/rally/opnfv-cinder.html'] 2018-05-17 17:56:11,063 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2018-05-17 17:56:11,063 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2018-05-17 17:56:11,063 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-heat.yaml 2018-05-17 17:56:11,063 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-05-17 17:56:11,070 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-05-17 17:56:11,070 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['heat'], 'concurrency': 4, 'netid': '3fc847d2-5f6a-4853-a522-dec6490a802f', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'flavor_name': 'rally-tiny-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-05-17 17:57:29,105 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 719891e6-9f51-4ca9-aedc-80622746385b 2018-05-17 17:57:29,106 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '719891e6-9f51-4ca9-aedc-80622746385b'] 2018-05-17 17:57:30,126 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 719891e6-9f51-4ca9-aedc-80622746385b: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task 719891e6-9f51-4ca9-aedc-80622746385b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.642 | 4.642 | 4.642 | 4.642 | 4.642 | 4.642 | 100.0% | 1 | | heat.update_stack | 3.326 | 3.326 | 3.326 | 3.326 | 3.326 | 3.326 | 100.0% | 1 | | heat.delete_stack | 3.264 | 3.264 | 3.264 | 3.264 | 3.264 | 3.264 | 100.0% | 1 | | total | 11.232 | 11.232 | 11.232 | 11.232 | 11.232 | 11.232 | 100.0% | 1 | | -> duration | 7.232 | 7.232 | 7.232 | 7.232 | 7.232 | 7.232 | 100.0% | 1 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.23207 Full duration: 18.912467 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task 719891e6-9f51-4ca9-aedc-80622746385b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.67 | 4.67 | 4.67 | 4.67 | 4.67 | 4.67 | 100.0% | 1 | | heat.check_stack | 0.535 | 0.535 | 0.535 | 0.535 | 0.535 | 0.535 | 100.0% | 1 | | heat.delete_stack | 1.541 | 1.541 | 1.541 | 1.541 | 1.541 | 1.541 | 100.0% | 1 | | total | 6.746 | 6.746 | 6.746 | 6.746 | 6.746 | 6.746 | 100.0% | 1 | | -> duration | 4.746 | 4.746 | 4.746 | 4.746 | 4.746 | 4.746 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.746214 Full duration: 15.823366 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task 719891e6-9f51-4ca9-aedc-80622746385b has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.38 | 4.38 | 4.38 | 4.38 | 4.38 | 4.38 | 100.0% | 1 | | heat.suspend_stack | 0.734 | 0.734 | 0.734 | 0.734 | 0.734 | 0.734 | 100.0% | 1 | | heat.resume_stack | 1.737 | 1.737 | 1.737 | 1.737 | 1.737 | 1.737 | 100.0% | 1 | | heat.delete_stack | 2.339 | 2.339 | 2.339 | 2.339 | 2.339 | 2.339 | 100.0% | 1 | | total | 9.19 | 9.19 | 9.19 | 9.19 | 9.19 | 9.19 | 100.0% | 1 | | -> duration | 7.19 | 7.19 | 7.19 | 7.19 | 7.19 | 7.19 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.189654 Full duration: 18.314329 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task 719891e6-9f51-4ca9-aedc-80622746385b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.549 | 0.549 | 0.549 | 0.549 | 0.549 | 0.549 | 100.0% | 1 | | total | 0.549 | 0.549 | 0.549 | 0.549 | 0.549 | 0.549 | 100.0% | 1 | | -> duration | 0.549 | 0.549 | 0.549 | 0.549 | 0.549 | 0.549 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.549336 Full duration: 7.534639 HINTS: * To plot HTML graphics with this data, run: rally task report 719891e6-9f51-4ca9-aedc-80622746385b --out output.html * To generate a JUnit report, run: rally task export 719891e6-9f51-4ca9-aedc-80622746385b --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 719891e6-9f51-4ca9-aedc-80622746385b --json --out output.json 2018-05-17 17:57:30,126 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '719891e6-9f51-4ca9-aedc-80622746385b'] 2018-05-17 17:57:31,062 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-05-17 17:57:31,063 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '719891e6-9f51-4ca9-aedc-80622746385b', '--out', u'/home/opnfv/functest/results/rally/opnfv-heat.html'] 2018-05-17 17:57:31,071 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2018-05-17 17:57:31,071 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2018-05-17 17:57:31,071 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-keystone.yaml 2018-05-17 17:57:31,072 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-05-17 17:57:31,088 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-05-17 17:57:31,089 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['keystone'], 'concurrency': 4, 'netid': '3fc847d2-5f6a-4853-a522-dec6490a802f', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'flavor_name': 'rally-tiny-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-05-17 18:00:35,548 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : d0ab56d3-c6c3-41fb-a933-6dfa330e2e9e 2018-05-17 18:00:35,549 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'd0ab56d3-c6c3-41fb-a933-6dfa330e2e9e'] 2018-05-17 18:00:36,617 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task d0ab56d3-c6c3-41fb-a933-6dfa330e2e9e: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task d0ab56d3-c6c3-41fb-a933-6dfa330e2e9e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.473 | 0.473 | 0.473 | 0.473 | 0.473 | 0.473 | 100.0% | 1 | | keystone_v3.add_role | 0.116 | 0.116 | 0.116 | 0.116 | 0.116 | 0.116 | 100.0% | 1 | | keystone_v3.revoke_role | 0.131 | 0.131 | 0.131 | 0.131 | 0.131 | 0.131 | 100.0% | 1 | | total | 0.719 | 0.719 | 0.719 | 0.719 | 0.719 | 0.719 | 100.0% | 1 | | -> duration | 0.719 | 0.719 | 0.719 | 0.719 | 0.719 | 0.719 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.719477 Full duration: 13.33431 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task d0ab56d3-c6c3-41fb-a933-6dfa330e2e9e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 1.096 | 1.096 | 1.096 | 1.096 | 1.096 | 1.096 | 100.0% | 1 | | keystone_v3.add_role | 0.169 | 0.169 | 0.169 | 0.169 | 0.169 | 0.169 | 100.0% | 1 | | keystone_v3.list_roles | 0.102 | 0.102 | 0.102 | 0.102 | 0.102 | 0.102 | 100.0% | 1 | | total | 1.367 | 1.367 | 1.367 | 1.367 | 1.367 | 1.367 | 100.0% | 1 | | -> duration | 1.367 | 1.367 | 1.367 | 1.367 | 1.367 | 1.367 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.367084 Full duration: 14.318325 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task d0ab56d3-c6c3-41fb-a933-6dfa330e2e9e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.644 | 0.644 | 0.644 | 0.644 | 0.644 | 0.644 | 100.0% | 1 | | keystone_v3.list_projects | 0.075 | 0.075 | 0.075 | 0.075 | 0.075 | 0.075 | 100.0% | 1 | | total | 0.719 | 0.719 | 0.719 | 0.719 | 0.719 | 0.719 | 100.0% | 1 | | -> duration | 0.719 | 0.719 | 0.719 | 0.719 | 0.719 | 0.719 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.719233 Full duration: 13.423969 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task d0ab56d3-c6c3-41fb-a933-6dfa330e2e9e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.473 | 0.473 | 0.473 | 0.473 | 0.473 | 0.473 | 100.0% | 1 | | keystone_v3.delete_role | 0.092 | 0.092 | 0.092 | 0.092 | 0.092 | 0.092 | 100.0% | 1 | | total | 0.566 | 0.566 | 0.566 | 0.566 | 0.566 | 0.566 | 100.0% | 1 | | -> duration | 0.566 | 0.566 | 0.566 | 0.566 | 0.566 | 0.566 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.565902 Full duration: 12.089867 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task d0ab56d3-c6c3-41fb-a933-6dfa330e2e9e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.473 | 0.473 | 0.473 | 0.473 | 0.473 | 0.473 | 100.0% | 1 | | keystone_v3.delete_service | 0.093 | 0.093 | 0.093 | 0.093 | 0.093 | 0.093 | 100.0% | 1 | | total | 0.566 | 0.566 | 0.566 | 0.566 | 0.566 | 0.566 | 100.0% | 1 | | -> duration | 0.566 | 0.566 | 0.566 | 0.566 | 0.566 | 0.566 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.566494 Full duration: 11.498549 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task d0ab56d3-c6c3-41fb-a933-6dfa330e2e9e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.71 | 0.71 | 0.71 | 0.71 | 0.71 | 0.71 | 100.0% | 1 | | keystone_v3.create_user | 0.421 | 0.421 | 0.421 | 0.421 | 0.421 | 0.421 | 100.0% | 1 | | -> keystone_v3.list_roles | 0.075 | 0.075 | 0.075 | 0.075 | 0.075 | 0.075 | 100.0% | 1 | | -> keystone_v3.add_role | 0.105 | 0.105 | 0.105 | 0.105 | 0.105 | 0.105 | 100.0% | 1 | | keystone_v3.create_role | 0.088 | 0.088 | 0.088 | 0.088 | 0.088 | 0.088 | 100.0% | 1 | | keystone_v3.get_project | 0.077 | 0.077 | 0.077 | 0.077 | 0.077 | 0.077 | 100.0% | 1 | | keystone_v3.get_user | 0.083 | 0.083 | 0.083 | 0.083 | 0.083 | 0.083 | 100.0% | 1 | | keystone_v3.get_role | 0.072 | 0.072 | 0.072 | 0.072 | 0.072 | 0.072 | 100.0% | 1 | | keystone_v3.list_services | 0.076 | 0.076 | 0.076 | 0.076 | 0.076 | 0.076 | 100.0% | 1 | | keystone_v3.get_services | 0.073 | 0.073 | 0.073 | 0.073 | 0.073 | 0.073 | 100.0% | 1 | | total | 1.687 | 1.687 | 1.687 | 1.687 | 1.687 | 1.687 | 100.0% | 1 | | -> duration | 1.687 | 1.687 | 1.687 | 1.687 | 1.687 | 1.687 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.687016 Full duration: 19.096476 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task d0ab56d3-c6c3-41fb-a933-6dfa330e2e9e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.664 | 0.664 | 0.664 | 0.664 | 0.664 | 0.664 | 100.0% | 1 | | keystone_v3.update_project | 0.137 | 0.137 | 0.137 | 0.137 | 0.137 | 0.137 | 100.0% | 1 | | keystone_v3.delete_project | 0.165 | 0.165 | 0.165 | 0.165 | 0.165 | 0.165 | 100.0% | 1 | | total | 0.967 | 0.967 | 0.967 | 0.967 | 0.967 | 0.967 | 100.0% | 1 | | -> duration | 0.967 | 0.967 | 0.967 | 0.967 | 0.967 | 0.967 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.966705 Full duration: 12.204984 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task d0ab56d3-c6c3-41fb-a933-6dfa330e2e9e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.642 | 0.642 | 0.642 | 0.642 | 0.642 | 0.642 | 100.0% | 1 | | total | 0.739 | 0.739 | 0.739 | 0.739 | 0.739 | 0.739 | 100.0% | 1 | | -> duration | 0.739 | 0.739 | 0.739 | 0.739 | 0.739 | 0.739 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.739081 Full duration: 13.997589 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task d0ab56d3-c6c3-41fb-a933-6dfa330e2e9e has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.738 | 0.738 | 0.738 | 0.738 | 0.738 | 0.738 | 100.0% | 1 | | total | 0.739 | 0.739 | 0.739 | 0.739 | 0.739 | 0.739 | 100.0% | 1 | | -> duration | 0.739 | 0.739 | 0.739 | 0.739 | 0.739 | 0.739 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.738548 Full duration: 13.799873 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task d0ab56d3-c6c3-41fb-a933-6dfa330e2e9e has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.601 | 0.601 | 0.601 | 0.601 | 0.601 | 0.601 | 100.0% | 1 | | keystone_v3.list_users | 0.138 | 0.138 | 0.138 | 0.138 | 0.138 | 0.138 | 100.0% | 1 | | total | 0.839 | 0.839 | 0.839 | 0.839 | 0.839 | 0.839 | 100.0% | 1 | | -> duration | 0.839 | 0.839 | 0.839 | 0.839 | 0.839 | 0.839 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.839463 Full duration: 14.297499 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "users_per_tenant": 10 }, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task d0ab56d3-c6c3-41fb-a933-6dfa330e2e9e has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.712 | 0.712 | 0.712 | 0.712 | 0.712 | 0.712 | 100.0% | 1 | | keystone_v3.create_users | 4.849 | 4.849 | 4.849 | 4.849 | 4.849 | 4.849 | 100.0% | 1 | | -> keystone_v3.create_user (x10) | 4.849 | 4.849 | 4.849 | 4.849 | 4.849 | 4.849 | 100.0% | 1 | | --> keystone_v3.list_roles (x10) | 0.875 | 0.875 | 0.875 | 0.875 | 0.875 | 0.875 | 100.0% | 1 | | --> keystone_v3.add_role (x10) | 1.305 | 1.305 | 1.305 | 1.305 | 1.305 | 1.305 | 100.0% | 1 | | total | 6.422 | 6.422 | 6.422 | 6.422 | 6.422 | 6.422 | 100.0% | 1 | | -> duration | 6.422 | 6.422 | 6.422 | 6.422 | 6.422 | 6.422 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.422029 Full duration: 23.30389 HINTS: * To plot HTML graphics with this data, run: rally task report d0ab56d3-c6c3-41fb-a933-6dfa330e2e9e --out output.html * To generate a JUnit report, run: rally task export d0ab56d3-c6c3-41fb-a933-6dfa330e2e9e --type junit --to output.xml * To get raw JSON output of task results, run: rally task report d0ab56d3-c6c3-41fb-a933-6dfa330e2e9e --json --out output.json 2018-05-17 18:00:36,618 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'd0ab56d3-c6c3-41fb-a933-6dfa330e2e9e'] 2018-05-17 18:00:37,709 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-05-17 18:00:37,709 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'd0ab56d3-c6c3-41fb-a933-6dfa330e2e9e', '--out', u'/home/opnfv/functest/results/rally/opnfv-keystone.html'] 2018-05-17 18:00:37,716 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2018-05-17 18:00:37,716 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2018-05-17 18:00:37,717 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-neutron.yaml 2018-05-17 18:00:37,717 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-05-17 18:00:37,732 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-05-17 18:00:37,733 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['neutron'], 'concurrency': 4, 'netid': '3fc847d2-5f6a-4853-a522-dec6490a802f', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'flavor_name': 'rally-tiny-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-05-17 18:05:32,679 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 355a0756-fda7-4908-9bc6-adf65eba1604 2018-05-17 18:05:32,679 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '355a0756-fda7-4908-9bc6-adf65eba1604'] 2018-05-17 18:05:33,713 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 355a0756-fda7-4908-9bc6-adf65eba1604: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } } } -------------------------------------------------------------------------------- Task 355a0756-fda7-4908-9bc6-adf65eba1604 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.691 | 1.691 | 1.691 | 1.691 | 1.691 | 1.691 | 100.0% | 1 | | neutron.delete_network | 0.763 | 0.763 | 0.763 | 0.763 | 0.763 | 0.763 | 100.0% | 1 | | total | 2.454 | 2.454 | 2.454 | 2.454 | 2.454 | 2.454 | 100.0% | 1 | | -> duration | 2.454 | 2.454 | 2.454 | 2.454 | 2.454 | 2.454 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.45387 Full duration: 14.511666 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "port": -1 } } } } -------------------------------------------------------------------------------- Task 355a0756-fda7-4908-9bc6-adf65eba1604 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.607 | 1.607 | 1.607 | 1.607 | 1.607 | 1.607 | 100.0% | 1 | | neutron.delete_port | 0.635 | 0.635 | 0.635 | 0.635 | 0.635 | 0.635 | 100.0% | 1 | | total | 2.242 | 2.242 | 2.242 | 2.242 | 2.242 | 2.242 | 100.0% | 1 | | -> duration | 2.242 | 2.242 | 2.242 | 2.242 | 2.242 | 2.242 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.241953 Full duration: 26.94591 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "router_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1, "router": -1 } } } } -------------------------------------------------------------------------------- Task 355a0756-fda7-4908-9bc6-adf65eba1604 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.015 | 1.015 | 1.015 | 1.015 | 1.015 | 1.015 | 100.0% | 1 | | neutron.create_subnet | 0.772 | 0.772 | 0.772 | 0.772 | 0.772 | 0.772 | 100.0% | 1 | | neutron.create_router | 0.127 | 0.127 | 0.127 | 0.127 | 0.127 | 0.127 | 100.0% | 1 | | neutron.add_interface_router | 2.794 | 2.794 | 2.794 | 2.794 | 2.794 | 2.794 | 100.0% | 1 | | neutron.remove_interface_router | 1.056 | 1.056 | 1.056 | 1.056 | 1.056 | 1.056 | 100.0% | 1 | | neutron.delete_router | 0.209 | 0.209 | 0.209 | 0.209 | 0.209 | 0.209 | 100.0% | 1 | | total | 5.972 | 5.972 | 5.972 | 5.972 | 5.972 | 5.972 | 100.0% | 1 | | -> duration | 5.972 | 5.972 | 5.972 | 5.972 | 5.972 | 5.972 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.97161 Full duration: 37.004117 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1 } } } } -------------------------------------------------------------------------------- Task 355a0756-fda7-4908-9bc6-adf65eba1604 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 1.062 | 1.062 | 1.062 | 1.062 | 1.062 | 1.062 | 100.0% | 1 | | neutron.delete_subnet | 0.351 | 0.351 | 0.351 | 0.351 | 0.351 | 0.351 | 100.0% | 1 | | total | 1.413 | 1.413 | 1.413 | 1.413 | 1.413 | 1.413 | 100.0% | 1 | | -> duration | 1.413 | 1.413 | 1.413 | 1.413 | 1.413 | 1.413 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.412839 Full duration: 27.624807 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } } } -------------------------------------------------------------------------------- Task 355a0756-fda7-4908-9bc6-adf65eba1604 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.978 | 0.978 | 0.978 | 0.978 | 0.978 | 0.978 | 100.0% | 1 | | neutron.list_networks | 0.28 | 0.28 | 0.28 | 0.28 | 0.28 | 0.28 | 100.0% | 1 | | total | 1.258 | 1.258 | 1.258 | 1.258 | 1.258 | 1.258 | 100.0% | 1 | | -> duration | 1.258 | 1.258 | 1.258 | 1.258 | 1.258 | 1.258 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.258174 Full duration: 15.921904 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "port": -1 } } } } -------------------------------------------------------------------------------- Task 355a0756-fda7-4908-9bc6-adf65eba1604 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.576 | 1.576 | 1.576 | 1.576 | 1.576 | 1.576 | 100.0% | 1 | | neutron.list_ports | 0.111 | 0.111 | 0.111 | 0.111 | 0.111 | 0.111 | 100.0% | 1 | | total | 1.687 | 1.687 | 1.687 | 1.687 | 1.687 | 1.687 | 100.0% | 1 | | -> duration | 1.687 | 1.687 | 1.687 | 1.687 | 1.687 | 1.687 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.687015 Full duration: 27.259013 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "router_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } } } -------------------------------------------------------------------------------- Task 355a0756-fda7-4908-9bc6-adf65eba1604 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.422 | 1.422 | 1.422 | 1.422 | 1.422 | 1.422 | 100.0% | 1 | | neutron.create_subnet | 0.677 | 0.677 | 0.677 | 0.677 | 0.677 | 0.677 | 100.0% | 1 | | neutron.create_router | 0.086 | 0.086 | 0.086 | 0.086 | 0.086 | 0.086 | 100.0% | 1 | | neutron.add_interface_router | 1.536 | 1.536 | 1.536 | 1.536 | 1.536 | 1.536 | 100.0% | 1 | | neutron.list_routers | 0.111 | 0.111 | 0.111 | 0.111 | 0.111 | 0.111 | 100.0% | 1 | | total | 3.832 | 3.832 | 3.832 | 3.832 | 3.832 | 3.832 | 100.0% | 1 | | -> duration | 3.832 | 3.832 | 3.832 | 3.832 | 3.832 | 3.832 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.831867 Full duration: 34.503489 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1 } } } } -------------------------------------------------------------------------------- Task 355a0756-fda7-4908-9bc6-adf65eba1604 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.839 | 0.839 | 0.839 | 0.839 | 0.839 | 0.839 | 100.0% | 1 | | neutron.create_subnet | 0.476 | 0.476 | 0.476 | 0.476 | 0.476 | 0.476 | 100.0% | 1 | | neutron.list_subnets | 0.079 | 0.079 | 0.079 | 0.079 | 0.079 | 0.079 | 100.0% | 1 | | total | 1.394 | 1.394 | 1.394 | 1.394 | 1.394 | 1.394 | 100.0% | 1 | | -> duration | 1.394 | 1.394 | 1.394 | 1.394 | 1.394 | 1.394 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.393973 Full duration: 29.68708 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } } } -------------------------------------------------------------------------------- Task 355a0756-fda7-4908-9bc6-adf65eba1604 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.963 | 0.963 | 0.963 | 0.963 | 0.963 | 0.963 | 100.0% | 1 | | neutron.delete_security_group | 0.111 | 0.111 | 0.111 | 0.111 | 0.111 | 0.111 | 100.0% | 1 | | total | 1.074 | 1.074 | 1.074 | 1.074 | 1.074 | 1.074 | 100.0% | 1 | | -> duration | 1.074 | 1.074 | 1.074 | 1.074 | 1.074 | 1.074 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.073577 Full duration: 14.556872 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } } } -------------------------------------------------------------------------------- Task 355a0756-fda7-4908-9bc6-adf65eba1604 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.837 | 0.837 | 0.837 | 0.837 | 0.837 | 0.837 | 100.0% | 1 | | neutron.create_security_group_rule | 0.162 | 0.162 | 0.162 | 0.162 | 0.162 | 0.162 | 100.0% | 1 | | neutron.delete_security_group_rule | 0.075 | 0.075 | 0.075 | 0.075 | 0.075 | 0.075 | 100.0% | 1 | | neutron.delete_security_group | 0.128 | 0.128 | 0.128 | 0.128 | 0.128 | 0.128 | 100.0% | 1 | | total | 1.202 | 1.202 | 1.202 | 1.202 | 1.202 | 1.202 | 100.0% | 1 | | -> duration | 1.202 | 1.202 | 1.202 | 1.202 | 1.202 | 1.202 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.201727 Full duration: 14.068797 -------------------------------------------------------------------------------- test scenario NeutronNetworks.set_and_clear_router_gateway args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": { "router:external": true } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "router": -1 } }, "roles": [ "admin" ] } } -------------------------------------------------------------------------------- Task 355a0756-fda7-4908-9bc6-adf65eba1604 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.071 | 1.071 | 1.071 | 1.071 | 1.071 | 1.071 | 100.0% | 1 | | neutron.create_router | 0.128 | 0.128 | 0.128 | 0.128 | 0.128 | 0.128 | 100.0% | 1 | | neutron.add_gateway_router | 2.038 | 2.038 | 2.038 | 2.038 | 2.038 | 2.038 | 100.0% | 1 | | neutron.remove_gateway_router | 0.902 | 0.902 | 0.902 | 0.902 | 0.902 | 0.902 | 100.0% | 1 | | total | 4.14 | 4.14 | 4.14 | 4.14 | 4.14 | 4.14 | 100.0% | 1 | | -> duration | 4.14 | 4.14 | 4.14 | 4.14 | 4.14 | 4.14 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.139789 Full duration: 23.78564 HINTS: * To plot HTML graphics with this data, run: rally task report 355a0756-fda7-4908-9bc6-adf65eba1604 --out output.html * To generate a JUnit report, run: rally task export 355a0756-fda7-4908-9bc6-adf65eba1604 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 355a0756-fda7-4908-9bc6-adf65eba1604 --json --out output.json 2018-05-17 18:05:33,713 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '355a0756-fda7-4908-9bc6-adf65eba1604'] 2018-05-17 18:05:34,767 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-05-17 18:05:34,768 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '355a0756-fda7-4908-9bc6-adf65eba1604', '--out', u'/home/opnfv/functest/results/rally/opnfv-neutron.html'] 2018-05-17 18:05:34,775 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2018-05-17 18:05:34,775 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2018-05-17 18:05:34,776 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-nova.yaml 2018-05-17 18:05:34,776 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-05-17 18:05:34,792 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-05-17 18:05:34,793 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['nova'], 'concurrency': 4, 'netid': '3fc847d2-5f6a-4853-a522-dec6490a802f', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'flavor_name': 'rally-tiny-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-05-17 18:12:28,469 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 7615601c-8a55-490d-a724-9dbec2186109 2018-05-17 18:12:28,470 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '7615601c-8a55-490d-a724-9dbec2186109'] 2018-05-17 18:12:29,524 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 7615601c-8a55-490d-a724-9dbec2186109: finished -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_live_migrate_server args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-a1bd2cb6-0d55-4462-bf74-54086d865fa3" }, "image": { "name": "Cirros-0.4.0-a1bd2cb6-0d55-4462-bf74-54086d865fa3" }, "block_migration": false, "nics": [ { "net-id": "3fc847d2-5f6a-4853-a522-dec6490a802f" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 7615601c-8a55-490d-a724-9dbec2186109 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 12.834 | 12.834 | 12.834 | 12.834 | 12.834 | 12.834 | 100.0% | 1 | | nova.find_host_to_migrate | 0.954 | 0.954 | 0.954 | 0.954 | 0.954 | 0.954 | 100.0% | 1 | | nova.live_migrate | 19.106 | 19.106 | 19.106 | 19.106 | 19.106 | 19.106 | 100.0% | 1 | | nova.delete_server | 4.811 | 4.811 | 4.811 | 4.811 | 4.811 | 4.811 | 100.0% | 1 | | total | 37.705 | 37.705 | 37.705 | 37.705 | 37.705 | 37.705 | 100.0% | 1 | | -> duration | 36.705 | 36.705 | 36.705 | 36.705 | 36.705 | 36.705 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 36.704757 Full duration: 47.299283 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_attach_created_volume_and_live_migrate args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-a1bd2cb6-0d55-4462-bf74-54086d865fa3" }, "image": { "name": "Cirros-0.4.0-a1bd2cb6-0d55-4462-bf74-54086d865fa3" }, "size": 10, "block_migration": false, "boot_server_kwargs": { "nics": [ { "net-id": "3fc847d2-5f6a-4853-a522-dec6490a802f" } ] } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 7615601c-8a55-490d-a724-9dbec2186109 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 10.115 | 10.115 | 10.115 | 10.115 | 10.115 | 10.115 | 100.0% | 1 | | cinder_v2.create_volume | 3.314 | 3.314 | 3.314 | 3.314 | 3.314 | 3.314 | 100.0% | 1 | | nova.attach_volume | 3.958 | 3.958 | 3.958 | 3.958 | 3.958 | 3.958 | 100.0% | 1 | | nova.find_host_to_migrate | 0.879 | 0.879 | 0.879 | 0.879 | 0.879 | 0.879 | 100.0% | 1 | | nova.live_migrate | 15.098 | 15.098 | 15.098 | 15.098 | 15.098 | 15.098 | 100.0% | 1 | | nova.detach_volume | 3.6 | 3.6 | 3.6 | 3.6 | 3.6 | 3.6 | 100.0% | 1 | | cinder_v2.delete_volume | 2.462 | 2.462 | 2.462 | 2.462 | 2.462 | 2.462 | 100.0% | 1 | | nova.delete_server | 5.123 | 5.123 | 5.123 | 5.123 | 5.123 | 5.123 | 100.0% | 1 | | total | 44.551 | 44.551 | 44.551 | 44.551 | 44.551 | 44.551 | 100.0% | 1 | | -> duration | 43.551 | 43.551 | 43.551 | 43.551 | 43.551 | 43.551 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 43.551236 Full duration: 55.223675 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume_and_live_migrate args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-a1bd2cb6-0d55-4462-bf74-54086d865fa3" }, "image": { "name": "Cirros-0.4.0-a1bd2cb6-0d55-4462-bf74-54086d865fa3" }, "block_migration": false, "volume_size": 10, "force_delete": false, "nics": [ { "net-id": "3fc847d2-5f6a-4853-a522-dec6490a802f" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 7615601c-8a55-490d-a724-9dbec2186109 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 12.26 | 12.26 | 12.26 | 12.26 | 12.26 | 12.26 | 100.0% | 1 | | nova.boot_server | 8.344 | 8.344 | 8.344 | 8.344 | 8.344 | 8.344 | 100.0% | 1 | | nova.find_host_to_migrate | 1.023 | 1.023 | 1.023 | 1.023 | 1.023 | 1.023 | 100.0% | 1 | | nova.live_migrate | 9.97 | 9.97 | 9.97 | 9.97 | 9.97 | 9.97 | 100.0% | 1 | | nova.delete_server | 11.829 | 11.829 | 11.829 | 11.829 | 11.829 | 11.829 | 100.0% | 1 | | total | 43.427 | 43.427 | 43.427 | 43.427 | 43.427 | 43.427 | 100.0% | 1 | | -> duration | 42.427 | 42.427 | 42.427 | 42.427 | 42.427 | 42.427 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 42.426695 Full duration: 54.754773 -------------------------------------------------------------------------------- test scenario NovaKeypair.boot_and_delete_server_with_keypair args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-a1bd2cb6-0d55-4462-bf74-54086d865fa3" }, "image": { "name": "Cirros-0.4.0-a1bd2cb6-0d55-4462-bf74-54086d865fa3" }, "server_kwargs": { "nics": [ { "net-id": "3fc847d2-5f6a-4853-a522-dec6490a802f" } ] } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "key_pairs": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } } } -------------------------------------------------------------------------------- Task 7615601c-8a55-490d-a724-9dbec2186109 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_keypair | 0.717 | 0.717 | 0.717 | 0.717 | 0.717 | 0.717 | 100.0% | 1 | | nova.boot_server | 9.947 | 9.947 | 9.947 | 9.947 | 9.947 | 9.947 | 100.0% | 1 | | nova.delete_server | 4.77 | 4.77 | 4.77 | 4.77 | 4.77 | 4.77 | 100.0% | 1 | | nova.delete_keypair | 0.04 | 0.04 | 0.04 | 0.04 | 0.04 | 0.04 | 100.0% | 1 | | total | 15.476 | 15.476 | 15.476 | 15.476 | 15.476 | 15.476 | 100.0% | 1 | | -> duration | 14.476 | 14.476 | 14.476 | 14.476 | 14.476 | 14.476 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 14.476214 Full duration: 36.26363 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_from_volume_and_delete args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-a1bd2cb6-0d55-4462-bf74-54086d865fa3" }, "image": { "name": "Cirros-0.4.0-a1bd2cb6-0d55-4462-bf74-54086d865fa3" }, "volume_size": 5, "nics": [ { "net-id": "3fc847d2-5f6a-4853-a522-dec6490a802f" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 }, "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } } } -------------------------------------------------------------------------------- Task 7615601c-8a55-490d-a724-9dbec2186109 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 10.031 | 10.031 | 10.031 | 10.031 | 10.031 | 10.031 | 100.0% | 1 | | nova.boot_server | 8.414 | 8.414 | 8.414 | 8.414 | 8.414 | 8.414 | 100.0% | 1 | | nova.delete_server | 4.684 | 4.684 | 4.684 | 4.684 | 4.684 | 4.684 | 100.0% | 1 | | total | 23.13 | 23.13 | 23.13 | 23.13 | 23.13 | 23.13 | 100.0% | 1 | | -> duration | 22.13 | 22.13 | 22.13 | 22.13 | 22.13 | 22.13 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 22.130253 Full duration: 46.906535 -------------------------------------------------------------------------------- test scenario NovaServers.pause_and_unpause_server args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-a1bd2cb6-0d55-4462-bf74-54086d865fa3" }, "image": { "name": "Cirros-0.4.0-a1bd2cb6-0d55-4462-bf74-54086d865fa3" }, "force_delete": false, "nics": [ { "net-id": "3fc847d2-5f6a-4853-a522-dec6490a802f" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": { "networks_per_tenant": 1, "start_cidr": "100.1.0.0/25" }, "quotas": { "neutron": { "network": -1, "port": -1, "subnet": -1 }, "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } } } -------------------------------------------------------------------------------- Task 7615601c-8a55-490d-a724-9dbec2186109 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 11.371 | 11.371 | 11.371 | 11.371 | 11.371 | 11.371 | 100.0% | 1 | | nova.pause_server | 2.545 | 2.545 | 2.545 | 2.545 | 2.545 | 2.545 | 100.0% | 1 | | nova.unpause_server | 2.364 | 2.364 | 2.364 | 2.364 | 2.364 | 2.364 | 100.0% | 1 | | nova.delete_server | 2.629 | 2.629 | 2.629 | 2.629 | 2.629 | 2.629 | 100.0% | 1 | | total | 18.91 | 18.91 | 18.91 | 18.91 | 18.91 | 18.91 | 100.0% | 1 | | -> duration | 13.91 | 13.91 | 13.91 | 13.91 | 13.91 | 13.91 | 100.0% | 1 | | -> idle_duration | 5.0 | 5.0 | 5.0 | 5.0 | 5.0 | 5.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 13.910479 Full duration: 39.218964 -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_migrate_server args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-a1bd2cb6-0d55-4462-bf74-54086d865fa3" }, "image": { "name": "Cirros-0.4.0-a1bd2cb6-0d55-4462-bf74-54086d865fa3" }, "nics": [ { "net-id": "3fc847d2-5f6a-4853-a522-dec6490a802f" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 7615601c-8a55-490d-a724-9dbec2186109 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 7.404 | 7.404 | 7.404 | 7.404 | 7.404 | 7.404 | 100.0% | 1 | | nova.migrate | 24.612 | 24.612 | 24.612 | 24.612 | 24.612 | 24.612 | 100.0% | 1 | | nova.resize_confirm | 5.012 | 5.012 | 5.012 | 5.012 | 5.012 | 5.012 | 100.0% | 1 | | nova.delete_server | 4.983 | 4.983 | 4.983 | 4.983 | 4.983 | 4.983 | 100.0% | 1 | | total | 42.012 | 42.012 | 42.012 | 42.012 | 42.012 | 42.012 | 100.0% | 1 | | -> duration | 41.012 | 41.012 | 41.012 | 41.012 | 41.012 | 41.012 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 41.012378 Full duration: 50.9295 -------------------------------------------------------------------------------- test scenario NovaServers.boot_server_and_list_interfaces args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-a1bd2cb6-0d55-4462-bf74-54086d865fa3" }, "image": { "name": "Cirros-0.4.0-a1bd2cb6-0d55-4462-bf74-54086d865fa3" }, "auto_assign_nic": true }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {} } } -------------------------------------------------------------------------------- Task 7615601c-8a55-490d-a724-9dbec2186109 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 10.216 | 10.216 | 10.216 | 10.216 | 10.216 | 10.216 | 100.0% | 1 | | nova.list_interfaces | 0.23 | 0.23 | 0.23 | 0.23 | 0.23 | 0.23 | 100.0% | 1 | | total | 10.446 | 10.446 | 10.446 | 10.446 | 10.446 | 10.446 | 100.0% | 1 | | -> duration | 9.446 | 9.446 | 9.446 | 9.446 | 9.446 | 9.446 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 9.445721 Full duration: 36.399353 -------------------------------------------------------------------------------- test scenario NovaServerGroups.create_and_delete_server_group args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "policies": [ "affinity" ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 7615601c-8a55-490d-a724-9dbec2186109 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.create_server_group | 0.735 | 0.735 | 0.735 | 0.735 | 0.735 | 0.735 | 100.0% | 1 | | nova.delete_server_group | 0.087 | 0.087 | 0.087 | 0.087 | 0.087 | 0.087 | 100.0% | 1 | | total | 0.822 | 0.822 | 0.822 | 0.822 | 0.822 | 0.822 | 100.0% | 1 | | -> duration | 0.822 | 0.822 | 0.822 | 0.822 | 0.822 | 0.822 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +--------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.821957 Full duration: 10.213906 HINTS: * To plot HTML graphics with this data, run: rally task report 7615601c-8a55-490d-a724-9dbec2186109 --out output.html * To generate a JUnit report, run: rally task export 7615601c-8a55-490d-a724-9dbec2186109 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 7615601c-8a55-490d-a724-9dbec2186109 --json --out output.json 2018-05-17 18:12:29,524 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '7615601c-8a55-490d-a724-9dbec2186109'] 2018-05-17 18:12:30,523 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-05-17 18:12:30,524 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '7615601c-8a55-490d-a724-9dbec2186109', '--out', u'/home/opnfv/functest/results/rally/opnfv-nova.html'] 2018-05-17 18:12:30,532 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" OK. 2018-05-17 18:12:30,532 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2018-05-17 18:12:30,532 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-quotas.yaml 2018-05-17 18:12:30,533 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-05-17 18:12:30,549 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'Quotas.nova_update_and_delete'] 2018-05-17 18:12:30,550 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['quotas'], 'concurrency': 4, 'netid': '3fc847d2-5f6a-4853-a522-dec6490a802f', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'flavor_name': 'rally-tiny-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-a1bd2cb6-0d55-4462-bf74-54086d865fa3', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-05-17 18:13:21,703 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 52713d77-8071-41b7-a6fc-3d58e985d185 2018-05-17 18:13:21,703 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '52713d77-8071-41b7-a6fc-3d58e985d185'] 2018-05-17 18:13:22,726 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 52713d77-8071-41b7-a6fc-3d58e985d185: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 52713d77-8071-41b7-a6fc-3d58e985d185 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.713 | 0.713 | 0.713 | 0.713 | 0.713 | 0.713 | 100.0% | 1 | | quotas.delete_quotas | 0.539 | 0.539 | 0.539 | 0.539 | 0.539 | 0.539 | 100.0% | 1 | | total | 1.252 | 1.252 | 1.252 | 1.252 | 1.252 | 1.252 | 100.0% | 1 | | -> duration | 1.252 | 1.252 | 1.252 | 1.252 | 1.252 | 1.252 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.251525 Full duration: 8.872852 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 52713d77-8071-41b7-a6fc-3d58e985d185 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.734 | 0.734 | 0.734 | 0.734 | 0.734 | 0.734 | 100.0% | 1 | | total | 0.734 | 0.734 | 0.734 | 0.734 | 0.734 | 0.734 | 100.0% | 1 | | -> duration | 0.734 | 0.734 | 0.734 | 0.734 | 0.734 | 0.734 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.734036 Full duration: 7.607077 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 52713d77-8071-41b7-a6fc-3d58e985d185 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.305 | 0.305 | 0.305 | 0.305 | 0.305 | 0.305 | 100.0% | 1 | | total | 0.686 | 0.686 | 0.686 | 0.686 | 0.686 | 0.686 | 100.0% | 1 | | -> duration | 0.686 | 0.686 | 0.686 | 0.686 | 0.686 | 0.686 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.686324 Full duration: 8.403012 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 52713d77-8071-41b7-a6fc-3d58e985d185 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.235 | 1.235 | 1.235 | 1.235 | 1.235 | 1.235 | 100.0% | 1 | | total | 1.235 | 1.235 | 1.235 | 1.235 | 1.235 | 1.235 | 100.0% | 1 | | -> duration | 1.235 | 1.235 | 1.235 | 1.235 | 1.235 | 1.235 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.235279 Full duration: 8.44057 HINTS: * To plot HTML graphics with this data, run: rally task report 52713d77-8071-41b7-a6fc-3d58e985d185 --out output.html * To generate a JUnit report, run: rally task export 52713d77-8071-41b7-a6fc-3d58e985d185 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 52713d77-8071-41b7-a6fc-3d58e985d185 --json --out output.json 2018-05-17 18:13:22,727 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '52713d77-8071-41b7-a6fc-3d58e985d185'] 2018-05-17 18:13:23,802 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-05-17 18:13:23,802 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '52713d77-8071-41b7-a6fc-3d58e985d185', '--out', u'/home/opnfv/functest/results/rally/opnfv-quotas.html'] 2018-05-17 18:13:23,810 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2018-05-17 18:13:23,815 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:44 | 6 | 100.00% | | glance | 01:22 | 4 | 100.00% | | cinder | 02:49 | 10 | 100.00% | | heat | 01:00 | 4 | 100.00% | | keystone | 02:41 | 11 | 100.00% | | neutron | 04:25 | 11 | 100.00% | | nova | 06:17 | 9 | 100.00% | | quotas | 00:33 | 4 | 100.00% | | | | | | | TOTAL: | 00:19:55 | 59 | 100.00% | +----------------+------------+----------------+-----------+ 2018-05-17 18:13:23,815 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_sanity' success_rate is 100.00% 2018-05-17 18:13:33,518 - xtesting.energy.energy - DEBUG - Restoring previous scenario (default/default) 2018-05-17 18:13:33,518 - xtesting.energy.energy - DEBUG - Submitting scenario (default/default) 2018-05-17 18:13:34,075 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-17 18:13:34,075 - xtesting.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | rally_sanity | functest | 23:41 | PASS | +----------------------+------------------+------------------+----------------+ 2018-05-17 18:13:34,079 - xtesting.ci.run_tests - INFO - Running test case 'refstack_defcore'... 2018-05-17 18:13:34,149 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-05-17 18:13:36,553 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-05-17 18:13:36.211 11197 INFO rally.deployment.engine [-] Deployment d883e3e0-ff64-4ad8-89f2-505ea7f4ce82 | Starting: Destroy cloud and free allocated resources. 2018-05-17 18:13:36.302 11197 INFO rally.deployment.engine [-] Deployment d883e3e0-ff64-4ad8-89f2-505ea7f4ce82 | Completed: Destroy cloud and free allocated resources. 2018-05-17 18:13:36.327 11197 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=3954d143-3e23-4081-bd84-af5fb15e5eb2). 2018-05-17 18:13:36.332 11197 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-05-17 18:13:38,852 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-05-17 18:13:38.518 11200 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=1b14d9e2-c7ab-44af-a582-2936555154a0) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 1b14d9e2-c7ab-44af-a582-2936555154a0 | 2018-05-17T18:13:38 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 1b14d9e2-c7ab-44af-a582-2936555154a0 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-05-17 18:13:42,163 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-05-17 18:13:42,163 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-05-17 18:13:44,533 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-05-17 18:13:44.256 11206 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=3954d143-3e23-4081-bd84-af5fb15e5eb2). 2018-05-17 18:13:44.390 11206 INFO rally.api [-] Verifier has been successfully deleted! 2018-05-17 18:13:48,094 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-05-17 18:13:46.607 11209 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-05-17 18:13:46.774 11209 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-05-17 18:13:47.893 11209 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=bb650726-f25c-4cd9-a8a6-1b3f5e3415bf) has been successfully created! Using verifier 'opnfv-tempest' (UUID=bb650726-f25c-4cd9-a8a6-1b3f5e3415bf) as the default verifier for the future CLI operations. 2018-05-17 18:13:51,098 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-05-17 18:13:53,653 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-05-17 18:13:59,201 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-05-17 18:14:04,761 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-05-17 18:14:03.976 11228 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=bb650726-f25c-4cd9-a8a6-1b3f5e3415bf) for deployment 'opnfv-rally' (UUID=1b14d9e2-c7ab-44af-a582-2936555154a0). 2018-05-17 18:14:04.629 11228 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=bb650726-f25c-4cd9-a8a6-1b3f5e3415bf) has been successfully configured for deployment 'opnfv-rally' (UUID=1b14d9e2-c7ab-44af-a582-2936555154a0)! 2018-05-17 18:14:04,761 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-05-17 18:14:04,761 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-05-17 18:14:04,764 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-05-17 18:14:06,793 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/refstack/tempest-list.txt']'. 2018-05-17 18:14:08,932 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:08.932 11240 INFO rally.api [-] Starting verification (UUID=1798d02e-ae3a-4a8b-8561-4bd0afc1156d) for deployment 'opnfv-rally' (UUID=1b14d9e2-c7ab-44af-a582-2936555154a0) by verifier 'opnfv-tempest' (UUID=bb650726-f25c-4cd9-a8a6-1b3f5e3415bf). 2018-05-17 18:14:08,932 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: 1798d02e-ae3a-4a8b-8561-4bd0afc1156d 2018-05-17 18:14:20,663 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:20.662 11240 INFO opnfv-tempest [-] {12} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.014s] 2018-05-17 18:14:21,096 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:21.095 11240 INFO opnfv-tempest [-] {14} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.362s] 2018-05-17 18:14:21,390 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:21.390 11240 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.452s] 2018-05-17 18:14:21,469 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:21.468 11240 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.078s] 2018-05-17 18:14:21,518 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:21.518 11240 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [0.627s] 2018-05-17 18:14:21,548 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:21.548 11240 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.030s] 2018-05-17 18:14:21,596 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:21.596 11240 INFO opnfv-tempest [-] {8} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.339s] 2018-05-17 18:14:27,553 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:27.553 11240 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password ... success [6.327s] 2018-05-17 18:14:30,741 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:30.740 11240 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.336s] 2018-05-17 18:14:31,247 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:31.247 11240 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.238s] 2018-05-17 18:14:31,416 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:31.416 11240 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.169s] 2018-05-17 18:14:32,000 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:32.000 11240 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.583s] 2018-05-17 18:14:33,248 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:33.248 11240 INFO opnfv-tempest [-] {14} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [3.192s] 2018-05-17 18:14:35,379 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:35.379 11240 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [4.637s] 2018-05-17 18:14:38,734 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:38.734 11240 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [3.354s] 2018-05-17 18:14:40,307 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:40.306 11240 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action ... success [0.216s] 2018-05-17 18:14:40,995 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:40.995 11240 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [4.303s] 2018-05-17 18:14:41,745 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:41.744 11240 INFO opnfv-tempest [-] {6} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [3.352s] 2018-05-17 18:14:41,953 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:41.952 11240 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [3.219s] 2018-05-17 18:14:42,401 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:42.400 11240 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.143s] 2018-05-17 18:14:42,416 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:42.416 11240 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.015s] 2018-05-17 18:14:42,564 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:42.564 11240 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [1.568s] 2018-05-17 18:14:43,239 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:43.238 11240 INFO opnfv-tempest [-] {6} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [1.493s] 2018-05-17 18:14:43,283 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:43.282 11240 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [0.866s] 2018-05-17 18:14:43,292 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:43.292 11240 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.009s] 2018-05-17 18:14:43,312 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:43.312 11240 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.020s] 2018-05-17 18:14:43,367 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:43.367 11240 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [1.413s] 2018-05-17 18:14:44,762 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:44.762 11240 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [1.393s] 2018-05-17 18:14:46,857 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:46.857 11240 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [2.093s] 2018-05-17 18:14:46,981 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:46.980 11240 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.125s] 2018-05-17 18:14:47,014 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:47.013 11240 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.033s] 2018-05-17 18:14:47,061 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:47.060 11240 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.047s] 2018-05-17 18:14:47,090 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:47.090 11240 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.029s] 2018-05-17 18:14:47,121 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:47.120 11240 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server ... success [26.515s] 2018-05-17 18:14:47,220 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:47.220 11240 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair ... success [19.665s] 2018-05-17 18:14:47,251 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:47.251 11240 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions ... success [6.944s] 2018-05-17 18:14:47,413 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:47.413 11240 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date ... success [0.141s] 2018-05-17 18:14:47,424 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:47.424 11240 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date ... success [0.011s] 2018-05-17 18:14:47,992 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:47.992 11240 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count ... success [0.568s] 2018-05-17 18:14:48,005 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:48.005 11240 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value ... success [0.013s] 2018-05-17 18:14:48,017 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:48.017 11240 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string ... success [0.012s] 2018-05-17 18:14:48,049 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:48.049 11240 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor ... success [0.032s] 2018-05-17 18:14:48,113 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:48.113 11240 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image ... success [0.063s] 2018-05-17 18:14:48,175 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:48.175 11240 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name ... success [0.060s] 2018-05-17 18:14:48,328 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:48.327 11240 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted ... success [0.153s] 2018-05-17 18:14:48,344 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:48.344 11240 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing ... success [0.015s] 2018-05-17 18:14:48,406 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:48.406 11240 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server ... success [0.062s] 2018-05-17 18:14:54,472 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:54.472 11240 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_flavor ... success [0.248s] 2018-05-17 18:14:55,080 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:55.080 11240 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_image ... success [0.606s] 2018-05-17 18:14:55,348 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:55.348 11240 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_name ... success [0.268s] 2018-05-17 18:14:55,587 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:55.586 11240 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_filter_by_server_status ... success [0.238s] 2018-05-17 18:14:55,819 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:55.818 11240 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_detailed_limit_results ... success [0.232s] 2018-05-17 18:14:55,889 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:55.889 11240 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_active_status ... success [0.069s] 2018-05-17 18:14:55,958 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:55.958 11240 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_flavor ... success [0.069s] 2018-05-17 18:14:56,051 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:56.051 11240 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_image ... success [0.092s] 2018-05-17 18:14:56,136 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:56.136 11240 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_limit ... success [0.084s] 2018-05-17 18:14:56,228 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:56.228 11240 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filter_by_server_name ... success [0.092s] 2018-05-17 18:14:56,420 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:56.419 11240 INFO opnfv-tempest [-] {7} tempest.api.compute.servers.test_list_server_filters.ListServerFiltersTestJSON.test_list_servers_filtered_by_name_wildcard ... success [0.191s] 2018-05-17 18:14:58,242 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:14:58.242 11240 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image ... success [1.190s] 2018-05-17 18:15:04,176 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:04.176 11240 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.150s] 2018-05-17 18:15:04,316 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:04.315 11240 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name ... success [0.139s] 2018-05-17 18:15:04,567 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:04.567 11240 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name ... success [0.251s] 2018-05-17 18:15:05,148 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:05.148 11240 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination ... success [0.580s] 2018-05-17 18:15:05,677 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:05.677 11240 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params ... success [0.528s] 2018-05-17 18:15:05,902 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:05.902 11240 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination ... success [0.224s] 2018-05-17 18:15:05,943 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:05.942 11240 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status ... success [0.040s] 2018-05-17 18:15:06,016 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:06.015 11240 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status ... success [0.072s] 2018-05-17 18:15:06,069 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:06.068 11240 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata ... success [0.053s] 2018-05-17 18:15:06,119 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:06.119 11240 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details ... success [0.049s] 2018-05-17 18:15:06,163 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:06.163 11240 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata ... success [0.044s] 2018-05-17 18:15:06,252 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:06.251 11240 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone ... success [0.087s] 2018-05-17 18:15:06,332 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:06.331 11240 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status ... success [0.079s] 2018-05-17 18:15:06,395 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:06.395 11240 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone ... success [0.063s] 2018-05-17 18:15:06,443 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:06.443 11240 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status ... success [0.049s] 2018-05-17 18:15:06,722 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:06.722 11240 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name ... success [1.025s] 2018-05-17 18:15:06,731 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:06.731 11240 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [7.770s] 2018-05-17 18:15:07,847 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:07.847 11240 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit ... success [1.123s] 2018-05-17 18:15:08,498 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:08.498 11240 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name ... success [5.585s] 2018-05-17 18:15:08,559 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:08.558 11240 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.062s] 2018-05-17 18:15:08,888 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:08.888 11240 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail ... success [0.328s] 2018-05-17 18:15:08,996 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:08.996 11240 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus ... success [0.107s] 2018-05-17 18:15:08,997 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:08.997 11240 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s] 2018-05-17 18:15:09,073 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:09.073 11240 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 ... success [1.226s] 2018-05-17 18:15:10,844 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:10.843 11240 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor ... success [1.768s] 2018-05-17 18:15:12,130 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:12.130 11240 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image ... success [1.287s] 2018-05-17 18:15:12,489 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:12.489 11240 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [5.757s] 2018-05-17 18:15:13,390 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:13.390 11240 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port ... success [4.889s] 2018-05-17 18:15:13,442 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:13.442 11240 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid ... success [1.311s] 2018-05-17 18:15:13,718 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:13.718 11240 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit ... success [0.276s] 2018-05-17 18:15:13,963 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:13.963 11240 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id ... success [0.244s] 2018-05-17 18:15:14,190 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:14.190 11240 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server ... success [0.226s] 2018-05-17 18:15:15,408 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:15.408 11240 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address ... success [1.216s] 2018-05-17 18:15:15,696 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:15.696 11240 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server ... success [0.288s] 2018-05-17 18:15:15,997 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:15.997 11240 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_deleted_server ... success [0.300s] 2018-05-17 18:15:16,473 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:16.473 11240 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server ... success [0.476s] 2018-05-17 18:15:17,778 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:17.778 11240 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank ... success [1.302s] 2018-05-17 18:15:17,910 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:17.909 11240 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [5.420s] 2018-05-17 18:15:18,132 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:18.132 11240 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server ... success [0.354s] 2018-05-17 18:15:18,630 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:18.629 11240 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server ... success [0.497s] 2018-05-17 18:15:18,958 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:18.957 11240 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 ... success [0.328s] 2018-05-17 18:15:19,422 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:19.421 11240 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name ... success [0.463s] 2018-05-17 18:15:21,006 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:21.006 11240 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name ... success [33.778s] 2018-05-17 18:15:22,000 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:21.999 11240 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [8.608s] 2018-05-17 18:15:24,469 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:24.468 11240 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [6.558s] 2018-05-17 18:15:26,191 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:26.191 11240 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [4.190s] 2018-05-17 18:15:26,239 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:26.239 11240 INFO opnfv-tempest [-] {15} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_lock_unlock_server ... success [27.399s] 2018-05-17 18:15:26,585 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:26.584 11240 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.393s] 2018-05-17 18:15:26,630 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:26.630 11240 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields ... success [0.045s] 2018-05-17 18:15:26,708 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:26.707 11240 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.078s] 2018-05-17 18:15:26,766 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:26.766 11240 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields ... success [0.057s] 2018-05-17 18:15:28,663 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:28.662 11240 INFO opnfv-tempest [-] {7} tempest.api.volume.test_extensions.ExtensionsTestJSON.test_list_extensions ... success [0.169s] 2018-05-17 18:15:29,551 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:29.550 11240 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [5.081s] 2018-05-17 18:15:32,587 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:32.586 11240 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address ... success [11.580s] 2018-05-17 18:15:36,213 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:36.212 11240 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [6.661s] 2018-05-17 18:15:37,927 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:37.926 11240 INFO opnfv-tempest [-] {15} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [11.689s] 2018-05-17 18:15:38,445 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:38.445 11240 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [2.232s] 2018-05-17 18:15:42,461 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:42.460 11240 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.551s] 2018-05-17 18:15:42,705 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:42.705 11240 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.244s] 2018-05-17 18:15:42,972 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:42.971 11240 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [0.266s] 2018-05-17 18:15:43,449 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:43.449 11240 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [0.477s] 2018-05-17 18:15:44,116 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:44.115 11240 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [0.666s] 2018-05-17 18:15:44,380 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:44.379 11240 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [5.933s] 2018-05-17 18:15:44,511 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:44.511 11240 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [0.395s] 2018-05-17 18:15:47,560 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:47.560 11240 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [3.179s] 2018-05-17 18:15:47,817 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:47.817 11240 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.257s] 2018-05-17 18:15:47,916 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:47.916 11240 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.098s] 2018-05-17 18:15:47,984 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:47.983 11240 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.067s] 2018-05-17 18:15:48,197 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:48.196 11240 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.212s] 2018-05-17 18:15:48,299 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:48.298 11240 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.102s] 2018-05-17 18:15:48,429 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:48.428 11240 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.129s] 2018-05-17 18:15:48,639 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:48.638 11240 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.209s] 2018-05-17 18:15:48,692 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:48.692 11240 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.053s] 2018-05-17 18:15:52,030 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:52.030 11240 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [3.337s] 2018-05-17 18:15:55,414 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:55.413 11240 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [3.509s] 2018-05-17 18:15:56,829 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:15:56.828 11240 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [1.415s] 2018-05-17 18:16:00,732 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:16:00.731 11240 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [3.898s] 2018-05-17 18:16:01,936 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:16:01.936 11240 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [1.207s] 2018-05-17 18:16:03,361 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:16:03.361 11240 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [1.423s] 2018-05-17 18:16:04,180 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:16:04.180 11240 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [0.819s] 2018-05-17 18:16:05,210 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:16:05.210 11240 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.028s] 2018-05-17 18:16:05,252 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:16:05.251 11240 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.044s] 2018-05-17 18:16:08,321 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:16:08.321 11240 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete ... success [5.917s] 2018-05-17 18:16:10,936 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:16:10.935 11240 INFO opnfv-tempest [-] {10} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_attach_detach_volume ... success [97.847s] 2018-05-17 18:16:19,901 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:16:19.900 11240 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot ... success [11.578s] 2018-05-17 18:16:30,282 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:16:30.281 11240 INFO opnfv-tempest [-] {15} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_rebuild_server ... success [52.342s] 2018-05-17 18:16:46,295 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:16:46.294 11240 INFO opnfv-tempest [-] {10} tempest.api.compute.volumes.test_attach_volume.AttachVolumeTestJSON.test_list_get_volume_attachments ... success [35.354s] 2018-05-17 18:16:47,412 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:16:47.412 11240 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name ... success [74.811s] 2018-05-17 18:16:52,622 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:16:52.622 11240 INFO opnfv-tempest [-] {2} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas ... success [0.308s] 2018-05-17 18:16:52,985 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:16:52.985 11240 INFO opnfv-tempest [-] {2} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas ... success [0.363s] 2018-05-17 18:16:54,878 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:16:54.878 11240 INFO opnfv-tempest [-] {15} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_stop_start_server ... success [24.596s] 2018-05-17 18:17:05,199 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:05.198 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_invalid_size ... success [0.014s] 2018-05-17 18:17:05,371 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:05.371 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_snapshot_id ... success [0.172s] 2018-05-17 18:17:05,559 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:05.559 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_source_volid ... success [0.186s] 2018-05-17 18:17:05,721 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:05.721 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_nonexistent_volume_type ... success [0.162s] 2018-05-17 18:17:05,999 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:05.999 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_negative ... success [0.278s] 2018-05-17 18:17:06,012 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:06.012 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_with_size_zero ... success [0.012s] 2018-05-17 18:17:06,986 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:06.985 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_create_volume_without_passing_size ... success [0.973s] 2018-05-17 18:17:07,121 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:07.121 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_invalid_volume_id ... success [0.135s] 2018-05-17 18:17:07,304 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:07.304 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_delete_volume_without_passing_volume_id ... success [0.183s] 2018-05-17 18:17:07,337 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:07.337 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_invalid_volume_id ... success [0.032s] 2018-05-17 18:17:07,347 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:07.347 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_get_volume_without_passing_volume_id ... success [0.009s] 2018-05-17 18:17:07,527 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:07.527 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_invalid_status ... success [0.179s] 2018-05-17 18:17:07,571 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:07.571 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_detail_with_nonexistent_name ... success [0.043s] 2018-05-17 18:17:07,759 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:07.758 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_invalid_status ... success [0.187s] 2018-05-17 18:17:07,797 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:07.797 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_list_volumes_with_nonexistent_name ... success [0.038s] 2018-05-17 18:17:08,004 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:08.003 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_negative_volume_status ... success [0.206s] 2018-05-17 18:17:08,038 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:08.037 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_reserve_volume_with_nonexistent_volume_id ... success [0.033s] 2018-05-17 18:17:08,068 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:08.067 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_unreserve_volume_with_nonexistent_volume_id ... success [0.030s] 2018-05-17 18:17:08,209 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:08.208 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_empty_volume_id ... success [0.140s] 2018-05-17 18:17:08,490 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:08.490 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_invalid_volume_id ... success [0.281s] 2018-05-17 18:17:08,525 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:08.525 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_update_volume_with_nonexistent_volume_id ... success [0.034s] 2018-05-17 18:17:08,557 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:08.557 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_delete_nonexistent_volume_id ... success [0.031s] 2018-05-17 18:17:08,600 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:08.600 11240 INFO opnfv-tempest [-] {10} tempest.api.volume.test_volumes_negative.VolumesNegativeTest.test_volume_get_nonexistent_volume_id ... success [0.043s] 2018-05-17 18:17:12,756 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:12.756 11240 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_image_schema ... success [0.146s] 2018-05-17 18:17:12,764 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:12.764 11240 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_images_schema ... success [0.008s] 2018-05-17 18:17:12,820 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:12.820 11240 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_container_format ... success [0.055s] 2018-05-17 18:17:12,848 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:12.848 11240 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_disk_format ... success [0.028s] 2018-05-17 18:17:12,875 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:12.875 11240 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_limit ... success [0.027s] 2018-05-17 18:17:12,923 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:12.922 11240 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_min_max_size ... success [0.046s] 2018-05-17 18:17:12,965 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:12.964 11240 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_size ... success [0.042s] 2018-05-17 18:17:13,006 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:13.005 11240 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_status ... success [0.040s] 2018-05-17 18:17:13,040 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:13.040 11240 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_visibility ... success [0.035s] 2018-05-17 18:17:13,082 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:13.082 11240 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_no_params ... success [0.041s] 2018-05-17 18:17:17,649 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:17.648 11240 INFO opnfv-tempest [-] {15} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [7.488s] 2018-05-17 18:17:30,656 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:30.656 11240 INFO opnfv-tempest [-] {15} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_as_clone ... success [13.004s] 2018-05-17 18:17:47,656 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:17:47.656 11240 INFO opnfv-tempest [-] {15} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [16.997s] 2018-05-17 18:17:52,827 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '1798d02e-ae3a-4a8b-8561-4bd0afc1156d']'. 2018-05-17 18:17:53,852 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-05-17 18:17:53,852 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-05-17 18:17:53,852 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-05-17 18:17:53,852 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 1798d02e-ae3a-4a8b-8561-4bd0afc1156d | 2018-05-17 18:17:53,853 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | finished | 2018-05-17 18:17:53,853 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-05-17 18:14:08 | 2018-05-17 18:17:53,853 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-05-17 18:17:52 | 2018-05-17 18:17:53,853 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:03:44 | 2018-05-17 18:17:53,853 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-05-17 18:17:53,853 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-05-17 18:17:53,853 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: bb650726-f25c-4cd9-a8a6-1b3f5e3415bf) | 2018-05-17 18:17:53,853 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-05-17 18:17:53,853 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 1b14d9e2-c7ab-44af-a582-2936555154a0) | 2018-05-17 18:17:53,853 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 186 | 2018-05-17 18:17:53,854 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 210.48 | 2018-05-17 18:17:53,854 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 186 | 2018-05-17 18:17:53,854 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 0 | 2018-05-17 18:17:53,854 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-05-17 18:17:53,854 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-05-17 18:17:53,854 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 0 | 2018-05-17 18:17:53,854 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-05-17 18:17:53,854 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +--------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-05-17 18:17:53,980 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest refstack_defcore success_rate is 100.0% 2018-05-17 18:18:01,176 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-17 18:18:01,177 - xtesting.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | refstack_defcore | functest | 04:10 | PASS | +--------------------------+------------------+------------------+----------------+ 2018-05-17 18:18:01,183 - xtesting.ci.run_tests - INFO - Running test case 'patrole'... 2018-05-17 18:18:01,273 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-05-17 18:18:03,833 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-05-17 18:18:03.394 11348 INFO rally.deployment.engine [-] Deployment 1b14d9e2-c7ab-44af-a582-2936555154a0 | Starting: Destroy cloud and free allocated resources. 2018-05-17 18:18:03.489 11348 INFO rally.deployment.engine [-] Deployment 1b14d9e2-c7ab-44af-a582-2936555154a0 | Completed: Destroy cloud and free allocated resources. 2018-05-17 18:18:03.537 11348 INFO rally.api [-] Deleting all verifications created by verifier 'opnfv-tempest' (UUID=bb650726-f25c-4cd9-a8a6-1b3f5e3415bf) for deployment 'opnfv-rally'. 2018-05-17 18:18:03.559 11348 INFO rally.api [-] Deleting verification (UUID=1798d02e-ae3a-4a8b-8561-4bd0afc1156d). 2018-05-17 18:18:03.611 11348 INFO rally.api [-] Verification has been successfully deleted! 2018-05-17 18:18:03.611 11348 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=bb650726-f25c-4cd9-a8a6-1b3f5e3415bf). 2018-05-17 18:18:03.624 11348 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-05-17 18:18:06,341 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-05-17 18:18:06.003 11351 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=e8a657c1-0462-4a8d-949a-e960f05e1495) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | e8a657c1-0462-4a8d-949a-e960f05e1495 | 2018-05-17T18:18:05 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: e8a657c1-0462-4a8d-949a-e960f05e1495 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-05-17 18:18:09,827 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-05-17 18:18:09,827 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-05-17 18:18:12,242 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-05-17 18:18:11.946 11357 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=bb650726-f25c-4cd9-a8a6-1b3f5e3415bf). 2018-05-17 18:18:12.081 11357 INFO rally.api [-] Verifier has been successfully deleted! 2018-05-17 18:18:15,594 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-05-17 18:18:14.136 11360 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-05-17 18:18:14.315 11360 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-05-17 18:18:15.398 11360 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=73233712-3c43-4d44-ab53-062132e20bb9) has been successfully created! Using verifier 'opnfv-tempest' (UUID=73233712-3c43-4d44-ab53-062132e20bb9) as the default verifier for the future CLI operations. 2018-05-17 18:18:18,482 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-05-17 18:18:20,395 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-05-17 18:18:27,431 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-05-17 18:18:33,001 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-05-17 18:18:32.176 11379 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=73233712-3c43-4d44-ab53-062132e20bb9) for deployment 'opnfv-rally' (UUID=e8a657c1-0462-4a8d-949a-e960f05e1495). 2018-05-17 18:18:32.836 11379 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=73233712-3c43-4d44-ab53-062132e20bb9) has been successfully configured for deployment 'opnfv-rally' (UUID=e8a657c1-0462-4a8d-949a-e960f05e1495)! 2018-05-17 18:18:33,001 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-05-17 18:18:33,001 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-05-17 18:18:33,004 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-05-17 18:18:33,014 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-05-17 18:18:36,335 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-73233712-3c43-4d44-ab53-062132e20bb9/repo; testr list-tests '(?!.*test_networks_multiprovider_rbac)(?=patrole_tempest_plugin.tests.api.(image|network|volume))' >/home/opnfv/functest/results/patrole/tempest-list.txt 2>/dev/null) 2018-05-17 18:18:36,336 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/patrole/tempest-list.txt']'. 2018-05-17 18:18:38,328 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 18:18:38.327 11388 INFO rally.api [-] Starting verification (UUID=22e491b8-ff4d-47fe-99bf-e2c8410e3f83) for deployment 'opnfv-rally' (UUID=e8a657c1-0462-4a8d-949a-e960f05e1495) by verifier 'opnfv-tempest' (UUID=73233712-3c43-4d44-ab53-062132e20bb9). 2018-05-17 18:18:38,328 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: 22e491b8-ff4d-47fe-99bf-e2c8410e3f83 2018-05-17 18:21:39,119 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '22e491b8-ff4d-47fe-99bf-e2c8410e3f83']'. 2018-05-17 18:21:40,107 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-05-17 18:21:40,108 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-05-17 18:21:40,108 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-05-17 18:21:40,108 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 22e491b8-ff4d-47fe-99bf-e2c8410e3f83 | 2018-05-17 18:21:40,108 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | finished | 2018-05-17 18:21:40,108 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-05-17 18:18:38 | 2018-05-17 18:21:40,108 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-05-17 18:21:38 | 2018-05-17 18:21:40,109 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:03:00 | 2018-05-17 18:21:40,109 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-05-17 18:21:40,109 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-05-17 18:21:40,109 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: 73233712-3c43-4d44-ab53-062132e20bb9) | 2018-05-17 18:21:40,109 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-05-17 18:21:40,109 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: e8a657c1-0462-4a8d-949a-e960f05e1495) | 2018-05-17 18:21:40,109 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 287 | 2018-05-17 18:21:40,109 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 170.416 | 2018-05-17 18:21:40,109 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 126 | 2018-05-17 18:21:40,110 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 161 | 2018-05-17 18:21:40,110 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-05-17 18:21:40,110 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-05-17 18:21:40,110 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 0 | 2018-05-17 18:21:40,110 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-05-17 18:21:40,110 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-05-17 18:21:40,290 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest patrole success_rate is 100.0% 2018-05-17 18:21:46,216 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-17 18:21:46,216 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | patrole | functest | 03:28 | PASS | +-------------------+------------------+------------------+----------------+ 2018-05-17 18:21:46,220 - xtesting.ci.run_tests - INFO - Running test case 'snaps_smoke'... 2018-05-17 18:21:46,964 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-05-17 19:22:40,492 - xtesting.core.unit - DEBUG - test_add_rule (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_delete_group (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_admin_user_to_new_project (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_new_user_to_admin_project (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_with_one_complex_rule (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_with_one_simple_rule (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_with_several_rules (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_group_without_rules (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_remove_rule_by_id (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_remove_rule_by_setting (snaps.openstack.tests.create_security_group_tests.CreateSecurityGroupTests) ... ok test_create_delete_image (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_image_clean_file (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_image_clean_url (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_image_clean_url_properties (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_same_image (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_create_same_image_new_settings (snaps.openstack.tests.create_image_tests.CreateImageSuccessTests) ... ok test_bad_image_file (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests) ... ok test_bad_image_image_type (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests) ... ok test_bad_image_name (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests) ... ok test_bad_image_url (snaps.openstack.tests.create_image_tests.CreateImageNegativeTests) ... ok test_create_three_part_image_from_file_3_creators (snaps.openstack.tests.create_image_tests.CreateMultiPartImageTests) ... ok test_create_three_part_image_from_url (snaps.openstack.tests.create_image_tests.CreateMultiPartImageTests) ... ok test_create_three_part_image_from_url_3_creators (snaps.openstack.tests.create_image_tests.CreateMultiPartImageTests) ... ok test_create_delete_keypair (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_from_file (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_large_key (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_only (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_save_both (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_save_pub_only (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsTests) ... ok test_create_keypair_exist_files_delete (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_keypair_exist_files_keep (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_keypair_gen_files_delete_1 (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_keypair_gen_files_delete_2 (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_keypair_gen_files_keep (snaps.openstack.tests.create_keypairs_tests.CreateKeypairsCleanupTests) ... ok test_create_delete_network (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_network_router_admin_user_to_new_project (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_network_router_new_user_to_admin_project (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_network_with_router (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_network_without_router (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_networks_same_name (snaps.openstack.tests.create_network_tests.CreateNetworkSuccessTests) ... ok test_create_delete_router (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_admin_state_True (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_admin_state_false (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_admin_user_to_new_project (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_external_network (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_new_user_as_admin_project (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_private_network (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_vanilla (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ok test_create_router_with_ext_port (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ... ERROR test_create_router_admin_ports (snaps.openstack.tests.create_router_tests.CreateRouterNegativeTests) ... ok test_create_router_invalid_gateway_name (snaps.openstack.tests.create_router_tests.CreateRouterNegativeTests) ... ok test_create_router_noname (snaps.openstack.tests.create_router_tests.CreateRouterNegativeTests) ... ok test_create_delete_qos (snaps.openstack.tests.create_qos_tests.CreateQoSTests) ... ok test_create_qos (snaps.openstack.tests.create_qos_tests.CreateQoSTests) ... ok test_create_same_qos (snaps.openstack.tests.create_qos_tests.CreateQoSTests) ... ok test_create_delete_volume_type (snaps.openstack.tests.create_volume_type_tests.CreateSimpleVolumeTypeSuccessTests) ... ok test_create_same_volume_type (snaps.openstack.tests.create_volume_type_tests.CreateSimpleVolumeTypeSuccessTests) ... ok test_create_volume_type (snaps.openstack.tests.create_volume_type_tests.CreateSimpleVolumeTypeSuccessTests) ... ok test_volume_type_with_encryption (snaps.openstack.tests.create_volume_type_tests.CreateVolumeTypeComplexTests) ... ok test_volume_type_with_qos (snaps.openstack.tests.create_volume_type_tests.CreateVolumeTypeComplexTests) ... ok test_volume_type_with_qos_and_encryption (snaps.openstack.tests.create_volume_type_tests.CreateVolumeTypeComplexTests) ... ok test_create_delete_volume (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeSuccessTests) ... ok test_create_same_volume (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeSuccessTests) ... ok test_create_volume_simple (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeSuccessTests) ... ok test_create_volume_bad_image (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeFailureTests) ... ok test_create_volume_bad_size (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeFailureTests) ... ok test_create_volume_bad_type (snaps.openstack.tests.create_volume_tests.CreateSimpleVolumeFailureTests) ... ok test_bad_volume_type (snaps.openstack.tests.create_volume_tests.CreateVolumeWithTypeTests) ... ok test_valid_volume_type (snaps.openstack.tests.create_volume_tests.CreateVolumeWithTypeTests) ... ok test_bad_image_name (snaps.openstack.tests.create_volume_tests.CreateVolumeWithImageTests) ... ok test_valid_volume_image (snaps.openstack.tests.create_volume_tests.CreateVolumeWithImageTests) ... ok test_check_vm_ip_dhcp (snaps.openstack.tests.create_instance_tests.SimpleHealthCheck) ... ok test_ping_via_router (snaps.openstack.tests.create_instance_tests.CreateInstanceTwoNetTests) ... ok test_create_admin_instance (snaps.openstack.tests.create_instance_tests.CreateInstanceSimpleTests) ... ok test_create_delete_instance (snaps.openstack.tests.create_instance_tests.CreateInstanceSimpleTests) ... ok test_set_allowed_address_pairs (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_allowed_address_pairs_bad_ip (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_allowed_address_pairs_bad_mac (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_invalid_ip_one_subnet (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_invalid_mac (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_mac_and_ip (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_valid_ip_one_subnet (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_custom_valid_mac (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_one_port_two_ip_one_subnet (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_set_one_port_two_ip_two_subnets (snaps.openstack.tests.create_instance_tests.CreateInstancePortManipulationTests) ... ok test_add_invalid_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_add_same_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_add_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_remove_security_group (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_remove_security_group_never_added (snaps.openstack.tests.create_instance_tests.InstanceSecurityGroupTests) ... ok test_deploy_vm_to_each_compute_node (snaps.openstack.tests.create_instance_tests.CreateInstanceOnComputeHost) ... ok test_create_instance_from_three_part_image (snaps.openstack.tests.create_instance_tests.CreateInstanceFromThreePartImage) ... ok test_create_instance_with_one_volume (snaps.openstack.tests.create_instance_tests.CreateInstanceVolumeTests) ... ok test_create_instance_with_two_volumes (snaps.openstack.tests.create_instance_tests.CreateInstanceVolumeTests) ... ok test_create_delete_stack (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_create_same_stack (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_create_stack_short_timeout (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_create_stack_template_dict (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_create_stack_template_file (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_retrieve_network_creators (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_retrieve_vm_inst_creators (snaps.openstack.tests.create_stack_tests.CreateStackSuccessTests) ... ok test_retrieve_volume_creator (snaps.openstack.tests.create_stack_tests.CreateStackVolumeTests) ... ok test_retrieve_volume_type_creator (snaps.openstack.tests.create_stack_tests.CreateStackVolumeTests) ... ok test_retrieve_flavor_creator (snaps.openstack.tests.create_stack_tests.CreateStackFlavorTests) ... ok test_retrieve_keypair_creator (snaps.openstack.tests.create_stack_tests.CreateStackKeypairTests) ... ok test_retrieve_security_group_creator (snaps.openstack.tests.create_stack_tests.CreateStackSecurityGroupTests) ... ok test_bad_stack_file (snaps.openstack.tests.create_stack_tests.CreateStackNegativeTests) ... ok test_missing_dependencies (snaps.openstack.tests.create_stack_tests.CreateStackNegativeTests) ... ok test_single_port_static (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_after_active (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_after_init (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_after_reboot (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_before_active (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_reverse_engineer (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_ssh_client_fip_second_creator (snaps.openstack.tests.create_instance_tests.CreateInstanceSingleNetworkTests) ... ok test_connect_via_ssh_heat_vm (snaps.openstack.tests.create_stack_tests.CreateStackFloatingIpTests) ... ok test_connect_via_ssh_heat_vm_derived (snaps.openstack.tests.create_stack_tests.CreateStackFloatingIpTests) ... ok test_apply_simple_playbook (snaps.provisioning.tests.ansible_utils_tests.AnsibleProvisioningTests) ... ok test_apply_template_playbook (snaps.provisioning.tests.ansible_utils_tests.AnsibleProvisioningTests) ... ok ====================================================================== ERROR: test_create_router_with_ext_port (snaps.openstack.tests.create_router_tests.CreateRouterSuccessTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/snaps/openstack/tests/create_router_tests.py", line 398, in test_create_router_with_ext_port self.router_creator.create() File "/usr/lib/python2.7/site-packages/snaps/openstack/create_router.py", line 128, in create self._neutron, self._os_creds, port_setting) File "/usr/lib/python2.7/site-packages/snaps/openstack/utils/neutron_utils.py", line 506, in create_port json_body = port_settings.dict_for_neutron(neutron, os_creds) File "/usr/lib/python2.7/site-packages/snaps/config/network.py", line 469, in dict_for_neutron + ' in project - ' + str(project_name)) PortConfigError: Cannot locate network with name - external in project - admin ---------------------------------------------------------------------- Ran 119 tests in 3653.478s FAILED (errors=1) 2018-05-17 19:22:40,658 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-17 19:22:40,658 - xtesting.ci.run_tests - INFO - Test result: +---------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +---------------------+------------------+------------------+----------------+ | snaps_smoke | functest | 60:53 | FAIL | +---------------------+------------------+------------------+----------------+ 2018-05-17 19:22:40,662 - xtesting.ci.run_tests - ERROR - The test case 'snaps_smoke' failed. 2018-05-17 19:22:40,662 - xtesting.ci.run_tests - INFO - Running test case 'neutron_trunk'... 2018-05-17 19:22:40,753 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-05-17 19:22:43,334 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-05-17 19:22:42.832 11615 INFO rally.deployment.engine [-] Deployment e8a657c1-0462-4a8d-949a-e960f05e1495 | Starting: Destroy cloud and free allocated resources. 2018-05-17 19:22:42.937 11615 INFO rally.deployment.engine [-] Deployment e8a657c1-0462-4a8d-949a-e960f05e1495 | Completed: Destroy cloud and free allocated resources. 2018-05-17 19:22:42.996 11615 INFO rally.api [-] Deleting all verifications created by verifier 'opnfv-tempest' (UUID=73233712-3c43-4d44-ab53-062132e20bb9) for deployment 'opnfv-rally'. 2018-05-17 19:22:43.042 11615 INFO rally.api [-] Deleting verification (UUID=22e491b8-ff4d-47fe-99bf-e2c8410e3f83). 2018-05-17 19:22:43.096 11615 INFO rally.api [-] Verification has been successfully deleted! 2018-05-17 19:22:43.097 11615 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=73233712-3c43-4d44-ab53-062132e20bb9). 2018-05-17 19:22:43.109 11615 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-05-17 19:22:45,730 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-05-17 19:22:45.460 11618 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=a7ffd39c-ae38-4ce5-9fc9-93b169b04ad9) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | a7ffd39c-ae38-4ce5-9fc9-93b169b04ad9 | 2018-05-17T19:22:45 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: a7ffd39c-ae38-4ce5-9fc9-93b169b04ad9 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-05-17 19:22:48,821 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-05-17 19:22:48,821 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-05-17 19:22:51,236 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-05-17 19:22:50.944 11624 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=73233712-3c43-4d44-ab53-062132e20bb9). 2018-05-17 19:22:51.080 11624 INFO rally.api [-] Verifier has been successfully deleted! 2018-05-17 19:22:54,598 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-05-17 19:22:53.177 11627 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-05-17 19:22:53.386 11627 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-05-17 19:22:54.416 11627 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=a31ced78-087e-4509-b44a-e8b679e094c9) has been successfully created! Using verifier 'opnfv-tempest' (UUID=a31ced78-087e-4509-b44a-e8b679e094c9) as the default verifier for the future CLI operations. 2018-05-17 19:22:57,505 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-05-17 19:22:59,640 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-05-17 19:23:08,616 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-05-17 19:23:14,224 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-05-17 19:23:13.232 11646 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=a31ced78-087e-4509-b44a-e8b679e094c9) for deployment 'opnfv-rally' (UUID=a7ffd39c-ae38-4ce5-9fc9-93b169b04ad9). 2018-05-17 19:23:14.065 11646 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=a31ced78-087e-4509-b44a-e8b679e094c9) has been successfully configured for deployment 'opnfv-rally' (UUID=a7ffd39c-ae38-4ce5-9fc9-93b169b04ad9)! 2018-05-17 19:23:14,225 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-05-17 19:23:14,225 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-05-17 19:23:14,227 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-05-17 19:23:14,240 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-05-17 19:23:17,001 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-a31ced78-087e-4509-b44a-e8b679e094c9/repo; testr list-tests 'neutron.tests.tempest.(api|scenario).test_trunk' >/home/opnfv/functest/results/neutron_trunk/test_list.txt 2>/dev/null) 2018-05-17 19:23:17,002 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Applying tempest blacklist... 2018-05-17 19:23:17,003 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Tempest blacklist file does not exist. 2018-05-17 19:23:17,003 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/neutron_trunk/test_list.txt']'. 2018-05-17 19:23:19,184 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-05-17 19:23:19.182 11655 INFO rally.api [-] Starting verification (UUID=3215cca2-9a1a-418c-b5c9-ce1bca4368b9) for deployment 'opnfv-rally' (UUID=a7ffd39c-ae38-4ce5-9fc9-93b169b04ad9) by verifier 'opnfv-tempest' (UUID=a31ced78-087e-4509-b44a-e8b679e094c9). 2018-05-17 19:23:19,184 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: 3215cca2-9a1a-418c-b5c9-ce1bca4368b9 2018-05-17 19:25:26,633 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '3215cca2-9a1a-418c-b5c9-ce1bca4368b9']'. 2018-05-17 19:25:27,561 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-05-17 19:25:27,562 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-05-17 19:25:27,562 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-05-17 19:25:27,562 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 3215cca2-9a1a-418c-b5c9-ce1bca4368b9 | 2018-05-17 19:25:27,562 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | finished | 2018-05-17 19:25:27,562 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-05-17 19:23:19 | 2018-05-17 19:25:27,562 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-05-17 19:25:26 | 2018-05-17 19:25:27,562 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:02:07 | 2018-05-17 19:25:27,562 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-05-17 19:25:27,562 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-05-17 19:25:27,562 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: a31ced78-087e-4509-b44a-e8b679e094c9) | 2018-05-17 19:25:27,563 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-05-17 19:25:27,563 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: a7ffd39c-ae38-4ce5-9fc9-93b169b04ad9) | 2018-05-17 19:25:27,563 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 52 | 2018-05-17 19:25:27,563 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 115.164 | 2018-05-17 19:25:27,563 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 43 | 2018-05-17 19:25:27,563 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 9 | 2018-05-17 19:25:27,563 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-05-17 19:25:27,563 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-05-17 19:25:27,563 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 0 | 2018-05-17 19:25:27,563 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-05-17 19:25:27,564 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-05-17 19:25:27,608 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest neutron_trunk success_rate is 100.0% 2018-05-17 19:25:37,800 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-17 19:25:37,800 - xtesting.ci.run_tests - INFO - Test result: +-----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------+------------------+------------------+----------------+ | neutron_trunk | functest | 02:40 | PASS | +-----------------------+------------------+------------------+----------------+ 2018-05-17 19:25:37,803 - xtesting.ci.run_tests - INFO - Xtesting report: +------------------------------+------------------+---------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +------------------------------+------------------+---------------+------------------+----------------+ | vping_ssh | functest | smoke | 00:59 | PASS | | vping_userdata | functest | smoke | 00:41 | PASS | | tempest_smoke_serial | functest | smoke | 13:13 | PASS | | rally_sanity | functest | smoke | 23:41 | PASS | | refstack_defcore | functest | smoke | 04:10 | PASS | | patrole | functest | smoke | 03:28 | PASS | | snaps_smoke | functest | smoke | 60:53 | FAIL | | neutron_trunk | functest | smoke | 02:40 | PASS | | odl | functest | smoke | 00:00 | SKIP | +------------------------------+------------------+---------------+------------------+----------------+ 2018-05-17 19:25:37,806 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR 2018-05-17 19:25:40,994 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-fraser-123 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-nosdn-bar-noha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-05-17 19:25:40,996 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=B4tCfMreUdWmPBKTPf4n9h22Q export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.26,192.30.9.9 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.26:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export OS_REGION_NAME=regionOne 2018-05-17 19:25:40,996 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-05-17 19:25:40,997 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +------------------+---------------+--------------------------+-------------------------------------------+-----------------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +------------------+---------------+--------------------------+-------------------------------------------+-----------------------------------------------+ | features | 2 | (daily)|(weekly) | Test suites from feature projects | doctor-notification barometercollectd | | | | | integrated in functest | | +------------------+---------------+--------------------------+-------------------------------------------+-----------------------------------------------+ 2018-05-17 19:25:40,998 - xtesting.ci.run_tests - INFO - Running tier 'features' 2018-05-17 19:25:40,998 - xtesting.ci.run_tests - INFO - Running test case 'doctor-notification'... 2018-05-17 19:28:46,746 - xtesting.core.feature - INFO - Test result is stored in '/var/lib/xtesting/results/doctor-notification.log' 2018-05-17 19:28:46,878 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-17 19:28:46,878 - xtesting.ci.run_tests - INFO - Test result: +-----------------------------+-----------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------------+-----------------+------------------+----------------+ | doctor-notification | doctor | 03:06 | PASS | +-----------------------------+-----------------+------------------+----------------+ 2018-05-17 19:28:46,881 - xtesting.ci.run_tests - INFO - Running test case 'barometercollectd'... 2018-05-17 20:11:35,271 - xtesting.core.feature - INFO - Test result is stored in '/var/lib/xtesting/results/barometercollectd.log' 2018-05-17 20:11:35,400 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-17 20:11:35,400 - xtesting.ci.run_tests - INFO - Test result: +---------------------------+-------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +---------------------------+-------------------+------------------+----------------+ | barometercollectd | barometer | 42:48 | FAIL | +---------------------------+-------------------+------------------+----------------+ 2018-05-17 20:11:35,404 - xtesting.ci.run_tests - ERROR - The test case 'barometercollectd' failed. 2018-05-17 20:11:35,405 - xtesting.ci.run_tests - INFO - Xtesting report: +-----------------------------+------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-----------------------------+------------------------+------------------+------------------+----------------+ | doctor-notification | doctor | features | 03:06 | PASS | | barometercollectd | barometer | features | 42:48 | FAIL | | bgpvpn | sdnvpn | features | 00:00 | SKIP | | functest-odl-sfc | sfc | features | 00:00 | SKIP | | fds | fastdatastacks | features | 00:00 | SKIP | +-----------------------------+------------------------+------------------+------------------+----------------+ 2018-05-17 20:11:35,409 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR 2018-05-17 20:12:26,021 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-fraser-123 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-nosdn-bar-noha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-05-17 20:12:26,023 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=B4tCfMreUdWmPBKTPf4n9h22Q export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.26,192.30.9.9 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.26:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export OS_REGION_NAME=regionOne 2018-05-17 20:12:26,023 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-05-17 20:12:26,023 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+-----------------+---------------------+-------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+-----------------+---------------------+-------------------+ +---------------+---------------+-----------------+---------------------+-------------------+ 2018-05-17 20:12:26,024 - xtesting.ci.run_tests - INFO - Xtesting report: +----------------------+------------------+--------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------+------------------+--------------+------------------+----------------+ | cloudify_ims | functest | vnf | 00:00 | SKIP | | vyos_vrouter | functest | vnf | 00:00 | SKIP | | juju_epc | functest | vnf | 00:00 | SKIP | +----------------------+------------------+--------------+------------------+----------------+ 2018-05-17 20:12:26,025 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-05-17 20:12:28,750 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-fraser-123 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-nosdn-bar-noha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-05-17 20:12:28,755 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=B4tCfMreUdWmPBKTPf4n9h22Q export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.26,192.30.9.9 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.26:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export OS_REGION_NAME=regionOne 2018-05-17 20:12:28,755 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-05-17 20:12:28,756 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +------------------+---------------+--------------------------+-------------------------------------------+-----------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +------------------+---------------+--------------------------+-------------------------------------------+-----------------------+ | features | 2 | (daily)|(weekly) | Test suites from feature projects | parser-basics | | | | | integrated in functest | | +------------------+---------------+--------------------------+-------------------------------------------+-----------------------+ 2018-05-17 20:12:28,758 - xtesting.ci.run_tests - INFO - Running tier 'features' 2018-05-17 20:12:28,758 - xtesting.ci.run_tests - INFO - Running test case 'parser-basics'... 2018-05-17 20:15:28,983 - xtesting.core.feature - INFO - Test result is stored in '/var/lib/xtesting/results/parser-basics.log' 2018-05-17 20:15:29,107 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-05-17 20:15:29,107 - xtesting.ci.run_tests - INFO - Test result: +-----------------------+-----------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------+-----------------+------------------+----------------+ | parser-basics | parser | 03:00 | PASS | +-----------------------+-----------------+------------------+----------------+ 2018-05-17 20:15:29,111 - xtesting.ci.run_tests - INFO - Xtesting report: +-----------------------+-----------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-----------------------+-----------------+------------------+------------------+----------------+ | parser-basics | parser | features | 03:00 | PASS | +-----------------------+-----------------+------------------+------------------+----------------+ 2018-05-17 20:15:29,112 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK