2018-03-18 12:50:50,561 - functest.ci.check_deployment - DEBUG - 172.30.9.22:5000 is reachable! 2018-03-18 12:50:50,562 - functest.ci.check_deployment - INFO - Connectivity to OS_AUTH_URL http://172.30.9.22:5000/v3 ...OK 2018-03-18 12:50:51,010 - functest.ci.check_deployment - INFO - Got token ...OK 2018-03-18 12:50:51,465 - functest.ci.check_deployment - DEBUG - 172.30.9.22:5000 is reachable! 2018-03-18 12:50:51,465 - functest.ci.check_deployment - INFO - Connectivity to the public endpoint http://172.30.9.22:5000 ...OK 2018-03-18 12:50:51,836 - functest.ci.check_deployment - DEBUG - 172.30.9.22:8774 is reachable! 2018-03-18 12:50:51,837 - functest.ci.check_deployment - INFO - Connectivity to endpoint 'compute' http://172.30.9.22:8774/v2.1 ...OK 2018-03-18 12:50:52,209 - functest.ci.check_deployment - DEBUG - 172.30.9.22:9696 is reachable! 2018-03-18 12:50:52,210 - functest.ci.check_deployment - INFO - Connectivity to endpoint 'network' http://172.30.9.22:9696 ...OK 2018-03-18 12:50:52,592 - functest.ci.check_deployment - DEBUG - 172.30.9.22:9292 is reachable! 2018-03-18 12:50:52,592 - functest.ci.check_deployment - INFO - Connectivity to endpoint 'image' http://172.30.9.22:9292 ...OK 2018-03-18 12:50:53,730 - functest.ci.check_deployment - INFO - Nova service ...OK 2018-03-18 12:50:55,413 - functest.ci.check_deployment - INFO - Neutron service ...OK 2018-03-18 12:50:57,816 - functest.ci.check_deployment - INFO - Glance service ...OK 2018-03-18 12:50:59,115 - functest.ci.check_deployment - INFO - External network found: external 2018-03-18 12:51:08,511 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-22 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-noha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-03-18 12:51:08,515 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=K6KQBgZhjwWMTmtUQkKkMHc8n export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.22,192.30.9.4 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.22:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.4 export OS_REGION_NAME=regionOne 2018-03-18 12:51:08,515 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-03-18 12:51:08,517 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ | healthcheck | 0 | (daily)|(weekly) | First tier to be executed to verify the | connection_check api_check | | | | | basic operations in the VIM. | snaps_health_check | +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ 2018-03-18 12:51:08,518 - xtesting.ci.run_tests - INFO - Running tier 'healthcheck' 2018-03-18 12:51:08,518 - xtesting.ci.run_tests - INFO - Running test case 'connection_check'... 2018-03-18 12:51:09,740 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-03-18 12:51:17,761 - xtesting.core.unit - DEBUG - test_glance_connect_fail (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_glance_connect_success (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_keystone_connect_fail (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_keystone_connect_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_neutron_connect_fail (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_neutron_connect_success (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_retrieve_ext_network_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_nova_connect_fail (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_connect_success (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_get_hypervisor_hosts (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_heat_connect_fail (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_heat_connect_success (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_cinder_connect_fail (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok test_cinder_connect_success (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok ---------------------------------------------------------------------- Ran 14 tests in 8.017s OK 2018-03-18 12:51:17,884 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-18 12:51:17,884 - xtesting.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | connection_check | functest | 00:08 | PASS | +--------------------------+------------------+------------------+----------------+ 2018-03-18 12:51:17,888 - xtesting.ci.run_tests - INFO - Running test case 'api_check'... 2018-03-18 12:51:18,569 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-03-18 13:00:44,575 - xtesting.core.unit - DEBUG - test_create_project_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_user_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_credentials (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_service (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_with_each_interface (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_grant_user_role_to_project (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_admin_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user_2x (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_2x (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_bad_domain (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_update_quotas (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_sec_grp_one_user (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_project_sec_grp_two_users (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_image_minimal_file (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_image_minimal_url (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_network (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_add_interface_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_missing_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip_to_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_network_object (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_simple (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_with_public_interface (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_delete_simple_sec_grp (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_rules (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_one_rule (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_get_sec_grp_by_id (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_floating_ips (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsFloatingIpTests) ... ok test_create_delete_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_key_from_file (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_delete_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_instance (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceTests) ... ok test_add_remove_volume (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_attach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_detach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_create_clean_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_delete_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_all_settings (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_existing (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_create_stack_x2 (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_get_settings_from_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateComplexStackTests) ... ok test_create_flavor_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsFlavorTests) ... ok test_create_keypair_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsKeypairTests) ... ok test_create_security_group_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsSecurityGroupTests) ... ok test_create_delete_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_back (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_both (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_front (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_delete_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_simple_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_delete_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_simple_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_bad_key_size (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_delete_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_simple_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_all_attrs (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_invalid_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos_and_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok ---------------------------------------------------------------------- Ran 83 tests in 565.952s OK 2018-03-18 13:00:44,705 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-18 13:00:44,706 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | api_check | functest | 09:26 | PASS | +-------------------+------------------+------------------+----------------+ 2018-03-18 13:00:44,710 - xtesting.ci.run_tests - INFO - Running test case 'snaps_health_check'... 2018-03-18 13:00:45,376 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-03-18 13:01:17,138 - xtesting.core.unit - DEBUG - test_check_vm_ip_dhcp (snaps.openstack.tests.create_instance_tests.SimpleHealthCheck) ... ok ---------------------------------------------------------------------- Ran 1 test in 31.761s OK 2018-03-18 13:01:17,256 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-18 13:01:17,256 - xtesting.ci.run_tests - INFO - Test result: +----------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------------+------------------+------------------+----------------+ | snaps_health_check | functest | 00:32 | PASS | +----------------------------+------------------+------------------+----------------+ 2018-03-18 13:01:17,262 - xtesting.ci.run_tests - INFO - Xtesting report: +----------------------------+------------------+---------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------------+------------------+---------------------+------------------+----------------+ | connection_check | functest | healthcheck | 00:08 | PASS | | api_check | functest | healthcheck | 09:26 | PASS | | snaps_health_check | functest | healthcheck | 00:32 | PASS | +----------------------------+------------------+---------------------+------------------+----------------+ 2018-03-18 13:01:17,266 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-03-18 13:01:47,737 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-22 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-noha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-03-18 13:01:47,740 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=K6KQBgZhjwWMTmtUQkKkMHc8n export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.22,192.30.9.4 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.22:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.4 export OS_REGION_NAME=regionOne 2018-03-18 13:01:47,740 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-03-18 13:01:47,741 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+--------------------------+------------------------------------------+-----------------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+--------------------------+------------------------------------------+-----------------------------------------------+ | smoke | 1 | (daily)|(weekly) | Set of basic Functional tests to | vping_userdata tempest_smoke_serial | | | | | validate the OPNFV scenarios. | rally_sanity refstack_defcore patrole | | | | | | odl snaps_smoke neutron_trunk | +---------------+---------------+--------------------------+------------------------------------------+-----------------------------------------------+ 2018-03-18 13:01:47,742 - xtesting.ci.run_tests - INFO - Running tier 'smoke' 2018-03-18 13:01:47,742 - xtesting.ci.run_tests - INFO - Running test case 'vping_userdata'... 2018-03-18 13:01:48,436 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup 2018-03-18 13:01:48,436 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-03-18 13:01:48' 2018-03-18 13:01:48,437 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--4a17a578-93c8-4413-97fb-74193cfe61f2' 2018-03-18 13:01:50,813 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-4a17a578-93c8-4413-97fb-74193cfe61f2' 2018-03-18 13:01:53,413 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-4a17a578-93c8-4413-97fb-74193cfe61f2' 2018-03-18 13:01:57,735 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-4a17a578-93c8-4413-97fb-74193cfe61f2' 2018-03-18 13:01:59,709 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-4a17a578-93c8-4413-97fb-74193cfe61f2' 2018-03-18 13:02:03,790 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-4a17a578-93c8-4413-97fb-74193cfe61f2' 2018-03-18 13:02:09,800 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution 2018-03-18 13:02:18,004 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping... 2018-03-18 13:02:20,251 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected! 2018-03-18 13:02:42,420 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-18 13:02:42,420 - xtesting.ci.run_tests - INFO - Test result: +------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------+------------------+------------------+----------------+ | vping_userdata | functest | 00:32 | PASS | +------------------------+------------------+------------------+----------------+ 2018-03-18 13:02:42,426 - xtesting.ci.run_tests - INFO - Running test case 'tempest_smoke_serial'... 2018-03-18 13:02:42,546 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-03-18 13:02:46,992 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-03-18 13:02:46.723 14 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=fcbe228b-fa28-4965-b71f-d188e952191b) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | fcbe228b-fa28-4965-b71f-d188e952191b | 2018-03-18T13:02:46 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: fcbe228b-fa28-4965-b71f-d188e952191b ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-03-18 13:02:50,189 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-03-18 13:02:50,190 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-03-18 13:02:55,809 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-03-18 13:02:54.539 23 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-03-18 13:02:54.681 23 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-03-18 13:02:55.663 23 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=849a206f-9422-46e5-aa75-8f9ba2fe3e34) has been successfully created! Using verifier 'opnfv-tempest' (UUID=849a206f-9422-46e5-aa75-8f9ba2fe3e34) as the default verifier for the future CLI operations. 2018-03-18 13:02:58,991 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-03-18 13:03:00,891 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-03-18 13:03:05,204 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-03-18 13:03:10,028 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-03-18 13:03:09.208 42 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=849a206f-9422-46e5-aa75-8f9ba2fe3e34) for deployment 'opnfv-rally' (UUID=fcbe228b-fa28-4965-b71f-d188e952191b). 2018-03-18 13:03:09.873 42 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=849a206f-9422-46e5-aa75-8f9ba2fe3e34) has been successfully configured for deployment 'opnfv-rally' (UUID=fcbe228b-fa28-4965-b71f-d188e952191b)! 2018-03-18 13:03:10,028 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-03-18 13:03:10,028 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-03-18 13:03:10,030 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-03-18 13:03:10,034 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-03-18 13:03:12,932 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-849a206f-9422-46e5-aa75-8f9ba2fe3e34/repo; testr list-tests '^tempest\.(api|scenario).*\[.*\bsmoke\b.*\]$' >/home/opnfv/functest/results/tempest/test_list.txt 2>/dev/null) 2018-03-18 13:03:12,933 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Applying tempest blacklist... 2018-03-18 13:03:12,934 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Tempest blacklist file does not exist. 2018-03-18 13:03:12,934 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/tempest/test_list.txt', '--concurrency', '1']'. 2018-03-18 13:03:14,977 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:03:14.976 51 INFO rally.api [-] Starting verification (UUID=b2ecb3da-2088-439b-9e4d-49199c140952) for deployment 'opnfv-rally' (UUID=fcbe228b-fa28-4965-b71f-d188e952191b) by verifier 'opnfv-tempest' (UUID=849a206f-9422-46e5-aa75-8f9ba2fe3e34). 2018-03-18 13:03:14,977 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: b2ecb3da-2088-439b-9e4d-49199c140952 2018-03-18 13:03:21,286 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:03:21.285 51 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor ... success [0.177s] 2018-03-18 13:03:21,345 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:03:21.345 51 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.060s] 2018-03-18 13:03:26,610 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:03:26.610 51 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create ... success [0.873s] 2018-03-18 13:03:28,108 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:03:28.108 51 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list ... success [1.498s] 2018-03-18 13:03:36,130 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:03:36.130 51 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete ... success [2.791s] 2018-03-18 13:03:49,053 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:03:49.052 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip ... success [7.893s] 2018-03-18 13:04:15,459 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:04:15.458 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers ... success [0.067s] 2018-03-18 13:04:15,460 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:04:15.460 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details ... success [0.001s] 2018-03-18 13:04:39,972 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:04:39.972 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.072s] 2018-03-18 13:04:39,973 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:04:39.973 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s] 2018-03-18 13:05:05,557 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:05:05.557 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.066s] 2018-03-18 13:05:05,558 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:05:05.558 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s] 2018-03-18 13:06:45,415 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:06:45.414 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... success [77.709s] 2018-03-18 13:07:03,831 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:07:03.831 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses ... success [0.049s] 2018-03-18 13:07:03,930 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:07:03.930 51 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network ... success [0.099s] 2018-03-18 13:07:11,257 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:07:11.256 51 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_get_version_details ... success [0.644s] 2018-03-18 13:07:11,267 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:07:11.267 51 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.012s] 2018-03-18 13:07:12,524 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:07:12.524 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_services.ServicesTestJSON ... skip: Identity api v2 is not enabled 2018-03-18 13:07:12,525 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:07:12.525 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_users.UsersTestJSON ... skip: Identity api v2 is not enabled 2018-03-18 13:07:16,166 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:07:16.165 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete ... success [0.351s] 2018-03-18 13:07:22,224 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:07:22.224 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists ... success [0.078s] 2018-03-18 13:07:27,838 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:07:27.838 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain ... success [0.578s] 2018-03-18 13:07:34,330 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:07:34.330 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint ... success [0.368s] 2018-03-18 13:07:43,576 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:07:43.576 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete ... success [2.978s] 2018-03-18 13:07:49,160 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:07:49.160 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy ... success [0.327s] 2018-03-18 13:07:54,485 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:07:54.485 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id ... success [0.171s] 2018-03-18 13:08:00,849 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:08:00.849 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list ... success [0.432s] 2018-03-18 13:08:07,252 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:08:07.251 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service ... success [0.416s] 2018-03-18 13:08:14,674 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:08:14.674 51 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all ... success [2.501s] 2018-03-18 13:08:16,819 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:08:16.818 51 INFO opnfv-tempest [-] {0} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery ... skip: Identity api v2 is not enabled 2018-03-18 13:08:18,846 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:08:18.846 51 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.076s] 2018-03-18 13:08:18,919 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:08:18.919 51 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.073s] 2018-03-18 13:08:18,993 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:08:18.992 51 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.072s] 2018-03-18 13:08:19,000 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:08:19.000 51 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions ... success [0.007s] 2018-03-18 13:08:22,236 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:08:22.235 51 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.327s] 2018-03-18 13:08:23,011 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:08:23.011 51 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file ... success [0.776s] 2018-03-18 13:08:23,985 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:08:23.985 51 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [0.974s] 2018-03-18 13:08:29,525 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:08:29.524 51 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_versions.VersionsTest.test_list_versions ... success [0.006s] 2018-03-18 13:08:34,449 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:08:34.449 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions ... success [1.906s] 2018-03-18 13:08:44,758 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:08:44.757 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address ... success [1.958s] 2018-03-18 13:08:47,697 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:08:47.697 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip ... success [2.938s] 2018-03-18 13:08:57,760 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:08:57.759 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network ... success [2.759s] 2018-03-18 13:09:00,310 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:09:00.309 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port ... success [2.549s] 2018-03-18 13:09:07,345 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:09:07.344 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet ... success [7.034s] 2018-03-18 13:09:15,577 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:09:15.577 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network ... success [2.575s] 2018-03-18 13:09:18,174 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:09:18.174 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port ... success [2.596s] 2018-03-18 13:09:21,955 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:09:21.954 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet ... success [3.780s] 2018-03-18 13:09:36,584 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:09:36.583 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet ... success [4.658s] 2018-03-18 13:09:36,998 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:09:36.998 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility ... success [0.415s] 2018-03-18 13:09:37,103 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:09:37.102 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks ... success [0.104s] 2018-03-18 13:09:37,155 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:09:37.155 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets ... success [0.052s] 2018-03-18 13:09:37,250 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:09:37.249 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network ... success [0.094s] 2018-03-18 13:09:37,556 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:09:37.556 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet ... success [0.306s] 2018-03-18 13:09:47,896 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:09:47.895 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [4.035s] 2018-03-18 13:09:48,164 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:09:48.164 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.268s] 2018-03-18 13:09:48,536 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:09:48.535 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.371s] 2018-03-18 13:09:48,587 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:09:48.587 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.051s] 2018-03-18 13:09:48,692 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:09:48.691 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.104s] 2018-03-18 13:09:48,746 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:09:48.745 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.053s] 2018-03-18 13:09:58,827 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:09:58.827 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools ... success [3.192s] 2018-03-18 13:10:03,005 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:10:03.004 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups ... success [4.177s] 2018-03-18 13:10:04,601 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:10:04.601 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port ... success [1.596s] 2018-03-18 13:10:04,804 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:10:04.804 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports ... success [0.203s] 2018-03-18 13:10:04,855 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:10:04.855 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port ... success [0.051s] 2018-03-18 13:10:14,946 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:10:14.945 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [3.412s] 2018-03-18 13:10:19,657 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:10:19.657 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups ... success [4.710s] 2018-03-18 13:10:21,160 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:10:21.160 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [1.503s] 2018-03-18 13:10:21,350 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:10:21.350 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.189s] 2018-03-18 13:10:21,398 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:10:21.398 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.048s] 2018-03-18 13:10:33,707 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:10:33.707 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces ... success [7.448s] 2018-03-18 13:10:38,203 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:10:38.203 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id ... success [4.496s] 2018-03-18 13:10:41,989 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:10:41.988 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id ... success [3.784s] 2018-03-18 13:10:44,653 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:10:44.653 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router ... success [2.663s] 2018-03-18 13:11:02,508 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:11:02.507 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [8.038s] 2018-03-18 13:11:07,227 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:11:07.227 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [4.719s] 2018-03-18 13:11:11,276 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:11:11.276 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [4.047s] 2018-03-18 13:11:13,724 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:11:13.724 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [2.448s] 2018-03-18 13:11:24,780 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:11:24.780 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group ... success [1.271s] 2018-03-18 13:11:26,293 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:11:26.292 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule ... success [1.510s] 2018-03-18 13:11:26,470 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:11:26.469 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups ... success [0.179s] 2018-03-18 13:11:30,621 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:11:30.621 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.176s] 2018-03-18 13:11:32,163 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:11:32.163 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.539s] 2018-03-18 13:11:32,213 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:11:32.213 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.052s] 2018-03-18 13:11:35,998 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:11:35.998 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [0.908s] 2018-03-18 13:11:39,107 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:11:39.107 51 INFO opnfv-tempest [-] {0} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.006s] 2018-03-18 13:11:40,243 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:11:40.243 51 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest ... skip: AccountQuotasTest skipped as swift is not available 2018-03-18 13:11:40,245 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:11:40.245 51 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_services.AccountTest ... skip: AccountTest skipped as swift is not available 2018-03-18 13:11:40,246 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:11:40.246 51 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest ... skip: ContainerQuotasTest skipped as swift is not available 2018-03-18 13:11:40,247 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:11:40.247 51 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest ... skip: ContainerTest skipped as swift is not available 2018-03-18 13:11:40,248 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:11:40.248 51 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_object_services.ObjectTest ... skip: ObjectTest skipped as swift is not available 2018-03-18 13:11:42,008 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:11:42.008 51 INFO opnfv-tempest [-] {0} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.013s] 2018-03-18 13:11:55,456 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:11:55.455 51 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_attach_detach_volume_to_instance ... success [8.360s] 2018-03-18 13:12:07,006 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:12:07.006 51 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [6.626s] 2018-03-18 13:12:17,088 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:12:17.087 51 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [10.078s] 2018-03-18 13:12:25,483 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:12:25.483 51 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.042s] 2018-03-18 13:13:23,962 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:13:23.962 51 INFO opnfv-tempest [-] {0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops ... success [52.868s] 2018-03-18 13:13:53,082 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:13:53.081 51 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops ... success [20.674s] 2018-03-18 13:14:26,597 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:14:26.596 51 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_multinode.TestServerMultinode.test_schedule_to_all_nodes ... success [17.541s] 2018-03-18 13:14:38,873 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', 'b2ecb3da-2088-439b-9e4d-49199c140952']'. 2018-03-18 13:14:39,803 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-03-18 13:14:39,803 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-03-18 13:14:39,804 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-18 13:14:39,804 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | b2ecb3da-2088-439b-9e4d-49199c140952 | 2018-03-18 13:14:39,804 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | finished | 2018-03-18 13:14:39,804 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-03-18 13:03:14 | 2018-03-18 13:14:39,804 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-03-18 13:14:38 | 2018-03-18 13:14:39,804 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:11:24 | 2018-03-18 13:14:39,804 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | concurrency: 1 | 2018-03-18 13:14:39,804 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | | load_list: (value is too long, use 'detailed' flag to display it) | 2018-03-18 13:14:39,804 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-03-18 13:14:39,804 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: 849a206f-9422-46e5-aa75-8f9ba2fe3e34) | 2018-03-18 13:14:39,805 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-03-18 13:14:39,805 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: fcbe228b-fa28-4965-b71f-d188e952191b) | 2018-03-18 13:14:39,805 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 109 | 2018-03-18 13:14:39,805 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 667.291 | 2018-03-18 13:14:39,805 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 90 | 2018-03-18 13:14:39,805 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 19 | 2018-03-18 13:14:39,805 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-03-18 13:14:39,805 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-03-18 13:14:39,805 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 0 | 2018-03-18 13:14:39,805 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-18 13:14:39,805 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-03-18 13:14:39,904 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest tempest_smoke_serial success_rate is 100.0% 2018-03-18 13:14:44,765 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-18 13:14:44,765 - xtesting.ci.run_tests - INFO - Test result: +------------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------------+------------------+------------------+----------------+ | tempest_smoke_serial | functest | 11:46 | PASS | +------------------------------+------------------+------------------+----------------+ 2018-03-18 13:14:44,769 - xtesting.ci.run_tests - INFO - Running test case 'rally_sanity'... 2018-03-18 13:14:49,218 - xtesting.energy.energy - INFO - Energy recorder API is not available, cause=HTTPConnectionPool(host='energy.opnfv.fr', port=80): Read timed out. (read timeout=4) 2018-03-18 13:14:49,218 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-03-18 13:14:51,699 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-03-18 13:14:51.320 116 INFO rally.deployment.engine [-] Deployment fcbe228b-fa28-4965-b71f-d188e952191b | Starting: Destroy cloud and free allocated resources. 2018-03-18 13:14:51.380 116 INFO rally.deployment.engine [-] Deployment fcbe228b-fa28-4965-b71f-d188e952191b | Completed: Destroy cloud and free allocated resources. 2018-03-18 13:14:51.418 116 INFO rally.api [-] Deleting all verifications created by verifier 'opnfv-tempest' (UUID=849a206f-9422-46e5-aa75-8f9ba2fe3e34) for deployment 'opnfv-rally'. 2018-03-18 13:14:51.436 116 INFO rally.api [-] Deleting verification (UUID=b2ecb3da-2088-439b-9e4d-49199c140952). 2018-03-18 13:14:51.479 116 INFO rally.api [-] Verification has been successfully deleted! 2018-03-18 13:14:51.479 116 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=849a206f-9422-46e5-aa75-8f9ba2fe3e34). 2018-03-18 13:14:51.488 116 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-03-18 13:14:54,074 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-03-18 13:14:53.771 119 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=6efcda0f-add1-47b6-9ca0-5ebd74c01c85) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 6efcda0f-add1-47b6-9ca0-5ebd74c01c85 | 2018-03-18T13:14:53 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 6efcda0f-add1-47b6-9ca0-5ebd74c01c85 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-03-18 13:14:57,332 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-03-18 13:14:57,333 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating the test name... 2018-03-18 13:14:58,762 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating image 'Cirros-0.4.0-1af00a23-c957-455b-9133-01d60a780c80'... 2018-03-18 13:15:00,892 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating network 'rally-net-1af00a23-c957-455b-9133-01d60a780c80'... 2018-03-18 13:15:02,601 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating router 'rally-router-1af00a23-c957-455b-9133-01d60a780c80'... 2018-03-18 13:15:06,602 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-tiny-1af00a23-c957-455b-9133-01d60a780c80'... 2018-03-18 13:15:07,200 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-mini-1af00a23-c957-455b-9133-01d60a780c80'... 2018-03-18 13:15:07,834 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2018-03-18 13:15:07,835 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-authenticate.yaml 2018-03-18 13:15:07,836 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-18 13:15:07,891 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-18 13:15:07,897 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['authenticate'], 'concurrency': 4, 'netid': '4d83e8de-f141-4f36-b85e-7231647ebc0d', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-1af00a23-c957-455b-9133-01d60a780c80', 'flavor_name': 'rally-tiny-1af00a23-c957-455b-9133-01d60a780c80', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-1af00a23-c957-455b-9133-01d60a780c80', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-18 13:16:07,153 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 796deafd-3398-4ff4-84fa-48b4b274a45b 2018-03-18 13:16:07,153 - functest.opnfv_tests.openstack.rally.rally - DEBUG - /home/opnfv/functest/results/rally does not exist, we create it. 2018-03-18 13:16:07,155 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '796deafd-3398-4ff4-84fa-48b4b274a45b'] 2018-03-18 13:16:08,258 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 796deafd-3398-4ff4-84fa-48b4b274a45b: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 796deafd-3398-4ff4-84fa-48b4b274a45b has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.457 | 0.457 | 0.457 | 0.457 | 0.457 | 0.457 | 100.0% | 1 | | total | 0.457 | 0.457 | 0.457 | 0.457 | 0.457 | 0.457 | 100.0% | 1 | | -> duration | 0.457 | 0.457 | 0.457 | 0.457 | 0.457 | 0.457 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.456979 Full duration: 6.59328 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 796deafd-3398-4ff4-84fa-48b4b274a45b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.326 | 0.326 | 0.326 | 0.326 | 0.326 | 0.326 | 100.0% | 1 | | total | 0.751 | 0.751 | 0.751 | 0.751 | 0.751 | 0.751 | 100.0% | 1 | | -> duration | 0.751 | 0.751 | 0.751 | 0.751 | 0.751 | 0.751 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.75118 Full duration: 7.227456 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 796deafd-3398-4ff4-84fa-48b4b274a45b has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.215 | 0.215 | 0.215 | 0.215 | 0.215 | 0.215 | 100.0% | 1 | | total | 0.62 | 0.62 | 0.62 | 0.62 | 0.62 | 0.62 | 100.0% | 1 | | -> duration | 0.62 | 0.62 | 0.62 | 0.62 | 0.62 | 0.62 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.619995 Full duration: 6.910725 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 796deafd-3398-4ff4-84fa-48b4b274a45b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.359 | 0.359 | 0.359 | 0.359 | 0.359 | 0.359 | 100.0% | 1 | | total | 0.77 | 0.77 | 0.77 | 0.77 | 0.77 | 0.77 | 100.0% | 1 | | -> duration | 0.77 | 0.77 | 0.77 | 0.77 | 0.77 | 0.77 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.770071 Full duration: 7.00778 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 796deafd-3398-4ff4-84fa-48b4b274a45b has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.347 | 0.347 | 0.347 | 0.347 | 0.347 | 0.347 | 100.0% | 1 | | total | 0.738 | 0.738 | 0.738 | 0.738 | 0.738 | 0.738 | 100.0% | 1 | | -> duration | 0.738 | 0.738 | 0.738 | 0.738 | 0.738 | 0.738 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.737676 Full duration: 7.114242 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 796deafd-3398-4ff4-84fa-48b4b274a45b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.204 | 0.204 | 0.204 | 0.204 | 0.204 | 0.204 | 100.0% | 1 | | total | 0.653 | 0.653 | 0.653 | 0.653 | 0.653 | 0.653 | 100.0% | 1 | | -> duration | 0.653 | 0.653 | 0.653 | 0.653 | 0.653 | 0.653 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.653431 Full duration: 7.375189 HINTS: * To plot HTML graphics with this data, run: rally task report 796deafd-3398-4ff4-84fa-48b4b274a45b --out output.html * To generate a JUnit report, run: rally task export 796deafd-3398-4ff4-84fa-48b4b274a45b --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 796deafd-3398-4ff4-84fa-48b4b274a45b --json --out output.json 2018-03-18 13:16:08,258 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '796deafd-3398-4ff4-84fa-48b4b274a45b'] 2018-03-18 13:16:09,155 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-18 13:16:09,155 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '796deafd-3398-4ff4-84fa-48b4b274a45b', '--out', u'/home/opnfv/functest/results/rally/opnfv-authenticate.html'] 2018-03-18 13:16:09,161 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2018-03-18 13:16:09,162 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2018-03-18 13:16:09,162 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-glance.yaml 2018-03-18 13:16:09,162 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-18 13:16:09,210 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-18 13:16:09,211 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['glance'], 'concurrency': 4, 'netid': '4d83e8de-f141-4f36-b85e-7231647ebc0d', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-1af00a23-c957-455b-9133-01d60a780c80', 'flavor_name': 'rally-tiny-1af00a23-c957-455b-9133-01d60a780c80', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-1af00a23-c957-455b-9133-01d60a780c80', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-18 13:17:32,226 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : f7832920-e171-4689-85f1-ea075f2c5b70 2018-03-18 13:17:32,227 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'f7832920-e171-4689-85f1-ea075f2c5b70'] 2018-03-18 13:17:33,277 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task f7832920-e171-4689-85f1-ea075f2c5b70: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task f7832920-e171-4689-85f1-ea075f2c5b70 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.158 | 4.158 | 4.158 | 4.158 | 4.158 | 4.158 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.047 | 0.047 | 0.047 | 0.047 | 0.047 | 0.047 | 100.0% | 1 | | -> glance_v2.upload_data | 1.857 | 1.857 | 1.857 | 1.857 | 1.857 | 1.857 | 100.0% | 1 | | glance_v2.delete_image | 0.859 | 0.859 | 0.859 | 0.859 | 0.859 | 0.859 | 100.0% | 1 | | total | 5.017 | 5.017 | 5.017 | 5.017 | 5.017 | 5.017 | 100.0% | 1 | | -> duration | 5.017 | 5.017 | 5.017 | 5.017 | 5.017 | 5.017 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.017326 Full duration: 12.88204 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task f7832920-e171-4689-85f1-ea075f2c5b70 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.374 | 3.374 | 3.374 | 3.374 | 3.374 | 3.374 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.049 | 0.049 | 0.049 | 0.049 | 0.049 | 0.049 | 100.0% | 1 | | -> glance_v2.upload_data | 1.08 | 1.08 | 1.08 | 1.08 | 1.08 | 1.08 | 100.0% | 1 | | glance_v2.list_images | 0.043 | 0.043 | 0.043 | 0.043 | 0.043 | 0.043 | 100.0% | 1 | | total | 3.417 | 3.417 | 3.417 | 3.417 | 3.417 | 3.417 | 100.0% | 1 | | -> duration | 3.417 | 3.417 | 3.417 | 3.417 | 3.417 | 3.417 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.417274 Full duration: 13.614419 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task f7832920-e171-4689-85f1-ea075f2c5b70 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.182 | 0.182 | 0.182 | 0.182 | 0.182 | 0.182 | 100.0% | 1 | | total | 0.182 | 0.182 | 0.182 | 0.182 | 0.182 | 0.182 | 100.0% | 1 | | -> duration | 0.182 | 0.182 | 0.182 | 0.182 | 0.182 | 0.182 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.182316 Full duration: 7.155613 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally-tiny-1af00a23-c957-455b-9133-01d60a780c80" }, "number_instances": 2, "nics": [ { "net-id": "4d83e8de-f141-4f36-b85e-7231647ebc0d" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } } } -------------------------------------------------------------------------------- Task f7832920-e171-4689-85f1-ea075f2c5b70 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 3.352 | 3.352 | 3.352 | 3.352 | 3.352 | 3.352 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 0.044 | 100.0% | 1 | | -> glance_v2.upload_data | 1.033 | 1.033 | 1.033 | 1.033 | 1.033 | 1.033 | 100.0% | 1 | | nova.boot_servers | 9.583 | 9.583 | 9.583 | 9.583 | 9.583 | 9.583 | 100.0% | 1 | | total | 12.936 | 12.936 | 12.936 | 12.936 | 12.936 | 12.936 | 100.0% | 1 | | -> duration | 11.936 | 11.936 | 11.936 | 11.936 | 11.936 | 11.936 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.936035 Full duration: 33.777889 HINTS: * To plot HTML graphics with this data, run: rally task report f7832920-e171-4689-85f1-ea075f2c5b70 --out output.html * To generate a JUnit report, run: rally task export f7832920-e171-4689-85f1-ea075f2c5b70 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report f7832920-e171-4689-85f1-ea075f2c5b70 --json --out output.json 2018-03-18 13:17:33,278 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'f7832920-e171-4689-85f1-ea075f2c5b70'] 2018-03-18 13:17:34,269 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-18 13:17:34,270 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'f7832920-e171-4689-85f1-ea075f2c5b70', '--out', u'/home/opnfv/functest/results/rally/opnfv-glance.html'] 2018-03-18 13:17:34,275 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2018-03-18 13:17:34,275 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "ceilometer" ... 2018-03-18 13:17:34,275 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-ceilometer.yaml 2018-03-18 13:17:34,275 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-18 13:17:34,305 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-18 13:17:34,305 - functest.opnfv_tests.openstack.rally.rally - INFO - No tests for scenario "ceilometer" 2018-03-18 13:17:34,305 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2018-03-18 13:17:34,305 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-cinder.yaml 2018-03-18 13:17:34,305 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-18 13:17:34,322 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-18 13:17:34,325 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['cinder'], 'concurrency': 4, 'netid': '4d83e8de-f141-4f36-b85e-7231647ebc0d', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-1af00a23-c957-455b-9133-01d60a780c80', 'flavor_name': 'rally-tiny-1af00a23-c957-455b-9133-01d60a780c80', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-1af00a23-c957-455b-9133-01d60a780c80', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-18 13:20:33,987 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 7be60f64-b906-4fde-a65d-1201f58bcdda 2018-03-18 13:20:33,988 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '7be60f64-b906-4fde-a65d-1201f58bcdda'] 2018-03-18 13:20:35,092 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 7be60f64-b906-4fde-a65d-1201f58bcdda: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "force": false }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 7be60f64-b906-4fde-a65d-1201f58bcdda has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_snapshot | 3.095 | 3.095 | 3.095 | 3.095 | 3.095 | 3.095 | 100.0% | 1 | | cinder_v2.delete_snapshot | 2.426 | 2.426 | 2.426 | 2.426 | 2.426 | 2.426 | 100.0% | 1 | | total | 5.521 | 5.521 | 5.521 | 5.521 | 5.521 | 5.521 | 100.0% | 1 | | -> duration | 5.521 | 5.521 | 5.521 | 5.521 | 5.521 | 5.521 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.521357 Full duration: 21.720948 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": { "max": 1, "min": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 7be60f64-b906-4fde-a65d-1201f58bcdda has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.069 | 3.069 | 3.069 | 3.069 | 3.069 | 3.069 | 100.0% | 1 | | cinder_v2.delete_volume | 2.181 | 2.181 | 2.181 | 2.181 | 2.181 | 2.181 | 100.0% | 1 | | total | 5.25 | 5.25 | 5.25 | 5.25 | 5.25 | 5.25 | 100.0% | 1 | | -> duration | 5.25 | 5.25 | 5.25 | 5.25 | 5.25 | 5.25 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.250441 Full duration: 14.443429 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "image": { "name": "Cirros-0.4.0-1af00a23-c957-455b-9133-01d60a780c80" }, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 7be60f64-b906-4fde-a65d-1201f58bcdda has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 7.909 | 7.909 | 7.909 | 7.909 | 7.909 | 7.909 | 100.0% | 1 | | cinder_v2.delete_volume | 2.319 | 2.319 | 2.319 | 2.319 | 2.319 | 2.319 | 100.0% | 1 | | total | 10.229 | 10.229 | 10.229 | 10.229 | 10.229 | 10.229 | 100.0% | 1 | | -> duration | 10.229 | 10.229 | 10.229 | 10.229 | 10.229 | 10.229 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 10.228851 Full duration: 19.971644 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 7be60f64-b906-4fde-a65d-1201f58bcdda has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.08 | 3.08 | 3.08 | 3.08 | 3.08 | 3.08 | 100.0% | 1 | | cinder_v2.delete_volume | 2.304 | 2.304 | 2.304 | 2.304 | 2.304 | 2.304 | 100.0% | 1 | | total | 5.384 | 5.384 | 5.384 | 5.384 | 5.384 | 5.384 | 100.0% | 1 | | -> duration | 5.384 | 5.384 | 5.384 | 5.384 | 5.384 | 5.384 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.384373 Full duration: 15.210981 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "new_size": 2, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 7be60f64-b906-4fde-a65d-1201f58bcdda has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.107 | 3.107 | 3.107 | 3.107 | 3.107 | 3.107 | 100.0% | 1 | | cinder_v2.extend_volume | 2.505 | 2.505 | 2.505 | 2.505 | 2.505 | 2.505 | 100.0% | 1 | | cinder_v2.delete_volume | 2.368 | 2.368 | 2.368 | 2.368 | 2.368 | 2.368 | 100.0% | 1 | | total | 7.98 | 7.98 | 7.98 | 7.98 | 7.98 | 7.98 | 100.0% | 1 | | -> duration | 7.98 | 7.98 | 7.98 | 7.98 | 7.98 | 7.98 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 7.979973 Full duration: 17.218383 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 7be60f64-b906-4fde-a65d-1201f58bcdda has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.207 | 3.207 | 3.207 | 3.207 | 3.207 | 3.207 | 100.0% | 1 | | cinder_v2.delete_volume | 2.425 | 2.425 | 2.425 | 2.425 | 2.425 | 2.425 | 100.0% | 1 | | total | 5.632 | 5.632 | 5.632 | 5.632 | 5.632 | 5.632 | 100.0% | 1 | | -> duration | 5.632 | 5.632 | 5.632 | 5.632 | 5.632 | 5.632 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.631823 Full duration: 21.412542 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 7be60f64-b906-4fde-a65d-1201f58bcdda has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 0.573 | 0.573 | 0.573 | 0.573 | 0.573 | 0.573 | 100.0% | 1 | | cinder_v2.list_qos | 0.155 | 0.155 | 0.155 | 0.155 | 0.155 | 0.155 | 100.0% | 1 | | total | 0.729 | 0.729 | 0.729 | 0.729 | 0.729 | 0.729 | 100.0% | 1 | | -> duration | 0.729 | 0.729 | 0.729 | 0.729 | 0.729 | 0.729 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.728576 Full duration: 11.286555 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 7be60f64-b906-4fde-a65d-1201f58bcdda has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 0.567 | 0.567 | 0.567 | 0.567 | 0.567 | 0.567 | 100.0% | 1 | | cinder_v2.set_qos | 0.173 | 0.173 | 0.173 | 0.173 | 0.173 | 0.173 | 100.0% | 1 | | total | 0.741 | 0.741 | 0.741 | 0.741 | 0.741 | 0.741 | 100.0% | 1 | | -> duration | 0.741 | 0.741 | 0.741 | 0.741 | 0.741 | 0.741 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.740647 Full duration: 11.204637 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "description": "rally tests creating types" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 7be60f64-b906-4fde-a65d-1201f58bcdda has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.586 | 0.586 | 0.586 | 0.586 | 0.586 | 0.586 | 100.0% | 1 | | cinder_v2.list_types | 0.158 | 0.158 | 0.158 | 0.158 | 0.158 | 0.158 | 100.0% | 1 | | total | 0.744 | 0.744 | 0.744 | 0.744 | 0.744 | 0.744 | 100.0% | 1 | | -> duration | 0.744 | 0.744 | 0.744 | 0.744 | 0.744 | 0.744 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.743918 Full duration: 11.592151 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 7be60f64-b906-4fde-a65d-1201f58bcdda has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.673 | 0.673 | 0.673 | 0.673 | 0.673 | 0.673 | 100.0% | 1 | | cinder_v2.create_encryption_type | 0.203 | 0.203 | 0.203 | 0.203 | 0.203 | 0.203 | 100.0% | 1 | | total | 0.876 | 0.876 | 0.876 | 0.876 | 0.876 | 0.876 | 100.0% | 1 | | -> duration | 0.876 | 0.876 | 0.876 | 0.876 | 0.876 | 0.876 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.875849 Full duration: 11.617768 HINTS: * To plot HTML graphics with this data, run: rally task report 7be60f64-b906-4fde-a65d-1201f58bcdda --out output.html * To generate a JUnit report, run: rally task export 7be60f64-b906-4fde-a65d-1201f58bcdda --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 7be60f64-b906-4fde-a65d-1201f58bcdda --json --out output.json 2018-03-18 13:20:35,092 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '7be60f64-b906-4fde-a65d-1201f58bcdda'] 2018-03-18 13:20:36,188 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-18 13:20:36,188 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '7be60f64-b906-4fde-a65d-1201f58bcdda', '--out', u'/home/opnfv/functest/results/rally/opnfv-cinder.html'] 2018-03-18 13:20:36,198 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2018-03-18 13:20:36,198 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2018-03-18 13:20:36,198 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-heat.yaml 2018-03-18 13:20:36,198 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-18 13:20:36,235 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-18 13:20:36,237 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['heat'], 'concurrency': 4, 'netid': '4d83e8de-f141-4f36-b85e-7231647ebc0d', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-1af00a23-c957-455b-9133-01d60a780c80', 'flavor_name': 'rally-tiny-1af00a23-c957-455b-9133-01d60a780c80', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-1af00a23-c957-455b-9133-01d60a780c80', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-18 13:21:48,266 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 5ef32e63-0199-47ad-9eda-803fd4aeb838 2018-03-18 13:21:48,267 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '5ef32e63-0199-47ad-9eda-803fd4aeb838'] 2018-03-18 13:21:49,315 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 5ef32e63-0199-47ad-9eda-803fd4aeb838: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task 5ef32e63-0199-47ad-9eda-803fd4aeb838 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.391 | 4.391 | 4.391 | 4.391 | 4.391 | 4.391 | 100.0% | 1 | | heat.update_stack | 2.404 | 2.404 | 2.404 | 2.404 | 2.404 | 2.404 | 100.0% | 1 | | heat.delete_stack | 2.354 | 2.354 | 2.354 | 2.354 | 2.354 | 2.354 | 100.0% | 1 | | total | 9.149 | 9.149 | 9.149 | 9.149 | 9.149 | 9.149 | 100.0% | 1 | | -> duration | 5.149 | 5.149 | 5.149 | 5.149 | 5.149 | 5.149 | 100.0% | 1 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.148827 Full duration: 16.990254 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task 5ef32e63-0199-47ad-9eda-803fd4aeb838 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.237 | 4.237 | 4.237 | 4.237 | 4.237 | 4.237 | 100.0% | 1 | | heat.check_stack | 1.735 | 1.735 | 1.735 | 1.735 | 1.735 | 1.735 | 100.0% | 1 | | heat.delete_stack | 2.263 | 2.263 | 2.263 | 2.263 | 2.263 | 2.263 | 100.0% | 1 | | total | 8.236 | 8.236 | 8.236 | 8.236 | 8.236 | 8.236 | 100.0% | 1 | | -> duration | 6.236 | 6.236 | 6.236 | 6.236 | 6.236 | 6.236 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.235542 Full duration: 15.788599 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task 5ef32e63-0199-47ad-9eda-803fd4aeb838 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.219 | 4.219 | 4.219 | 4.219 | 4.219 | 4.219 | 100.0% | 1 | | heat.suspend_stack | 0.5 | 0.5 | 0.5 | 0.5 | 0.5 | 0.5 | 100.0% | 1 | | heat.resume_stack | 0.305 | 0.305 | 0.305 | 0.305 | 0.305 | 0.305 | 100.0% | 1 | | heat.delete_stack | 1.313 | 1.313 | 1.313 | 1.313 | 1.313 | 1.313 | 100.0% | 1 | | total | 6.338 | 6.338 | 6.338 | 6.338 | 6.338 | 6.338 | 100.0% | 1 | | -> duration | 4.338 | 4.338 | 4.338 | 4.338 | 4.338 | 4.338 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.338432 Full duration: 15.45804 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task 5ef32e63-0199-47ad-9eda-803fd4aeb838 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.557 | 0.557 | 0.557 | 0.557 | 0.557 | 0.557 | 100.0% | 1 | | total | 0.557 | 0.557 | 0.557 | 0.557 | 0.557 | 0.557 | 100.0% | 1 | | -> duration | 0.557 | 0.557 | 0.557 | 0.557 | 0.557 | 0.557 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.556889 Full duration: 7.962196 HINTS: * To plot HTML graphics with this data, run: rally task report 5ef32e63-0199-47ad-9eda-803fd4aeb838 --out output.html * To generate a JUnit report, run: rally task export 5ef32e63-0199-47ad-9eda-803fd4aeb838 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 5ef32e63-0199-47ad-9eda-803fd4aeb838 --json --out output.json 2018-03-18 13:21:49,315 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '5ef32e63-0199-47ad-9eda-803fd4aeb838'] 2018-03-18 13:21:50,365 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-18 13:21:50,365 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '5ef32e63-0199-47ad-9eda-803fd4aeb838', '--out', u'/home/opnfv/functest/results/rally/opnfv-heat.html'] 2018-03-18 13:21:50,373 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2018-03-18 13:21:50,373 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2018-03-18 13:21:50,373 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-keystone.yaml 2018-03-18 13:21:50,373 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-18 13:21:50,414 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-18 13:21:50,418 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['keystone'], 'concurrency': 4, 'netid': '4d83e8de-f141-4f36-b85e-7231647ebc0d', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-1af00a23-c957-455b-9133-01d60a780c80', 'flavor_name': 'rally-tiny-1af00a23-c957-455b-9133-01d60a780c80', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-1af00a23-c957-455b-9133-01d60a780c80', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-18 13:24:48,732 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 934d38fa-bd21-4896-9b65-685c20501ad5 2018-03-18 13:24:48,732 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '934d38fa-bd21-4896-9b65-685c20501ad5'] 2018-03-18 13:24:49,771 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 934d38fa-bd21-4896-9b65-685c20501ad5: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 934d38fa-bd21-4896-9b65-685c20501ad5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.474 | 0.474 | 0.474 | 0.474 | 0.474 | 0.474 | 100.0% | 1 | | keystone_v3.add_role | 0.117 | 0.117 | 0.117 | 0.117 | 0.117 | 0.117 | 100.0% | 1 | | keystone_v3.revoke_role | 0.215 | 0.215 | 0.215 | 0.215 | 0.215 | 0.215 | 100.0% | 1 | | total | 0.806 | 0.806 | 0.806 | 0.806 | 0.806 | 0.806 | 100.0% | 1 | | -> duration | 0.806 | 0.806 | 0.806 | 0.806 | 0.806 | 0.806 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.805764 Full duration: 13.310959 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 934d38fa-bd21-4896-9b65-685c20501ad5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.467 | 0.467 | 0.467 | 0.467 | 0.467 | 0.467 | 100.0% | 1 | | keystone_v3.add_role | 0.11 | 0.11 | 0.11 | 0.11 | 0.11 | 0.11 | 100.0% | 1 | | keystone_v3.list_roles | 0.095 | 0.095 | 0.095 | 0.095 | 0.095 | 0.095 | 100.0% | 1 | | total | 0.672 | 0.672 | 0.672 | 0.672 | 0.672 | 0.672 | 100.0% | 1 | | -> duration | 0.672 | 0.672 | 0.672 | 0.672 | 0.672 | 0.672 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.672028 Full duration: 13.334233 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 934d38fa-bd21-4896-9b65-685c20501ad5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.639 | 0.639 | 0.639 | 0.639 | 0.639 | 0.639 | 100.0% | 1 | | keystone_v3.list_projects | 0.082 | 0.082 | 0.082 | 0.082 | 0.082 | 0.082 | 100.0% | 1 | | total | 0.721 | 0.721 | 0.721 | 0.721 | 0.721 | 0.721 | 100.0% | 1 | | -> duration | 0.721 | 0.721 | 0.721 | 0.721 | 0.721 | 0.721 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.721394 Full duration: 13.694682 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 934d38fa-bd21-4896-9b65-685c20501ad5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.471 | 0.471 | 0.471 | 0.471 | 0.471 | 0.471 | 100.0% | 1 | | keystone_v3.delete_role | 0.089 | 0.089 | 0.089 | 0.089 | 0.089 | 0.089 | 100.0% | 1 | | total | 0.56 | 0.56 | 0.56 | 0.56 | 0.56 | 0.56 | 100.0% | 1 | | -> duration | 0.56 | 0.56 | 0.56 | 0.56 | 0.56 | 0.56 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.560274 Full duration: 11.194946 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 934d38fa-bd21-4896-9b65-685c20501ad5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.561 | 0.561 | 0.561 | 0.561 | 0.561 | 0.561 | 100.0% | 1 | | keystone_v3.delete_service | 0.109 | 0.109 | 0.109 | 0.109 | 0.109 | 0.109 | 100.0% | 1 | | total | 0.671 | 0.671 | 0.671 | 0.671 | 0.671 | 0.671 | 100.0% | 1 | | -> duration | 0.671 | 0.671 | 0.671 | 0.671 | 0.671 | 0.671 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.670663 Full duration: 11.663693 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 934d38fa-bd21-4896-9b65-685c20501ad5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.635 | 0.635 | 0.635 | 0.635 | 0.635 | 0.635 | 100.0% | 1 | | keystone_v3.create_user | 0.438 | 0.438 | 0.438 | 0.438 | 0.438 | 0.438 | 100.0% | 1 | | -> keystone_v3.list_roles | 0.08 | 0.08 | 0.08 | 0.08 | 0.08 | 0.08 | 100.0% | 1 | | -> keystone_v3.add_role | 0.108 | 0.108 | 0.108 | 0.108 | 0.108 | 0.108 | 100.0% | 1 | | keystone_v3.create_role | 0.087 | 0.087 | 0.087 | 0.087 | 0.087 | 0.087 | 100.0% | 1 | | keystone_v3.get_project | 0.076 | 0.076 | 0.076 | 0.076 | 0.076 | 0.076 | 100.0% | 1 | | keystone_v3.get_user | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 100.0% | 1 | | keystone_v3.get_role | 0.076 | 0.076 | 0.076 | 0.076 | 0.076 | 0.076 | 100.0% | 1 | | keystone_v3.list_services | 0.079 | 0.079 | 0.079 | 0.079 | 0.079 | 0.079 | 100.0% | 1 | | keystone_v3.get_services | 0.076 | 0.076 | 0.076 | 0.076 | 0.076 | 0.076 | 100.0% | 1 | | total | 1.656 | 1.656 | 1.656 | 1.656 | 1.656 | 1.656 | 100.0% | 1 | | -> duration | 1.656 | 1.656 | 1.656 | 1.656 | 1.656 | 1.656 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.656054 Full duration: 18.847242 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 934d38fa-bd21-4896-9b65-685c20501ad5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.63 | 0.63 | 0.63 | 0.63 | 0.63 | 0.63 | 100.0% | 1 | | keystone_v3.update_project | 0.09 | 0.09 | 0.09 | 0.09 | 0.09 | 0.09 | 100.0% | 1 | | keystone_v3.delete_project | 0.132 | 0.132 | 0.132 | 0.132 | 0.132 | 0.132 | 100.0% | 1 | | total | 0.853 | 0.853 | 0.853 | 0.853 | 0.853 | 0.853 | 100.0% | 1 | | -> duration | 0.853 | 0.853 | 0.853 | 0.853 | 0.853 | 0.853 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.852923 Full duration: 11.726767 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task 934d38fa-bd21-4896-9b65-685c20501ad5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.64 | 0.64 | 0.64 | 0.64 | 0.64 | 0.64 | 100.0% | 1 | | total | 0.728 | 0.728 | 0.728 | 0.728 | 0.728 | 0.728 | 100.0% | 1 | | -> duration | 0.728 | 0.728 | 0.728 | 0.728 | 0.728 | 0.728 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.728343 Full duration: 13.436438 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task 934d38fa-bd21-4896-9b65-685c20501ad5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.649 | 0.649 | 0.649 | 0.649 | 0.649 | 0.649 | 100.0% | 1 | | total | 0.649 | 0.649 | 0.649 | 0.649 | 0.649 | 0.649 | 100.0% | 1 | | -> duration | 0.649 | 0.649 | 0.649 | 0.649 | 0.649 | 0.649 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.649405 Full duration: 13.377288 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task 934d38fa-bd21-4896-9b65-685c20501ad5 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.633 | 0.633 | 0.633 | 0.633 | 0.633 | 0.633 | 100.0% | 1 | | keystone_v3.list_users | 0.093 | 0.093 | 0.093 | 0.093 | 0.093 | 0.093 | 100.0% | 1 | | total | 0.818 | 0.818 | 0.818 | 0.818 | 0.818 | 0.818 | 100.0% | 1 | | -> duration | 0.818 | 0.818 | 0.818 | 0.818 | 0.818 | 0.818 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.817576 Full duration: 13.519682 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "users_per_tenant": 10 }, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task 934d38fa-bd21-4896-9b65-685c20501ad5 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.647 | 0.647 | 0.647 | 0.647 | 0.647 | 0.647 | 100.0% | 1 | | keystone_v3.create_users | 4.565 | 4.565 | 4.565 | 4.565 | 4.565 | 4.565 | 100.0% | 1 | | -> keystone_v3.create_user (x10) | 4.564 | 4.564 | 4.564 | 4.564 | 4.564 | 4.564 | 100.0% | 1 | | --> keystone_v3.list_roles (x10) | 0.866 | 0.866 | 0.866 | 0.866 | 0.866 | 0.866 | 100.0% | 1 | | --> keystone_v3.add_role (x10) | 1.103 | 1.103 | 1.103 | 1.103 | 1.103 | 1.103 | 100.0% | 1 | | total | 6.123 | 6.123 | 6.123 | 6.123 | 6.123 | 6.123 | 100.0% | 1 | | -> duration | 6.123 | 6.123 | 6.123 | 6.123 | 6.123 | 6.123 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.12263 Full duration: 22.984794 HINTS: * To plot HTML graphics with this data, run: rally task report 934d38fa-bd21-4896-9b65-685c20501ad5 --out output.html * To generate a JUnit report, run: rally task export 934d38fa-bd21-4896-9b65-685c20501ad5 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 934d38fa-bd21-4896-9b65-685c20501ad5 --json --out output.json 2018-03-18 13:24:49,772 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '934d38fa-bd21-4896-9b65-685c20501ad5'] 2018-03-18 13:24:50,874 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-18 13:24:50,875 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '934d38fa-bd21-4896-9b65-685c20501ad5', '--out', u'/home/opnfv/functest/results/rally/opnfv-keystone.html'] 2018-03-18 13:24:50,883 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2018-03-18 13:24:50,883 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2018-03-18 13:24:50,883 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-neutron.yaml 2018-03-18 13:24:50,884 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-18 13:24:50,926 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-18 13:24:50,934 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['neutron'], 'concurrency': 4, 'netid': '4d83e8de-f141-4f36-b85e-7231647ebc0d', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-1af00a23-c957-455b-9133-01d60a780c80', 'flavor_name': 'rally-tiny-1af00a23-c957-455b-9133-01d60a780c80', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-1af00a23-c957-455b-9133-01d60a780c80', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-18 13:29:10,953 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 05743bd3-138f-45a2-b2aa-84e5e0ac478c 2018-03-18 13:29:10,953 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '05743bd3-138f-45a2-b2aa-84e5e0ac478c'] 2018-03-18 13:29:12,067 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 05743bd3-138f-45a2-b2aa-84e5e0ac478c: aborted -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } } } -------------------------------------------------------------------------------- Task 05743bd3-138f-45a2-b2aa-84e5e0ac478c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.092 | 1.092 | 1.092 | 1.092 | 1.092 | 1.092 | 100.0% | 1 | | neutron.delete_network | 0.801 | 0.801 | 0.801 | 0.801 | 0.801 | 0.801 | 100.0% | 1 | | total | 1.893 | 1.893 | 1.893 | 1.893 | 1.893 | 1.893 | 100.0% | 1 | | -> duration | 1.893 | 1.893 | 1.893 | 1.893 | 1.893 | 1.893 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.89342 Full duration: 14.158177 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "port": -1 } } } } -------------------------------------------------------------------------------- Task 05743bd3-138f-45a2-b2aa-84e5e0ac478c has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.416 | 1.416 | 1.416 | 1.416 | 1.416 | 1.416 | 100.0% | 1 | | neutron.delete_port | 0.566 | 0.566 | 0.566 | 0.566 | 0.566 | 0.566 | 100.0% | 1 | | total | 1.982 | 1.982 | 1.982 | 1.982 | 1.982 | 1.982 | 100.0% | 1 | | -> duration | 1.982 | 1.982 | 1.982 | 1.982 | 1.982 | 1.982 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.98166 Full duration: 26.54829 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "router_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1, "router": -1 } } } } -------------------------------------------------------------------------------- Task 05743bd3-138f-45a2-b2aa-84e5e0ac478c has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.815 | 0.815 | 0.815 | 0.815 | 0.815 | 0.815 | 100.0% | 1 | | neutron.create_subnet | 0.717 | 0.717 | 0.717 | 0.717 | 0.717 | 0.717 | 100.0% | 1 | | neutron.create_router | 0.164 | 0.164 | 0.164 | 0.164 | 0.164 | 0.164 | 100.0% | 1 | | neutron.add_interface_router | 1.643 | 1.643 | 1.643 | 1.643 | 1.643 | 1.643 | 100.0% | 1 | | neutron.remove_interface_router | 0.964 | 0.964 | 0.964 | 0.964 | 0.964 | 0.964 | 100.0% | 1 | | neutron.delete_router | 0.269 | 0.269 | 0.269 | 0.269 | 0.269 | 0.269 | 100.0% | 1 | | total | 4.574 | 4.574 | 4.574 | 4.574 | 4.574 | 4.574 | 100.0% | 1 | | -> duration | 4.574 | 4.574 | 4.574 | 4.574 | 4.574 | 4.574 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.57397 Full duration: 32.388523 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1 } } } } -------------------------------------------------------------------------------- Task 05743bd3-138f-45a2-b2aa-84e5e0ac478c has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 1.031 | 1.031 | 1.031 | 1.031 | 1.031 | 1.031 | 100.0% | 1 | | neutron.delete_subnet | 0.506 | 0.506 | 0.506 | 0.506 | 0.506 | 0.506 | 100.0% | 1 | | total | 1.537 | 1.537 | 1.537 | 1.537 | 1.537 | 1.537 | 100.0% | 1 | | -> duration | 1.537 | 1.537 | 1.537 | 1.537 | 1.537 | 1.537 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.537216 Full duration: 27.391837 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } } } -------------------------------------------------------------------------------- Task 05743bd3-138f-45a2-b2aa-84e5e0ac478c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.046 | 1.046 | 1.046 | 1.046 | 1.046 | 1.046 | 100.0% | 1 | | neutron.list_networks | 0.184 | 0.184 | 0.184 | 0.184 | 0.184 | 0.184 | 100.0% | 1 | | total | 1.23 | 1.23 | 1.23 | 1.23 | 1.23 | 1.23 | 100.0% | 1 | | -> duration | 1.23 | 1.23 | 1.23 | 1.23 | 1.23 | 1.23 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.230221 Full duration: 15.736802 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "port": -1 } } } } -------------------------------------------------------------------------------- Task 05743bd3-138f-45a2-b2aa-84e5e0ac478c has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.331 | 1.331 | 1.331 | 1.331 | 1.331 | 1.331 | 100.0% | 1 | | neutron.list_ports | 0.114 | 0.114 | 0.114 | 0.114 | 0.114 | 0.114 | 100.0% | 1 | | total | 1.445 | 1.445 | 1.445 | 1.445 | 1.445 | 1.445 | 100.0% | 1 | | -> duration | 1.445 | 1.445 | 1.445 | 1.445 | 1.445 | 1.445 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.445019 Full duration: 23.872832 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "router_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } } } -------------------------------------------------------------------------------- Task 05743bd3-138f-45a2-b2aa-84e5e0ac478c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.785 | 0.785 | 0.785 | 0.785 | 0.785 | 0.785 | 100.0% | 1 | | neutron.create_subnet | 0.576 | 0.576 | 0.576 | 0.576 | 0.576 | 0.576 | 100.0% | 1 | | neutron.create_router | 0.163 | 0.163 | 0.163 | 0.163 | 0.163 | 0.163 | 100.0% | 1 | | neutron.add_interface_router | 1.879 | 1.879 | 1.879 | 1.879 | 1.879 | 1.879 | 100.0% | 1 | | neutron.list_routers | 0.081 | 0.081 | 0.081 | 0.081 | 0.081 | 0.081 | 100.0% | 1 | | total | 3.485 | 3.485 | 3.485 | 3.485 | 3.485 | 3.485 | 100.0% | 1 | | -> duration | 3.485 | 3.485 | 3.485 | 3.485 | 3.485 | 3.485 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.484649 Full duration: 35.091836 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1 } } } } -------------------------------------------------------------------------------- Task 05743bd3-138f-45a2-b2aa-84e5e0ac478c has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.865 | 0.865 | 0.865 | 0.865 | 0.865 | 0.865 | 100.0% | 1 | | neutron.create_subnet | 0.668 | 0.668 | 0.668 | 0.668 | 0.668 | 0.668 | 100.0% | 1 | | neutron.list_subnets | 0.095 | 0.095 | 0.095 | 0.095 | 0.095 | 0.095 | 100.0% | 1 | | total | 1.628 | 1.628 | 1.628 | 1.628 | 1.628 | 1.628 | 100.0% | 1 | | -> duration | 1.628 | 1.628 | 1.628 | 1.628 | 1.628 | 1.628 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.628442 Full duration: 28.176426 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } } } -------------------------------------------------------------------------------- Task 05743bd3-138f-45a2-b2aa-84e5e0ac478c has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.927 | 0.927 | 0.927 | 0.927 | 0.927 | 0.927 | 100.0% | 1 | | neutron.delete_security_group | 0.15 | 0.15 | 0.15 | 0.15 | 0.15 | 0.15 | 100.0% | 1 | | total | 1.077 | 1.077 | 1.077 | 1.077 | 1.077 | 1.077 | 100.0% | 1 | | -> duration | 1.077 | 1.077 | 1.077 | 1.077 | 1.077 | 1.077 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.077127 Full duration: 13.432877 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } } } -------------------------------------------------------------------------------- Task 05743bd3-138f-45a2-b2aa-84e5e0ac478c has 1 error(s) -------------------------------------------------------------------------------- Conflict: Security Group 10d5cce7-2282-4ca5-8327-4b33e3d5a2cd cannot perform precommit_delete due to Callback networking_odl.common.callback.OdlSecurityGroupsHandler.sg_callback_precommit--9223372036850816584 failed with "argument of type 'NoneType' is not iterable". Neutron server returns request_ids: ['req-84a7ebf7-ecdf-46dd-9519-d0a9f9bd4d77'] Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally/plugins/openstack/scenarios/neutron/security_groups.py", line 236, in run self._delete_security_group(security_group) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 87, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally/plugins/openstack/scenarios/neutron/utils.py", line 631, in _delete_security_group security_group["security_group"]["id"]) File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 962, in delete_security_group return self.delete(self.security_group_path % (security_group)) File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 348, in delete headers=headers, params=params) File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 329, in retry_request headers=headers, params=params) File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 292, in do_request self._handle_fault_response(status_code, replybody, resp) File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 268, in _handle_fault_response exception_handler_v20(status_code, error_body) File "/usr/lib/python2.7/site-packages/neutronclient/v2_0/client.py", line 92, in exception_handler_v20 request_ids=request_ids) Conflict: Security Group 10d5cce7-2282-4ca5-8327-4b33e3d5a2cd cannot perform precommit_delete due to Callback networking_odl.common.callback.OdlSecurityGroupsHandler.sg_callback_precommit--9223372036850816584 failed with "argument of type 'NoneType' is not iterable". Neutron server returns request_ids: ['req-84a7ebf7-ecdf-46dd-9519-d0a9f9bd4d77'] -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.866 | 0.866 | 0.866 | 0.866 | 0.866 | 0.866 | 100.0% | 1 | | neutron.create_security_group_rule | 0.185 | 0.185 | 0.185 | 0.185 | 0.185 | 0.185 | 100.0% | 1 | | neutron.delete_security_group_rule | 0.11 | 0.11 | 0.11 | 0.11 | 0.11 | 0.11 | 100.0% | 1 | | neutron.delete_security_group | 0.092 | 0.092 | 0.092 | 0.092 | 0.092 | 0.092 | 0.0% | 1 | | total | 1.253 | 1.253 | 1.253 | 1.253 | 1.253 | 1.253 | 0.0% | 1 | | -> duration | 1.253 | 1.253 | 1.253 | 1.253 | 1.253 | 1.253 | 0.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0% | 1 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.253307 Full duration: 14.975745 HINTS: * To plot HTML graphics with this data, run: rally task report 05743bd3-138f-45a2-b2aa-84e5e0ac478c --out output.html * To generate a JUnit report, run: rally task export 05743bd3-138f-45a2-b2aa-84e5e0ac478c --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 05743bd3-138f-45a2-b2aa-84e5e0ac478c --json --out output.json 2018-03-18 13:29:12,067 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '05743bd3-138f-45a2-b2aa-84e5e0ac478c'] 2018-03-18 13:29:13,142 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-18 13:29:13,142 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '05743bd3-138f-45a2-b2aa-84e5e0ac478c', '--out', u'/home/opnfv/functest/results/rally/opnfv-neutron.html'] 2018-03-18 13:29:13,151 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" Failed. 2018-03-18 13:29:13,152 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2018-03-18 13:29:13,152 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-nova.yaml 2018-03-18 13:29:13,153 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-18 13:29:13,212 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-18 13:29:13,218 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['nova'], 'concurrency': 4, 'netid': '4d83e8de-f141-4f36-b85e-7231647ebc0d', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-1af00a23-c957-455b-9133-01d60a780c80', 'flavor_name': 'rally-tiny-1af00a23-c957-455b-9133-01d60a780c80', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-1af00a23-c957-455b-9133-01d60a780c80', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-18 13:32:09,826 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : ae68a43b-538f-4641-aec9-7f853fc21f35 2018-03-18 13:32:09,826 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'ae68a43b-538f-4641-aec9-7f853fc21f35'] 2018-03-18 13:32:10,856 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task ae68a43b-538f-4641-aec9-7f853fc21f35: aborted -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_live_migrate_server args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-1af00a23-c957-455b-9133-01d60a780c80" }, "image": { "name": "Cirros-0.4.0-1af00a23-c957-455b-9133-01d60a780c80" }, "block_migration": false, "nics": [ { "net-id": "4d83e8de-f141-4f36-b85e-7231647ebc0d" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task ae68a43b-538f-4641-aec9-7f853fc21f35 has 1 error(s) -------------------------------------------------------------------------------- RallyException: Live Migration failed: Migration complete but instance did not change host: overcloud-novacompute-1.opnfvlf.org Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally/plugins/openstack/scenarios/nova/servers.py", line 722, in run block_migration, disk_over_commit) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 87, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally/plugins/openstack/scenarios/nova/utils.py", line 770, in _live_migrate "but instance did not change host: %s" % host_pre_migrate) RallyException: Live Migration failed: Migration complete but instance did not change host: overcloud-novacompute-1.opnfvlf.org -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 8.357 | 8.357 | 8.357 | 8.357 | 8.357 | 8.357 | 100.0% | 1 | | nova.find_host_to_migrate | 0.904 | 0.904 | 0.904 | 0.904 | 0.904 | 0.904 | 100.0% | 1 | | nova.live_migrate | 132.115 | 132.115 | 132.115 | 132.115 | 132.115 | 132.115 | 0.0% | 1 | | total | 141.376 | 141.376 | 141.376 | 141.376 | 141.376 | 141.376 | 0.0% | 1 | | -> duration | 140.376 | 140.376 | 140.376 | 140.376 | 140.376 | 140.376 | 0.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 140.3763 Full duration: 155.171624 HINTS: * To plot HTML graphics with this data, run: rally task report ae68a43b-538f-4641-aec9-7f853fc21f35 --out output.html * To generate a JUnit report, run: rally task export ae68a43b-538f-4641-aec9-7f853fc21f35 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report ae68a43b-538f-4641-aec9-7f853fc21f35 --json --out output.json 2018-03-18 13:32:10,856 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'ae68a43b-538f-4641-aec9-7f853fc21f35'] 2018-03-18 13:32:11,875 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-18 13:32:11,876 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'ae68a43b-538f-4641-aec9-7f853fc21f35', '--out', u'/home/opnfv/functest/results/rally/opnfv-nova.html'] 2018-03-18 13:32:11,883 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2018-03-18 13:32:11,883 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2018-03-18 13:32:11,883 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-quotas.yaml 2018-03-18 13:32:11,883 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-18 13:32:11,902 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-18 13:32:11,903 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['quotas'], 'concurrency': 4, 'netid': '4d83e8de-f141-4f36-b85e-7231647ebc0d', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-1af00a23-c957-455b-9133-01d60a780c80', 'flavor_name': 'rally-tiny-1af00a23-c957-455b-9133-01d60a780c80', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-1af00a23-c957-455b-9133-01d60a780c80', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-18 13:32:58,273 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 0e0f93c3-b56d-4c8c-bf73-777dd4bb5a3b 2018-03-18 13:32:58,273 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '0e0f93c3-b56d-4c8c-bf73-777dd4bb5a3b'] 2018-03-18 13:32:59,265 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 0e0f93c3-b56d-4c8c-bf73-777dd4bb5a3b: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 0e0f93c3-b56d-4c8c-bf73-777dd4bb5a3b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.66 | 0.66 | 0.66 | 0.66 | 0.66 | 0.66 | 100.0% | 1 | | quotas.delete_quotas | 0.177 | 0.177 | 0.177 | 0.177 | 0.177 | 0.177 | 100.0% | 1 | | total | 0.838 | 0.838 | 0.838 | 0.838 | 0.838 | 0.838 | 100.0% | 1 | | -> duration | 0.838 | 0.838 | 0.838 | 0.838 | 0.838 | 0.838 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.837616 Full duration: 7.817652 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 0e0f93c3-b56d-4c8c-bf73-777dd4bb5a3b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.699 | 0.699 | 0.699 | 0.699 | 0.699 | 0.699 | 100.0% | 1 | | total | 0.699 | 0.699 | 0.699 | 0.699 | 0.699 | 0.699 | 100.0% | 1 | | -> duration | 0.699 | 0.699 | 0.699 | 0.699 | 0.699 | 0.699 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.69873 Full duration: 7.750101 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 0e0f93c3-b56d-4c8c-bf73-777dd4bb5a3b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.292 | 0.292 | 0.292 | 0.292 | 0.292 | 0.292 | 100.0% | 1 | | total | 0.685 | 0.685 | 0.685 | 0.685 | 0.685 | 0.685 | 100.0% | 1 | | -> duration | 0.685 | 0.685 | 0.685 | 0.685 | 0.685 | 0.685 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.684884 Full duration: 7.823867 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 0e0f93c3-b56d-4c8c-bf73-777dd4bb5a3b has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.913 | 0.913 | 0.913 | 0.913 | 0.913 | 0.913 | 100.0% | 1 | | total | 0.913 | 0.913 | 0.913 | 0.913 | 0.913 | 0.913 | 100.0% | 1 | | -> duration | 0.913 | 0.913 | 0.913 | 0.913 | 0.913 | 0.913 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.913391 Full duration: 8.51402 HINTS: * To plot HTML graphics with this data, run: rally task report 0e0f93c3-b56d-4c8c-bf73-777dd4bb5a3b --out output.html * To generate a JUnit report, run: rally task export 0e0f93c3-b56d-4c8c-bf73-777dd4bb5a3b --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 0e0f93c3-b56d-4c8c-bf73-777dd4bb5a3b --json --out output.json 2018-03-18 13:32:59,266 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '0e0f93c3-b56d-4c8c-bf73-777dd4bb5a3b'] 2018-03-18 13:33:00,314 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-18 13:33:00,314 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '0e0f93c3-b56d-4c8c-bf73-777dd4bb5a3b', '--out', u'/home/opnfv/functest/results/rally/opnfv-quotas.html'] 2018-03-18 13:33:00,321 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2018-03-18 13:33:00,325 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:42 | 6 | 100.00% | | glance | 01:07 | 4 | 100.00% | | cinder | 02:35 | 10 | 100.00% | | heat | 00:56 | 4 | 100.00% | | keystone | 02:37 | 11 | 100.00% | | neutron | 03:51 | 10 | 90.00% | | nova | 02:35 | 1 | 0.00% | | quotas | 00:31 | 4 | 100.00% | | | | | | | TOTAL: | 00:14:57 | 50 | 96.00% | +----------------+------------+----------------+-----------+ 2018-03-18 13:33:00,325 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_sanity' success_rate is 96.00% 2018-03-18 13:33:07,324 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-18 13:33:07,324 - xtesting.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | rally_sanity | functest | 18:18 | FAIL | +----------------------+------------------+------------------+----------------+ 2018-03-18 13:33:07,329 - xtesting.ci.run_tests - ERROR - The test case 'rally_sanity' failed. 2018-03-18 13:33:07,329 - xtesting.ci.run_tests - INFO - Running test case 'refstack_defcore'... 2018-03-18 13:33:07,434 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-03-18 13:33:09,749 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-03-18 13:33:09.422 9441 INFO rally.deployment.engine [-] Deployment 6efcda0f-add1-47b6-9ca0-5ebd74c01c85 | Starting: Destroy cloud and free allocated resources. 2018-03-18 13:33:09.500 9441 INFO rally.deployment.engine [-] Deployment 6efcda0f-add1-47b6-9ca0-5ebd74c01c85 | Completed: Destroy cloud and free allocated resources. 2018-03-18 13:33:09.526 9441 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=849a206f-9422-46e5-aa75-8f9ba2fe3e34). 2018-03-18 13:33:09.531 9441 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-03-18 13:33:12,206 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-03-18 13:33:11.961 9444 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=3430473d-56a6-44a2-a546-fb7a862280b5) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 3430473d-56a6-44a2-a546-fb7a862280b5 | 2018-03-18T13:33:11 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 3430473d-56a6-44a2-a546-fb7a862280b5 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-03-18 13:33:15,393 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-03-18 13:33:15,393 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-03-18 13:33:17,719 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-03-18 13:33:17.422 9450 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=849a206f-9422-46e5-aa75-8f9ba2fe3e34). 2018-03-18 13:33:17.541 9450 INFO rally.api [-] Verifier has been successfully deleted! 2018-03-18 13:33:21,155 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-03-18 13:33:19.780 9453 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-03-18 13:33:19.919 9453 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-03-18 13:33:20.930 9453 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=7b21af82-88e7-4205-9060-8cb40f7dd858) has been successfully created! Using verifier 'opnfv-tempest' (UUID=7b21af82-88e7-4205-9060-8cb40f7dd858) as the default verifier for the future CLI operations. 2018-03-18 13:33:23,996 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-03-18 13:33:25,740 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-03-18 13:33:30,149 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-03-18 13:33:35,086 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-03-18 13:33:34.247 9472 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=7b21af82-88e7-4205-9060-8cb40f7dd858) for deployment 'opnfv-rally' (UUID=3430473d-56a6-44a2-a546-fb7a862280b5). 2018-03-18 13:33:34.921 9472 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=7b21af82-88e7-4205-9060-8cb40f7dd858) has been successfully configured for deployment 'opnfv-rally' (UUID=3430473d-56a6-44a2-a546-fb7a862280b5)! 2018-03-18 13:33:35,086 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-03-18 13:33:35,086 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-03-18 13:33:35,089 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-03-18 13:33:37,198 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/refstack/tempest-list.txt']'. 2018-03-18 13:33:39,286 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:33:39.285 9484 INFO rally.api [-] Starting verification (UUID=942488da-3e4e-4315-8db9-ef431e855239) for deployment 'opnfv-rally' (UUID=3430473d-56a6-44a2-a546-fb7a862280b5) by verifier 'opnfv-tempest' (UUID=7b21af82-88e7-4205-9060-8cb40f7dd858). 2018-03-18 13:33:39,287 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: 942488da-3e4e-4315-8db9-ef431e855239 2018-03-18 13:33:49,254 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:33:49.254 9484 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.283s] 2018-03-18 13:33:49,341 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:33:49.341 9484 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.088s] 2018-03-18 13:33:49,349 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:33:49.349 9484 INFO opnfv-tempest [-] {12} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.013s] 2018-03-18 13:33:49,689 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:33:49.688 9484 INFO opnfv-tempest [-] {14} tempest.api.identity.v3.test_tokens.TokensV3Test.test_create_token ... success [0.345s] 2018-03-18 13:33:49,756 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:33:49.756 9484 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_delete_non_existing_tag ... success [0.685s] 2018-03-18 13:33:49,788 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:33:49.788 9484 INFO opnfv-tempest [-] {8} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.429s] 2018-03-18 13:33:50,043 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:33:50.043 9484 INFO opnfv-tempest [-] {6} tempest.api.image.v2.test_images_tags_negative.ImagesTagsNegativeTest.test_update_tags_for_non_existing_image ... success [0.287s] 2018-03-18 13:33:50,953 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:33:50.952 9484 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [1.596s] 2018-03-18 13:33:53,554 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:33:53.554 9484 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [2.602s] 2018-03-18 13:33:54,288 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:33:54.288 9484 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_server_with_admin_password ... success [5.212s] 2018-03-18 13:33:56,916 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:33:56.915 9484 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.447s] 2018-03-18 13:33:57,342 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:33:57.341 9484 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.144s] 2018-03-18 13:33:57,581 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:33:57.580 9484 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.238s] 2018-03-18 13:33:57,681 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:33:57.680 9484 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.100s] 2018-03-18 13:33:58,870 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:33:58.870 9484 INFO opnfv-tempest [-] {14} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.622s] 2018-03-18 13:33:59,382 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:33:59.382 9484 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [2.465s] 2018-03-18 13:34:00,385 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:00.384 9484 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action ... success [0.154s] 2018-03-18 13:34:00,951 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:00.951 9484 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [1.569s] 2018-03-18 13:34:01,365 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:01.365 9484 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [1.623s] 2018-03-18 13:34:01,420 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:01.419 9484 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_with_nonexistent_volume_id ... success [0.226s] 2018-03-18 13:34:01,618 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:01.618 9484 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [0.665s] 2018-03-18 13:34:01,634 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:01.634 9484 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_without_passing_volume_id ... success [0.214s] 2018-03-18 13:34:02,168 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:02.168 9484 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [0.802s] 2018-03-18 13:34:02,495 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:02.495 9484 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.170s] 2018-03-18 13:34:02,510 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:02.509 9484 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.015s] 2018-03-18 13:34:02,800 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:02.800 9484 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [0.289s] 2018-03-18 13:34:02,807 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:02.806 9484 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.007s] 2018-03-18 13:34:02,959 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:02.959 9484 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [1.341s] 2018-03-18 13:34:02,977 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:02.976 9484 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.169s] 2018-03-18 13:34:04,497 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:04.496 9484 INFO opnfv-tempest [-] {3} tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_list_instance_actions ... success [4.110s] 2018-03-18 13:34:05,009 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:05.009 9484 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [2.048s] 2018-03-18 13:34:05,927 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:05.927 9484 INFO opnfv-tempest [-] {6} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_crud_snapshot_metadata ... success [1.504s] 2018-03-18 13:34:06,381 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:06.380 9484 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [1.369s] 2018-03-18 13:34:06,485 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:06.484 9484 INFO opnfv-tempest [-] {6} tempest.api.volume.test_snapshot_metadata.SnapshotMetadataTestJSON.test_update_show_snapshot_metadata_item ... success [0.557s] 2018-03-18 13:34:06,500 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:06.500 9484 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.121s] 2018-03-18 13:34:06,522 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:06.522 9484 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.022s] 2018-03-18 13:34:06,548 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:06.548 9484 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.025s] 2018-03-18 13:34:06,567 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:06.566 9484 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.018s] 2018-03-18 13:34:13,055 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:13.054 9484 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_specify_keypair ... success [18.762s] 2018-03-18 13:34:15,312 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:15.312 9484 INFO opnfv-tempest [-] {3} tempest.api.image.v2.test_images_tags.ImagesTagsTest.test_update_delete_tags_for_image ... success [0.821s] 2018-03-18 13:34:22,573 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:22.573 9484 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.047s] 2018-03-18 13:34:22,635 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:22.635 9484 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_by_name ... success [0.061s] 2018-03-18 13:34:22,829 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:22.829 9484 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_by_name ... success [0.194s] 2018-03-18 13:34:23,087 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:23.087 9484 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_pagination ... success [0.257s] 2018-03-18 13:34:23,488 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:23.488 9484 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_details_with_multiple_params ... success [0.400s] 2018-03-18 13:34:23,869 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:23.868 9484 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_pagination ... success [0.380s] 2018-03-18 13:34:23,906 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:23.906 9484 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_param_display_name_and_status ... success [0.038s] 2018-03-18 13:34:23,958 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:23.958 9484 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_display_name_and_status ... success [0.051s] 2018-03-18 13:34:24,029 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:24.029 9484 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_detail_param_metadata ... success [0.070s] 2018-03-18 13:34:24,079 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:24.079 9484 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_details ... success [0.049s] 2018-03-18 13:34:24,120 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:24.120 9484 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list_with_param_metadata ... success [0.041s] 2018-03-18 13:34:24,214 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:24.214 9484 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_availability_zone ... success [0.093s] 2018-03-18 13:34:24,299 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:24.299 9484 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_by_status ... success [0.084s] 2018-03-18 13:34:24,351 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:24.351 9484 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_availability_zone ... success [0.052s] 2018-03-18 13:34:24,404 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:24.403 9484 INFO opnfv-tempest [-] {6} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volumes_list_details_by_status ... success [0.052s] 2018-03-18 13:34:24,627 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:24.626 9484 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_bulk_port ... success [3.096s] 2018-03-18 13:34:29,412 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:29.412 9484 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [4.784s] 2018-03-18 13:34:31,847 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:31.847 9484 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [2.434s] 2018-03-18 13:34:31,910 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:31.909 9484 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.063s] 2018-03-18 13:34:31,957 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:31.957 9484 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_list_ports_fields ... success [0.047s] 2018-03-18 13:34:32,009 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:32.009 9484 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.052s] 2018-03-18 13:34:32,057 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:32.057 9484 INFO opnfv-tempest [-] {3} tempest.api.network.test_ports.PortsTestJSON.test_show_port_fields ... success [0.048s] 2018-03-18 13:34:33,612 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:33.611 9484 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_create_with_existing_server_name ... success [20.553s] 2018-03-18 13:34:34,179 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:34.179 9484 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_future_date ... success [0.065s] 2018-03-18 13:34:34,192 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:34.191 9484 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_changes_since_invalid_date ... success [0.012s] 2018-03-18 13:34:34,332 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:34.332 9484 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_greater_than_actual_count ... success [0.139s] 2018-03-18 13:34:34,345 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:34.344 9484 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_negative_value ... success [0.012s] 2018-03-18 13:34:34,357 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:34.356 9484 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_limits_pass_string ... success [0.012s] 2018-03-18 13:34:34,388 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:34.387 9484 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_flavor ... success [0.030s] 2018-03-18 13:34:34,451 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:34.451 9484 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_image ... success [0.063s] 2018-03-18 13:34:34,521 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:34.521 9484 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_by_non_existing_server_name ... success [0.068s] 2018-03-18 13:34:34,689 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:34.689 9484 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_detail_server_is_deleted ... success [0.167s] 2018-03-18 13:34:34,705 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:34.704 9484 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_status_non_existing ... success [0.015s] 2018-03-18 13:34:35,019 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:35.019 9484 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_list_servers_negative.ListServersNegativeTestJSON.test_list_servers_with_a_deleted_server ... success [0.314s] 2018-03-18 13:34:38,650 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:38.650 9484 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server ... success [49.278s] 2018-03-18 13:34:42,512 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:42.511 9484 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_access_server_address ... success [8.900s] 2018-03-18 13:34:42,551 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:42.551 9484 INFO opnfv-tempest [-] {5} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_delete_image ... success [43.034s] 2018-03-18 13:34:43,157 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:43.157 9484 INFO opnfv-tempest [-] {5} tempest.api.compute.images.test_images_oneserver.ImagesOneServerTestJSON.test_create_image_specify_multibyte_character_image_name ... success [0.609s] 2018-03-18 13:34:48,736 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:48.736 9484 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_all_attributes ... success [3.135s] 2018-03-18 13:34:53,466 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:53.465 9484 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_allocation_pools ... success [4.729s] 2018-03-18 13:34:53,924 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:53.923 9484 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name ... success [1.152s] 2018-03-18 13:34:55,056 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:55.056 9484 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit ... success [1.131s] 2018-03-18 13:34:56,035 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:56.035 9484 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 ... success [0.977s] 2018-03-18 13:34:57,050 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:57.050 9484 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor ... success [1.014s] 2018-03-18 13:34:57,689 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:57.689 9484 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_dhcp_enabled ... success [4.223s] 2018-03-18 13:34:58,075 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:58.075 9484 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image ... success [1.023s] 2018-03-18 13:34:59,358 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:59.358 9484 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid ... success [1.282s] 2018-03-18 13:34:59,596 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:59.596 9484 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit ... success [0.237s] 2018-03-18 13:34:59,864 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:34:59.864 9484 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id ... success [0.267s] 2018-03-18 13:35:00,133 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:00.133 9484 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server ... success [0.268s] 2018-03-18 13:35:00,770 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:00.769 9484 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw ... success [3.079s] 2018-03-18 13:35:01,349 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:01.348 9484 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address ... success [1.213s] 2018-03-18 13:35:01,603 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:01.603 9484 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server ... success [0.254s] 2018-03-18 13:35:01,860 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:01.859 9484 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_deleted_server ... success [0.255s] 2018-03-18 13:35:02,215 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:02.215 9484 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server ... success [0.354s] 2018-03-18 13:35:03,224 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:03.224 9484 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank ... success [1.006s] 2018-03-18 13:35:03,274 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:03.274 9484 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_gw_and_allocation_pools ... success [2.504s] 2018-03-18 13:35:03,489 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:03.489 9484 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server ... success [0.265s] 2018-03-18 13:35:03,739 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:03.739 9484 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server ... success [0.249s] 2018-03-18 13:35:03,981 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:03.980 9484 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 ... success [0.240s] 2018-03-18 13:35:04,218 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:04.218 9484 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name ... success [0.237s] 2018-03-18 13:35:07,507 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:07.507 9484 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_with_host_routes_and_dns_nameservers ... success [4.232s] 2018-03-18 13:35:08,764 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:08.763 9484 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_host_name_is_same_as_server_name ... success [3.116s] 2018-03-18 13:35:08,834 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:08.834 9484 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.070s] 2018-03-18 13:35:09,061 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:09.061 9484 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers_with_detail ... success [0.226s] 2018-03-18 13:35:09,159 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:09.159 9484 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_created_server_vcpus ... success [0.096s] 2018-03-18 13:35:09,160 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:09.160 9484 INFO opnfv-tempest [-] {5} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s] 2018-03-18 13:35:10,452 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:10.452 9484 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_delete_subnet_without_gateway ... success [2.944s] 2018-03-18 13:35:14,790 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:14.789 9484 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [4.335s] 2018-03-18 13:35:19,074 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:19.074 9484 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_delete_network_with_subnet ... success [4.284s] 2018-03-18 13:35:19,401 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:19.401 9484 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.326s] 2018-03-18 13:35:19,502 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:19.502 9484 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks_fields ... success [0.102s] 2018-03-18 13:35:19,727 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:19.727 9484 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.223s] 2018-03-18 13:35:19,777 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:19.777 9484 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets_fields ... success [0.049s] 2018-03-18 13:35:19,885 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:19.885 9484 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.106s] 2018-03-18 13:35:20,133 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:20.133 9484 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network_fields ... success [0.247s] 2018-03-18 13:35:20,185 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:20.184 9484 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.051s] 2018-03-18 13:35:20,248 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:20.248 9484 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet_fields ... success [0.064s] 2018-03-18 13:35:24,542 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:24.541 9484 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_update_subnet_gw_dns_host_routes_dhcp ... success [4.291s] 2018-03-18 13:35:24,789 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:24.789 9484 INFO opnfv-tempest [-] {5} tempest.api.volume.test_availability_zone.AvailabilityZoneTestJSON.test_get_availability_zone_list ... success [0.158s] 2018-03-18 13:35:35,513 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:35.512 9484 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_snapshot_create_get_list_update_delete ... success [4.252s] 2018-03-18 13:35:42,016 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:42.015 9484 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_snapshots.VolumesSnapshotTestJSON.test_volume_from_snapshot ... success [6.501s] 2018-03-18 13:35:50,493 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:50.493 9484 INFO opnfv-tempest [-] {2} tempest.api.compute.servers.test_servers.ServersTestJSON.test_update_server_name ... success [67.965s] 2018-03-18 13:35:54,639 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:54.638 9484 INFO opnfv-tempest [-] {2} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_default_quotas ... success [0.244s] 2018-03-18 13:35:54,996 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:35:54.996 9484 INFO opnfv-tempest [-] {2} tempest.api.compute.test_quotas.QuotasTestJSON.test_get_quotas ... success [0.358s] 2018-03-18 13:36:04,548 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:36:04.547 9484 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_image_schema ... success [0.009s] 2018-03-18 13:36:04,697 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:36:04.697 9484 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_get_images_schema ... success [0.149s] 2018-03-18 13:36:04,741 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:36:04.740 9484 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_container_format ... success [0.043s] 2018-03-18 13:36:04,770 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:36:04.770 9484 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_disk_format ... success [0.029s] 2018-03-18 13:36:05,038 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:36:05.038 9484 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_limit ... success [0.267s] 2018-03-18 13:36:05,089 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:36:05.088 9484 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_min_max_size ... success [0.049s] 2018-03-18 13:36:05,135 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:36:05.134 9484 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_size ... success [0.046s] 2018-03-18 13:36:05,183 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:36:05.182 9484 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_status ... success [0.047s] 2018-03-18 13:36:05,223 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:36:05.223 9484 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_images_param_visibility ... success [0.039s] 2018-03-18 13:36:05,265 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:36:05.264 9484 INFO opnfv-tempest [-] {2} tempest.api.image.v2.test_images.ListUserImagesTest.test_list_no_params ... success [0.041s] 2018-03-18 13:37:20,693 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:37:20.693 9484 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_host_name_is_same_as_server_name ... fail [187.277s] 2018-03-18 13:37:20,764 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:37:20.764 9484 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.077s] 2018-03-18 13:37:21,287 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:37:21.286 9484 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers_with_detail ... success [0.521s] 2018-03-18 13:40:28,763 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:40:28.762 9484 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_created_server_vcpus ... fail [187.466s] 2018-03-18 13:40:28,764 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:40:28.763 9484 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s] 2018-03-18 13:40:45,769 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:40:45.769 9484 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.380s] 2018-03-18 13:40:45,998 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:40:45.997 9484 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.228s] 2018-03-18 13:40:46,230 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:40:46.229 9484 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [0.231s] 2018-03-18 13:40:46,614 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:40:46.614 9484 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [0.384s] 2018-03-18 13:40:47,006 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:40:47.005 9484 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [0.390s] 2018-03-18 13:40:47,407 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:40:47.406 9484 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [0.402s] 2018-03-18 13:40:54,060 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:40:54.060 9484 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.496s] 2018-03-18 13:40:55,158 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:40:55.158 9484 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [1.098s] 2018-03-18 13:40:57,827 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:40:57.826 9484 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [2.665s] 2018-03-18 13:40:58,498 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:40:58.497 9484 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [0.673s] 2018-03-18 13:40:59,903 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:40:59.903 9484 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [1.404s] 2018-03-18 13:41:01,073 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:41:01.073 9484 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [1.170s] 2018-03-18 13:41:02,376 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:41:02.376 9484 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.300s] 2018-03-18 13:41:02,424 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:41:02.424 9484 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.049s] 2018-03-18 13:41:05,214 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '942488da-3e4e-4315-8db9-ef431e855239']'. 2018-03-18 13:41:06,216 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-03-18 13:41:06,217 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-03-18 13:41:06,217 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-18 13:41:06,217 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 942488da-3e4e-4315-8db9-ef431e855239 | 2018-03-18 13:41:06,217 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | failed | 2018-03-18 13:41:06,217 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-03-18 13:33:39 | 2018-03-18 13:41:06,217 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-03-18 13:41:04 | 2018-03-18 13:41:06,217 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:07:25 | 2018-03-18 13:41:06,217 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-03-18 13:41:06,217 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-03-18 13:41:06,217 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: 7b21af82-88e7-4205-9060-8cb40f7dd858) | 2018-03-18 13:41:06,218 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-03-18 13:41:06,218 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 3430473d-56a6-44a2-a546-fb7a862280b5) | 2018-03-18 13:41:06,218 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 154 | 2018-03-18 13:41:06,218 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 435.954 | 2018-03-18 13:41:06,218 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 152 | 2018-03-18 13:41:06,218 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 0 | 2018-03-18 13:41:06,218 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-03-18 13:41:06,218 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-03-18 13:41:06,218 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 2 | 2018-03-18 13:41:06,219 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-18 13:41:06,219 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +--------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-03-18 13:41:06,301 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest refstack_defcore success_rate is 98.7012987013% 2018-03-18 13:41:11,627 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-18 13:41:11,628 - xtesting.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | refstack_defcore | functest | 07:48 | FAIL | +--------------------------+------------------+------------------+----------------+ 2018-03-18 13:41:11,632 - xtesting.ci.run_tests - ERROR - The test case 'refstack_defcore' failed. 2018-03-18 13:41:11,632 - xtesting.ci.run_tests - INFO - Running test case 'patrole'... 2018-03-18 13:41:11,723 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-03-18 13:41:14,351 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-03-18 13:41:13.875 9578 INFO rally.deployment.engine [-] Deployment 3430473d-56a6-44a2-a546-fb7a862280b5 | Starting: Destroy cloud and free allocated resources. 2018-03-18 13:41:13.957 9578 INFO rally.deployment.engine [-] Deployment 3430473d-56a6-44a2-a546-fb7a862280b5 | Completed: Destroy cloud and free allocated resources. 2018-03-18 13:41:14.006 9578 INFO rally.api [-] Deleting all verifications created by verifier 'opnfv-tempest' (UUID=7b21af82-88e7-4205-9060-8cb40f7dd858) for deployment 'opnfv-rally'. 2018-03-18 13:41:14.029 9578 INFO rally.api [-] Deleting verification (UUID=942488da-3e4e-4315-8db9-ef431e855239). 2018-03-18 13:41:14.075 9578 INFO rally.api [-] Verification has been successfully deleted! 2018-03-18 13:41:14.076 9578 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=7b21af82-88e7-4205-9060-8cb40f7dd858). 2018-03-18 13:41:14.087 9578 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-03-18 13:41:16,812 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-03-18 13:41:16.511 9581 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=8ba1f36f-6e39-4996-ae33-38b7a04597d6) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 8ba1f36f-6e39-4996-ae33-38b7a04597d6 | 2018-03-18T13:41:16 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 8ba1f36f-6e39-4996-ae33-38b7a04597d6 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-03-18 13:41:19,966 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-03-18 13:41:19,966 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-03-18 13:41:22,346 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-03-18 13:41:21.994 9587 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=7b21af82-88e7-4205-9060-8cb40f7dd858). 2018-03-18 13:41:22.119 9587 INFO rally.api [-] Verifier has been successfully deleted! 2018-03-18 13:41:25,567 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-03-18 13:41:24.283 9590 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-03-18 13:41:24.412 9590 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-03-18 13:41:25.436 9590 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=717f6d26-f1dd-4f90-9a8f-9ac86cc2a112) has been successfully created! Using verifier 'opnfv-tempest' (UUID=717f6d26-f1dd-4f90-9a8f-9ac86cc2a112) as the default verifier for the future CLI operations. 2018-03-18 13:41:28,507 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-03-18 13:41:30,148 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-03-18 13:41:34,235 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-03-18 13:41:39,187 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-03-18 13:41:38.233 9609 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=717f6d26-f1dd-4f90-9a8f-9ac86cc2a112) for deployment 'opnfv-rally' (UUID=8ba1f36f-6e39-4996-ae33-38b7a04597d6). 2018-03-18 13:41:39.030 9609 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=717f6d26-f1dd-4f90-9a8f-9ac86cc2a112) has been successfully configured for deployment 'opnfv-rally' (UUID=8ba1f36f-6e39-4996-ae33-38b7a04597d6)! 2018-03-18 13:41:39,187 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-03-18 13:41:39,188 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-03-18 13:41:39,190 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-03-18 13:41:39,200 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-03-18 13:41:42,155 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-717f6d26-f1dd-4f90-9a8f-9ac86cc2a112/repo; testr list-tests '(?!.*test_networks_multiprovider_rbac)(?=patrole_tempest_plugin.tests.api.(image|network|volume))' >/home/opnfv/functest/results/patrole/tempest-list.txt 2>/dev/null) 2018-03-18 13:41:42,156 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/patrole/tempest-list.txt']'. 2018-03-18 13:41:44,122 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 13:41:44.122 9618 INFO rally.api [-] Starting verification (UUID=bc00c36b-d3dc-44ad-bc1b-7412d3ef67aa) for deployment 'opnfv-rally' (UUID=8ba1f36f-6e39-4996-ae33-38b7a04597d6) by verifier 'opnfv-tempest' (UUID=717f6d26-f1dd-4f90-9a8f-9ac86cc2a112). 2018-03-18 13:41:44,123 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: bc00c36b-d3dc-44ad-bc1b-7412d3ef67aa 2018-03-18 13:44:18,167 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', 'bc00c36b-d3dc-44ad-bc1b-7412d3ef67aa']'. 2018-03-18 13:44:19,202 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-03-18 13:44:19,202 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-03-18 13:44:19,202 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-18 13:44:19,203 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | bc00c36b-d3dc-44ad-bc1b-7412d3ef67aa | 2018-03-18 13:44:19,203 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | finished | 2018-03-18 13:44:19,203 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-03-18 13:41:44 | 2018-03-18 13:44:19,203 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-03-18 13:44:17 | 2018-03-18 13:44:19,203 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:02:33 | 2018-03-18 13:44:19,203 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-03-18 13:44:19,203 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-03-18 13:44:19,203 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: 717f6d26-f1dd-4f90-9a8f-9ac86cc2a112) | 2018-03-18 13:44:19,203 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-03-18 13:44:19,203 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 8ba1f36f-6e39-4996-ae33-38b7a04597d6) | 2018-03-18 13:44:19,203 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 287 | 2018-03-18 13:44:19,203 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 145.279 | 2018-03-18 13:44:19,203 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 124 | 2018-03-18 13:44:19,204 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 163 | 2018-03-18 13:44:19,204 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-03-18 13:44:19,204 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-03-18 13:44:19,204 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 0 | 2018-03-18 13:44:19,204 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-18 13:44:19,204 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-03-18 13:44:19,327 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest patrole success_rate is 100.0% 2018-03-18 13:44:23,475 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-18 13:44:23,475 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | patrole | functest | 02:55 | PASS | +-------------------+------------------+------------------+----------------+ 2018-03-18 13:44:23,480 - xtesting.ci.run_tests - INFO - Running test case 'odl'... 2018-03-18 13:44:40,822 - xtesting.core.robotframework - INFO - ============================================================================== Basic & Neutron ============================================================================== Basic & Neutron.Basic ============================================================================== Basic & Neutron.Basic.Restconf Modules :: Test suite to verify Restconf is OK. ============================================================================== Get Controller Modules :: Get the restconf modules, check 200 stat... | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Basic.Restconf Modules :: Test suite to verify Res... | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Basic & Neutron.Basic | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Basic & Neutron.Neutron :: Test suite for Neutron Plugin ============================================================================== Basic & Neutron.Neutron.Reachability ============================================================================== Get the complete list of networks :: Get the complete list of netw... | PASS | ------------------------------------------------------------------------------ Get the complete list of subnets :: Get the complete list of subnets | PASS | ------------------------------------------------------------------------------ Get the complete list of ports :: Get the complete list of ports | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Reachability | PASS | 3 critical tests, 3 passed, 0 failed 3 tests total, 3 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Networks :: Checking Network created in OpenStack a... ============================================================================== Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS | ------------------------------------------------------------------------------ Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS | ------------------------------------------------------------------------------ Create Network :: Create new network in OpenStack | PASS | ------------------------------------------------------------------------------ Check Network :: Check network created in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Networks :: Checking Network created in Op... | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Subnets :: Checking Subnets created in OpenStack ar... ============================================================================== Check OpenStack Subnets :: Checking OpenStack Neutron for known su... | PASS | ------------------------------------------------------------------------------ Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS | ------------------------------------------------------------------------------ Create New subnet :: Create new subnet in OpenStack | PASS | ------------------------------------------------------------------------------ Check New subnet :: Check new subnet created in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Subnets :: Checking Subnets created in Ope... | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Ports :: Checking Port created in OpenStack are pus... ============================================================================== Check OpenStack ports :: Checking OpenStack Neutron for known ports | PASS | ------------------------------------------------------------------------------ Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS | ------------------------------------------------------------------------------ Create New Port :: Create new port in OpenStack | PASS | ------------------------------------------------------------------------------ Check New Port :: Check new port created in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Ports :: Checking Port created in OpenStac... | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Delete Ports :: Checking Port deleted in OpenStack ... ============================================================================== Delete New Port :: Delete previously created port in OpenStack | PASS | ------------------------------------------------------------------------------ Check Port Deleted :: Check port deleted in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Delete Ports :: Checking Port deleted in O... | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Delete Subnets :: Checking Subnets deleted in OpenS... ============================================================================== Delete New subnet :: Delete previously created subnet in OpenStack | PASS | ------------------------------------------------------------------------------ Check New subnet deleted :: Check subnet deleted in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Delete Subnets :: Checking Subnets deleted... | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Delete Networks :: Checking Network deleted in Open... ============================================================================== Delete Network :: Delete network in OpenStack | PASS | ------------------------------------------------------------------------------ Check Network deleted :: Check network deleted in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Delete Networks :: Checking Network delete... | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Basic & Neutron.Neutron :: Test suite for Neutron Plugin | PASS | 21 critical tests, 21 passed, 0 failed 21 tests total, 21 passed, 0 failed ============================================================================== Basic & Neutron | PASS | 22 critical tests, 22 passed, 0 failed 22 tests total, 22 passed, 0 failed ============================================================================== Output: /home/opnfv/functest/results/odl/output.xml 2018-03-18 13:44:40,822 - xtesting.core.robotframework - INFO - Results were successfully generated 2018-03-18 13:44:40,859 - xtesting.core.robotframework - INFO - Results were successfully parsed 2018-03-18 13:44:40,971 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-18 13:44:40,971 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | odl | functest | 00:17 | PASS | +-------------------+------------------+------------------+----------------+ 2018-03-18 13:44:40,976 - xtesting.ci.run_tests - INFO - Running test case 'snaps_smoke'... 2018-03-18 13:44:41,845 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-03-18 14:34:33,998 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-18 14:34:34,000 - xtesting.ci.run_tests - INFO - Test result: +---------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +---------------------+------------------+------------------+----------------+ | snaps_smoke | functest | 49:52 | FAIL | +---------------------+------------------+------------------+----------------+ 2018-03-18 14:34:34,004 - xtesting.ci.run_tests - ERROR - The test case 'snaps_smoke' failed. 2018-03-18 14:34:34,004 - xtesting.ci.run_tests - INFO - Running test case 'neutron_trunk'... 2018-03-18 14:34:34,103 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-03-18 14:34:36,779 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-03-18 14:34:36.256 9800 INFO rally.deployment.engine [-] Deployment 8ba1f36f-6e39-4996-ae33-38b7a04597d6 | Starting: Destroy cloud and free allocated resources. 2018-03-18 14:34:36.352 9800 INFO rally.deployment.engine [-] Deployment 8ba1f36f-6e39-4996-ae33-38b7a04597d6 | Completed: Destroy cloud and free allocated resources. 2018-03-18 14:34:36.415 9800 INFO rally.api [-] Deleting all verifications created by verifier 'opnfv-tempest' (UUID=717f6d26-f1dd-4f90-9a8f-9ac86cc2a112) for deployment 'opnfv-rally'. 2018-03-18 14:34:36.448 9800 INFO rally.api [-] Deleting verification (UUID=bc00c36b-d3dc-44ad-bc1b-7412d3ef67aa). 2018-03-18 14:34:36.499 9800 INFO rally.api [-] Verification has been successfully deleted! 2018-03-18 14:34:36.500 9800 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=717f6d26-f1dd-4f90-9a8f-9ac86cc2a112). 2018-03-18 14:34:36.513 9800 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-03-18 14:34:39,306 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-03-18 14:34:38.962 9803 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=8f468629-e228-416f-9eda-30ee1471ee1c) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 8f468629-e228-416f-9eda-30ee1471ee1c | 2018-03-18T14:34:38 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 8f468629-e228-416f-9eda-30ee1471ee1c ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-03-18 14:34:42,669 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-03-18 14:34:42,670 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-03-18 14:34:44,851 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-03-18 14:34:44.574 9809 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=717f6d26-f1dd-4f90-9a8f-9ac86cc2a112). 2018-03-18 14:34:44.686 9809 INFO rally.api [-] Verifier has been successfully deleted! 2018-03-18 14:34:48,269 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-03-18 14:34:46.925 9812 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-03-18 14:34:47.070 9812 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-03-18 14:34:48.111 9812 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=b38da937-b523-4b39-9c32-523bf73a6201) has been successfully created! Using verifier 'opnfv-tempest' (UUID=b38da937-b523-4b39-9c32-523bf73a6201) as the default verifier for the future CLI operations. 2018-03-18 14:34:56,617 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-03-18 14:35:01,614 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-03-18 14:35:00.746 9831 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=b38da937-b523-4b39-9c32-523bf73a6201) for deployment 'opnfv-rally' (UUID=8f468629-e228-416f-9eda-30ee1471ee1c). 2018-03-18 14:35:01.430 9831 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=b38da937-b523-4b39-9c32-523bf73a6201) has been successfully configured for deployment 'opnfv-rally' (UUID=8f468629-e228-416f-9eda-30ee1471ee1c)! 2018-03-18 14:35:04,451 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-b38da937-b523-4b39-9c32-523bf73a6201/repo; testr list-tests 'neutron.tests.tempest.(api|scenario).test_trunk' >/home/opnfv/functest/results/neutron_trunk/test_list.txt 2>/dev/null) 2018-03-18 14:35:04,453 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/neutron_trunk/test_list.txt']'. 2018-03-18 14:35:06,789 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-18 14:35:06.787 9840 INFO rally.api [-] Starting verification (UUID=5d5e2fb6-9bb7-46cf-ab7f-839594f33b44) for deployment 'opnfv-rally' (UUID=8f468629-e228-416f-9eda-30ee1471ee1c) by verifier 'opnfv-tempest' (UUID=b38da937-b523-4b39-9c32-523bf73a6201). 2018-03-18 14:36:54,590 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '5d5e2fb6-9bb7-46cf-ab7f-839594f33b44']'. 2018-03-18 14:36:55,470 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-03-18 14:36:55,470 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-03-18 14:36:55,471 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-18 14:36:55,471 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 5d5e2fb6-9bb7-46cf-ab7f-839594f33b44 | 2018-03-18 14:36:55,471 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | finished | 2018-03-18 14:36:55,471 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-03-18 14:35:06 | 2018-03-18 14:36:55,471 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-03-18 14:36:54 | 2018-03-18 14:36:55,471 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:01:48 | 2018-03-18 14:36:55,471 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-03-18 14:36:55,471 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-03-18 14:36:55,471 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: b38da937-b523-4b39-9c32-523bf73a6201) | 2018-03-18 14:36:55,471 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-03-18 14:36:55,471 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 8f468629-e228-416f-9eda-30ee1471ee1c) | 2018-03-18 14:36:55,472 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 52 | 2018-03-18 14:36:55,472 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 97.594 | 2018-03-18 14:36:55,472 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 43 | 2018-03-18 14:36:55,472 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 9 | 2018-03-18 14:36:55,472 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-03-18 14:36:55,472 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-03-18 14:36:55,472 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 0 | 2018-03-18 14:36:55,472 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-18 14:36:55,472 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-03-18 14:36:55,497 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest neutron_trunk success_rate is 100.0% 2018-03-18 14:37:00,139 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-18 14:37:00,139 - xtesting.ci.run_tests - INFO - Test result: +-----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------+------------------+------------------+----------------+ | neutron_trunk | functest | 02:09 | PASS | +-----------------------+------------------+------------------+----------------+ 2018-03-18 14:37:00,144 - xtesting.ci.run_tests - INFO - Xtesting report: +------------------------------+------------------+---------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +------------------------------+------------------+---------------+------------------+----------------+ | vping_userdata | functest | smoke | 00:32 | PASS | | tempest_smoke_serial | functest | smoke | 11:46 | PASS | | rally_sanity | functest | smoke | 18:18 | FAIL | | refstack_defcore | functest | smoke | 07:48 | FAIL | | patrole | functest | smoke | 02:55 | PASS | | odl | functest | smoke | 00:17 | PASS | | snaps_smoke | functest | smoke | 49:52 | FAIL | | neutron_trunk | functest | smoke | 02:09 | PASS | | vping_ssh | functest | smoke | 00:00 | SKIP | | odl_netvirt | functest | smoke | 00:00 | SKIP | +------------------------------+------------------+---------------+------------------+----------------+ 2018-03-18 14:37:00,152 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR 2018-03-18 14:37:49,425 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-22 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-noha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-03-18 14:37:49,429 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=K6KQBgZhjwWMTmtUQkKkMHc8n export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.22,192.30.9.4 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.22:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.4 export OS_REGION_NAME=regionOne 2018-03-18 14:37:49,430 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-03-18 14:37:49,431 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +------------------+---------------+--------------------------+-------------------------------------------+------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +------------------+---------------+--------------------------+-------------------------------------------+------------------------------------+ | features | 2 | (daily)|(weekly) | Test suites from feature projects | doctor-notification bgpvpn | | | | | integrated in functest | | +------------------+---------------+--------------------------+-------------------------------------------+------------------------------------+ 2018-03-18 14:37:49,432 - xtesting.ci.run_tests - INFO - Running tier 'features' 2018-03-18 14:37:49,432 - xtesting.ci.run_tests - INFO - Running test case 'doctor-notification'... 2018-03-18 14:40:41,044 - xtesting.core.feature - INFO - Test result is stored in '/var/lib/xtesting/results/doctor-notification.log' 2018-03-18 14:40:41,160 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-18 14:40:41,161 - xtesting.ci.run_tests - INFO - Test result: +-----------------------------+-----------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------------+-----------------+------------------+----------------+ | doctor-notification | doctor | 02:52 | PASS | +-----------------------------+-----------------+------------------+----------------+ 2018-03-18 14:40:41,164 - xtesting.ci.run_tests - INFO - Running test case 'bgpvpn'... 2018-03-18 14:42:53,241 - functest.utils.functest_utils - DEBUG - Executing command: 'ping 172.30.9.201 -c 10' 2018-03-18 15:08:22,774 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-03-18 15:08:27,210 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-03-18 15:08:26.979 105 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=e3441daa-3ec9-440f-b00e-73180c819752) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | e3441daa-3ec9-440f-b00e-73180c819752 | 2018-03-18T15:08:26 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: e3441daa-3ec9-440f-b00e-73180c819752 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-03-18 15:08:30,301 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+----------------+-----------+ | Service | Service Type | Status | +-------------+----------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+----------------+-----------+ 2018-03-18 15:08:30,301 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-03-18 15:08:35,548 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-03-18 15:08:34.425 114 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-03-18 15:08:34.551 114 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-03-18 15:08:35.401 114 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=6fc0e807-634c-4188-b7d9-df1423d7df87) has been successfully created! Using verifier 'opnfv-tempest' (UUID=6fc0e807-634c-4188-b7d9-df1423d7df87) as the default verifier for the future CLI operations. 2018-03-18 15:08:41,676 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-03-18 15:08:40.769 133 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=6fc0e807-634c-4188-b7d9-df1423d7df87) for deployment 'opnfv-rally' (UUID=e3441daa-3ec9-440f-b00e-73180c819752). 2018-03-18 15:08:41.490 133 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=6fc0e807-634c-4188-b7d9-df1423d7df87) has been successfully configured for deployment 'opnfv-rally' (UUID=e3441daa-3ec9-440f-b00e-73180c819752)! 2018-03-18 15:08:41,676 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-03-18 15:16:10,060 - functest.utils.functest_utils - DEBUG - Executing command: 'rm -rf /tmp/sdnvpn-logs/;mkdir -p /tmp/sdnvpn-logs/' 2018-03-18 15:16:13,760 - functest.utils.functest_utils - DEBUG - Executing command: 'mkdir -p /tmp/sdnvpn-logs/' 2018-03-18 15:16:13,773 - functest.utils.functest_utils - DEBUG - Executing command: 'cd /tmp/sdnvpn-logs/; tar -xzvf /tmp/log_output-overcloud-controller-0.tar.gz --strip-components=1' 2018-03-18 15:16:14,326 - functest.utils.functest_utils - DEBUG - Executing command: 'mkdir -p /tmp/sdnvpn-logs/' 2018-03-18 15:16:14,337 - functest.utils.functest_utils - DEBUG - Executing command: 'cd /tmp/sdnvpn-logs/; tar -xzvf /tmp/log_output-overcloud-novacompute-0.tar.gz --strip-components=1' 2018-03-18 15:16:14,566 - functest.utils.functest_utils - DEBUG - Executing command: 'mkdir -p /tmp/sdnvpn-logs/' 2018-03-18 15:16:14,579 - functest.utils.functest_utils - DEBUG - Executing command: 'cd /tmp/sdnvpn-logs/; tar -xzvf /tmp/log_output-overcloud-novacompute-1.tar.gz --strip-components=1' 2018-03-18 15:16:14,602 - functest.utils.functest_utils - DEBUG - Executing command: 'cd /home/opnfv/functest/results;tar czvf sdnvpn-logs-overall.tar.gz /tmp/sdnvpn-logs/' 2018-03-18 15:16:15,408 - xtesting.core.feature - INFO - Test result is stored in '/var/lib/xtesting/results/bgpvpn.log' 2018-03-18 15:16:15,534 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-18 15:16:15,534 - xtesting.ci.run_tests - INFO - Test result: +-------------------+-----------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+-----------------+------------------+----------------+ | bgpvpn | sdnvpn | 35:34 | FAIL | +-------------------+-----------------+------------------+----------------+ 2018-03-18 15:16:15,538 - xtesting.ci.run_tests - ERROR - The test case 'bgpvpn' failed. 2018-03-18 15:16:15,539 - xtesting.ci.run_tests - INFO - Xtesting report: +-----------------------------+------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-----------------------------+------------------------+------------------+------------------+----------------+ | doctor-notification | doctor | features | 02:52 | PASS | | bgpvpn | sdnvpn | features | 35:34 | FAIL | | functest-odl-sfc | sfc | features | 00:00 | SKIP | | barometercollectd | barometer | features | 00:00 | SKIP | | fds | fastdatastacks | features | 00:00 | SKIP | +-----------------------------+------------------------+------------------+------------------+----------------+ 2018-03-18 15:16:15,543 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR 2018-03-18 15:17:09,908 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-22 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-noha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-03-18 15:17:09,912 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=K6KQBgZhjwWMTmtUQkKkMHc8n export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.22,192.30.9.4 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.22:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.4 export OS_REGION_NAME=regionOne 2018-03-18 15:17:09,912 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-03-18 15:17:09,912 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+-----------------+---------------------+-------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+-----------------+---------------------+-------------------+ +---------------+---------------+-----------------+---------------------+-------------------+ 2018-03-18 15:17:09,913 - xtesting.ci.run_tests - INFO - Xtesting report: +----------------------+------------------+--------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------+------------------+--------------+------------------+----------------+ | cloudify_ims | functest | vnf | 00:00 | SKIP | | vyos_vrouter | functest | vnf | 00:00 | SKIP | | juju_epc | functest | vnf | 00:00 | SKIP | +----------------------+------------------+--------------+------------------+----------------+ 2018-03-18 15:17:09,914 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-03-18 15:17:45,482 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-22 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-bgpvpn-noha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-03-18 15:17:45,486 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=K6KQBgZhjwWMTmtUQkKkMHc8n export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.22,192.30.9.4 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.22:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.4 export OS_REGION_NAME=regionOne 2018-03-18 15:17:45,487 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-03-18 15:17:45,487 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+-----------------+---------------------+-------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+-----------------+---------------------+-------------------+ +---------------+---------------+-----------------+---------------------+-------------------+ 2018-03-18 15:17:45,488 - xtesting.ci.run_tests - INFO - Xtesting report: +-----------------------+-----------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-----------------------+-----------------+------------------+------------------+----------------+ | parser-basics | parser | features | 00:00 | SKIP | +-----------------------+-----------------+------------------+------------------+----------------+ 2018-03-18 15:17:45,489 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK