2018-03-20 00:01:41,292 - functest.ci.check_deployment - DEBUG - 172.30.9.21:5000 is reachable! 2018-03-20 00:01:41,292 - functest.ci.check_deployment - INFO - Connectivity to OS_AUTH_URL http://172.30.9.21:5000/v3 ...OK 2018-03-20 00:01:41,769 - functest.ci.check_deployment - INFO - Got token ...OK 2018-03-20 00:01:42,247 - functest.ci.check_deployment - DEBUG - 172.30.9.21:5000 is reachable! 2018-03-20 00:01:42,247 - functest.ci.check_deployment - INFO - Connectivity to the public endpoint http://172.30.9.21:5000 ...OK 2018-03-20 00:01:42,718 - functest.ci.check_deployment - DEBUG - 172.30.9.21:8774 is reachable! 2018-03-20 00:01:42,719 - functest.ci.check_deployment - INFO - Connectivity to endpoint 'compute' http://172.30.9.21:8774/v2.1 ...OK 2018-03-20 00:01:43,117 - functest.ci.check_deployment - DEBUG - 172.30.9.21:9696 is reachable! 2018-03-20 00:01:43,117 - functest.ci.check_deployment - INFO - Connectivity to endpoint 'network' http://172.30.9.21:9696 ...OK 2018-03-20 00:01:43,492 - functest.ci.check_deployment - DEBUG - 172.30.9.21:9292 is reachable! 2018-03-20 00:01:43,492 - functest.ci.check_deployment - INFO - Connectivity to endpoint 'image' http://172.30.9.21:9292 ...OK 2018-03-20 00:01:44,837 - functest.ci.check_deployment - INFO - Nova service ...OK 2018-03-20 00:01:45,884 - functest.ci.check_deployment - INFO - Neutron service ...OK 2018-03-20 00:01:45,933 - functest.ci.check_deployment - INFO - Glance service ...OK 2018-03-20 00:01:48,126 - functest.ci.check_deployment - INFO - External network found: external 2018-03-20 00:01:56,877 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-27 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-nofeature-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-03-20 00:01:56,882 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=MWw2sKmZRwKpjxuJDJubKTWmB export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.21,192.30.9.10 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.21:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.10 export OS_REGION_NAME=regionOne 2018-03-20 00:01:56,883 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-03-20 00:01:56,884 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ | healthcheck | 0 | (daily)|(weekly) | First tier to be executed to verify the | connection_check api_check | | | | | basic operations in the VIM. | snaps_health_check | +---------------------+---------------+--------------------------+-------------------------------------------------+------------------------------------+ 2018-03-20 00:01:56,886 - xtesting.ci.run_tests - INFO - Running tier 'healthcheck' 2018-03-20 00:01:56,887 - xtesting.ci.run_tests - INFO - Running test case 'connection_check'... 2018-03-20 00:02:00,091 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-03-20 00:02:10,415 - xtesting.core.unit - DEBUG - test_glance_connect_fail (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_glance_connect_success (snaps.openstack.utils.tests.glance_utils_tests.GlanceSmokeTests) ... ok test_keystone_connect_fail (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_keystone_connect_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneSmokeTests) ... ok test_neutron_connect_fail (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_neutron_connect_success (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_retrieve_ext_network_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronSmokeTests) ... ok test_nova_connect_fail (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_connect_success (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_nova_get_hypervisor_hosts (snaps.openstack.utils.tests.nova_utils_tests.NovaSmokeTests) ... ok test_heat_connect_fail (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_heat_connect_success (snaps.openstack.utils.tests.heat_utils_tests.HeatSmokeTests) ... ok test_cinder_connect_fail (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok test_cinder_connect_success (snaps.openstack.utils.tests.cinder_utils_tests.CinderSmokeTests) ... ok ---------------------------------------------------------------------- Ran 14 tests in 10.312s OK 2018-03-20 00:02:10,537 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-20 00:02:10,537 - xtesting.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | connection_check | functest | 00:10 | PASS | +--------------------------+------------------+------------------+----------------+ 2018-03-20 00:02:10,541 - xtesting.ci.run_tests - INFO - Running test case 'api_check'... 2018-03-20 00:02:11,666 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-03-20 00:14:49,802 - xtesting.core.unit - DEBUG - test_create_project_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_user_minimal (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_credentials (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_fail_without_proper_service (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_success (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_get_endpoint_with_each_interface (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_grant_user_role_to_project (snaps.openstack.utils.tests.keystone_utils_tests.KeystoneUtilsTests) ... ok test_create_admin_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_user_2x (snaps.openstack.tests.create_user_tests.CreateUserSuccessTests) ... ok test_create_delete_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_2x (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_bad_domain (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_update_quotas (snaps.openstack.tests.create_project_tests.CreateProjectSuccessTests) ... ok test_create_project_sec_grp_one_user (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_project_sec_grp_two_users (snaps.openstack.tests.create_project_tests.CreateProjectUserTests) ... ok test_create_image_minimal_file (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_image_minimal_url (snaps.openstack.utils.tests.glance_utils_tests.GlanceUtilsTests) ... ok test_create_network (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_network_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsNetworkTests) ... ok test_create_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_cidr (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_create_subnet_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSubnetTests) ... ok test_add_interface_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_missing_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_router (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_add_interface_router_null_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_empty_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_invalid_ip_to_subnet (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_ip (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_port_null_network_object (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_simple (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_router_with_public_interface (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsRouterTests) ... ok test_create_delete_simple_sec_grp (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_name (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_no_rules (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_create_sec_grp_one_rule (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_get_sec_grp_by_id (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsSecurityGroupTests) ... ok test_floating_ips (snaps.openstack.utils.tests.neutron_utils_tests.NeutronUtilsFloatingIpTests) ... ok test_create_delete_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_key_from_file (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_keypair (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsKeypairTests) ... ok test_create_delete_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_flavor (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsFlavorTests) ... ok test_create_instance (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceTests) ... ok test_add_remove_volume (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_attach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_detach_volume_nowait (snaps.openstack.utils.tests.nova_utils_tests.NovaUtilsInstanceVolumeTests) ... ok test_create_clean_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_delete_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_all_settings (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_flavor_existing (snaps.openstack.tests.create_flavor_tests.CreateFlavorTests) ... ok test_create_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_create_stack_x2 (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateSimpleStackTests) ... ok test_get_settings_from_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsCreateComplexStackTests) ... ok test_create_flavor_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsFlavorTests) ... ok test_create_keypair_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsKeypairTests) ... ok test_create_security_group_with_stack (snaps.openstack.utils.tests.heat_utils_tests.HeatUtilsSecurityGroupTests) ... ok test_create_delete_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_back (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_both (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_qos_front (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsQoSTests) ... ok test_create_delete_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_simple_volume (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTests) ... ok test_create_delete_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_simple_volume_type (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsSimpleVolumeTypeTests) ... ok test_create_bad_key_size (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_delete_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_simple_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_all_attrs (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsAddEncryptionTests) ... ok test_create_with_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_invalid_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok test_create_with_qos_and_encryption (snaps.openstack.utils.tests.cinder_utils_tests.CinderUtilsVolumeTypeCompleteTests) ... ok ---------------------------------------------------------------------- Ran 83 tests in 758.084s OK 2018-03-20 00:14:49,918 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-20 00:14:49,918 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | api_check | functest | 12:38 | PASS | +-------------------+------------------+------------------+----------------+ 2018-03-20 00:14:49,922 - xtesting.ci.run_tests - INFO - Running test case 'snaps_health_check'... 2018-03-20 00:14:50,962 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-03-20 00:15:29,286 - xtesting.core.unit - DEBUG - test_check_vm_ip_dhcp (snaps.openstack.tests.create_instance_tests.SimpleHealthCheck) ... ok ---------------------------------------------------------------------- Ran 1 test in 38.323s OK 2018-03-20 00:15:29,394 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-20 00:15:29,395 - xtesting.ci.run_tests - INFO - Test result: +----------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------------+------------------+------------------+----------------+ | snaps_health_check | functest | 00:38 | PASS | +----------------------------+------------------+------------------+----------------+ 2018-03-20 00:15:29,399 - xtesting.ci.run_tests - INFO - Xtesting report: +----------------------------+------------------+---------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------------+------------------+---------------------+------------------+----------------+ | connection_check | functest | healthcheck | 00:10 | PASS | | api_check | functest | healthcheck | 12:38 | PASS | | snaps_health_check | functest | healthcheck | 00:38 | PASS | +----------------------------+------------------+---------------------+------------------+----------------+ 2018-03-20 00:15:29,402 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-03-20 00:15:32,504 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-27 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-nofeature-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-03-20 00:15:32,506 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=MWw2sKmZRwKpjxuJDJubKTWmB export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.21,192.30.9.10 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.21:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.10 export OS_REGION_NAME=regionOne 2018-03-20 00:15:32,506 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-03-20 00:15:32,507 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+--------------------------+------------------------------------------+--------------------------------------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+--------------------------+------------------------------------------+--------------------------------------------------+ | smoke | 1 | (daily)|(weekly) | Set of basic Functional tests to | vping_ssh vping_userdata | | | | | validate the OPNFV scenarios. | tempest_smoke_serial rally_sanity | | | | | | refstack_defcore patrole odl snaps_smoke | | | | | | neutron_trunk | +---------------+---------------+--------------------------+------------------------------------------+--------------------------------------------------+ 2018-03-20 00:15:32,508 - xtesting.ci.run_tests - INFO - Running tier 'smoke' 2018-03-20 00:15:32,508 - xtesting.ci.run_tests - INFO - Running test case 'vping_ssh'... 2018-03-20 00:15:33,317 - xtesting.energy.energy - INFO - API recorder available at : http://energy.opnfv.fr/resources/recorders/environment/lf-pod1 2018-03-20 00:15:33,318 - xtesting.energy.energy - DEBUG - Getting current scenario 2018-03-20 00:15:33,797 - xtesting.energy.energy - DEBUG - Starting recording 2018-03-20 00:15:33,797 - xtesting.energy.energy - DEBUG - Submitting scenario (vping_ssh/running) 2018-03-20 00:15:34,231 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup 2018-03-20 00:15:34,231 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-03-20 00:15:34' 2018-03-20 00:15:34,231 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--8470d44d-4660-4438-91ce-9bad7f5a9356' 2018-03-20 00:15:37,885 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-8470d44d-4660-4438-91ce-9bad7f5a9356' 2018-03-20 00:15:41,081 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-8470d44d-4660-4438-91ce-9bad7f5a9356' 2018-03-20 00:15:48,586 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-8470d44d-4660-4438-91ce-9bad7f5a9356' 2018-03-20 00:15:49,631 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating keypair with name: 'vPing-keypair-8470d44d-4660-4438-91ce-9bad7f5a9356' 2018-03-20 00:15:50,373 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-8470d44d-4660-4438-91ce-9bad7f5a9356' 2018-03-20 00:15:56,612 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Security group with name: 'vPing-sg-8470d44d-4660-4438-91ce-9bad7f5a9356' 2018-03-20 00:16:01,127 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-8470d44d-4660-4438-91ce-9bad7f5a9356' 2018-03-20 00:16:21,676 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution 2018-03-20 00:16:27,029 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Trying to transfer ping.sh 2018-03-20 00:16:27,174 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping... 2018-03-20 00:16:28,182 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected! 2018-03-20 00:16:34,422 - functest.opnfv_tests.openstack.vping.vping_base - ERROR - Unexpected error cleaning - Security Group 5d5f3e71-e56e-41d2-beb2-6abc17a6d3a2 cannot perform precommit_delete due to Callback networking_odl.common.callback.OdlSecurityGroupsHandler.sg_callback_precommit--9223372036854743125 failed with "argument of type 'NoneType' is not iterable". Neutron server returns request_ids: ['req-ba7d056a-d5f6-4223-a532-fc2d2695eb36'] 2018-03-20 00:16:46,341 - xtesting.energy.energy - DEBUG - Restoring previous scenario (refstack_defcore/running) 2018-03-20 00:16:46,341 - xtesting.energy.energy - DEBUG - Submitting scenario (refstack_defcore/running) 2018-03-20 00:16:46,877 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-20 00:16:46,878 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | vping_ssh | functest | 00:54 | PASS | +-------------------+------------------+------------------+----------------+ 2018-03-20 00:16:46,881 - xtesting.ci.run_tests - INFO - Running test case 'vping_userdata'... 2018-03-20 00:16:46,980 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin virtual environment setup 2018-03-20 00:16:46,980 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing Start Time:'2018-03-20 00:16:46' 2018-03-20 00:16:46,981 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating image with name: 'functest-vping--4b953198-f0bc-4575-ad04-5f4ec37d100f' 2018-03-20 00:16:49,894 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating network with name: 'vping-net-4b953198-f0bc-4575-ad04-5f4ec37d100f' 2018-03-20 00:16:52,593 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating router with name: 'vping-router-4b953198-f0bc-4575-ad04-5f4ec37d100f' 2018-03-20 00:16:58,989 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating flavor with name: 'vping-flavor-4b953198-f0bc-4575-ad04-5f4ec37d100f' 2018-03-20 00:16:59,685 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 1 instance with name: 'opnfv-vping-1-4b953198-f0bc-4575-ad04-5f4ec37d100f' 2018-03-20 00:17:06,564 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Creating VM 2 instance with name: 'opnfv-vping-2-4b953198-f0bc-4575-ad04-5f4ec37d100f' 2018-03-20 00:17:13,361 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Begin test execution 2018-03-20 00:17:23,307 - functest.opnfv_tests.openstack.vping.vping_base - INFO - Waiting for ping... 2018-03-20 00:17:25,903 - functest.opnfv_tests.openstack.vping.vping_base - INFO - vPing detected! 2018-03-20 00:17:43,469 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-20 00:17:43,469 - xtesting.ci.run_tests - INFO - Test result: +------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------+------------------+------------------+----------------+ | vping_userdata | functest | 00:39 | PASS | +------------------------+------------------+------------------+----------------+ 2018-03-20 00:17:43,473 - xtesting.ci.run_tests - INFO - Running test case 'tempest_smoke_serial'... 2018-03-20 00:17:43,600 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-03-20 00:17:49,279 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-03-20 00:17:48.940 18 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=7c3b1a6b-07e1-4160-9878-9dedd8988e38) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 7c3b1a6b-07e1-4160-9878-9dedd8988e38 | 2018-03-20T00:17:48 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 7c3b1a6b-07e1-4160-9878-9dedd8988e38 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-03-20 00:17:52,569 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+-------------------+-----------+ | Service | Service Type | Status | +-------------+-------------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | nfv-orchestration | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+-------------------+-----------+ 2018-03-20 00:17:52,569 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-03-20 00:17:58,489 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-03-20 00:17:56.926 27 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-03-20 00:17:57.077 27 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-03-20 00:17:58.321 27 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=f963ab93-904b-456c-9278-bc264d80150f) has been successfully created! Using verifier 'opnfv-tempest' (UUID=f963ab93-904b-456c-9278-bc264d80150f) as the default verifier for the future CLI operations. 2018-03-20 00:18:01,476 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-03-20 00:18:04,127 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-03-20 00:18:11,115 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-03-20 00:18:16,417 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-03-20 00:18:15.408 46 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=f963ab93-904b-456c-9278-bc264d80150f) for deployment 'opnfv-rally' (UUID=7c3b1a6b-07e1-4160-9878-9dedd8988e38). 2018-03-20 00:18:16.284 46 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=f963ab93-904b-456c-9278-bc264d80150f) has been successfully configured for deployment 'opnfv-rally' (UUID=7c3b1a6b-07e1-4160-9878-9dedd8988e38)! 2018-03-20 00:18:16,417 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-03-20 00:18:16,417 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-03-20 00:18:16,420 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-03-20 00:18:16,423 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-03-20 00:18:19,774 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-f963ab93-904b-456c-9278-bc264d80150f/repo; testr list-tests '^tempest\.(api|scenario).*\[.*\bsmoke\b.*\]$' >/home/opnfv/functest/results/tempest/test_list.txt 2>/dev/null) 2018-03-20 00:18:19,775 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Applying tempest blacklist... 2018-03-20 00:18:19,776 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Tempest blacklist file does not exist. 2018-03-20 00:18:19,777 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/tempest/test_list.txt', '--concurrency', '1']'. 2018-03-20 00:18:21,918 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:18:21.916 55 INFO rally.api [-] Starting verification (UUID=81e3f155-f97b-4520-8851-56c9de6f17aa) for deployment 'opnfv-rally' (UUID=7c3b1a6b-07e1-4160-9878-9dedd8988e38) by verifier 'opnfv-tempest' (UUID=f963ab93-904b-456c-9278-bc264d80150f). 2018-03-20 00:18:21,918 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: 81e3f155-f97b-4520-8851-56c9de6f17aa 2018-03-20 00:18:29,323 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:18:29.322 55 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_get_flavor ... success [0.180s] 2018-03-20 00:18:29,388 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:18:29.387 55 INFO opnfv-tempest [-] {0} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.063s] 2018-03-20 00:18:36,522 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:18:36.522 55 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_create ... success [1.536s] 2018-03-20 00:18:40,148 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:18:40.148 55 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_group_rules.SecurityGroupRulesTestJSON.test_security_group_rules_list ... success [3.625s] 2018-03-20 00:18:53,609 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:18:53.609 55 INFO opnfv-tempest [-] {0} tempest.api.compute.security_groups.test_security_groups.SecurityGroupsTestJSON.test_security_groups_create_list_delete ... success [6.313s] 2018-03-20 00:19:12,075 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:19:12.074 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_add_remove_fixed_ip ... success [11.728s] 2018-03-20 00:19:46,763 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:19:46.763 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_list_servers ... success [0.066s] 2018-03-20 00:19:46,765 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:19:46.765 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestBootFromVolume.test_verify_server_details ... success [0.001s] 2018-03-20 00:20:18,506 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:20:18.506 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_list_servers ... success [0.075s] 2018-03-20 00:20:18,508 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:20:18.508 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestJSON.test_verify_server_details ... success [0.001s] 2018-03-20 00:20:48,647 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:20:48.646 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_list_servers ... success [0.071s] 2018-03-20 00:20:48,649 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:20:48.648 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_create_server.ServersTestManualDisk.test_verify_server_details ... success [0.001s] 2018-03-20 00:27:27,581 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:27:27.581 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard ... fail [368.679s] 2018-03-20 00:27:48,503 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:27:48.503 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses ... success [0.050s] 2018-03-20 00:27:48,606 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:27:48.606 55 INFO opnfv-tempest [-] {0} tempest.api.compute.servers.test_server_addresses.ServerAddressesTestJSON.test_list_server_addresses_by_network ... success [0.103s] 2018-03-20 00:27:55,499 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:27:55.498 55 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_get_version_details ... success [0.648s] 2018-03-20 00:27:55,508 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:27:55.508 55 INFO opnfv-tempest [-] {0} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.009s] 2018-03-20 00:27:57,042 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:27:57.042 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_services.ServicesTestJSON ... skip: Identity api v2 is not enabled 2018-03-20 00:27:57,043 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:27:57.043 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v2.test_users.UsersTestJSON ... skip: Identity api v2 is not enabled 2018-03-20 00:28:00,973 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:28:00.972 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON.test_credentials_create_get_update_delete ... success [0.351s] 2018-03-20 00:28:07,060 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:28:07.059 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DefaultDomainTestJSON.test_default_domain_exists ... success [0.085s] 2018-03-20 00:28:14,246 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:28:14.246 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_domains.DomainsTestJSON.test_create_update_delete_domain ... success [0.775s] 2018-03-20 00:28:21,684 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:28:21.684 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_endpoints.EndPointsTestJSON.test_update_endpoint ... success [0.506s] 2018-03-20 00:28:31,980 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:28:31.979 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_groups.GroupsV3TestJSON.test_group_users_add_list_delete ... success [3.303s] 2018-03-20 00:28:38,419 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:28:38.419 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_policies.PoliciesTestJSON.test_create_update_delete_policy ... success [0.365s] 2018-03-20 00:28:44,479 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:28:44.479 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_regions.RegionsTestJSON.test_create_region_with_specific_id ... success [0.218s] 2018-03-20 00:28:52,071 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:28:52.071 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_roles.RolesV3TestJSON.test_role_create_update_show_list ... success [0.468s] 2018-03-20 00:28:59,544 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:28:59.543 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_services.ServicesTestJSON.test_create_update_get_service ... success [0.448s] 2018-03-20 00:29:07,953 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:29:07.952 55 INFO opnfv-tempest [-] {0} tempest.api.identity.admin.v3.test_trusts.TrustsV3TestJSON.test_get_trusts_all ... success [2.796s] 2018-03-20 00:29:10,688 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:29:10.687 55 INFO opnfv-tempest [-] {0} tempest.api.identity.v2.test_api_discovery.TestApiDiscovery ... skip: Identity api v2 is not enabled 2018-03-20 00:29:12,664 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:29:12.664 55 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.079s] 2018-03-20 00:29:12,752 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:29:12.752 55 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.088s] 2018-03-20 00:29:12,825 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:29:12.824 55 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.071s] 2018-03-20 00:29:12,831 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:29:12.831 55 INFO opnfv-tempest [-] {0} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_list_api_versions ... success [0.006s] 2018-03-20 00:29:17,031 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:29:17.030 55 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.751s] 2018-03-20 00:29:19,202 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:29:19.202 55 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_register_upload_get_image_file ... success [2.169s] 2018-03-20 00:29:20,517 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:29:20.516 55 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [1.315s] 2018-03-20 00:29:27,958 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:29:27.957 55 INFO opnfv-tempest [-] {0} tempest.api.image.v2.test_versions.VersionsTest.test_list_versions ... success [0.006s] 2018-03-20 00:29:35,228 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:29:35.228 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_extensions.ExtensionsTestJSON.test_list_show_extensions ... success [3.908s] 2018-03-20 00:29:51,294 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:29:51.294 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_floating_ip_specifying_a_fixed_ip_address ... success [2.298s] 2018-03-20 00:29:54,852 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:29:54.851 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_floating_ips.FloatingIPTestJSON.test_create_list_show_update_delete_floating_ip ... success [3.556s] 2018-03-20 00:30:05,693 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:30:05.692 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_network ... success [3.046s] 2018-03-20 00:30:09,585 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:30:09.585 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_port ... success [3.891s] 2018-03-20 00:30:18,204 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:30:18.203 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsIpV6Test.test_bulk_create_delete_subnet ... success [8.617s] 2018-03-20 00:30:28,180 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:30:28.180 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_network ... success [3.012s] 2018-03-20 00:30:31,845 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:30:31.844 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_port ... success [3.663s] 2018-03-20 00:30:37,476 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:30:37.476 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.BulkNetworkOpsTest.test_bulk_create_delete_subnet ... success [5.631s] 2018-03-20 00:30:53,872 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:30:53.871 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_create_update_delete_network_subnet ... success [6.077s] 2018-03-20 00:30:54,172 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:30:54.172 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_external_network_visibility ... success [0.300s] 2018-03-20 00:30:54,445 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:30:54.444 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_networks ... success [0.273s] 2018-03-20 00:30:54,500 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:30:54.500 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_list_subnets ... success [0.055s] 2018-03-20 00:30:54,763 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:30:54.762 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_network ... success [0.262s] 2018-03-20 00:30:54,952 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:30:54.952 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksIpV6Test.test_show_subnet ... success [0.190s] 2018-03-20 00:31:10,447 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:31:10.447 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_create_update_delete_network_subnet ... success [6.371s] 2018-03-20 00:31:10,873 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:31:10.872 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_external_network_visibility ... success [0.426s] 2018-03-20 00:31:11,020 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:31:11.020 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_networks ... success [0.147s] 2018-03-20 00:31:11,225 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:31:11.225 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_list_subnets ... success [0.204s] 2018-03-20 00:31:11,645 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:31:11.645 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_network ... success [0.419s] 2018-03-20 00:31:11,726 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:31:11.726 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_networks.NetworksTest.test_show_subnet ... success [0.081s] 2018-03-20 00:31:24,801 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:31:24.800 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_in_allowed_allocation_pools ... success [4.821s] 2018-03-20 00:31:31,649 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:31:31.649 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_port_with_no_securitygroups ... success [6.848s] 2018-03-20 00:31:33,285 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:31:33.284 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_create_update_delete_port ... success [1.635s] 2018-03-20 00:31:33,339 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:31:33.339 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_list_ports ... success [0.055s] 2018-03-20 00:31:33,542 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:31:33.541 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsIpV6TestJSON.test_show_port ... success [0.202s] 2018-03-20 00:31:46,120 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:31:46.120 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_in_allowed_allocation_pools ... success [5.068s] 2018-03-20 00:31:52,324 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:31:52.323 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_port_with_no_securitygroups ... success [6.203s] 2018-03-20 00:31:54,563 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:31:54.562 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_create_update_delete_port ... success [2.238s] 2018-03-20 00:31:54,765 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:31:54.764 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_list_ports ... success [0.202s] 2018-03-20 00:31:54,840 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:31:54.840 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_ports.PortsTestJSON.test_show_port ... success [0.076s] 2018-03-20 00:32:09,679 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:32:09.679 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_multiple_router_interfaces ... success [9.292s] 2018-03-20 00:32:15,466 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:32:15.466 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_port_id ... success [5.787s] 2018-03-20 00:32:20,619 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:32:20.618 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_add_remove_router_interface_with_subnet_id ... success [5.151s] 2018-03-20 00:32:23,832 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:32:23.832 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersIpV6Test.test_create_show_list_update_delete_router ... success [3.214s] 2018-03-20 00:32:48,835 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:32:48.835 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_multiple_router_interfaces ... success [9.936s] 2018-03-20 00:32:54,426 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:32:54.426 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_port_id ... success [5.590s] 2018-03-20 00:32:58,930 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:32:58.930 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_add_remove_router_interface_with_subnet_id ... success [4.503s] 2018-03-20 00:33:03,253 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:33:03.252 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_routers.RoutersTest.test_create_show_list_update_delete_router ... success [4.322s] 2018-03-20 00:33:20,733 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:33:20.733 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_list_update_show_delete_security_group ... success [1.561s] 2018-03-20 00:33:23,491 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:33:23.490 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_create_show_delete_security_group_rule ... success [2.755s] 2018-03-20 00:33:23,680 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:33:23.680 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupIPv6Test.test_list_security_groups ... success [0.192s] 2018-03-20 00:33:28,802 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:33:28.801 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.873s] 2018-03-20 00:33:30,977 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:33:30.977 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [2.172s] 2018-03-20 00:33:31,277 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:33:31.277 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.303s] 2018-03-20 00:33:35,595 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:33:35.594 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_subnetpools_extensions.SubnetPoolsTestJSON.test_create_list_show_update_delete_subnetpools ... success [1.265s] 2018-03-20 00:33:39,200 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:33:39.200 55 INFO opnfv-tempest [-] {0} tempest.api.network.test_versions.NetworksApiDiscovery.test_api_version_resources ... success [0.006s] 2018-03-20 00:33:40,679 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:33:40.679 55 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_quotas.AccountQuotasTest ... skip: AccountQuotasTest skipped as swift is not available 2018-03-20 00:33:40,680 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:33:40.680 55 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_account_services.AccountTest ... skip: AccountTest skipped as swift is not available 2018-03-20 00:33:40,681 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:33:40.680 55 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_quotas.ContainerQuotasTest ... skip: ContainerQuotasTest skipped as swift is not available 2018-03-20 00:33:40,681 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:33:40.681 55 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_container_services.ContainerTest ... skip: ContainerTest skipped as swift is not available 2018-03-20 00:33:40,682 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:33:40.682 55 INFO opnfv-tempest [-] {0} tempest.api.object_storage.test_object_services.ObjectTest ... skip: ObjectTest skipped as swift is not available 2018-03-20 00:33:42,567 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:33:42.567 55 INFO opnfv-tempest [-] {0} tempest.api.volume.test_versions.VersionsTest.test_list_versions ... success [0.011s] 2018-03-20 00:34:01,322 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:34:01.321 55 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_actions.VolumesActionsTest.test_attach_detach_volume_to_instance ... success [12.319s] 2018-03-20 00:34:14,481 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:34:14.480 55 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete ... success [8.228s] 2018-03-20 00:34:26,180 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:34:26.179 55 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_get.VolumesGetTest.test_volume_create_get_update_delete_from_image ... success [11.698s] 2018-03-20 00:34:35,427 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:34:35.427 55 INFO opnfv-tempest [-] {0} tempest.api.volume.test_volumes_list.VolumesListTestJSON.test_volume_list ... success [0.040s] 2018-03-20 00:37:14,551 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:37:14.550 55 INFO opnfv-tempest [-] {0} tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops ... fail [152.656s] 2018-03-20 00:38:52,999 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:38:52.998 55 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_basic_ops.TestServerBasicOps.test_server_basic_ops ... success [89.702s] 2018-03-20 00:39:39,507 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 00:39:39.506 55 INFO opnfv-tempest [-] {0} tempest.scenario.test_server_multinode.TestServerMultinode.test_schedule_to_all_nodes ... success [26.248s] 2018-03-20 00:39:55,562 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '81e3f155-f97b-4520-8851-56c9de6f17aa']'. 2018-03-20 00:39:56,545 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-03-20 00:39:56,546 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-03-20 00:39:56,546 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-20 00:39:56,546 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 81e3f155-f97b-4520-8851-56c9de6f17aa | 2018-03-20 00:39:56,546 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | failed | 2018-03-20 00:39:56,546 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-03-20 00:18:21 | 2018-03-20 00:39:56,546 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-03-20 00:39:55 | 2018-03-20 00:39:56,546 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:21:34 | 2018-03-20 00:39:56,546 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | concurrency: 1 | 2018-03-20 00:39:56,546 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | | load_list: (value is too long, use 'detailed' flag to display it) | 2018-03-20 00:39:56,546 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-03-20 00:39:56,547 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: f963ab93-904b-456c-9278-bc264d80150f) | 2018-03-20 00:39:56,547 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-03-20 00:39:56,547 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 7c3b1a6b-07e1-4160-9878-9dedd8988e38) | 2018-03-20 00:39:56,547 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 109 | 2018-03-20 00:39:56,547 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 1272.471 | 2018-03-20 00:39:56,547 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 88 | 2018-03-20 00:39:56,547 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 19 | 2018-03-20 00:39:56,547 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-03-20 00:39:56,547 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-03-20 00:39:56,547 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 2 | 2018-03-20 00:39:56,548 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-20 00:39:56,548 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-03-20 00:39:56,646 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest tempest_smoke_serial success_rate is 97.7777777778% 2018-03-20 00:40:03,865 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-20 00:40:03,866 - xtesting.ci.run_tests - INFO - Test result: +------------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +------------------------------+------------------+------------------+----------------+ | tempest_smoke_serial | functest | 22:02 | FAIL | +------------------------------+------------------+------------------+----------------+ 2018-03-20 00:40:03,870 - xtesting.ci.run_tests - ERROR - The test case 'tempest_smoke_serial' failed. 2018-03-20 00:40:03,870 - xtesting.ci.run_tests - INFO - Running test case 'rally_sanity'... 2018-03-20 00:40:03,968 - xtesting.energy.energy - DEBUG - Getting current scenario 2018-03-20 00:40:04,429 - xtesting.energy.energy - DEBUG - Starting recording 2018-03-20 00:40:04,429 - xtesting.energy.energy - DEBUG - Submitting scenario (rally_sanity/running) 2018-03-20 00:40:04,844 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-03-20 00:40:07,352 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-03-20 00:40:06.933 156 INFO rally.deployment.engine [-] Deployment 7c3b1a6b-07e1-4160-9878-9dedd8988e38 | Starting: Destroy cloud and free allocated resources. 2018-03-20 00:40:07.029 156 INFO rally.deployment.engine [-] Deployment 7c3b1a6b-07e1-4160-9878-9dedd8988e38 | Completed: Destroy cloud and free allocated resources. 2018-03-20 00:40:07.068 156 INFO rally.api [-] Deleting all verifications created by verifier 'opnfv-tempest' (UUID=f963ab93-904b-456c-9278-bc264d80150f) for deployment 'opnfv-rally'. 2018-03-20 00:40:07.085 156 INFO rally.api [-] Deleting verification (UUID=81e3f155-f97b-4520-8851-56c9de6f17aa). 2018-03-20 00:40:07.128 156 INFO rally.api [-] Verification has been successfully deleted! 2018-03-20 00:40:07.128 156 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=f963ab93-904b-456c-9278-bc264d80150f). 2018-03-20 00:40:07.139 156 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-03-20 00:40:09,750 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-03-20 00:40:09.436 159 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=365f3f20-2b17-44bd-a073-174f1ef2b279) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 365f3f20-2b17-44bd-a073-174f1ef2b279 | 2018-03-20T00:40:09 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 365f3f20-2b17-44bd-a073-174f1ef2b279 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-03-20 00:40:13,101 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+-------------------+-----------+ | Service | Service Type | Status | +-------------+-------------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | nfv-orchestration | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+-------------------+-----------+ 2018-03-20 00:40:13,101 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Validating the test name... 2018-03-20 00:40:14,577 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating image 'Cirros-0.4.0-e88bceb8-62d7-4057-85e1-58ff3b49328c'... 2018-03-20 00:40:17,557 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating network 'rally-net-e88bceb8-62d7-4057-85e1-58ff3b49328c'... 2018-03-20 00:40:20,002 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating router 'rally-router-e88bceb8-62d7-4057-85e1-58ff3b49328c'... 2018-03-20 00:40:26,120 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-tiny-e88bceb8-62d7-4057-85e1-58ff3b49328c'... 2018-03-20 00:40:26,844 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Creating flavor 'rally-mini-e88bceb8-62d7-4057-85e1-58ff3b49328c'... 2018-03-20 00:40:27,547 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "authenticate" ... 2018-03-20 00:40:27,547 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-authenticate.yaml 2018-03-20 00:40:27,548 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-20 00:40:27,592 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-20 00:40:27,597 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['authenticate'], 'concurrency': 4, 'netid': '7f3fcf49-a1e8-428d-ae29-2c98666643d6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'flavor_name': 'rally-tiny-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-20 00:41:27,807 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : fa5b0d4a-480f-4115-ba8d-f1fd0d5f2def 2018-03-20 00:41:27,808 - functest.opnfv_tests.openstack.rally.rally - DEBUG - /home/opnfv/functest/results/rally does not exist, we create it. 2018-03-20 00:41:27,810 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'fa5b0d4a-480f-4115-ba8d-f1fd0d5f2def'] 2018-03-20 00:41:28,807 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task fa5b0d4a-480f-4115-ba8d-f1fd0d5f2def: finished -------------------------------------------------------------------------------- test scenario Authenticate.keystone args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task fa5b0d4a-480f-4115-ba8d-f1fd0d5f2def has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.keystone | 0.478 | 0.478 | 0.478 | 0.478 | 0.478 | 0.478 | 100.0% | 1 | | total | 0.478 | 0.478 | 0.478 | 0.478 | 0.478 | 0.478 | 100.0% | 1 | | -> duration | 0.478 | 0.478 | 0.478 | 0.478 | 0.478 | 0.478 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.47762 Full duration: 7.004366 -------------------------------------------------------------------------------- test scenario Authenticate.validate_cinder args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task fa5b0d4a-480f-4115-ba8d-f1fd0d5f2def has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_cinder | 0.43 | 0.43 | 0.43 | 0.43 | 0.43 | 0.43 | 100.0% | 1 | | total | 0.861 | 0.861 | 0.861 | 0.861 | 0.861 | 0.861 | 100.0% | 1 | | -> duration | 0.861 | 0.861 | 0.861 | 0.861 | 0.861 | 0.861 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.861072 Full duration: 7.510852 -------------------------------------------------------------------------------- test scenario Authenticate.validate_glance args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task fa5b0d4a-480f-4115-ba8d-f1fd0d5f2def has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_glance | 0.534 | 0.534 | 0.534 | 0.534 | 0.534 | 0.534 | 100.0% | 1 | | total | 0.962 | 0.962 | 0.962 | 0.962 | 0.962 | 0.962 | 100.0% | 1 | | -> duration | 0.962 | 0.962 | 0.962 | 0.962 | 0.962 | 0.962 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.962243 Full duration: 7.637945 -------------------------------------------------------------------------------- test scenario Authenticate.validate_heat args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task fa5b0d4a-480f-4115-ba8d-f1fd0d5f2def has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_heat | 0.372 | 0.372 | 0.372 | 0.372 | 0.372 | 0.372 | 100.0% | 1 | | total | 0.799 | 0.799 | 0.799 | 0.799 | 0.799 | 0.799 | 100.0% | 1 | | -> duration | 0.799 | 0.799 | 0.799 | 0.799 | 0.799 | 0.799 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.798531 Full duration: 7.836578 -------------------------------------------------------------------------------- test scenario Authenticate.validate_neutron args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task fa5b0d4a-480f-4115-ba8d-f1fd0d5f2def has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_neutron | 0.649 | 0.649 | 0.649 | 0.649 | 0.649 | 0.649 | 100.0% | 1 | | total | 1.059 | 1.059 | 1.059 | 1.059 | 1.059 | 1.059 | 100.0% | 1 | | -> duration | 1.059 | 1.059 | 1.059 | 1.059 | 1.059 | 1.059 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.059453 Full duration: 8.044587 -------------------------------------------------------------------------------- test scenario Authenticate.validate_nova args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "repetitions": 2 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task fa5b0d4a-480f-4115-ba8d-f1fd0d5f2def has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | authenticate.validate_nova | 0.229 | 0.229 | 0.229 | 0.229 | 0.229 | 0.229 | 100.0% | 1 | | total | 0.684 | 0.684 | 0.684 | 0.684 | 0.684 | 0.684 | 100.0% | 1 | | -> duration | 0.684 | 0.684 | 0.684 | 0.684 | 0.684 | 0.684 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.683577 Full duration: 7.896336 HINTS: * To plot HTML graphics with this data, run: rally task report fa5b0d4a-480f-4115-ba8d-f1fd0d5f2def --out output.html * To generate a JUnit report, run: rally task export fa5b0d4a-480f-4115-ba8d-f1fd0d5f2def --type junit --to output.xml * To get raw JSON output of task results, run: rally task report fa5b0d4a-480f-4115-ba8d-f1fd0d5f2def --json --out output.json 2018-03-20 00:41:28,807 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'fa5b0d4a-480f-4115-ba8d-f1fd0d5f2def'] 2018-03-20 00:41:29,808 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-20 00:41:29,808 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'fa5b0d4a-480f-4115-ba8d-f1fd0d5f2def', '--out', u'/home/opnfv/functest/results/rally/opnfv-authenticate.html'] 2018-03-20 00:41:29,816 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "authenticate" OK. 2018-03-20 00:41:29,816 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "glance" ... 2018-03-20 00:41:29,817 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-glance.yaml 2018-03-20 00:41:29,817 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-20 00:41:29,864 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-20 00:41:29,866 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['glance'], 'concurrency': 4, 'netid': '7f3fcf49-a1e8-428d-ae29-2c98666643d6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'flavor_name': 'rally-tiny-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-20 00:43:07,592 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 0b5b2b30-ef53-4b5a-bb9d-bb2c70124cd4 2018-03-20 00:43:07,593 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '0b5b2b30-ef53-4b5a-bb9d-bb2c70124cd4'] 2018-03-20 00:43:08,654 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 0b5b2b30-ef53-4b5a-bb9d-bb2c70124cd4: finished -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_delete_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 0b5b2b30-ef53-4b5a-bb9d-bb2c70124cd4 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.634 | 4.634 | 4.634 | 4.634 | 4.634 | 4.634 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.494 | 0.494 | 0.494 | 0.494 | 0.494 | 0.494 | 100.0% | 1 | | -> glance_v2.upload_data | 1.708 | 1.708 | 1.708 | 1.708 | 1.708 | 1.708 | 100.0% | 1 | | glance_v2.delete_image | 1.131 | 1.131 | 1.131 | 1.131 | 1.131 | 1.131 | 100.0% | 1 | | total | 5.766 | 5.766 | 5.766 | 5.766 | 5.766 | 5.766 | 100.0% | 1 | | -> duration | 5.766 | 5.766 | 5.766 | 5.766 | 5.766 | 5.766 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.765543 Full duration: 14.307411 -------------------------------------------------------------------------------- test scenario GlanceImages.create_and_list_image args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 0b5b2b30-ef53-4b5a-bb9d-bb2c70124cd4 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.549 | 4.549 | 4.549 | 4.549 | 4.549 | 4.549 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.595 | 0.595 | 0.595 | 0.595 | 0.595 | 0.595 | 100.0% | 1 | | -> glance_v2.upload_data | 1.529 | 1.529 | 1.529 | 1.529 | 1.529 | 1.529 | 100.0% | 1 | | glance_v2.list_images | 0.039 | 0.039 | 0.039 | 0.039 | 0.039 | 0.039 | 100.0% | 1 | | total | 4.588 | 4.588 | 4.588 | 4.588 | 4.588 | 4.588 | 100.0% | 1 | | -> duration | 4.588 | 4.588 | 4.588 | 4.588 | 4.588 | 4.588 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 4.588269 Full duration: 16.881022 -------------------------------------------------------------------------------- test scenario GlanceImages.list_images args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 0b5b2b30-ef53-4b5a-bb9d-bb2c70124cd4 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.list_images | 0.345 | 0.345 | 0.345 | 0.345 | 0.345 | 0.345 | 100.0% | 1 | | total | 0.345 | 0.345 | 0.345 | 0.345 | 0.345 | 0.345 | 100.0% | 1 | | -> duration | 0.345 | 0.345 | 0.345 | 0.345 | 0.345 | 0.345 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.344795 Full duration: 7.938022 -------------------------------------------------------------------------------- test scenario GlanceImages.create_image_and_boot_instances args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "container_format": "bare", "disk_format": "qcow2", "image_location": "/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img", "flavor": { "name": "rally-tiny-e88bceb8-62d7-4057-85e1-58ff3b49328c" }, "number_instances": 2, "nics": [ { "net-id": "7f3fcf49-a1e8-428d-ae29-2c98666643d6" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "nova": { "cores": -1, "floating_ips": -1, "instances": -1, "ram": -1, "security_group_rules": -1, "security_groups": -1 } } } } -------------------------------------------------------------------------------- Task 0b5b2b30-ef53-4b5a-bb9d-bb2c70124cd4 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | glance_v2.create_image | 4.083 | 4.083 | 4.083 | 4.083 | 4.083 | 4.083 | 100.0% | 1 | | -> glance_v2.get_image (x2) | 0.495 | 0.495 | 0.495 | 0.495 | 0.495 | 0.495 | 100.0% | 1 | | -> glance_v2.upload_data | 1.111 | 1.111 | 1.111 | 1.111 | 1.111 | 1.111 | 100.0% | 1 | | nova.boot_servers | 13.469 | 13.469 | 13.469 | 13.469 | 13.469 | 13.469 | 100.0% | 1 | | total | 17.554 | 17.554 | 17.554 | 17.554 | 17.554 | 17.554 | 100.0% | 1 | | -> duration | 16.554 | 16.554 | 16.554 | 16.554 | 16.554 | 16.554 | 100.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 16.553669 Full duration: 40.425055 HINTS: * To plot HTML graphics with this data, run: rally task report 0b5b2b30-ef53-4b5a-bb9d-bb2c70124cd4 --out output.html * To generate a JUnit report, run: rally task export 0b5b2b30-ef53-4b5a-bb9d-bb2c70124cd4 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 0b5b2b30-ef53-4b5a-bb9d-bb2c70124cd4 --json --out output.json 2018-03-20 00:43:08,655 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '0b5b2b30-ef53-4b5a-bb9d-bb2c70124cd4'] 2018-03-20 00:43:09,690 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-20 00:43:09,690 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '0b5b2b30-ef53-4b5a-bb9d-bb2c70124cd4', '--out', u'/home/opnfv/functest/results/rally/opnfv-glance.html'] 2018-03-20 00:43:09,697 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "glance" OK. 2018-03-20 00:43:09,697 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "ceilometer" ... 2018-03-20 00:43:09,697 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-ceilometer.yaml 2018-03-20 00:43:09,698 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-20 00:43:09,739 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-20 00:43:09,739 - functest.opnfv_tests.openstack.rally.rally - INFO - No tests for scenario "ceilometer" 2018-03-20 00:43:09,739 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "cinder" ... 2018-03-20 00:43:09,739 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-cinder.yaml 2018-03-20 00:43:09,740 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-20 00:43:09,771 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-20 00:43:09,776 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['cinder'], 'concurrency': 4, 'netid': '7f3fcf49-a1e8-428d-ae29-2c98666643d6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'flavor_name': 'rally-tiny-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-20 00:46:29,080 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 2a0c138b-7801-45e4-970a-a6504b978922 2018-03-20 00:46:29,081 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '2a0c138b-7801-45e4-970a-a6504b978922'] 2018-03-20 00:46:30,481 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 2a0c138b-7801-45e4-970a-a6504b978922: finished -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_snapshot args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "force": false }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 2a0c138b-7801-45e4-970a-a6504b978922 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_snapshot | 3.113 | 3.113 | 3.113 | 3.113 | 3.113 | 3.113 | 100.0% | 1 | | cinder_v2.delete_snapshot | 2.618 | 2.618 | 2.618 | 2.618 | 2.618 | 2.618 | 100.0% | 1 | | total | 5.732 | 5.732 | 5.732 | 5.732 | 5.732 | 5.732 | 100.0% | 1 | | -> duration | 5.732 | 5.732 | 5.732 | 5.732 | 5.732 | 5.732 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.731753 Full duration: 23.126807 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": { "max": 1, "min": 1 } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 2a0c138b-7801-45e4-970a-a6504b978922 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.174 | 3.174 | 3.174 | 3.174 | 3.174 | 3.174 | 100.0% | 1 | | cinder_v2.delete_volume | 2.615 | 2.615 | 2.615 | 2.615 | 2.615 | 2.615 | 100.0% | 1 | | total | 5.789 | 5.789 | 5.789 | 5.789 | 5.789 | 5.789 | 100.0% | 1 | | -> duration | 5.789 | 5.789 | 5.789 | 5.789 | 5.789 | 5.789 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.789411 Full duration: 15.799198 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "image": { "name": "Cirros-0.4.0-e88bceb8-62d7-4057-85e1-58ff3b49328c" }, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 2a0c138b-7801-45e4-970a-a6504b978922 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 8.82 | 8.82 | 8.82 | 8.82 | 8.82 | 8.82 | 100.0% | 1 | | cinder_v2.delete_volume | 2.754 | 2.754 | 2.754 | 2.754 | 2.754 | 2.754 | 100.0% | 1 | | total | 11.575 | 11.575 | 11.575 | 11.575 | 11.575 | 11.575 | 100.0% | 1 | | -> duration | 11.575 | 11.575 | 11.575 | 11.575 | 11.575 | 11.575 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 11.574678 Full duration: 22.204866 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 2a0c138b-7801-45e4-970a-a6504b978922 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.172 | 3.172 | 3.172 | 3.172 | 3.172 | 3.172 | 100.0% | 1 | | cinder_v2.delete_volume | 2.595 | 2.595 | 2.595 | 2.595 | 2.595 | 2.595 | 100.0% | 1 | | total | 5.768 | 5.768 | 5.768 | 5.768 | 5.768 | 5.768 | 100.0% | 1 | | -> duration | 5.768 | 5.768 | 5.768 | 5.768 | 5.768 | 5.768 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.767791 Full duration: 15.927691 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_and_extend_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "new_size": 2, "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } } } } -------------------------------------------------------------------------------- Task 2a0c138b-7801-45e4-970a-a6504b978922 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.305 | 3.305 | 3.305 | 3.305 | 3.305 | 3.305 | 100.0% | 1 | | cinder_v2.extend_volume | 2.511 | 2.511 | 2.511 | 2.511 | 2.511 | 2.511 | 100.0% | 1 | | cinder_v2.delete_volume | 2.518 | 2.518 | 2.518 | 2.518 | 2.518 | 2.518 | 100.0% | 1 | | total | 8.333 | 8.333 | 8.333 | 8.333 | 8.333 | 8.333 | 100.0% | 1 | | -> duration | 8.333 | 8.333 | 8.333 | 8.333 | 8.333 | 8.333 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 8.333343 Full duration: 18.735332 -------------------------------------------------------------------------------- test scenario CinderVolumes.create_from_volume_and_delete_volume args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "size": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "cinder": { "gigabytes": -1, "snapshots": -1, "volumes": -1 } }, "volumes": { "size": 1, "volumes_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 2a0c138b-7801-45e4-970a-a6504b978922 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume | 3.371 | 3.371 | 3.371 | 3.371 | 3.371 | 3.371 | 100.0% | 1 | | cinder_v2.delete_volume | 2.869 | 2.869 | 2.869 | 2.869 | 2.869 | 2.869 | 100.0% | 1 | | total | 6.241 | 6.241 | 6.241 | 6.241 | 6.241 | 6.241 | 100.0% | 1 | | -> duration | 6.241 | 6.241 | 6.241 | 6.241 | 6.241 | 6.241 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.240581 Full duration: 22.994991 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_list_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "consumer": "both", "write_iops_sec": "10", "read_iops_sec": "1000" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 2a0c138b-7801-45e4-970a-a6504b978922 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 0.612 | 0.612 | 0.612 | 0.612 | 0.612 | 0.612 | 100.0% | 1 | | cinder_v2.list_qos | 0.173 | 0.173 | 0.173 | 0.173 | 0.173 | 0.173 | 100.0% | 1 | | total | 0.786 | 0.786 | 0.786 | 0.786 | 0.786 | 0.786 | 100.0% | 1 | | -> duration | 0.786 | 0.786 | 0.786 | 0.786 | 0.786 | 0.786 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.7858 Full duration: 12.503385 -------------------------------------------------------------------------------- test scenario CinderQos.create_and_set_qos args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "consumer": "back-end", "write_iops_sec": "10", "read_iops_sec": "1000", "set_consumer": "both", "set_write_iops_sec": "11", "set_read_iops_sec": "1001" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 2a0c138b-7801-45e4-970a-a6504b978922 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_qos | 0.608 | 0.608 | 0.608 | 0.608 | 0.608 | 0.608 | 100.0% | 1 | | cinder_v2.set_qos | 0.191 | 0.191 | 0.191 | 0.191 | 0.191 | 0.191 | 100.0% | 1 | | total | 0.8 | 0.8 | 0.8 | 0.8 | 0.8 | 0.8 | 100.0% | 1 | | -> duration | 0.8 | 0.8 | 0.8 | 0.8 | 0.8 | 0.8 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.800203 Full duration: 12.444108 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_and_list_volume_types args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "description": "rally tests creating types" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 2a0c138b-7801-45e4-970a-a6504b978922 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.629 | 0.629 | 0.629 | 0.629 | 0.629 | 0.629 | 100.0% | 1 | | cinder_v2.list_types | 0.176 | 0.176 | 0.176 | 0.176 | 0.176 | 0.176 | 100.0% | 1 | | total | 0.805 | 0.805 | 0.805 | 0.805 | 0.805 | 0.805 | 100.0% | 1 | | -> duration | 0.805 | 0.805 | 0.805 | 0.805 | 0.805 | 0.805 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.805413 Full duration: 12.735981 -------------------------------------------------------------------------------- test scenario CinderVolumeTypes.create_volume_type_and_encryption_type args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "description": "rally tests creating types", "provider": "LuksEncryptor", "cipher": "aes-xts-plain64", "key_size": 512, "control_location": "front-end" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 2a0c138b-7801-45e4-970a-a6504b978922 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | cinder_v2.create_volume_type | 0.593 | 0.593 | 0.593 | 0.593 | 0.593 | 0.593 | 100.0% | 1 | | cinder_v2.create_encryption_type | 0.219 | 0.219 | 0.219 | 0.219 | 0.219 | 0.219 | 100.0% | 1 | | total | 0.812 | 0.812 | 0.812 | 0.812 | 0.812 | 0.812 | 100.0% | 1 | | -> duration | 0.812 | 0.812 | 0.812 | 0.812 | 0.812 | 0.812 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.81224 Full duration: 12.640954 HINTS: * To plot HTML graphics with this data, run: rally task report 2a0c138b-7801-45e4-970a-a6504b978922 --out output.html * To generate a JUnit report, run: rally task export 2a0c138b-7801-45e4-970a-a6504b978922 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 2a0c138b-7801-45e4-970a-a6504b978922 --json --out output.json 2018-03-20 00:46:30,482 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '2a0c138b-7801-45e4-970a-a6504b978922'] 2018-03-20 00:46:31,574 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-20 00:46:31,575 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '2a0c138b-7801-45e4-970a-a6504b978922', '--out', u'/home/opnfv/functest/results/rally/opnfv-cinder.html'] 2018-03-20 00:46:31,582 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "cinder" OK. 2018-03-20 00:46:31,582 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "heat" ... 2018-03-20 00:46:31,582 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-heat.yaml 2018-03-20 00:46:31,582 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-20 00:46:31,600 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-20 00:46:31,601 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['heat'], 'concurrency': 4, 'netid': '7f3fcf49-a1e8-428d-ae29-2c98666643d6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'flavor_name': 'rally-tiny-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-20 00:47:52,826 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 074a5678-85c2-4e75-830a-65980ad21dd9 2018-03-20 00:47:52,827 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '074a5678-85c2-4e75-830a-65980ad21dd9'] 2018-03-20 00:47:53,925 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 074a5678-85c2-4e75-830a-65980ad21dd9: finished -------------------------------------------------------------------------------- test scenario HeatStacks.create_update_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/autoscaling_policy.yaml.template", "updated_template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/updated_autoscaling_policy_inplace.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task 074a5678-85c2-4e75-830a-65980ad21dd9 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.746 | 4.746 | 4.746 | 4.746 | 4.746 | 4.746 | 100.0% | 1 | | heat.update_stack | 3.019 | 3.019 | 3.019 | 3.019 | 3.019 | 3.019 | 100.0% | 1 | | heat.delete_stack | 2.69 | 2.69 | 2.69 | 2.69 | 2.69 | 2.69 | 100.0% | 1 | | total | 10.456 | 10.456 | 10.456 | 10.456 | 10.456 | 10.456 | 100.0% | 1 | | -> duration | 6.456 | 6.456 | 6.456 | 6.456 | 6.456 | 6.456 | 100.0% | 1 | | -> idle_duration | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 4.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.455697 Full duration: 19.038633 -------------------------------------------------------------------------------- test scenario HeatStacks.create_check_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task 074a5678-85c2-4e75-830a-65980ad21dd9 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.489 | 4.489 | 4.489 | 4.489 | 4.489 | 4.489 | 100.0% | 1 | | heat.check_stack | 1.41 | 1.41 | 1.41 | 1.41 | 1.41 | 1.41 | 100.0% | 1 | | heat.delete_stack | 1.463 | 1.463 | 1.463 | 1.463 | 1.463 | 1.463 | 100.0% | 1 | | total | 7.362 | 7.362 | 7.362 | 7.362 | 7.362 | 7.362 | 100.0% | 1 | | -> duration | 5.362 | 5.362 | 5.362 | 5.362 | 5.362 | 5.362 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.361753 Full duration: 17.46527 -------------------------------------------------------------------------------- test scenario HeatStacks.create_suspend_resume_delete_stack args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "template_path": "/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates/random_strings.yaml.template" }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task 074a5678-85c2-4e75-830a-65980ad21dd9 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.create_stack | 4.643 | 4.643 | 4.643 | 4.643 | 4.643 | 4.643 | 100.0% | 1 | | heat.suspend_stack | 0.799 | 0.799 | 0.799 | 0.799 | 0.799 | 0.799 | 100.0% | 1 | | heat.resume_stack | 0.699 | 0.699 | 0.699 | 0.699 | 0.699 | 0.699 | 100.0% | 1 | | heat.delete_stack | 2.513 | 2.513 | 2.513 | 2.513 | 2.513 | 2.513 | 100.0% | 1 | | total | 8.655 | 8.655 | 8.655 | 8.655 | 8.655 | 8.655 | 100.0% | 1 | | -> duration | 6.655 | 6.655 | 6.655 | 6.655 | 6.655 | 6.655 | 100.0% | 1 | | -> idle_duration | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 2.0 | 100.0% | 1 | +--------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.654846 Full duration: 17.300002 -------------------------------------------------------------------------------- test scenario HeatStacks.list_stacks_and_resources args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "roles": [ "heat_stack_owner" ] } } -------------------------------------------------------------------------------- Task 074a5678-85c2-4e75-830a-65980ad21dd9 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | heat.list_stacks | 0.598 | 0.598 | 0.598 | 0.598 | 0.598 | 0.598 | 100.0% | 1 | | total | 0.598 | 0.598 | 0.598 | 0.598 | 0.598 | 0.598 | 100.0% | 1 | | -> duration | 0.598 | 0.598 | 0.598 | 0.598 | 0.598 | 0.598 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.59774 Full duration: 8.480277 HINTS: * To plot HTML graphics with this data, run: rally task report 074a5678-85c2-4e75-830a-65980ad21dd9 --out output.html * To generate a JUnit report, run: rally task export 074a5678-85c2-4e75-830a-65980ad21dd9 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 074a5678-85c2-4e75-830a-65980ad21dd9 --json --out output.json 2018-03-20 00:47:53,926 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '074a5678-85c2-4e75-830a-65980ad21dd9'] 2018-03-20 00:47:54,990 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-20 00:47:54,990 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '074a5678-85c2-4e75-830a-65980ad21dd9', '--out', u'/home/opnfv/functest/results/rally/opnfv-heat.html'] 2018-03-20 00:47:54,998 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "heat" OK. 2018-03-20 00:47:54,998 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "keystone" ... 2018-03-20 00:47:54,998 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-keystone.yaml 2018-03-20 00:47:54,999 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-20 00:47:55,037 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-20 00:47:55,040 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['keystone'], 'concurrency': 4, 'netid': '7f3fcf49-a1e8-428d-ae29-2c98666643d6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'flavor_name': 'rally-tiny-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-20 00:51:11,396 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : dd0e0030-ecfb-4e56-a412-c2dc6459c21f 2018-03-20 00:51:11,397 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'dd0e0030-ecfb-4e56-a412-c2dc6459c21f'] 2018-03-20 00:51:12,618 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task dd0e0030-ecfb-4e56-a412-c2dc6459c21f: finished -------------------------------------------------------------------------------- test scenario KeystoneBasic.add_and_remove_user_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task dd0e0030-ecfb-4e56-a412-c2dc6459c21f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.484 | 0.484 | 0.484 | 0.484 | 0.484 | 0.484 | 100.0% | 1 | | keystone_v3.add_role | 0.129 | 0.129 | 0.129 | 0.129 | 0.129 | 0.129 | 100.0% | 1 | | keystone_v3.revoke_role | 0.119 | 0.119 | 0.119 | 0.119 | 0.119 | 0.119 | 100.0% | 1 | | total | 0.732 | 0.732 | 0.732 | 0.732 | 0.732 | 0.732 | 100.0% | 1 | | -> duration | 0.732 | 0.732 | 0.732 | 0.732 | 0.732 | 0.732 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.732143 Full duration: 14.676528 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_add_and_list_user_roles args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task dd0e0030-ecfb-4e56-a412-c2dc6459c21f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.511 | 0.511 | 0.511 | 0.511 | 0.511 | 0.511 | 100.0% | 1 | | keystone_v3.add_role | 0.123 | 0.123 | 0.123 | 0.123 | 0.123 | 0.123 | 100.0% | 1 | | keystone_v3.list_roles | 0.109 | 0.109 | 0.109 | 0.109 | 0.109 | 0.109 | 100.0% | 1 | | total | 0.743 | 0.743 | 0.743 | 0.743 | 0.743 | 0.743 | 100.0% | 1 | | -> duration | 0.743 | 0.743 | 0.743 | 0.743 | 0.743 | 0.743 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.743472 Full duration: 14.310344 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_tenants args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task dd0e0030-ecfb-4e56-a412-c2dc6459c21f has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.687 | 0.687 | 0.687 | 0.687 | 0.687 | 0.687 | 100.0% | 1 | | keystone_v3.list_projects | 0.081 | 0.081 | 0.081 | 0.081 | 0.081 | 0.081 | 100.0% | 1 | | total | 0.769 | 0.769 | 0.769 | 0.769 | 0.769 | 0.769 | 100.0% | 1 | | -> duration | 0.769 | 0.769 | 0.769 | 0.769 | 0.769 | 0.769 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.768663 Full duration: 14.818548 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_role args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task dd0e0030-ecfb-4e56-a412-c2dc6459c21f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_role | 0.486 | 0.486 | 0.486 | 0.486 | 0.486 | 0.486 | 100.0% | 1 | | keystone_v3.delete_role | 0.108 | 0.108 | 0.108 | 0.108 | 0.108 | 0.108 | 100.0% | 1 | | total | 0.594 | 0.594 | 0.594 | 0.594 | 0.594 | 0.594 | 100.0% | 1 | | -> duration | 0.594 | 0.594 | 0.594 | 0.594 | 0.594 | 0.594 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.593639 Full duration: 12.337734 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_delete_service args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task dd0e0030-ecfb-4e56-a412-c2dc6459c21f has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_service | 0.506 | 0.506 | 0.506 | 0.506 | 0.506 | 0.506 | 100.0% | 1 | | keystone_v3.delete_service | 0.104 | 0.104 | 0.104 | 0.104 | 0.104 | 0.104 | 100.0% | 1 | | total | 0.61 | 0.61 | 0.61 | 0.61 | 0.61 | 0.61 | 100.0% | 1 | | -> duration | 0.61 | 0.61 | 0.61 | 0.61 | 0.61 | 0.61 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.610312 Full duration: 12.461466 -------------------------------------------------------------------------------- test scenario KeystoneBasic.get_entities args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task dd0e0030-ecfb-4e56-a412-c2dc6459c21f has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.703 | 0.703 | 0.703 | 0.703 | 0.703 | 0.703 | 100.0% | 1 | | keystone_v3.create_user | 0.486 | 0.486 | 0.486 | 0.486 | 0.486 | 0.486 | 100.0% | 1 | | -> keystone_v3.list_roles | 0.086 | 0.086 | 0.086 | 0.086 | 0.086 | 0.086 | 100.0% | 1 | | -> keystone_v3.add_role | 0.126 | 0.126 | 0.126 | 0.126 | 0.126 | 0.126 | 100.0% | 1 | | keystone_v3.create_role | 0.104 | 0.104 | 0.104 | 0.104 | 0.104 | 0.104 | 100.0% | 1 | | keystone_v3.get_project | 0.09 | 0.09 | 0.09 | 0.09 | 0.09 | 0.09 | 100.0% | 1 | | keystone_v3.get_user | 0.091 | 0.091 | 0.091 | 0.091 | 0.091 | 0.091 | 100.0% | 1 | | keystone_v3.get_role | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 0.085 | 100.0% | 1 | | keystone_v3.list_services | 0.088 | 0.088 | 0.088 | 0.088 | 0.088 | 0.088 | 100.0% | 1 | | keystone_v3.get_services | 0.077 | 0.077 | 0.077 | 0.077 | 0.077 | 0.077 | 100.0% | 1 | | total | 1.817 | 1.817 | 1.817 | 1.817 | 1.817 | 1.817 | 100.0% | 1 | | -> duration | 1.817 | 1.817 | 1.817 | 1.817 | 1.817 | 1.817 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.817052 Full duration: 19.892991 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_update_and_delete_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task dd0e0030-ecfb-4e56-a412-c2dc6459c21f has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.652 | 0.652 | 0.652 | 0.652 | 0.652 | 0.652 | 100.0% | 1 | | keystone_v3.update_project | 0.095 | 0.095 | 0.095 | 0.095 | 0.095 | 0.095 | 100.0% | 1 | | keystone_v3.delete_project | 0.142 | 0.142 | 0.142 | 0.142 | 0.142 | 0.142 | 100.0% | 1 | | total | 0.89 | 0.89 | 0.89 | 0.89 | 0.89 | 0.89 | 100.0% | 1 | | -> duration | 0.89 | 0.89 | 0.89 | 0.89 | 0.89 | 0.89 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.890043 Full duration: 12.570118 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_user args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task dd0e0030-ecfb-4e56-a412-c2dc6459c21f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.688 | 0.688 | 0.688 | 0.688 | 0.688 | 0.688 | 100.0% | 1 | | total | 0.779 | 0.779 | 0.779 | 0.779 | 0.779 | 0.779 | 100.0% | 1 | | -> duration | 0.779 | 0.779 | 0.779 | 0.779 | 0.779 | 0.779 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.779062 Full duration: 15.166618 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task dd0e0030-ecfb-4e56-a412-c2dc6459c21f has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.678 | 0.678 | 0.678 | 0.678 | 0.678 | 0.678 | 100.0% | 1 | | total | 0.679 | 0.679 | 0.679 | 0.679 | 0.679 | 0.679 | 100.0% | 1 | | -> duration | 0.679 | 0.679 | 0.679 | 0.679 | 0.679 | 0.679 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.678729 Full duration: 14.61645 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_and_list_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task dd0e0030-ecfb-4e56-a412-c2dc6459c21f has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_user | 0.694 | 0.694 | 0.694 | 0.694 | 0.694 | 0.694 | 100.0% | 1 | | keystone_v3.list_users | 0.094 | 0.094 | 0.094 | 0.094 | 0.094 | 0.094 | 100.0% | 1 | | total | 0.881 | 0.881 | 0.881 | 0.881 | 0.881 | 0.881 | 100.0% | 1 | | -> duration | 0.881 | 0.881 | 0.881 | 0.881 | 0.881 | 0.881 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.880519 Full duration: 14.847376 -------------------------------------------------------------------------------- test scenario KeystoneBasic.create_tenant_with_users args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "users_per_tenant": 10 }, "sla": { "failure_rate": { "max": 0 } }, "context": {} } -------------------------------------------------------------------------------- Task dd0e0030-ecfb-4e56-a412-c2dc6459c21f has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | keystone_v3.create_project | 0.69 | 0.69 | 0.69 | 0.69 | 0.69 | 0.69 | 100.0% | 1 | | keystone_v3.create_users | 5.032 | 5.032 | 5.032 | 5.032 | 5.032 | 5.032 | 100.0% | 1 | | -> keystone_v3.create_user (x10) | 5.032 | 5.032 | 5.032 | 5.032 | 5.032 | 5.032 | 100.0% | 1 | | --> keystone_v3.list_roles (x10) | 0.83 | 0.83 | 0.83 | 0.83 | 0.83 | 0.83 | 100.0% | 1 | | --> keystone_v3.add_role (x10) | 1.227 | 1.227 | 1.227 | 1.227 | 1.227 | 1.227 | 100.0% | 1 | | total | 6.694 | 6.694 | 6.694 | 6.694 | 6.694 | 6.694 | 100.0% | 1 | | -> duration | 6.694 | 6.694 | 6.694 | 6.694 | 6.694 | 6.694 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 6.694357 Full duration: 22.927131 HINTS: * To plot HTML graphics with this data, run: rally task report dd0e0030-ecfb-4e56-a412-c2dc6459c21f --out output.html * To generate a JUnit report, run: rally task export dd0e0030-ecfb-4e56-a412-c2dc6459c21f --type junit --to output.xml * To get raw JSON output of task results, run: rally task report dd0e0030-ecfb-4e56-a412-c2dc6459c21f --json --out output.json 2018-03-20 00:51:12,619 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'dd0e0030-ecfb-4e56-a412-c2dc6459c21f'] 2018-03-20 00:51:13,658 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-20 00:51:13,658 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'dd0e0030-ecfb-4e56-a412-c2dc6459c21f', '--out', u'/home/opnfv/functest/results/rally/opnfv-keystone.html'] 2018-03-20 00:51:13,668 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "keystone" OK. 2018-03-20 00:51:13,668 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "neutron" ... 2018-03-20 00:51:13,668 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-neutron.yaml 2018-03-20 00:51:13,669 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-20 00:51:13,711 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-20 00:51:13,718 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['neutron'], 'concurrency': 4, 'netid': '7f3fcf49-a1e8-428d-ae29-2c98666643d6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'flavor_name': 'rally-tiny-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-20 00:55:26,767 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 40311d28-dcc4-498a-a5fb-f765e144ed71 2018-03-20 00:55:26,767 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '40311d28-dcc4-498a-a5fb-f765e144ed71'] 2018-03-20 00:55:27,908 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 40311d28-dcc4-498a-a5fb-f765e144ed71: finished -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } } } -------------------------------------------------------------------------------- Task 40311d28-dcc4-498a-a5fb-f765e144ed71 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.03 | 1.03 | 1.03 | 1.03 | 1.03 | 1.03 | 100.0% | 1 | | neutron.delete_network | 1.197 | 1.197 | 1.197 | 1.197 | 1.197 | 1.197 | 100.0% | 1 | | total | 2.227 | 2.227 | 2.227 | 2.227 | 2.227 | 2.227 | 100.0% | 1 | | -> duration | 2.227 | 2.227 | 2.227 | 2.227 | 2.227 | 2.227 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.227322 Full duration: 15.495733 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "port": -1 } } } } -------------------------------------------------------------------------------- Task 40311d28-dcc4-498a-a5fb-f765e144ed71 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_port | 1.545 | 1.545 | 1.545 | 1.545 | 1.545 | 1.545 | 100.0% | 1 | | neutron.delete_port | 0.768 | 0.768 | 0.768 | 0.768 | 0.768 | 0.768 | 100.0% | 1 | | total | 2.313 | 2.313 | 2.313 | 2.313 | 2.313 | 2.313 | 100.0% | 1 | | -> duration | 2.313 | 2.313 | 2.313 | 2.313 | 2.313 | 2.313 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.312702 Full duration: 37.960559 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "router_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1, "port": -1, "router": -1 } } } } -------------------------------------------------------------------------------- Task 40311d28-dcc4-498a-a5fb-f765e144ed71 has 0 error(s) -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 0.857 | 0.857 | 0.857 | 0.857 | 0.857 | 0.857 | 100.0% | 1 | | neutron.create_subnet | 0.873 | 0.873 | 0.873 | 0.873 | 0.873 | 0.873 | 100.0% | 1 | | neutron.create_router | 0.323 | 0.323 | 0.323 | 0.323 | 0.323 | 0.323 | 100.0% | 1 | | neutron.add_interface_router | 1.703 | 1.703 | 1.703 | 1.703 | 1.703 | 1.703 | 100.0% | 1 | | neutron.remove_interface_router | 1.197 | 1.197 | 1.197 | 1.197 | 1.197 | 1.197 | 100.0% | 1 | | neutron.delete_router | 0.471 | 0.471 | 0.471 | 0.471 | 0.471 | 0.471 | 100.0% | 1 | | total | 5.424 | 5.424 | 5.424 | 5.424 | 5.424 | 5.424 | 100.0% | 1 | | -> duration | 5.424 | 5.424 | 5.424 | 5.424 | 5.424 | 5.424 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +---------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 5.423799 Full duration: 36.385731 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_delete_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1 } } } } -------------------------------------------------------------------------------- Task 40311d28-dcc4-498a-a5fb-f765e144ed71 has 0 error(s) -------------------------------------------------------------------------------- +--------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_subnet | 1.206 | 1.206 | 1.206 | 1.206 | 1.206 | 1.206 | 100.0% | 1 | | neutron.delete_subnet | 1.852 | 1.852 | 1.852 | 1.852 | 1.852 | 1.852 | 100.0% | 1 | | total | 3.059 | 3.059 | 3.059 | 3.059 | 3.059 | 3.059 | 100.0% | 1 | | -> duration | 3.059 | 3.059 | 3.059 | 3.059 | 3.059 | 3.059 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.058797 Full duration: 30.144522 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_networks args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {} }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1 } } } } -------------------------------------------------------------------------------- Task 40311d28-dcc4-498a-a5fb-f765e144ed71 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.003 | 1.003 | 1.003 | 1.003 | 1.003 | 1.003 | 100.0% | 1 | | neutron.list_networks | 0.28 | 0.28 | 0.28 | 0.28 | 0.28 | 0.28 | 100.0% | 1 | | total | 1.284 | 1.284 | 1.284 | 1.284 | 1.284 | 1.284 | 100.0% | 1 | | -> duration | 1.284 | 1.284 | 1.284 | 1.284 | 1.284 | 1.284 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.283638 Full duration: 16.757433 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_ports args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "port_create_args": {}, "ports_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "port": -1 } } } } -------------------------------------------------------------------------------- Task 40311d28-dcc4-498a-a5fb-f765e144ed71 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 12.417128 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_routers args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "router_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1, "router": -1 } } } } -------------------------------------------------------------------------------- Task 40311d28-dcc4-498a-a5fb-f765e144ed71 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 10.352105 -------------------------------------------------------------------------------- test scenario NeutronNetworks.create_and_list_subnets args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": {}, "subnet_cidr_start": "1.1.0.0/30", "subnet_create_args": {}, "subnets_per_network": 1 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "network": {}, "quotas": { "neutron": { "network": -1, "subnet": -1 } } } } -------------------------------------------------------------------------------- Task 40311d28-dcc4-498a-a5fb-f765e144ed71 has 0 error(s) -------------------------------------------------------------------------------- +-----------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | total | n/a | n/a | n/a | n/a | n/a | n/a | n/a | 0 | +--------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.0 Full duration: 9.906119 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_groups args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } } } -------------------------------------------------------------------------------- Task 40311d28-dcc4-498a-a5fb-f765e144ed71 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.953 | 0.953 | 0.953 | 0.953 | 0.953 | 0.953 | 100.0% | 1 | | neutron.delete_security_group | 0.725 | 0.725 | 0.725 | 0.725 | 0.725 | 0.725 | 100.0% | 1 | | total | 1.679 | 1.679 | 1.679 | 1.679 | 1.679 | 1.679 | 100.0% | 1 | | -> duration | 1.679 | 1.679 | 1.679 | 1.679 | 1.679 | 1.679 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.678523 Full duration: 15.074549 -------------------------------------------------------------------------------- test scenario NeutronSecurityGroup.create_and_delete_security_group_rule args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": {}, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "security_group": -1 } } } } -------------------------------------------------------------------------------- Task 40311d28-dcc4-498a-a5fb-f765e144ed71 has 0 error(s) -------------------------------------------------------------------------------- +---------------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_security_group | 0.952 | 0.952 | 0.952 | 0.952 | 0.952 | 0.952 | 100.0% | 1 | | neutron.create_security_group_rule | 0.509 | 0.509 | 0.509 | 0.509 | 0.509 | 0.509 | 100.0% | 1 | | neutron.delete_security_group_rule | 0.275 | 0.275 | 0.275 | 0.275 | 0.275 | 0.275 | 100.0% | 1 | | neutron.delete_security_group | 0.305 | 0.305 | 0.305 | 0.305 | 0.305 | 0.305 | 100.0% | 1 | | total | 2.041 | 2.041 | 2.041 | 2.041 | 2.041 | 2.041 | 100.0% | 1 | | -> duration | 2.041 | 2.041 | 2.041 | 2.041 | 2.041 | 2.041 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +------------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 2.041034 Full duration: 14.890262 -------------------------------------------------------------------------------- test scenario NeutronNetworks.set_and_clear_router_gateway args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "network_create_args": { "router:external": true } }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 }, "quotas": { "neutron": { "network": -1, "router": -1 } }, "roles": [ "admin" ] } } -------------------------------------------------------------------------------- Task 40311d28-dcc4-498a-a5fb-f765e144ed71 has 0 error(s) -------------------------------------------------------------------------------- +----------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | neutron.create_network | 1.076 | 1.076 | 1.076 | 1.076 | 1.076 | 1.076 | 100.0% | 1 | | neutron.create_router | 0.312 | 0.312 | 0.312 | 0.312 | 0.312 | 0.312 | 100.0% | 1 | | neutron.add_gateway_router | 1.44 | 1.44 | 1.44 | 1.44 | 1.44 | 1.44 | 100.0% | 1 | | neutron.remove_gateway_router | 0.81 | 0.81 | 0.81 | 0.81 | 0.81 | 0.81 | 100.0% | 1 | | total | 3.638 | 3.638 | 3.638 | 3.638 | 3.638 | 3.638 | 100.0% | 1 | | -> duration | 3.638 | 3.638 | 3.638 | 3.638 | 3.638 | 3.638 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +-------------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 3.638361 Full duration: 24.405349 HINTS: * To plot HTML graphics with this data, run: rally task report 40311d28-dcc4-498a-a5fb-f765e144ed71 --out output.html * To generate a JUnit report, run: rally task export 40311d28-dcc4-498a-a5fb-f765e144ed71 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 40311d28-dcc4-498a-a5fb-f765e144ed71 --json --out output.json 2018-03-20 00:55:27,908 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '40311d28-dcc4-498a-a5fb-f765e144ed71'] 2018-03-20 00:55:28,928 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-20 00:55:28,928 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '40311d28-dcc4-498a-a5fb-f765e144ed71', '--out', u'/home/opnfv/functest/results/rally/opnfv-neutron.html'] 2018-03-20 00:55:28,935 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "neutron" OK. 2018-03-20 00:55:28,935 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "nova" ... 2018-03-20 00:55:28,936 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/sanity/opnfv-nova.yaml 2018-03-20 00:55:28,936 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-20 00:55:28,964 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-20 00:55:28,975 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['nova'], 'concurrency': 4, 'netid': '7f3fcf49-a1e8-428d-ae29-2c98666643d6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'flavor_name': 'rally-tiny-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-20 00:58:36,777 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : 85af355a-4a7c-4250-be21-768b5a735409 2018-03-20 00:58:36,777 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', '85af355a-4a7c-4250-be21-768b5a735409'] 2018-03-20 00:58:37,761 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task 85af355a-4a7c-4250-be21-768b5a735409: aborted -------------------------------------------------------------------------------- test scenario NovaServers.boot_and_live_migrate_server args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "flavor": { "name": "rally-tiny-e88bceb8-62d7-4057-85e1-58ff3b49328c" }, "image": { "name": "Cirros-0.4.0-e88bceb8-62d7-4057-85e1-58ff3b49328c" }, "block_migration": false, "nics": [ { "net-id": "7f3fcf49-a1e8-428d-ae29-2c98666643d6" } ] }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task 85af355a-4a7c-4250-be21-768b5a735409 has 1 error(s) -------------------------------------------------------------------------------- RallyException: Live Migration failed: Migration complete but instance did not change host: overcloud-novacompute-1.opnfvlf.org Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/rally/task/runner.py", line 71, in _run_scenario_once getattr(scenario_inst, method_name)(**scenario_kwargs) File "/usr/lib/python2.7/site-packages/rally/plugins/openstack/scenarios/nova/servers.py", line 722, in run block_migration, disk_over_commit) File "/usr/lib/python2.7/site-packages/rally/task/atomic.py", line 87, in func_atomic_actions f = func(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/rally/plugins/openstack/scenarios/nova/utils.py", line 770, in _live_migrate "but instance did not change host: %s" % host_pre_migrate) RallyException: Live Migration failed: Migration complete but instance did not change host: overcloud-novacompute-1.opnfvlf.org -------------------------------------------------------------------------------- +------------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | nova.boot_server | 9.853 | 9.853 | 9.853 | 9.853 | 9.853 | 9.853 | 100.0% | 1 | | nova.find_host_to_migrate | 1.362 | 1.362 | 1.362 | 1.362 | 1.362 | 1.362 | 100.0% | 1 | | nova.live_migrate | 136.031 | 136.031 | 136.031 | 136.031 | 136.031 | 136.031 | 0.0% | 1 | | total | 147.246 | 147.246 | 147.246 | 147.246 | 147.246 | 147.246 | 0.0% | 1 | | -> duration | 146.246 | 146.246 | 146.246 | 146.246 | 146.246 | 146.246 | 0.0% | 1 | | -> idle_duration | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 1.0 | 0.0% | 1 | +---------------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 146.245557 Full duration: 162.596531 HINTS: * To plot HTML graphics with this data, run: rally task report 85af355a-4a7c-4250-be21-768b5a735409 --out output.html * To generate a JUnit report, run: rally task export 85af355a-4a7c-4250-be21-768b5a735409 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report 85af355a-4a7c-4250-be21-768b5a735409 --json --out output.json 2018-03-20 00:58:37,762 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', '85af355a-4a7c-4250-be21-768b5a735409'] 2018-03-20 00:58:38,753 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-20 00:58:38,754 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', '85af355a-4a7c-4250-be21-768b5a735409', '--out', u'/home/opnfv/functest/results/rally/opnfv-nova.html'] 2018-03-20 00:58:38,761 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "nova" Failed. 2018-03-20 00:58:38,761 - functest.opnfv_tests.openstack.rally.rally - INFO - Starting test scenario "quotas" ... 2018-03-20 00:58:38,761 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Scenario fetched from : /usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/opnfv-quotas.yaml 2018-03-20 00:58:38,761 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Applying blacklist... 2018-03-20 00:58:38,801 - functest.opnfv_tests.openstack.rally.rally - DEBUG - Blacklisted tests: [u'CeilometerSamples.list_samples', u'CeilometerMeters.list_matched_meters', u'CeilometerSamples.list_matched_samples', u'Quotas.nova_update_and_delete', u'CeilometerStats.get_stats', u'CeilometerResource.list_matched_resources', u'CeilometerEvents..*', u'CeilometerMeters.list_meters', u'CeilometerTraits..*', u'Ceilometer..*', u'CeilometerResource.list_resources', u'CeilometerResource.get_tenant_resources', u'CeilometerEvents.create_user_and_list_event_types', u'CeilometerQueries.create_and_query_samples', u'CeilometerStats.create_meter_and_get_stats'] 2018-03-20 00:58:38,803 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'start', '--abort-on-sla-failure', '--task', '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/task.yaml', '--task-args', "{'smoke': True, 'tmpl_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/templates', 'floating_network': 'external', 'service_list': ['quotas'], 'concurrency': 4, 'netid': '7f3fcf49-a1e8-428d-ae29-2c98666643d6', 'tenants_amount': 3, 'image_name': 'Cirros-0.4.0-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'flavor_name': 'rally-tiny-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'glance_image_location': '/home/opnfv/functest/images/cirros-0.4.0-x86_64-disk.img', 'use_existing_users': False, 'flavor_alt_name': 'rally-mini-e88bceb8-62d7-4057-85e1-58ff3b49328c', 'iterations': 10, 'users_amount': 2, 'sup_dir': '/usr/lib/python2.7/site-packages/functest/opnfv_tests/openstack/rally/scenario/support', 'glance_image_format': 'qcow2'}"] 2018-03-20 00:59:32,069 - functest.opnfv_tests.openstack.rally.rally - DEBUG - task_id : f17aab64-dac0-45b6-88e0-87e16b15dcc5 2018-03-20 00:59:32,070 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'detailed', 'f17aab64-dac0-45b6-88e0-87e16b15dcc5'] 2018-03-20 00:59:33,065 - functest.opnfv_tests.openstack.rally.rally - INFO - -------------------------------------------------------------------------------- Task f17aab64-dac0-45b6-88e0-87e16b15dcc5: finished -------------------------------------------------------------------------------- test scenario Quotas.cinder_update_and_delete args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task f17aab64-dac0-45b6-88e0-87e16b15dcc5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.688 | 0.688 | 0.688 | 0.688 | 0.688 | 0.688 | 100.0% | 1 | | quotas.delete_quotas | 0.181 | 0.181 | 0.181 | 0.181 | 0.181 | 0.181 | 100.0% | 1 | | total | 0.869 | 0.869 | 0.869 | 0.869 | 0.869 | 0.869 | 100.0% | 1 | | -> duration | 0.869 | 0.869 | 0.869 | 0.869 | 0.869 | 0.869 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.86933 Full duration: 8.92103 -------------------------------------------------------------------------------- test scenario Quotas.cinder_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task f17aab64-dac0-45b6-88e0-87e16b15dcc5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.728 | 0.728 | 0.728 | 0.728 | 0.728 | 0.728 | 100.0% | 1 | | total | 0.728 | 0.728 | 0.728 | 0.728 | 0.728 | 0.728 | 100.0% | 1 | | -> duration | 0.728 | 0.728 | 0.728 | 0.728 | 0.728 | 0.728 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.728343 Full duration: 9.004631 -------------------------------------------------------------------------------- test scenario Quotas.neutron_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task f17aab64-dac0-45b6-88e0-87e16b15dcc5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 0.298 | 0.298 | 0.298 | 0.298 | 0.298 | 0.298 | 100.0% | 1 | | total | 0.707 | 0.707 | 0.707 | 0.707 | 0.707 | 0.707 | 100.0% | 1 | | -> duration | 0.707 | 0.707 | 0.707 | 0.707 | 0.707 | 0.707 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 0.707218 Full duration: 8.462308 -------------------------------------------------------------------------------- test scenario Quotas.nova_update args position 0 args values: { "runner": { "concurrency": 1, "times": 1 }, "hooks": [], "args": { "max_quota": 1024 }, "sla": { "failure_rate": { "max": 0 } }, "context": { "users": { "tenants": 1, "users_per_tenant": 1 } } } -------------------------------------------------------------------------------- Task f17aab64-dac0-45b6-88e0-87e16b15dcc5 has 0 error(s) -------------------------------------------------------------------------------- +-------------------------------------------------------------------------------------------------------------------------+ | Response Times (sec) | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | Action | Min (sec) | Median (sec) | 90%ile (sec) | 95%ile (sec) | Max (sec) | Avg (sec) | Success | Count | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ | quotas.update_quotas | 1.014 | 1.014 | 1.014 | 1.014 | 1.014 | 1.014 | 100.0% | 1 | | total | 1.014 | 1.014 | 1.014 | 1.014 | 1.014 | 1.014 | 100.0% | 1 | | -> duration | 1.014 | 1.014 | 1.014 | 1.014 | 1.014 | 1.014 | 100.0% | 1 | | -> idle_duration | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 100.0% | 1 | +----------------------+-----------+--------------+--------------+--------------+-----------+-----------+---------+-------+ Load duration: 1.013854 Full duration: 8.930253 HINTS: * To plot HTML graphics with this data, run: rally task report f17aab64-dac0-45b6-88e0-87e16b15dcc5 --out output.html * To generate a JUnit report, run: rally task export f17aab64-dac0-45b6-88e0-87e16b15dcc5 --type junit --to output.xml * To get raw JSON output of task results, run: rally task report f17aab64-dac0-45b6-88e0-87e16b15dcc5 --json --out output.json 2018-03-20 00:59:33,066 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'results', 'f17aab64-dac0-45b6-88e0-87e16b15dcc5'] 2018-03-20 00:59:34,130 - functest.opnfv_tests.openstack.rally.rally - DEBUG - saving json file 2018-03-20 00:59:34,131 - functest.opnfv_tests.openstack.rally.rally - DEBUG - running command: ['rally', 'task', 'report', 'f17aab64-dac0-45b6-88e0-87e16b15dcc5', '--out', u'/home/opnfv/functest/results/rally/opnfv-quotas.html'] 2018-03-20 00:59:34,138 - functest.opnfv_tests.openstack.rally.rally - INFO - Test scenario: "quotas" OK. 2018-03-20 00:59:34,142 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally Summary Report: +----------------+------------+----------------+-----------+ | Module | Duration | nb. Test Run | Success | +----------------+------------+----------------+-----------+ | authenticate | 00:45 | 6 | 100.00% | | glance | 01:19 | 4 | 100.00% | | cinder | 02:49 | 10 | 100.00% | | heat | 01:02 | 4 | 100.00% | | keystone | 02:48 | 11 | 100.00% | | neutron | 03:43 | 8 | 100.00% | | nova | 02:42 | 1 | 0.00% | | quotas | 00:35 | 4 | 100.00% | | | | | | | TOTAL: | 00:15:47 | 48 | 97.92% | +----------------+------------+----------------+-----------+ 2018-03-20 00:59:34,142 - functest.opnfv_tests.openstack.rally.rally - INFO - Rally 'rally_sanity' success_rate is 97.92% 2018-03-20 00:59:42,858 - xtesting.energy.energy - DEBUG - Restoring previous scenario (refstack_defcore/running) 2018-03-20 00:59:42,859 - xtesting.energy.energy - DEBUG - Submitting scenario (refstack_defcore/running) 2018-03-20 00:59:43,400 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-20 00:59:43,401 - xtesting.ci.run_tests - INFO - Test result: +----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +----------------------+------------------+------------------+----------------+ | rally_sanity | functest | 19:38 | FAIL | +----------------------+------------------+------------------+----------------+ 2018-03-20 00:59:43,405 - xtesting.ci.run_tests - ERROR - The test case 'rally_sanity' failed. 2018-03-20 00:59:43,405 - xtesting.ci.run_tests - INFO - Running test case 'refstack_defcore'... 2018-03-20 00:59:43,506 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-03-20 00:59:45,913 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-03-20 00:59:45.597 9215 INFO rally.deployment.engine [-] Deployment 365f3f20-2b17-44bd-a073-174f1ef2b279 | Starting: Destroy cloud and free allocated resources. 2018-03-20 00:59:45.682 9215 INFO rally.deployment.engine [-] Deployment 365f3f20-2b17-44bd-a073-174f1ef2b279 | Completed: Destroy cloud and free allocated resources. 2018-03-20 00:59:45.704 9215 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=f963ab93-904b-456c-9278-bc264d80150f). 2018-03-20 00:59:45.709 9215 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-03-20 00:59:48,267 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-03-20 00:59:47.966 9218 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=42c990fc-723f-413d-9e95-9a1f5b120996) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 42c990fc-723f-413d-9e95-9a1f5b120996 | 2018-03-20T00:59:47 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 42c990fc-723f-413d-9e95-9a1f5b120996 ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-03-20 00:59:51,668 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+-------------------+-----------+ | Service | Service Type | Status | +-------------+-------------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | nfv-orchestration | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+-------------------+-----------+ 2018-03-20 00:59:51,669 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-03-20 00:59:54,117 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-03-20 00:59:53.775 9224 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=f963ab93-904b-456c-9278-bc264d80150f). 2018-03-20 00:59:53.945 9224 INFO rally.api [-] Verifier has been successfully deleted! 2018-03-20 00:59:58,300 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-03-20 00:59:56.187 9227 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-03-20 00:59:56.317 9227 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-03-20 00:59:58.053 9227 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=4910d06f-46e1-487a-be8a-92039d0da537) has been successfully created! Using verifier 'opnfv-tempest' (UUID=4910d06f-46e1-487a-be8a-92039d0da537) as the default verifier for the future CLI operations. 2018-03-20 01:00:01,197 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-03-20 01:00:03,896 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-03-20 01:00:10,356 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-03-20 01:00:15,888 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-03-20 01:00:14.486 9246 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=4910d06f-46e1-487a-be8a-92039d0da537) for deployment 'opnfv-rally' (UUID=42c990fc-723f-413d-9e95-9a1f5b120996). 2018-03-20 01:00:15.715 9246 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=4910d06f-46e1-487a-be8a-92039d0da537) has been successfully configured for deployment 'opnfv-rally' (UUID=42c990fc-723f-413d-9e95-9a1f5b120996)! 2018-03-20 01:00:15,888 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-03-20 01:00:15,888 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-03-20 01:00:15,890 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-03-20 01:00:18,881 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/refstack/tempest-list.txt']'. 2018-03-20 01:00:20,945 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:20.944 9258 INFO rally.api [-] Starting verification (UUID=e5668f25-8319-4e48-99dc-e7d95f32bd11) for deployment 'opnfv-rally' (UUID=42c990fc-723f-413d-9e95-9a1f5b120996) by verifier 'opnfv-tempest' (UUID=4910d06f-46e1-487a-be8a-92039d0da537). 2018-03-20 01:00:20,946 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: e5668f25-8319-4e48-99dc-e7d95f32bd11 2018-03-20 01:00:30,998 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:30.998 9258 INFO opnfv-tempest [-] {12} tempest.api.compute.test_versions.TestVersions.test_list_api_versions ... success [0.011s] 2018-03-20 01:00:31,124 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:31.124 9258 INFO opnfv-tempest [-] {8} tempest.api.compute.servers.test_availability_zone.AZV2TestJSON.test_get_availability_zone_list_with_non_admin_user ... success [0.259s] 2018-03-20 01:00:31,217 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:31.217 9258 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors ... success [0.212s] 2018-03-20 01:00:31,284 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:31.284 9258 INFO opnfv-tempest [-] {4} tempest.api.compute.flavors.test_flavors.FlavorsV2TestJSON.test_list_flavors_with_detail ... success [0.066s] 2018-03-20 01:00:31,806 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:31.806 9258 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_delete_image ... success [0.868s] 2018-03-20 01:00:34,223 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:34.223 9258 INFO opnfv-tempest [-] {9} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image ... success [2.416s] 2018-03-20 01:00:34,818 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:34.818 9258 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_media_types ... success [0.082s] 2018-03-20 01:00:34,905 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:34.905 9258 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_resources ... success [0.086s] 2018-03-20 01:00:34,986 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:34.986 9258 INFO opnfv-tempest [-] {4} tempest.api.identity.v3.test_api_discovery.TestApiDiscovery.test_api_version_statuses ... success [0.080s] 2018-03-20 01:00:35,767 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:35.767 9258 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_additional_default_security_group_fails ... success [0.207s] 2018-03-20 01:00:38,510 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:38.509 9258 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_duplicate_security_group_rule_fails ... success [2.739s] 2018-03-20 01:00:40,130 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:40.129 9258 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_image_null_id ... success [0.163s] 2018-03-20 01:00:40,265 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:40.264 9258 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_crud_volume_metadata ... success [3.347s] 2018-03-20 01:00:40,296 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:40.295 9258 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_delete_non_existing_image ... success [0.166s] 2018-03-20 01:00:40,659 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:40.659 9258 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_ethertype ... success [2.150s] 2018-03-20 01:00:41,035 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:41.035 9258 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_with_nonexistent_volume_id ... success [0.180s] 2018-03-20 01:00:41,223 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:41.223 9258 INFO opnfv-tempest [-] {8} tempest.api.volume.test_volume_metadata.VolumesMetadataTest.test_update_show_volume_metadata_item ... success [0.957s] 2018-03-20 01:00:41,241 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:41.241 9258 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_delete_deleted_image ... success [0.944s] 2018-03-20 01:00:41,322 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:41.322 9258 INFO opnfv-tempest [-] {9} tempest.api.volume.test_volumes_snapshots_negative.VolumesSnapshotNegativeTestJSON.test_create_snapshot_without_passing_volume_id ... success [0.288s] 2018-03-20 01:00:41,409 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:41.408 9258 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_image_null_id ... success [0.167s] 2018-03-20 01:00:41,562 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:41.561 9258 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_protocol ... success [0.902s] 2018-03-20 01:00:41,655 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:41.655 9258 INFO opnfv-tempest [-] {4} tempest.api.image.v2.test_images_negative.ImagesNegativeTest.test_get_non_existent_image ... success [0.246s] 2018-03-20 01:00:43,065 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:43.064 9258 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_bad_remote_ip_prefix ... success [1.501s] 2018-03-20 01:00:46,317 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:46.317 9258 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_invalid_ports ... success [3.251s] 2018-03-20 01:00:47,372 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:47.372 9258 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_active_server ... success [16.371s] 2018-03-20 01:00:48,307 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:48.306 9258 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_remote_groupid ... success [1.989s] 2018-03-20 01:00:48,825 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:48.824 9258 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_create_security_group_rule_with_non_existent_security_group ... success [0.518s] 2018-03-20 01:00:48,993 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:48.993 9258 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_create_server.ServersTestJSON ... fail 2018-03-20 01:00:49,382 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:49.381 9258 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_delete_non_existent_security_group ... success [0.556s] 2018-03-20 01:00:49,614 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:49.614 9258 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group ... success [0.232s] 2018-03-20 01:00:49,638 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:49.637 9258 INFO opnfv-tempest [-] {12} tempest.api.network.test_security_groups_negative.NegativeSecGroupTest.test_show_non_existent_security_group_rule ... success [0.023s] 2018-03-20 01:00:59,295 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:59.294 9258 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_delete_server_metadata_item ... success [0.361s] 2018-03-20 01:00:59,506 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:59.506 9258 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_get_server_metadata_item ... success [0.212s] 2018-03-20 01:00:59,723 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:00:59.722 9258 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_list_server_metadata ... success [0.213s] 2018-03-20 01:01:00,088 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:00.087 9258 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata ... success [0.364s] 2018-03-20 01:01:00,479 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:00.478 9258 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_set_server_metadata_item ... success [0.391s] 2018-03-20 01:01:00,874 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:00.874 9258 INFO opnfv-tempest [-] {1} tempest.api.compute.servers.test_server_metadata.ServerMetadataTestJSON.test_update_server_metadata ... success [0.395s] 2018-03-20 01:01:04,385 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:04.384 9258 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_numeric_server_name ... success [1.877s] 2018-03-20 01:01:06,786 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:06.785 9258 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_metadata_exceeds_length_limit ... success [2.400s] 2018-03-20 01:01:07,825 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:07.825 9258 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_list_update_show_delete_security_group ... success [1.898s] 2018-03-20 01:01:08,745 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:08.745 9258 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_server_name_length_exceeds_256 ... success [1.959s] 2018-03-20 01:01:10,050 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:10.050 9258 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_additional_args ... success [2.225s] 2018-03-20 01:01:10,484 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:10.484 9258 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_flavor ... success [1.738s] 2018-03-20 01:01:11,965 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:11.965 9258 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_image ... success [1.480s] 2018-03-20 01:01:13,752 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:13.752 9258 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_create_with_invalid_network_uuid ... success [1.786s] 2018-03-20 01:01:14,532 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:14.532 9258 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_id_exceeding_length_limit ... success [0.779s] 2018-03-20 01:01:14,761 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:14.760 9258 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_delete_server_pass_negative_id ... success [0.229s] 2018-03-20 01:01:15,578 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:15.578 9258 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_icmp_type_code ... success [5.523s] 2018-03-20 01:01:15,693 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:15.692 9258 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_get_non_existent_server ... success [0.931s] 2018-03-20 01:01:16,388 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:16.387 9258 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_protocol_integer_value ... success [0.812s] 2018-03-20 01:01:17,250 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:17.249 9258 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_invalid_ip_v6_address ... success [1.555s] 2018-03-20 01:01:17,876 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:17.876 9258 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_reboot_non_existent_server ... success [0.627s] 2018-03-20 01:01:17,884 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:17.884 9258 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_group_id ... success [1.496s] 2018-03-20 01:01:18,275 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:18.275 9258 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_deleted_server ... success [0.398s] 2018-03-20 01:01:18,931 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:18.930 9258 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_rebuild_non_existent_server ... success [0.655s] 2018-03-20 01:01:19,713 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:19.713 9258 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_security_group_rule_with_remote_ip_prefix ... success [1.828s] 2018-03-20 01:01:20,690 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:20.690 9258 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_server_name_blank ... success [1.758s] 2018-03-20 01:01:21,278 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:21.277 9258 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_create_show_delete_security_group_rule ... success [1.561s] 2018-03-20 01:01:21,294 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:21.294 9258 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_stop_non_existent_server ... success [0.604s] 2018-03-20 01:01:21,321 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:21.320 9258 INFO opnfv-tempest [-] {1} tempest.api.network.test_security_groups.SecGroupTest.test_list_security_groups ... success [0.046s] 2018-03-20 01:01:22,202 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:22.201 9258 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_name_of_non_existent_server ... success [0.906s] 2018-03-20 01:01:22,588 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:22.587 9258 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_name_length_exceeds_256 ... success [0.385s] 2018-03-20 01:01:22,958 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:01:22.957 9258 INFO opnfv-tempest [-] {11} tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_update_server_set_empty_name ... success [0.369s] 2018-03-20 01:01:27,778 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', 'e5668f25-8319-4e48-99dc-e7d95f32bd11']'. 2018-03-20 01:01:28,717 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-03-20 01:01:28,717 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-03-20 01:01:28,717 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-20 01:01:28,717 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | e5668f25-8319-4e48-99dc-e7d95f32bd11 | 2018-03-20 01:01:28,717 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | failed | 2018-03-20 01:01:28,718 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-03-20 01:00:20 | 2018-03-20 01:01:28,718 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-03-20 01:01:27 | 2018-03-20 01:01:28,718 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:01:07 | 2018-03-20 01:01:28,718 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-03-20 01:01:28,718 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-03-20 01:01:28,718 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: 4910d06f-46e1-487a-be8a-92039d0da537) | 2018-03-20 01:01:28,718 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-03-20 01:01:28,718 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 42c990fc-723f-413d-9e95-9a1f5b120996) | 2018-03-20 01:01:28,718 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 67 | 2018-03-20 01:01:28,718 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 53.98 | 2018-03-20 01:01:28,718 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 62 | 2018-03-20 01:01:28,718 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 0 | 2018-03-20 01:01:28,718 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-03-20 01:01:28,718 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-03-20 01:01:28,718 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 5 | 2018-03-20 01:01:28,719 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-20 01:01:28,719 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-03-20 01:01:28,739 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest refstack_defcore success_rate is 92.5373134328% 2018-03-20 01:01:34,748 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-20 01:01:34,749 - xtesting.ci.run_tests - INFO - Test result: +--------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +--------------------------+------------------+------------------+----------------+ | refstack_defcore | functest | 01:33 | FAIL | +--------------------------+------------------+------------------+----------------+ 2018-03-20 01:01:34,753 - xtesting.ci.run_tests - ERROR - The test case 'refstack_defcore' failed. 2018-03-20 01:01:34,753 - xtesting.ci.run_tests - INFO - Running test case 'patrole'... 2018-03-20 01:01:34,851 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-03-20 01:01:37,314 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-03-20 01:01:36.979 9348 INFO rally.deployment.engine [-] Deployment 42c990fc-723f-413d-9e95-9a1f5b120996 | Starting: Destroy cloud and free allocated resources. 2018-03-20 01:01:37.066 9348 INFO rally.deployment.engine [-] Deployment 42c990fc-723f-413d-9e95-9a1f5b120996 | Completed: Destroy cloud and free allocated resources. 2018-03-20 01:01:37.087 9348 INFO rally.api [-] Deleting all verifications created by verifier 'opnfv-tempest' (UUID=4910d06f-46e1-487a-be8a-92039d0da537) for deployment 'opnfv-rally'. 2018-03-20 01:01:37.096 9348 INFO rally.api [-] Deleting verification (UUID=e5668f25-8319-4e48-99dc-e7d95f32bd11). 2018-03-20 01:01:37.127 9348 INFO rally.api [-] Verification has been successfully deleted! 2018-03-20 01:01:37.128 9348 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=4910d06f-46e1-487a-be8a-92039d0da537). 2018-03-20 01:01:37.135 9348 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-03-20 01:01:39,860 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-03-20 01:01:39.473 9351 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=ee25e628-c954-4412-9dd3-aff153c65e1a) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | ee25e628-c954-4412-9dd3-aff153c65e1a | 2018-03-20T01:01:39 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: ee25e628-c954-4412-9dd3-aff153c65e1a ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-03-20 01:01:43,199 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+-------------------+-----------+ | Service | Service Type | Status | +-------------+-------------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | nfv-orchestration | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+-------------------+-----------+ 2018-03-20 01:01:43,199 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-03-20 01:01:45,546 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-03-20 01:01:45.293 9357 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=4910d06f-46e1-487a-be8a-92039d0da537). 2018-03-20 01:01:45.413 9357 INFO rally.api [-] Verifier has been successfully deleted! 2018-03-20 01:01:48,981 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-03-20 01:01:47.529 9360 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-03-20 01:01:47.647 9360 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-03-20 01:01:48.802 9360 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=757338c3-4129-48b6-83fa-40ae878ea84c) has been successfully created! Using verifier 'opnfv-tempest' (UUID=757338c3-4129-48b6-83fa-40ae878ea84c) as the default verifier for the future CLI operations. 2018-03-20 01:01:51,889 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating private network for Tempest suite 2018-03-20 01:01:54,442 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Creating two images for Tempest suite 2018-03-20 01:02:01,294 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-03-20 01:02:06,981 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-03-20 01:02:05.528 9379 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=757338c3-4129-48b6-83fa-40ae878ea84c) for deployment 'opnfv-rally' (UUID=ee25e628-c954-4412-9dd3-aff153c65e1a). 2018-03-20 01:02:06.810 9379 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=757338c3-4129-48b6-83fa-40ae878ea84c) has been successfully configured for deployment 'opnfv-rally' (UUID=ee25e628-c954-4412-9dd3-aff153c65e1a)! 2018-03-20 01:02:06,981 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Looking for tempest.conf file... 2018-03-20 01:02:06,982 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Updating selected tempest.conf parameters... 2018-03-20 01:02:06,984 - functest.opnfv_tests.openstack.tempest.conf_utils - DEBUG - Add/Update required params defined in tempest_conf.yaml into tempest.conf file 2018-03-20 01:02:06,995 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Generating test case list... 2018-03-20 01:02:10,121 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-757338c3-4129-48b6-83fa-40ae878ea84c/repo; testr list-tests '(?!.*test_networks_multiprovider_rbac)(?=patrole_tempest_plugin.tests.api.(image|network|volume))' >/home/opnfv/functest/results/patrole/tempest-list.txt 2>/dev/null) 2018-03-20 01:02:10,121 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/patrole/tempest-list.txt']'. 2018-03-20 01:02:12,332 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:02:12.331 9388 INFO rally.api [-] Starting verification (UUID=70ef4116-35f4-4830-b7d6-d2cb89e22cc9) for deployment 'opnfv-rally' (UUID=ee25e628-c954-4412-9dd3-aff153c65e1a) by verifier 'opnfv-tempest' (UUID=757338c3-4129-48b6-83fa-40ae878ea84c). 2018-03-20 01:02:12,332 - functest.opnfv_tests.openstack.tempest.tempest - DEBUG - Verification UUID: 70ef4116-35f4-4830-b7d6-d2cb89e22cc9 2018-03-20 01:04:53,261 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', '70ef4116-35f4-4830-b7d6-d2cb89e22cc9']'. 2018-03-20 01:04:54,282 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-03-20 01:04:54,282 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-03-20 01:04:54,282 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-20 01:04:54,283 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | 70ef4116-35f4-4830-b7d6-d2cb89e22cc9 | 2018-03-20 01:04:54,283 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | failed | 2018-03-20 01:04:54,283 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-03-20 01:02:12 | 2018-03-20 01:04:54,283 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-03-20 01:04:52 | 2018-03-20 01:04:54,283 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:02:40 | 2018-03-20 01:04:54,283 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-03-20 01:04:54,283 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-03-20 01:04:54,283 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: 757338c3-4129-48b6-83fa-40ae878ea84c) | 2018-03-20 01:04:54,283 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-03-20 01:04:54,283 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: ee25e628-c954-4412-9dd3-aff153c65e1a) | 2018-03-20 01:04:54,284 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 287 | 2018-03-20 01:04:54,284 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 150.768 | 2018-03-20 01:04:54,284 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 122 | 2018-03-20 01:04:54,284 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 163 | 2018-03-20 01:04:54,284 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-03-20 01:04:54,284 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-03-20 01:04:54,284 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 2 | 2018-03-20 01:04:54,284 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-20 01:04:54,284 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-03-20 01:04:54,439 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest patrole success_rate is 98.3870967742% 2018-03-20 01:05:01,958 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-20 01:05:01,959 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | patrole | functest | 03:10 | FAIL | +-------------------+------------------+------------------+----------------+ 2018-03-20 01:05:01,963 - xtesting.ci.run_tests - ERROR - The test case 'patrole' failed. 2018-03-20 01:05:01,963 - xtesting.ci.run_tests - INFO - Running test case 'odl'... 2018-03-20 01:05:22,917 - xtesting.core.robotframework - INFO - ============================================================================== Basic & Neutron ============================================================================== Basic & Neutron.Basic ============================================================================== Basic & Neutron.Basic.Restconf Modules :: Test suite to verify Restconf is OK. ============================================================================== Get Controller Modules :: Get the restconf modules, check 200 stat... | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Basic.Restconf Modules :: Test suite to verify Res... | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Basic & Neutron.Basic | PASS | 1 critical test, 1 passed, 0 failed 1 test total, 1 passed, 0 failed ============================================================================== Basic & Neutron.Neutron :: Test suite for Neutron Plugin ============================================================================== Basic & Neutron.Neutron.Reachability ============================================================================== Get the complete list of networks :: Get the complete list of netw... | PASS | ------------------------------------------------------------------------------ Get the complete list of subnets :: Get the complete list of subnets | PASS | ------------------------------------------------------------------------------ Get the complete list of ports :: Get the complete list of ports | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Reachability | PASS | 3 critical tests, 3 passed, 0 failed 3 tests total, 3 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Networks :: Checking Network created in OpenStack a... ============================================================================== Check OpenStack Networks :: Checking OpenStack Neutron for known n... | PASS | ------------------------------------------------------------------------------ Check OpenDaylight Networks :: Checking OpenDaylight Neutron API f... | PASS | ------------------------------------------------------------------------------ Create Network :: Create new network in OpenStack | PASS | ------------------------------------------------------------------------------ Check Network :: Check network created in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Networks :: Checking Network created in Op... | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Subnets :: Checking Subnets created in OpenStack ar... ============================================================================== Check OpenStack Subnets :: Checking OpenStack Neutron for known su... | PASS | ------------------------------------------------------------------------------ Check OpenDaylight subnets :: Checking OpenDaylight Neutron API fo... | PASS | ------------------------------------------------------------------------------ Create New subnet :: Create new subnet in OpenStack | PASS | ------------------------------------------------------------------------------ Check New subnet :: Check new subnet created in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Subnets :: Checking Subnets created in Ope... | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Ports :: Checking Port created in OpenStack are pus... ============================================================================== Check OpenStack ports :: Checking OpenStack Neutron for known ports | PASS | ------------------------------------------------------------------------------ Check OpenDaylight ports :: Checking OpenDaylight Neutron API for ... | PASS | ------------------------------------------------------------------------------ Create New Port :: Create new port in OpenStack | PASS | ------------------------------------------------------------------------------ Check New Port :: Check new port created in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Ports :: Checking Port created in OpenStac... | PASS | 4 critical tests, 4 passed, 0 failed 4 tests total, 4 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Delete Ports :: Checking Port deleted in OpenStack ... ============================================================================== Delete New Port :: Delete previously created port in OpenStack | PASS | ------------------------------------------------------------------------------ Check Port Deleted :: Check port deleted in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Delete Ports :: Checking Port deleted in O... | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Delete Subnets :: Checking Subnets deleted in OpenS... ============================================================================== Delete New subnet :: Delete previously created subnet in OpenStack | PASS | ------------------------------------------------------------------------------ Check New subnet deleted :: Check subnet deleted in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Delete Subnets :: Checking Subnets deleted... | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Basic & Neutron.Neutron.Delete Networks :: Checking Network deleted in Open... ============================================================================== Delete Network :: Delete network in OpenStack | PASS | ------------------------------------------------------------------------------ Check Network deleted :: Check network deleted in OpenDaylight | PASS | ------------------------------------------------------------------------------ Basic & Neutron.Neutron.Delete Networks :: Checking Network delete... | PASS | 2 critical tests, 2 passed, 0 failed 2 tests total, 2 passed, 0 failed ============================================================================== Basic & Neutron.Neutron :: Test suite for Neutron Plugin | PASS | 21 critical tests, 21 passed, 0 failed 21 tests total, 21 passed, 0 failed ============================================================================== Basic & Neutron | PASS | 22 critical tests, 22 passed, 0 failed 22 tests total, 22 passed, 0 failed ============================================================================== Output: /home/opnfv/functest/results/odl/output.xml 2018-03-20 01:05:22,918 - xtesting.core.robotframework - INFO - Results were successfully generated 2018-03-20 01:05:22,982 - xtesting.core.robotframework - INFO - Results were successfully parsed 2018-03-20 01:05:23,094 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-20 01:05:23,094 - xtesting.ci.run_tests - INFO - Test result: +-------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-------------------+------------------+------------------+----------------+ | odl | functest | 00:19 | PASS | +-------------------+------------------+------------------+----------------+ 2018-03-20 01:05:23,098 - xtesting.ci.run_tests - INFO - Running test case 'snaps_smoke'... 2018-03-20 01:05:24,078 - functest.opnfv_tests.openstack.snaps.snaps_test_runner - INFO - Using flavor metadata 'None' 2018-03-20 01:46:33,569 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-20 01:46:33,570 - xtesting.ci.run_tests - INFO - Test result: +---------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +---------------------+------------------+------------------+----------------+ | snaps_smoke | functest | 41:09 | FAIL | +---------------------+------------------+------------------+----------------+ 2018-03-20 01:46:33,573 - xtesting.ci.run_tests - ERROR - The test case 'snaps_smoke' failed. 2018-03-20 01:46:33,574 - xtesting.ci.run_tests - INFO - Running test case 'neutron_trunk'... 2018-03-20 01:46:33,669 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Creating Rally environment... 2018-03-20 01:46:36,132 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment destroy --deployment opnfv-rally 2018-03-20 01:46:35.694 9478 INFO rally.deployment.engine [-] Deployment ee25e628-c954-4412-9dd3-aff153c65e1a | Starting: Destroy cloud and free allocated resources. 2018-03-20 01:46:35.782 9478 INFO rally.deployment.engine [-] Deployment ee25e628-c954-4412-9dd3-aff153c65e1a | Completed: Destroy cloud and free allocated resources. 2018-03-20 01:46:35.837 9478 INFO rally.api [-] Deleting all verifications created by verifier 'opnfv-tempest' (UUID=757338c3-4129-48b6-83fa-40ae878ea84c) for deployment 'opnfv-rally'. 2018-03-20 01:46:35.867 9478 INFO rally.api [-] Deleting verification (UUID=70ef4116-35f4-4830-b7d6-d2cb89e22cc9). 2018-03-20 01:46:35.906 9478 INFO rally.api [-] Verification has been successfully deleted! 2018-03-20 01:46:35.907 9478 INFO rally.api [-] Deleting deployment-specific data for verifier 'opnfv-tempest' (UUID=757338c3-4129-48b6-83fa-40ae878ea84c). 2018-03-20 01:46:35.920 9478 INFO rally.api [-] Deployment-specific data has been successfully deleted! 2018-03-20 01:46:38,580 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment create --fromenv --name opnfv-rally 2018-03-20 01:46:38.296 9481 INFO rally.deployment.engines.existing [-] Save deployment 'opnfv-rally' (uuid=69e7dfb8-4e39-42e3-b584-1ecd59bbd36e) with 'openstack' platform. +--------------------------------------+---------------------+-------------+------------------+--------+ | uuid | created_at | name | status | active | +--------------------------------------+---------------------+-------------+------------------+--------+ | 69e7dfb8-4e39-42e3-b584-1ecd59bbd36e | 2018-03-20T01:46:38 | opnfv-rally | deploy->finished | | +--------------------------------------+---------------------+-------------+------------------+--------+ Using deployment: 69e7dfb8-4e39-42e3-b584-1ecd59bbd36e ~/.rally/openrc was updated HINTS: * To use standard OpenStack clients, set up your env by running: source ~/.rally/openrc OpenStack clients are now configured, e.g run: openstack image list 2018-03-20 01:46:41,841 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally deployment check -------------------------------------------------------------------------------- Platform openstack: -------------------------------------------------------------------------------- Available services: +-------------+-------------------+-----------+ | Service | Service Type | Status | +-------------+-------------------+-----------+ | __unknown__ | alarming | Available | | __unknown__ | key-manager | Available | | __unknown__ | nfv-orchestration | Available | | __unknown__ | placement | Available | | __unknown__ | policy | Available | | __unknown__ | volumev2 | Available | | __unknown__ | volumev3 | Available | | ceilometer | metering | Available | | cinder | volume | Available | | cloud | cloudformation | Available | | glance | image | Available | | gnocchi | metric | Available | | heat | orchestration | Available | | keystone | identity | Available | | neutron | network | Available | | nova | compute | Available | +-------------+-------------------+-----------+ 2018-03-20 01:46:41,842 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - Create verifier from existing repo... 2018-03-20 01:46:44,185 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify delete-verifier --id opnfv-tempest --force 2018-03-20 01:46:43.927 9487 INFO rally.api [-] Deleting verifier 'opnfv-tempest' (UUID=757338c3-4129-48b6-83fa-40ae878ea84c). 2018-03-20 01:46:44.039 9487 INFO rally.api [-] Verifier has been successfully deleted! 2018-03-20 01:46:47,417 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify create-verifier --source /src/tempest --name opnfv-tempest --type tempest --system-wide 2018-03-20 01:46:46.182 9490 INFO rally.api [-] Creating verifier 'opnfv-tempest'. 2018-03-20 01:46:46.303 9490 INFO rally.verification.manager [-] Cloning verifier repo from /src/tempest. 2018-03-20 01:46:47.285 9490 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=de26cb57-9e0c-4357-9a1a-c59637949508) has been successfully created! Using verifier 'opnfv-tempest' (UUID=de26cb57-9e0c-4357-9a1a-c59637949508) as the default verifier for the future CLI operations. 2018-03-20 01:46:59,374 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Creating two flavors for Tempest suite 2018-03-20 01:47:04,627 - functest.opnfv_tests.openstack.tempest.conf_utils - INFO - rally verify configure-verifier --reconfigure --id opnfv-tempest 2018-03-20 01:47:03.585 9509 INFO rally.api [-] Configuring verifier 'opnfv-tempest' (UUID=de26cb57-9e0c-4357-9a1a-c59637949508) for deployment 'opnfv-rally' (UUID=69e7dfb8-4e39-42e3-b584-1ecd59bbd36e). 2018-03-20 01:47:04.464 9509 INFO rally.api [-] Verifier 'opnfv-tempest' (UUID=de26cb57-9e0c-4357-9a1a-c59637949508) has been successfully configured for deployment 'opnfv-rally' (UUID=69e7dfb8-4e39-42e3-b584-1ecd59bbd36e)! 2018-03-20 01:47:08,751 - functest.opnfv_tests.openstack.tempest.tempest - INFO - (cd /root/.rally/verification/verifier-de26cb57-9e0c-4357-9a1a-c59637949508/repo; testr list-tests 'neutron.tests.tempest.(api|scenario).test_trunk' >/home/opnfv/functest/results/neutron_trunk/test_list.txt 2>/dev/null) 2018-03-20 01:47:08,752 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Starting Tempest test suite: '['rally', 'verify', 'start', '--load-list', u'/home/opnfv/functest/results/neutron_trunk/test_list.txt']'. 2018-03-20 01:47:11,291 - functest.opnfv_tests.openstack.tempest.tempest - INFO - 2018-03-20 01:47:11.290 9518 INFO rally.api [-] Starting verification (UUID=f7e07580-c74c-4536-a4dd-8388be08e069) for deployment 'opnfv-rally' (UUID=69e7dfb8-4e39-42e3-b584-1ecd59bbd36e) by verifier 'opnfv-tempest' (UUID=de26cb57-9e0c-4357-9a1a-c59637949508). 2018-03-20 01:49:02,899 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Showing result for a verification: '['rally', 'verify', 'show', '--uuid', 'f7e07580-c74c-4536-a4dd-8388be08e069']'. 2018-03-20 01:49:03,822 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------+ 2018-03-20 01:49:03,823 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verification | 2018-03-20 01:49:03,823 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-20 01:49:03,823 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | UUID | f7e07580-c74c-4536-a4dd-8388be08e069 | 2018-03-20 01:49:03,823 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Status | failed | 2018-03-20 01:49:03,823 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Started at | 2018-03-20 01:47:10 | 2018-03-20 01:49:03,823 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Finished at | 2018-03-20 01:49:02 | 2018-03-20 01:49:03,823 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Duration | 0:01:52 | 2018-03-20 01:49:03,823 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Run arguments | load_list: (value is too long, use 'detailed' flag to display it) | 2018-03-20 01:49:03,823 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tags | - | 2018-03-20 01:49:03,824 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier name | opnfv-tempest (UUID: de26cb57-9e0c-4357-9a1a-c59637949508) | 2018-03-20 01:49:03,824 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Verifier type | tempest (platform: openstack) | 2018-03-20 01:49:03,824 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Deployment name | opnfv-rally (UUID: 69e7dfb8-4e39-42e3-b584-1ecd59bbd36e) | 2018-03-20 01:49:03,824 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests count | 52 | 2018-03-20 01:49:03,824 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Tests duration, sec | 99.609 | 2018-03-20 01:49:03,824 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Success | 42 | 2018-03-20 01:49:03,824 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Skipped | 8 | 2018-03-20 01:49:03,824 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Expected failures | 0 | 2018-03-20 01:49:03,824 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Unexpected success | 0 | 2018-03-20 01:49:03,824 - functest.opnfv_tests.openstack.tempest.tempest - INFO - | Failures | 2 | 2018-03-20 01:49:03,824 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +---------------------+-------------------------------------------------------------------+ 2018-03-20 01:49:03,825 - functest.opnfv_tests.openstack.tempest.tempest - INFO - +-----------------------------------------------------------------------------------------------------------------------------------------------------+ 2018-03-20 01:49:03,839 - functest.opnfv_tests.openstack.tempest.tempest - INFO - Tempest neutron_trunk success_rate is 95.4545454545% 2018-03-20 01:49:10,790 - xtesting.core.testcase - INFO - The results were successfully pushed to DB http://testresults.opnfv.org/test/api/v1/results 2018-03-20 01:49:10,791 - xtesting.ci.run_tests - INFO - Test result: +-----------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | DURATION | RESULT | +-----------------------+------------------+------------------+----------------+ | neutron_trunk | functest | 02:20 | FAIL | +-----------------------+------------------+------------------+----------------+ 2018-03-20 01:49:10,795 - xtesting.ci.run_tests - ERROR - The test case 'neutron_trunk' failed. 2018-03-20 01:49:10,796 - xtesting.ci.run_tests - INFO - Xtesting report: +------------------------------+------------------+---------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +------------------------------+------------------+---------------+------------------+----------------+ | vping_ssh | functest | smoke | 00:54 | PASS | | vping_userdata | functest | smoke | 00:39 | PASS | | tempest_smoke_serial | functest | smoke | 22:02 | FAIL | | rally_sanity | functest | smoke | 19:38 | FAIL | | refstack_defcore | functest | smoke | 01:33 | FAIL | | patrole | functest | smoke | 03:10 | FAIL | | odl | functest | smoke | 00:19 | PASS | | snaps_smoke | functest | smoke | 41:09 | FAIL | | neutron_trunk | functest | smoke | 02:20 | FAIL | | odl_netvirt | functest | smoke | 00:00 | SKIP | +------------------------------+------------------+---------------+------------------+----------------+ 2018-03-20 01:49:10,803 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_ERROR 2018-03-20 01:49:13,920 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-27 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-nofeature-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-03-20 01:49:13,922 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=MWw2sKmZRwKpjxuJDJubKTWmB export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.21,192.30.9.10 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.21:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.10 export OS_REGION_NAME=regionOne 2018-03-20 01:49:13,923 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-03-20 01:49:13,923 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+-----------------+---------------------+-------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+-----------------+---------------------+-------------------+ +---------------+---------------+-----------------+---------------------+-------------------+ 2018-03-20 01:49:13,923 - xtesting.ci.run_tests - INFO - Xtesting report: +-----------------------------+------------------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-----------------------------+------------------------+------------------+------------------+----------------+ | doctor-notification | doctor | features | 00:00 | SKIP | | bgpvpn | sdnvpn | features | 00:00 | SKIP | | functest-odl-sfc | sfc | features | 00:00 | SKIP | | barometercollectd | barometer | features | 00:00 | SKIP | | fds | fastdatastacks | features | 00:00 | SKIP | +-----------------------------+------------------------+------------------+------------------+----------------+ 2018-03-20 01:49:13,925 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-03-20 01:49:16,386 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-27 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-nofeature-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-03-20 01:49:16,391 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=MWw2sKmZRwKpjxuJDJubKTWmB export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.21,192.30.9.10 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.21:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.10 export OS_REGION_NAME=regionOne 2018-03-20 01:49:16,391 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-03-20 01:49:16,391 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+-----------------+---------------------+-------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+-----------------+---------------------+-------------------+ +---------------+---------------+-----------------+---------------------+-------------------+ 2018-03-20 01:49:16,392 - xtesting.ci.run_tests - INFO - Xtesting report: +----------------------+------------------+--------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------+------------------+--------------+------------------+----------------+ | cloudify_ims | functest | vnf | 00:00 | SKIP | | vyos_vrouter | functest | vnf | 00:00 | SKIP | | juju_epc | functest | vnf | 00:00 | SKIP | +----------------------+------------------+--------------+------------------+----------------+ 2018-03-20 01:49:16,394 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK 2018-03-20 01:49:18,831 - xtesting.ci.run_tests - INFO - Deployment description: +--------------------------------------+----------------------------------------------------------+ | ENV VAR | VALUE | +--------------------------------------+----------------------------------------------------------+ | BUILD_TAG | jenkins-functest-apex-baremetal-daily-master-27 | | ENERGY_RECORDER_API_URL | http://energy.opnfv.fr/resources | | ENERGY_RECORDER_API_PASSWORD | | | CI_LOOP | daily | | TEST_DB_URL | http://testresults.opnfv.org/test/api/v1/results | | INSTALLER_TYPE | apex | | DEPLOY_SCENARIO | os-odl-nofeature-ha | | ENERGY_RECORDER_API_USER | | | NODE_NAME | lf-pod1 | +--------------------------------------+----------------------------------------------------------+ 2018-03-20 01:49:18,834 - xtesting.ci.run_tests - INFO - Sourcing env file /var/lib/xtesting/conf/env_file # Clear any old environment that may conflict. for key in $( set | awk '{FS="="} /^OS_/ {print $1}' ); do unset $key ; done export OS_USERNAME=admin export OS_USER_DOMAIN_NAME=Default export OS_PROJECT_DOMAIN_NAME=Default export OS_BAREMETAL_API_VERSION=1.34 export NOVA_VERSION=1.1 export OS_PROJECT_NAME=admin export OS_PASSWORD=MWw2sKmZRwKpjxuJDJubKTWmB export OS_NO_CACHE=True export COMPUTE_API_VERSION=1.1 export no_proxy=,172.30.9.21,192.30.9.10 export OS_VOLUME_API_VERSION=3 export OS_CLOUDNAME=overcloud export OS_AUTH_URL=http://172.30.9.21:5000/v3 export IRONIC_API_VERSION=1.34 export OS_IDENTITY_API_VERSION=3 export OS_IMAGE_API_VERSION=2 export OS_AUTH_TYPE=password export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available" # Add OS_CLOUDNAME to PS1 if [ -z "${CLOUDPROMPT_ENABLED:-}" ]; then export PS1=${PS1:-""} export PS1=\${OS_CLOUDNAME:+"(\$OS_CLOUDNAME)"}\ $PS1 export CLOUDPROMPT_ENABLED=1 fi export SDN_CONTROLLER_IP=192.30.9.10 export OS_REGION_NAME=regionOne 2018-03-20 01:49:18,834 - xtesting.ci.run_tests - DEBUG - Test args: all 2018-03-20 01:49:18,834 - xtesting.ci.run_tests - INFO - TESTS TO BE EXECUTED: +---------------+---------------+-----------------+---------------------+-------------------+ | TIERS | ORDER | CI LOOP | DESCRIPTION | TESTCASES | +---------------+---------------+-----------------+---------------------+-------------------+ +---------------+---------------+-----------------+---------------------+-------------------+ 2018-03-20 01:49:18,834 - xtesting.ci.run_tests - INFO - Xtesting report: +-----------------------+-----------------+------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +-----------------------+-----------------+------------------+------------------+----------------+ | parser-basics | parser | features | 00:00 | SKIP | +-----------------------+-----------------+------------------+------------------+----------------+ 2018-03-20 01:49:18,835 - xtesting.ci.run_tests - INFO - Execution exit value: Result.EX_OK